-- Logs begin at Fri 2022-06-17 14:24:02 UTC, end at Fri 2022-06-17 15:59:27 UTC. -- Jun 17 15:02:21.844487 dv-cinder-825492-23-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 17 15:02:21.853316 dv-cinder-825492-23-iscsi devstack@n-api.service[103266]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 17 15:02:21.855298 dv-cinder-825492-23-iscsi devstack@n-api.service[103266]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jun 17 15:02:21 2022] *** Jun 17 15:02:21.855298 dv-cinder-825492-23-iscsi devstack@n-api.service[103266]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 17 15:02:21.855298 dv-cinder-825492-23-iscsi devstack@n-api.service[103266]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 17 15:02:21.855298 dv-cinder-825492-23-iscsi devstack@n-api.service[103266]: nodename: dv-cinder-825492-23-iscsi Jun 17 15:02:21.855298 dv-cinder-825492-23-iscsi devstack@n-api.service[103266]: machine: x86_64 Jun 17 15:02:21.855298 dv-cinder-825492-23-iscsi devstack@n-api.service[103266]: clock source: unix Jun 17 15:02:21.855298 dv-cinder-825492-23-iscsi devstack@n-api.service[103266]: pcre jit disabled Jun 17 15:02:21.855298 dv-cinder-825492-23-iscsi devstack@n-api.service[103266]: detected number of CPU cores: 4 Jun 17 15:02:21.855298 dv-cinder-825492-23-iscsi devstack@n-api.service[103266]: current working directory: / Jun 17 15:02:21.855298 dv-cinder-825492-23-iscsi devstack@n-api.service[103266]: detected binary path: /usr/bin/uwsgi-core Jun 17 15:02:21.855979 dv-cinder-825492-23-iscsi devstack@n-api.service[103266]: your processes number limit is 47680 Jun 17 15:02:21.855979 dv-cinder-825492-23-iscsi devstack@n-api.service[103266]: your memory page size is 4096 bytes Jun 17 15:02:21.855979 dv-cinder-825492-23-iscsi devstack@n-api.service[103266]: detected max file descriptor number: 2048 Jun 17 15:02:21.855979 dv-cinder-825492-23-iscsi devstack@n-api.service[103266]: lock engine: pthread robust mutexes Jun 17 15:02:21.855979 dv-cinder-825492-23-iscsi devstack@n-api.service[103266]: thunder lock: enabled Jun 17 15:02:21.855979 dv-cinder-825492-23-iscsi devstack@n-api.service[103266]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 17 15:02:21.855979 dv-cinder-825492-23-iscsi devstack@n-api.service[103266]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 17 15:02:21.899625 dv-cinder-825492-23-iscsi devstack@n-api.service[103266]: Python main interpreter initialized at 0x559616e689c0 Jun 17 15:02:21.899625 dv-cinder-825492-23-iscsi devstack@n-api.service[103266]: python threads support enabled Jun 17 15:02:21.899625 dv-cinder-825492-23-iscsi devstack@n-api.service[103266]: your server socket listen backlog is limited to 100 connections Jun 17 15:02:21.899625 dv-cinder-825492-23-iscsi devstack@n-api.service[103266]: your mercy for graceful operations on workers is 90 seconds Jun 17 15:02:21.900047 dv-cinder-825492-23-iscsi devstack@n-api.service[103266]: mapped 403077 bytes (393 KB) for 2 cores Jun 17 15:02:21.900047 dv-cinder-825492-23-iscsi devstack@n-api.service[103266]: *** Operational MODE: preforking *** Jun 17 15:02:21.900386 dv-cinder-825492-23-iscsi devstack@n-api.service[103266]: *** uWSGI is running in multiple interpreter mode *** Jun 17 15:02:21.900386 dv-cinder-825492-23-iscsi devstack@n-api.service[103266]: spawned uWSGI master process (pid: 103266) Jun 17 15:02:21.900602 dv-cinder-825492-23-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 17 15:02:21.901202 dv-cinder-825492-23-iscsi devstack@n-api.service[103266]: spawned uWSGI worker 1 (pid: 103267, cores: 1) Jun 17 15:02:21.901533 dv-cinder-825492-23-iscsi devstack@n-api.service[103266]: spawned uWSGI worker 2 (pid: 103268, cores: 1) Jun 17 15:02:21.901699 dv-cinder-825492-23-iscsi devstack@n-api.service[103266]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 17 15:02:22.563343 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 17 15:02:22.577563 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 17 15:02:23.756016 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 17 15:02:23.756016 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: from cryptography.utils import int_from_bytes Jun 17 15:02:23.756737 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 17 15:02:23.756737 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: from cryptography.utils import int_from_bytes Jun 17 15:02:23.759904 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 17 15:02:23.759904 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: from cryptography.utils import int_from_bytes Jun 17 15:02:23.760350 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 17 15:02:23.760350 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: from cryptography.utils import int_from_bytes Jun 17 15:02:26.334184 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 17 15:02:26.334789 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 17 15:02:26.335225 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 17 15:02:26.335583 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 17 15:02:26.335836 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 17 15:02:26.336220 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.336564 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.336884 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.337200 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.337539 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.337835 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.338149 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.338463 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.338784 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.339040 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.339352 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.339675 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-825492-23-iscsi {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.339996 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.340299 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.340627 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.340940 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.341208 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 17 15:02:26.341589 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.341684 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 17 15:02:26.341769 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.341862 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.342530 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 17 15:02:26.342872 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.342988 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 17 15:02:26.343147 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 17 15:02:26.343307 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.343533 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.343662 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.343859 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.343985 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.344182 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.344343 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.344538 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.344650 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.344846 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.344938 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.345162 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.345245 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.345465 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.345560 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.345785 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.345877 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.346091 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.346182 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.346359 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.346490 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-825492-23-iscsi {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.346704 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.346827 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.347007 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-825492-23-iscsi {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.347116 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.347323 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.347439 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.347636 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.347818 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.347922 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.348103 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.348292 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.348422 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.348617 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.348724 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.348897 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.349076 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.349185 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.349353 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.349662 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.349767 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.349975 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.350084 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.350277 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.350385 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.350587 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.350691 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.350888 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.350994 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.351183 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.351295 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.351491 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.351583 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.351811 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.351932 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.352112 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.352210 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.352436 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.352543 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.352685 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.352783 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.352988 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.353135 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-825492-23-iscsi {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.353307 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.353450 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.353625 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.353764 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.353951 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.354083 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.354188 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.354433 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.354529 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.354749 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.354842 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.355067 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.355158 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.355370 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.355467 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.355674 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.355760 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.355976 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.356067 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.356278 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.356475 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.356605 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.356698 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.356906 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.356992 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.357208 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.357303 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.357509 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.357654 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.357857 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.357955 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.358166 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.358266 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.358481 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.358567 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.358783 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.358875 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.359099 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.359185 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.359350 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.359493 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.359658 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.359755 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.359979 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.360067 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.360300 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.360438 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.360649 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.360744 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.360899 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.360988 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.361148 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.361272 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.361466 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.361590 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.361790 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.361894 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.362092 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.362185 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.362399 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.362494 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.362704 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.362797 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.363011 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.363097 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.363316 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.363409 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.363609 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.363693 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.363906 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.363992 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.364207 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.364292 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.364548 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.364636 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.364851 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.364944 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.365153 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.365240 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.365454 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.365540 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.365752 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.365838 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.366053 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.366146 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.366355 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.366448 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.366655 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.366741 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.366955 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.367041 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.367256 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.367351 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.367557 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.367655 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.367857 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.367948 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.368156 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.368253 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.368476 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.368628 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.368792 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.368877 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.369108 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.369200 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.369409 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.369503 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.369709 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.369799 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.370008 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.370108 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.370267 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.370362 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.370569 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.370654 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.370872 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.370964 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.371183 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.371277 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.371486 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.371571 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.371782 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.371887 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.372085 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.372205 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.374800 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.374922 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.375009 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.375079 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.375079 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.375209 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.375209 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.375331 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.375398 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.375462 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.375462 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.375600 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.375600 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.375740 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.375809 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.375874 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.375947 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.376014 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.376078 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.376149 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.376149 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.376273 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.376368 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.376439 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.376518 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.376684 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.376765 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.376855 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.376940 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.376940 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.377080 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.377168 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.377254 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.377403 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.377555 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.377708 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.377852 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.378009 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.378164 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.378311 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.378487 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.378625 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.378796 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.378958 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.379103 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.379287 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.379473 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.379627 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.379782 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.379941 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.380114 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.380270 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.380499 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.380621 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.380806 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.380936 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.381115 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.381245 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.381435 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.381555 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.381743 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.381878 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.382050 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.382185 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.382356 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.382491 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.382660 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.382823 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.382964 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.383095 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.383266 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.383410 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.383571 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.383735 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.383874 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.384048 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.384171 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.384384 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.384516 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.384703 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.384837 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.385011 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.385147 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.385324 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.385453 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.385650 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.385757 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.385967 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.386082 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:02:26.386274 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.386419 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.386610 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.386888 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.386974 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.387243 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.387351 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.387561 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.387659 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.387880 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.387972 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.388211 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.388301 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.388518 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.388607 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.389337 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.389434 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.389655 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.389741 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.389982 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.390076 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.390291 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.390384 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.390602 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.390686 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.390906 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.390993 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.391213 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.391299 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.391517 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.391674 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.391822 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.391909 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.392129 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.392216 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.392484 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.392589 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.392797 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.392885 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.393109 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.393196 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.393416 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.393510 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.393727 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.393813 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.394034 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.394119 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.394342 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.394436 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.394655 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.394742 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.394957 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.395042 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.395259 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.395357 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.395562 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.395648 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.395867 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.395966 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.396166 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.396254 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.396506 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.396594 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.396834 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.396962 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.397140 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.397229 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.397469 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.397565 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.397773 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.397860 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.398078 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.398173 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.398383 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.398469 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.398688 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.398774 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.398989 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.399083 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.399296 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.399380 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.399599 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.399692 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.399900 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.399987 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.400218 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.400311 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.400546 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.400646 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.400847 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.400936 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.401159 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.401254 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.401458 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.401560 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.401759 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.401844 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.402067 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.402152 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.402370 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.402463 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.402676 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.402769 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.402982 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.403073 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.403287 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.403373 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.403591 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.403682 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.403902 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.403987 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.404212 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.404299 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.405088 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.405189 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.405433 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.405532 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.405734 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.405827 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.406051 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.406136 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.406362 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.406449 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.406672 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.406760 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.406976 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.407094 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.407283 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.407381 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.407582 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.407668 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.407882 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.407969 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.408182 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.408281 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.408511 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.408599 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.408811 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.408897 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.409110 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.409206 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.409409 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.409502 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.409708 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.409800 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.410008 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.410102 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.410328 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.410421 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.410631 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.410717 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.410930 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.411017 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.411228 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.411313 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.411524 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.411620 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.411853 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.411939 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.412153 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.412237 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.412512 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.412601 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.412844 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.412932 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.413151 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.413239 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.413473 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.413557 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.413783 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.413878 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.414097 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.414181 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.414403 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.414503 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.414710 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.414795 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.415015 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.415101 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.415320 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.415415 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.415624 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.415718 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.415930 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.416026 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.416231 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.416342 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.416571 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.416668 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.416875 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.416961 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.417181 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.417289 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.417483 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.417570 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.417783 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.417875 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.418094 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.418191 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.418397 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.418490 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.418700 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.418787 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.419003 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.419104 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.419349 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.419456 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.419653 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.419740 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.419960 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.420067 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.420293 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.420490 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.420623 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.420709 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.420929 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.421026 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.421275 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.421362 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.421590 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.421676 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.421900 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.421988 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.422215 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.422301 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.422522 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.422618 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.422832 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.422926 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.423137 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.423232 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.423452 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.423551 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.423752 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.423837 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.424064 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.424150 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.424408 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.424510 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.424725 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.424812 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.425036 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.425133 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.425340 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.425435 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.425656 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.425742 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.425965 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.426051 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.426274 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.426362 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.426583 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.426669 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.426885 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.426977 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.427192 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.427298 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.427499 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.427642 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.427809 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.427897 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.428117 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.428205 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.428447 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.428535 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.428751 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.428836 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.429061 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.429158 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.429372 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.429470 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.429676 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.429777 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.429977 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.430068 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.430285 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.430376 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.430593 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.430699 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.430902 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.430987 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.431206 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.431293 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.431519 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.431619 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.431821 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.431906 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.432125 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.432211 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.432468 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.432568 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.432778 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.432864 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.433080 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.433167 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.433382 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.433484 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.433684 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.433780 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.433993 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.434078 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.434300 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.434387 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.434606 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.434692 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.434926 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.435017 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.435229 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.435317 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.435532 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.435617 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.435864 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.435951 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.436169 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.436262 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.436496 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.436583 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.436805 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.436899 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.437111 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.437199 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.437413 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.437499 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.437720 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.437815 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.438028 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.438114 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.438336 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.438422 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.438641 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.438737 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.438963 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.439049 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.439266 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.439352 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.439574 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.439680 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.439876 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.439968 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.440177 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.440270 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.440507 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.440606 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.440812 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.440900 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.441118 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.441383 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.441479 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.441716 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.441804 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.442027 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.442114 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.442341 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.442436 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.442659 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.442744 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.442967 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.443054 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.443280 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.443376 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.443587 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.443681 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.443895 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.443989 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.444216 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.444313 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.444551 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.444647 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.444860 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.445012 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.445166 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.445260 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.445474 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.445561 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.445776 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.445861 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.446081 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.446167 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.446385 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.446473 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.446693 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.446780 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.446998 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.447094 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.447302 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.447390 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.447606 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.447693 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.447906 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.448007 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.448219 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.448306 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.448543 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.448816 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.448910 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.449144 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.449231 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.449463 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.449573 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.449767 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.449855 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.450068 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.450157 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.450368 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.450455 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.450671 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.450773 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.451011 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.451097 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.451827 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.451929 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.452163 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.452267 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.452507 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.452603 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.452821 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.452919 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.453130 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.453217 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.453431 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.453516 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.453740 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.453825 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.454043 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.454127 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.454348 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.454436 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.454649 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.454736 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.454955 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.455055 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.455257 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.455345 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.455558 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.455652 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.455861 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.455955 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.456163 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.456255 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.456493 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.456593 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.456798 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.456893 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.457098 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.457190 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.457405 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.457491 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.457706 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.457806 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.458010 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.458099 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.458315 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.458409 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.458613 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.458710 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.458913 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.458999 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.459218 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.459305 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.459524 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.459613 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.459823 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.460182 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.460414 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.460516 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.460718 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.460806 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.461032 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.461129 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.461332 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.461420 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.461633 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.461721 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.461932 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.462025 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.462236 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.462322 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.462542 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.462630 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.462848 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.462963 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.463157 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.463270 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.463462 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.463562 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.463763 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.463858 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.464063 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.464165 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.464391 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.464488 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.464695 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.464787 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.464999 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.465101 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.465302 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.465402 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.465618 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.465712 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.465929 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.466037 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.466226 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.466320 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.466531 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.466625 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.466832 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.466969 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.467669 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.467775 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.467971 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.468080 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.468278 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.468380 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.468603 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.468701 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.468904 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.468993 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.469204 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.469292 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.469505 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.469598 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.469808 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.469945 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.470117 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.470206 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.470419 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.470504 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.470720 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.470814 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.471017 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.471111 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.471316 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.471403 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.471632 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.471726 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.471937 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.472025 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.472245 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.472353 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.472575 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.472676 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.472879 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.473022 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.473190 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.473325 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.473495 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.473590 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.473803 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.473890 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.474107 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.474200 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.474406 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.474493 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.474708 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.474793 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.475013 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.475099 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.475319 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.475405 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.475619 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.475712 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.475919 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.476013 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.476219 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.476306 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.476558 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.476657 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.476862 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.476948 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.477167 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.477264 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.477483 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.477570 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.477792 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.477886 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.478093 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.478178 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.478395 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.478481 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.478699 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.478794 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.479000 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.479085 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.479306 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.479392 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.479611 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.479705 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.479917 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.480054 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.480226 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.480313 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.480558 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.480657 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.480865 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.480953 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.481174 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.481260 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.481478 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.481567 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.481785 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.481871 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.482091 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.482184 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.482394 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.482482 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.483035 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.483123 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.483351 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.483435 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.483655 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.483743 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.483962 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.484049 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.484264 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.484397 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.484597 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.484685 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.484906 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.485013 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.485232 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.485334 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.485560 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.485652 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.485869 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.485959 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.486179 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.486279 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.486491 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.486582 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.486808 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.486900 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.487119 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.487223 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.487428 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.487525 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.487730 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.487820 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.488038 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.488151 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.488369 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.488464 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.488686 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.488773 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.489000 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.489166 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.489309 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.489403 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.489619 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.489705 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.489927 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.490020 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.490231 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.490318 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.490540 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.490625 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.490842 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.490929 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.491143 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.491277 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.491450 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.491535 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.491753 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.491840 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.492060 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.492146 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.492387 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.492491 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.492789 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.492881 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.493092 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.493180 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.493422 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.493519 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.493728 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.493815 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.494042 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.494130 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.494355 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.494450 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.494672 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.494760 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.494987 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.495076 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.495295 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.495390 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.495605 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.495714 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.495912 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.496027 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.496236 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.496369 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.496582 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.496669 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.496890 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.496976 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.497200 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.497289 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.497502 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.497588 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.497823 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.497910 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.498161 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.498251 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.498477 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.498606 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.498797 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.498913 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.499209 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.499318 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.499530 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.499619 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.499835 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.499920 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.500155 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.500241 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.500501 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.500591 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.500805 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.500903 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.501108 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.501282 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.501415 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.501592 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.501716 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.501901 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.502018 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.502225 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.502339 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.502548 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.502636 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.502872 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.502958 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.503177 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.503265 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.503492 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.503625 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.503801 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.503889 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.504098 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.504185 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.504442 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.504545 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.504746 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.504833 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.505066 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.505153 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.505373 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.505462 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.505692 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.505786 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.506011 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.506097 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.506314 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.506401 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.506636 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.506731 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.506941 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.507057 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.507241 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.507383 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.507541 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.507694 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.507842 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.508016 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.508183 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.508357 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.508510 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.508673 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.508827 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.508982 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.509157 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.509292 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.509486 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.509600 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.509796 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.509907 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.510129 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.510216 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.510453 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.510544 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.510764 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.510852 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.511079 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.511166 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.511402 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.511491 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.511705 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.511791 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.512008 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.512103 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.512312 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.512458 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.512633 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.512737 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.512935 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.513031 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.513237 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.513324 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.513542 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.513635 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.514363 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.514469 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.514666 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.514752 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.514966 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.515063 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.515288 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.515383 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.515591 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.515678 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.515911 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.516004 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.516215 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.516302 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.516540 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.516628 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.516843 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.516929 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.517145 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.517234 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.517484 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.517571 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.517786 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.517873 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.518117 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.518204 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.518431 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.518517 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.518749 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.518834 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.519063 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.519149 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.519366 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.519450 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.519686 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.519782 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.519992 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.520076 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.520300 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.520454 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.520633 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.520732 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.520937 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.521032 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.521243 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.521330 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.521548 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.521645 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.521857 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.521942 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.522161 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.522246 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.522467 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.522562 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.522773 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.522867 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.523085 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.523170 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.523389 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.523617 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.523705 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.523943 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.524030 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.524257 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.524403 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.524593 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.524687 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.524902 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.524989 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.525214 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.525309 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.525526 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.525626 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.525838 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.525925 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.526145 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.526239 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.526451 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.526537 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.526757 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.526843 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.527071 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.527158 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.527385 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.527472 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.527709 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.527806 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.528027 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.528115 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.528350 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.528439 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.528669 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.528808 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.528968 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.529051 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.529276 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.529364 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.530121 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.530225 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.530519 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.530645 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.530759 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.530874 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.531037 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.531134 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.531356 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.531442 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.531669 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.531890 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.531977 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.532220 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.532308 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.532573 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.532665 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.532886 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.532983 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.533192 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.533285 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.533502 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.533589 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.533811 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.533950 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.534121 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.534209 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.534430 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.534517 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.534741 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.534838 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.535053 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.535184 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.535360 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.535454 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.535679 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.535776 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.535994 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.536082 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.536361 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.536538 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.536666 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.536853 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.536983 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.537186 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.537281 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.537511 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.537606 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.537834 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.537922 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.538148 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.538235 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.538463 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.538558 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.538788 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.538917 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.539092 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.539179 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.539394 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.539482 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.539701 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.539788 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.540009 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.540094 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.540313 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.540418 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.540655 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.540753 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.540962 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.541056 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.541264 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.541350 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.541572 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.541658 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.541877 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.541975 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.542198 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.542411 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.542533 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.542760 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.542846 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.543077 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.543177 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.543405 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.543493 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.543729 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.543824 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.544044 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.544249 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.544377 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.544595 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.544682 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.544932 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.545038 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.545287 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.545381 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.545599 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.545696 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.545911 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.545999 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.546214 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.546300 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.546518 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.546612 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.546828 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.546916 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.547132 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.547219 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.547432 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.547525 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.547740 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.547826 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.548041 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.548134 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.548383 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.548486 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.548693 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.548781 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.548997 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.549089 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.549299 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.549394 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.549606 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.549694 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.549910 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.550135 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.550229 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.550483 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.550571 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.550788 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.550875 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.551096 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.551198 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.551399 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.551488 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.551702 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.551789 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.552005 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.552099 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.552312 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.552445 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.552635 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.552723 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.552940 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.553035 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.553252 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.553339 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.553564 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.553650 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.553869 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.553964 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.554168 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.554253 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.554474 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.554566 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.554778 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.554865 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.555079 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.555178 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.555389 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.555476 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.555692 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.555856 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.556018 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.556106 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.556343 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.556445 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.556649 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.556873 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.556960 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.557206 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.557292 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.557527 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.557623 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.557836 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.557929 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.560780 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.561026 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.561193 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.561280 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.561360 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.561439 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.561518 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.561603 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.561697 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.561792 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.561874 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.561941 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.562007 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.562149 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.562242 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.562324 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.562403 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.562482 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.562482 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.562624 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.562711 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.562792 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.562871 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.562949 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.563027 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.563705 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.563809 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.563892 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.563972 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.564062 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.564150 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.564228 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.564298 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.564395 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.564477 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.564556 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.564634 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.564771 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.564860 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.564940 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.565019 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.565098 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.565186 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.565186 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.565332 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.565410 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.565488 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.565573 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.565661 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.565749 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.565880 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.565962 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.566040 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.566223 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.566322 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.566535 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.566624 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.566863 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.566953 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.567174 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.567271 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.567481 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.567575 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.567790 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.567896 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.568099 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.568188 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.568432 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.568535 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.568776 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.568879 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.569054 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.569192 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.569363 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.569451 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.569671 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.569761 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.570497 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.570586 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.570666 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.570745 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.570831 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.570921 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.571003 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.571082 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.571160 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.571259 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.571484 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.571579 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.571802 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.571890 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.572121 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.572208 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.572472 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.572578 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.572787 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.572873 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.573094 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.573186 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.573401 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.573488 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.573704 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.573789 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.574007 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.574093 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.574308 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.574395 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.574614 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.574699 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.574915 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.575001 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.575218 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.575312 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.575520 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.575637 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.575826 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.575951 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.576131 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.576812 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.576976 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.577132 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.577280 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.577448 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.577582 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.577771 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.577882 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.578094 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.578182 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.578403 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.578498 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.578723 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.578810 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.579035 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.579129 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.579334 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.579420 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.579632 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.579718 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.579933 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.580027 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.580233 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.580321 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.580586 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.580673 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.580916 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.581016 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.581220 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.581307 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.581530 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.581617 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.581836 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.581930 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.582143 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.582236 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.582444 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.582538 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.582743 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.582838 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.583052 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.583138 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.583356 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.583443 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.583658 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.583745 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.583960 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.584045 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.584314 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.584480 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.584599 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.584687 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.585162 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.585261 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.585466 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.585553 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.585772 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.585867 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.586075 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.586162 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.586379 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.586474 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.586682 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.586771 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.586989 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.587075 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.587296 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.587460 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.587599 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.587693 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.587900 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.587988 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.588203 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.588298 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.588529 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.588636 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.588856 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.588948 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.589165 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.589260 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.589472 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.589559 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.589784 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.589871 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.590090 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.590178 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.590399 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.590485 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.590703 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.590791 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.591014 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.591100 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.591333 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.591420 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.591647 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.591741 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.592000 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.592598 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.592838 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.592927 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.593165 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.593260 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.593477 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.593566 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.593790 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.593878 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.594102 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.594199 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.594413 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.594543 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.594725 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.594822 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.595051 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.595146 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.595356 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.595451 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.595602 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 17 15:02:26.595689 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.595983 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.596300 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.596644 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.596962 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.597279 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.597609 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.597921 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.598231 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.598545 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.598856 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.599167 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.599481 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.599796 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.600125 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.600486 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.600798 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.601123 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.601451 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.601803 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.602114 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.602457 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.602788 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.603104 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.603416 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.603723 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:02:26.603966 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 17 15:02:26.657826 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: INFO dbcounter [None req-d336812b-605a-4806-829d-af70a9b24292 None None] Registered counter for database nova_api Jun 17 15:02:26.666288 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: INFO dbcounter [None req-28eff5d5-d842-40f3-9102-17b9c6f48da3 None None] Registered counter for database nova_api Jun 17 15:02:26.677597 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG oslo_db.sqlalchemy.engines [None req-d336812b-605a-4806-829d-af70a9b24292 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103267) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 15:02:26.684416 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG dbcounter [-] [103267] Writer thread running {{(pid=103267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 15:02:26.686701 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG oslo_db.sqlalchemy.engines [None req-28eff5d5-d842-40f3-9102-17b9c6f48da3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103268) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 15:02:26.693215 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG dbcounter [-] [103268] Writer thread running {{(pid=103268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 15:02:26.742213 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.context [None req-d336812b-605a-4806-829d-af70a9b24292 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b6b5fdf2-9eb8-4963-9495-5b73caa9f013(cell1) {{(pid=103267) load_cells /opt/stack/nova/nova/context.py:464}} Jun 17 15:02:26.747948 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG oslo_concurrency.lockutils [None req-d336812b-605a-4806-829d-af70a9b24292 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:02:26.751531 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG oslo_concurrency.lockutils [None req-d336812b-605a-4806-829d-af70a9b24292 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:02:26.751823 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.context [None req-28eff5d5-d842-40f3-9102-17b9c6f48da3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b6b5fdf2-9eb8-4963-9495-5b73caa9f013(cell1) {{(pid=103268) load_cells /opt/stack/nova/nova/context.py:464}} Jun 17 15:02:26.752422 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG oslo_concurrency.lockutils [None req-d336812b-605a-4806-829d-af70a9b24292 None None] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:02:26.754460 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG oslo_concurrency.lockutils [None req-d336812b-605a-4806-829d-af70a9b24292 None None] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:02:26.756098 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG oslo_concurrency.lockutils [None req-28eff5d5-d842-40f3-9102-17b9c6f48da3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:02:26.756485 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: INFO dbcounter [None req-d336812b-605a-4806-829d-af70a9b24292 None None] Registered counter for database nova_cell0 Jun 17 15:02:26.757723 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG oslo_concurrency.lockutils [None req-28eff5d5-d842-40f3-9102-17b9c6f48da3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:02:26.758520 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG oslo_concurrency.lockutils [None req-28eff5d5-d842-40f3-9102-17b9c6f48da3 None None] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:02:26.760310 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: INFO dbcounter [None req-d336812b-605a-4806-829d-af70a9b24292 None None] Registered counter for database nova_cell1 Jun 17 15:02:26.760589 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG oslo_concurrency.lockutils [None req-28eff5d5-d842-40f3-9102-17b9c6f48da3 None None] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:02:26.762661 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: INFO dbcounter [None req-28eff5d5-d842-40f3-9102-17b9c6f48da3 None None] Registered counter for database nova_cell0 Jun 17 15:02:26.767242 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: INFO dbcounter [None req-28eff5d5-d842-40f3-9102-17b9c6f48da3 None None] Registered counter for database nova_cell1 Jun 17 15:02:26.769176 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG oslo_db.sqlalchemy.engines [None req-d336812b-605a-4806-829d-af70a9b24292 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103267) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 15:02:26.770453 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG oslo_db.sqlalchemy.engines [None req-d336812b-605a-4806-829d-af70a9b24292 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103267) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 15:02:26.774759 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG oslo_db.sqlalchemy.engines [None req-28eff5d5-d842-40f3-9102-17b9c6f48da3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103268) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 15:02:26.776047 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG dbcounter [-] [103267] Writer thread running {{(pid=103267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 15:02:26.777044 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG oslo_db.sqlalchemy.engines [None req-28eff5d5-d842-40f3-9102-17b9c6f48da3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103268) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 15:02:26.782089 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG dbcounter [-] [103268] Writer thread running {{(pid=103268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 15:02:26.784721 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG dbcounter [-] [103268] Writer thread running {{(pid=103268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 15:02:26.914128 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG dbcounter [-] [103267] Writer thread running {{(pid=103267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 15:02:26.924183 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: INFO dbcounter [None req-d336812b-605a-4806-829d-af70a9b24292 None None] Registered counter for database nova_cell0 Jun 17 15:02:26.932046 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: INFO dbcounter [None req-28eff5d5-d842-40f3-9102-17b9c6f48da3 None None] Registered counter for database nova_cell0 Jun 17 15:02:26.933302 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG oslo_db.sqlalchemy.engines [None req-d336812b-605a-4806-829d-af70a9b24292 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103267) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 15:02:26.938461 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG dbcounter [-] [103267] Writer thread running {{(pid=103267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 15:02:26.941508 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG oslo_db.sqlalchemy.engines [None req-28eff5d5-d842-40f3-9102-17b9c6f48da3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103268) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 15:02:26.945842 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG dbcounter [-] [103268] Writer thread running {{(pid=103268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 15:02:27.276122 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: WARNING keystonemiddleware.auth_token [None req-28eff5d5-d842-40f3-9102-17b9c6f48da3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 17 15:02:27.280382 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: WARNING keystonemiddleware.auth_token [None req-d336812b-605a-4806-829d-af70a9b24292 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 17 15:02:27.283506 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: WARNING keystonemiddleware.auth_token [None req-28eff5d5-d842-40f3-9102-17b9c6f48da3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 17 15:02:27.287673 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: WARNING keystonemiddleware.auth_token [None req-d336812b-605a-4806-829d-af70a9b24292 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 17 15:02:27.624746 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: WARNING keystonemiddleware.auth_token [None req-28eff5d5-d842-40f3-9102-17b9c6f48da3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 17 15:02:27.630759 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: WARNING keystonemiddleware.auth_token [None req-28eff5d5-d842-40f3-9102-17b9c6f48da3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 17 15:02:27.631114 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: WARNING keystonemiddleware.auth_token [None req-d336812b-605a-4806-829d-af70a9b24292 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 17 15:02:27.636048 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559616e689c0 pid: 103268 (default app) Jun 17 15:02:27.637137 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: WARNING keystonemiddleware.auth_token [None req-d336812b-605a-4806-829d-af70a9b24292 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 17 15:02:27.638235 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-28eff5d5-d842-40f3-9102-17b9c6f48da3 None None] Calling method '>' {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:02:27.639437 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.requestlog [None req-28eff5d5-d842-40f3-9102-17b9c6f48da3 None None] 10.222.0.48 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001762 Jun 17 15:02:27.640175 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: [pid: 103268|app: 0|req: 1/1] 10.222.0.48 () {50 vars in 788 bytes} [Fri Jun 17 15:02:27 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:02:27.642515 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559616e689c0 pid: 103267 (default app) Jun 17 15:03:44.584802 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-28eff5d5-d842-40f3-9102-17b9c6f48da3 None None] Calling method '>' {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:03:44.586275 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.requestlog [None req-28eff5d5-d842-40f3-9102-17b9c6f48da3 None None] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001968 Jun 17 15:03:44.586747 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: [pid: 103268|app: 0|req: 2/2] 10.222.0.48 () {54 vars in 930 bytes} [Fri Jun 17 15:03:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:03:44.599925 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG dbcounter [-] [103267] Writing DB stats nova_api:SELECT=3 {{(pid=103267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:03:44.601079 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG dbcounter [-] [103267] Writing DB stats nova_cell0:SELECT=3 {{(pid=103267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:03:44.602163 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG dbcounter [-] [103267] Writing DB stats nova_cell1:SELECT=3 {{(pid=103267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:03:44.602998 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG dbcounter [-] [103267] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:03:45.078377 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi [None req-a7fc1f8d-a29e-41a2-9a27-63ce9de1c8ba admin admin] Calling method '>' {{(pid=103267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:03:45.112509 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: INFO nova.api.openstack.requestlog [None req-a7fc1f8d-a29e-41a2-9a27-63ce9de1c8ba admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.517976 Jun 17 15:03:45.113271 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: [pid: 103267|app: 0|req: 1/3] 10.222.0.48 () {60 vars in 1291 bytes} [Fri Jun 17 15:03:44 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:03:47.366815 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-28eff5d5-d842-40f3-9102-17b9c6f48da3 None None] Calling method '>' {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:03:47.367861 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.requestlog [None req-28eff5d5-d842-40f3-9102-17b9c6f48da3 None None] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Jun 17 15:03:47.368259 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: [pid: 103268|app: 0|req: 3/4] 10.222.0.48 () {54 vars in 930 bytes} [Fri Jun 17 15:03:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:03:47.441997 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi [None req-744b81d6-ccaa-42c0-a270-234094b9a2ef admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "vcpus": 1, "id": "c1", "disk": 1, "name": "cirros256", "swap": 0, "rxtx_factor": 1.0}} {{(pid=103267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:03:47.463423 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 17 15:03:47.463423 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: warnings.warn(msg) Jun 17 15:03:47.495290 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: INFO nova.api.openstack.requestlog [None req-744b81d6-ccaa-42c0-a270-234094b9a2ef admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.115207 Jun 17 15:03:47.496645 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: [pid: 103267|app: 0|req: 2/5] 10.222.0.48 () {64 vars in 1282 bytes} [Fri Jun 17 15:03:47 2022] POST /compute/v2.1/flavors => generated 407 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:03:47.510280 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG dbcounter [-] [103268] Writing DB stats nova_api:SELECT=3 {{(pid=103268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:03:47.511530 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG dbcounter [-] [103268] Writing DB stats nova_cell0:SELECT=3 {{(pid=103268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:03:47.513469 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG dbcounter [-] [103268] Writing DB stats nova_cell1:SELECT=3 {{(pid=103268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:03:47.514328 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG dbcounter [-] [103268] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:03:47.728533 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-35c52583-0cd3-40f6-b9c1-52f547a3d1ce admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:03:47.731057 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 17 15:03:47.731057 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: warnings.warn(msg) Jun 17 15:03:47.812742 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.requestlog [None req-35c52583-0cd3-40f6-b9c1-52f547a3d1ce admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.307313 Jun 17 15:03:47.818711 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: [pid: 103268|app: 0|req: 4/6] 10.222.0.48 () {64 vars in 1335 bytes} [Fri Jun 17 15:03:47 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:03:50.013506 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi [None req-744b81d6-ccaa-42c0-a270-234094b9a2ef admin admin] Calling method '>' {{(pid=103267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:03:50.014521 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: INFO nova.api.openstack.requestlog [None req-744b81d6-ccaa-42c0-a270-234094b9a2ef admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002047 Jun 17 15:03:50.015072 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: [pid: 103267|app: 0|req: 3/7] 10.222.0.48 () {54 vars in 930 bytes} [Fri Jun 17 15:03:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:03:50.121842 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-3fcf2e91-b811-4229-92dc-0b58af1502f2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "os-flavor-access:is_public": true, "ram": 512, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 1, "id": "d1", "name": "ds512M"}} {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:03:50.140738 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 17 15:03:50.140738 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: warnings.warn(msg) Jun 17 15:03:50.159561 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.requestlog [None req-3fcf2e91-b811-4229-92dc-0b58af1502f2 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.138738 Jun 17 15:03:50.160317 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: [pid: 103268|app: 0|req: 5/8] 10.222.0.48 () {64 vars in 1282 bytes} [Fri Jun 17 15:03:50 2022] POST /compute/v2.1/flavors => generated 404 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:03:50.172783 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi [None req-9af016ed-072b-49dd-8b5f-994095468757 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:03:50.174334 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 17 15:03:50.174334 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: warnings.warn(msg) Jun 17 15:03:50.209561 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: INFO nova.api.openstack.requestlog [None req-9af016ed-072b-49dd-8b5f-994095468757 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040917 Jun 17 15:03:50.210412 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: [pid: 103267|app: 0|req: 4/9] 10.222.0.48 () {64 vars in 1335 bytes} [Fri Jun 17 15:03:50 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:03:52.468742 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-3fcf2e91-b811-4229-92dc-0b58af1502f2 admin admin] Calling method '>' {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:03:52.469847 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.requestlog [None req-3fcf2e91-b811-4229-92dc-0b58af1502f2 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001603 Jun 17 15:03:52.470584 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: [pid: 103268|app: 0|req: 6/10] 10.222.0.48 () {54 vars in 930 bytes} [Fri Jun 17 15:03:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:03:52.533111 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi [None req-3971cfb5-dc35-4ecc-a0d1-d74982946f1f admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 1, "name": "ds1G", "swap": 0, "id": "d2", "disk": 10, "os-flavor-access:is_public": true, "ram": 1024}} {{(pid=103267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:03:52.553328 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: INFO nova.api.openstack.requestlog [None req-3971cfb5-dc35-4ecc-a0d1-d74982946f1f admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.076743 Jun 17 15:03:52.554115 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: [pid: 103267|app: 0|req: 5/11] 10.222.0.48 () {64 vars in 1282 bytes} [Fri Jun 17 15:03:52 2022] POST /compute/v2.1/flavors => generated 404 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:03:52.567316 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-5c7390b7-7613-4403-af5a-b22eed5ab57f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:03:52.594162 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.requestlog [None req-5c7390b7-7613-4403-af5a-b22eed5ab57f admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030517 Jun 17 15:03:52.604374 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: [pid: 103268|app: 0|req: 7/12] 10.222.0.48 () {64 vars in 1335 bytes} [Fri Jun 17 15:03:52 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:03:54.772980 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi [None req-3971cfb5-dc35-4ecc-a0d1-d74982946f1f admin admin] Calling method '>' {{(pid=103267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:03:54.774016 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: INFO nova.api.openstack.requestlog [None req-3971cfb5-dc35-4ecc-a0d1-d74982946f1f admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001570 Jun 17 15:03:54.774582 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: [pid: 103267|app: 0|req: 6/13] 10.222.0.48 () {54 vars in 930 bytes} [Fri Jun 17 15:03:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:03:54.838137 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-5f059fef-c4b9-48fa-8536-ee71cd3fa5c8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "rxtx_factor": 1.0, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 2, "name": "ds2G", "os-flavor-access:is_public": true, "disk": 10}} {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:03:54.856056 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.requestlog [None req-5f059fef-c4b9-48fa-8536-ee71cd3fa5c8 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.075441 Jun 17 15:03:54.856733 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: [pid: 103268|app: 0|req: 8/14] 10.222.0.48 () {64 vars in 1282 bytes} [Fri Jun 17 15:03:54 2022] POST /compute/v2.1/flavors => generated 404 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:03:54.868457 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi [None req-de91557b-449f-43d5-b781-79f20f0d326f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:03:54.892478 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: INFO nova.api.openstack.requestlog [None req-de91557b-449f-43d5-b781-79f20f0d326f admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027410 Jun 17 15:03:54.893068 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: [pid: 103267|app: 0|req: 7/15] 10.222.0.48 () {64 vars in 1335 bytes} [Fri Jun 17 15:03:54 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:03:57.056870 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-5f059fef-c4b9-48fa-8536-ee71cd3fa5c8 admin admin] Calling method '>' {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:03:57.057941 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.requestlog [None req-5f059fef-c4b9-48fa-8536-ee71cd3fa5c8 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001591 Jun 17 15:03:57.058392 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: [pid: 103268|app: 0|req: 9/16] 10.222.0.48 () {54 vars in 930 bytes} [Fri Jun 17 15:03:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:03:57.136838 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi [None req-d8abd9a9-d526-40af-8fd2-0beb9096366c admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "swap": 0, "ram": 4096, "name": "ds4G", "os-flavor-access:is_public": true, "vcpus": 4, "rxtx_factor": 1.0}} {{(pid=103267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:03:57.156610 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: INFO nova.api.openstack.requestlog [None req-d8abd9a9-d526-40af-8fd2-0beb9096366c admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.091916 Jun 17 15:03:57.157318 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: [pid: 103267|app: 0|req: 8/17] 10.222.0.48 () {64 vars in 1282 bytes} [Fri Jun 17 15:03:57 2022] POST /compute/v2.1/flavors => generated 404 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:03:57.172756 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-48f6f19e-01f0-4eef-8516-bb5280d93c59 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:03:57.213370 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.requestlog [None req-48f6f19e-01f0-4eef-8516-bb5280d93c59 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044847 Jun 17 15:03:57.214220 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: [pid: 103268|app: 0|req: 10/18] 10.222.0.48 () {64 vars in 1335 bytes} [Fri Jun 17 15:03:57 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:03:59.460243 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi [None req-d8abd9a9-d526-40af-8fd2-0beb9096366c admin admin] Calling method '>' {{(pid=103267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:03:59.462061 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: INFO nova.api.openstack.requestlog [None req-d8abd9a9-d526-40af-8fd2-0beb9096366c admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002485 Jun 17 15:03:59.462529 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: [pid: 103267|app: 0|req: 9/19] 10.222.0.48 () {54 vars in 930 bytes} [Fri Jun 17 15:03:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:03:59.530568 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-3f5db042-7006-485c-87fe-7047a6b389e2 admin admin] Calling method '>' {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:03:59.556984 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.requestlog [None req-3f5db042-7006-485c-87fe-7047a6b389e2 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.086663 Jun 17 15:03:59.563821 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: [pid: 103268|app: 0|req: 11/20] 10.222.0.48 () {60 vars in 1291 bytes} [Fri Jun 17 15:03:59 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:04:01.870801 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi [None req-d8abd9a9-d526-40af-8fd2-0beb9096366c admin admin] Calling method '>' {{(pid=103267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:04:01.872320 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: INFO nova.api.openstack.requestlog [None req-d8abd9a9-d526-40af-8fd2-0beb9096366c admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001845 Jun 17 15:04:01.872751 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: [pid: 103267|app: 0|req: 10/21] 10.222.0.48 () {54 vars in 930 bytes} [Fri Jun 17 15:04:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:04:01.933813 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-95b8a0e1-b873-42a2-909e-a3c31a2108c1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "ram": 512, "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 1, "name": "m1.tiny", "vcpus": 1}} {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:04:01.954326 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.requestlog [None req-95b8a0e1-b873-42a2-909e-a3c31a2108c1 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.075271 Jun 17 15:04:01.954888 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: [pid: 103268|app: 0|req: 12/22] 10.222.0.48 () {64 vars in 1282 bytes} [Fri Jun 17 15:04:01 2022] POST /compute/v2.1/flavors => generated 402 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:04:01.973259 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi [None req-8d9e0d46-7671-463d-bdba-9ee253b18344 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:04:02.011182 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: INFO nova.api.openstack.requestlog [None req-8d9e0d46-7671-463d-bdba-9ee253b18344 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043758 Jun 17 15:04:02.012193 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: [pid: 103267|app: 0|req: 11/23] 10.222.0.48 () {64 vars in 1332 bytes} [Fri Jun 17 15:04:01 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:04:04.323113 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-95b8a0e1-b873-42a2-909e-a3c31a2108c1 admin admin] Calling method '>' {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:04:04.324440 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.requestlog [None req-95b8a0e1-b873-42a2-909e-a3c31a2108c1 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001844 Jun 17 15:04:04.325627 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: [pid: 103268|app: 0|req: 13/24] 10.222.0.48 () {54 vars in 930 bytes} [Fri Jun 17 15:04:04 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:04:04.401295 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi [None req-68dc9f96-3944-4925-85e4-c900e748840e admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "2", "name": "m1.small", "disk": 20, "ram": 2048, "rxtx_factor": 1.0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=103267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:04:04.424692 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: INFO nova.api.openstack.requestlog [None req-68dc9f96-3944-4925-85e4-c900e748840e admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.091176 Jun 17 15:04:04.425652 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: [pid: 103267|app: 0|req: 12/25] 10.222.0.48 () {64 vars in 1282 bytes} [Fri Jun 17 15:04:04 2022] POST /compute/v2.1/flavors => generated 405 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:04:04.438319 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-9f62ee08-e63f-4605-b13d-b03b82fef9ad admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:04:04.464189 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.requestlog [None req-9f62ee08-e63f-4605-b13d-b03b82fef9ad admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029626 Jun 17 15:04:04.464822 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: [pid: 103268|app: 0|req: 14/26] 10.222.0.48 () {64 vars in 1332 bytes} [Fri Jun 17 15:04:04 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:04:06.784048 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi [None req-68dc9f96-3944-4925-85e4-c900e748840e admin admin] Calling method '>' {{(pid=103267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:04:06.785818 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: INFO nova.api.openstack.requestlog [None req-68dc9f96-3944-4925-85e4-c900e748840e admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002488 Jun 17 15:04:06.786398 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: [pid: 103267|app: 0|req: 13/27] 10.222.0.48 () {54 vars in 930 bytes} [Fri Jun 17 15:04:06 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:04:06.868356 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-a15b95c0-7c91-4b94-a17e-faaa387c8005 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "swap": 0, "id": "3", "ram": 4096, "os-flavor-access:is_public": true, "disk": 40, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2}} {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:04:06.914249 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.requestlog [None req-a15b95c0-7c91-4b94-a17e-faaa387c8005 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.118811 Jun 17 15:04:06.914815 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: [pid: 103268|app: 0|req: 15/28] 10.222.0.48 () {64 vars in 1282 bytes} [Fri Jun 17 15:04:06 2022] POST /compute/v2.1/flavors => generated 406 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:04:06.927845 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi [None req-5c91932a-19e7-4f78-9ebe-39d51784a3ae admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:04:06.953768 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: INFO nova.api.openstack.requestlog [None req-5c91932a-19e7-4f78-9ebe-39d51784a3ae admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029724 Jun 17 15:04:06.954221 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: [pid: 103267|app: 0|req: 14/29] 10.222.0.48 () {64 vars in 1332 bytes} [Fri Jun 17 15:04:06 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:04:09.128850 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-a15b95c0-7c91-4b94-a17e-faaa387c8005 admin admin] Calling method '>' {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:04:09.129938 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.requestlog [None req-a15b95c0-7c91-4b94-a17e-faaa387c8005 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001564 Jun 17 15:04:09.130342 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: [pid: 103268|app: 0|req: 16/30] 10.222.0.48 () {54 vars in 930 bytes} [Fri Jun 17 15:04:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:04:09.195502 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi [None req-8bddf44a-a1aa-4d58-a9fe-184e4bf31ed1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large", "id": "4", "disk": 80, "swap": 0, "rxtx_factor": 1.0, "ram": 8192}} {{(pid=103267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:04:09.215373 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: INFO nova.api.openstack.requestlog [None req-8bddf44a-a1aa-4d58-a9fe-184e4bf31ed1 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.078877 Jun 17 15:04:09.215954 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: [pid: 103267|app: 0|req: 15/31] 10.222.0.48 () {64 vars in 1282 bytes} [Fri Jun 17 15:04:09 2022] POST /compute/v2.1/flavors => generated 405 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:04:09.228361 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-ac794e18-12b0-4d4a-aae4-60c2de4a200c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:04:09.253490 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.requestlog [None req-ac794e18-12b0-4d4a-aae4-60c2de4a200c admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028822 Jun 17 15:04:09.254200 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: [pid: 103268|app: 0|req: 17/32] 10.222.0.48 () {64 vars in 1332 bytes} [Fri Jun 17 15:04:09 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:04:11.568181 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi [None req-8bddf44a-a1aa-4d58-a9fe-184e4bf31ed1 admin admin] Calling method '>' {{(pid=103267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:04:11.569240 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: INFO nova.api.openstack.requestlog [None req-8bddf44a-a1aa-4d58-a9fe-184e4bf31ed1 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Jun 17 15:04:11.569644 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: [pid: 103267|app: 0|req: 16/33] 10.222.0.48 () {54 vars in 930 bytes} [Fri Jun 17 15:04:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:04:11.645281 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-e65795a6-03a4-4e6d-a02c-eb309badc625 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "swap": 0, "ram": 16384, "name": "m1.xlarge", "vcpus": 8, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "os-flavor-access:is_public": true}} {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:04:11.663650 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.requestlog [None req-e65795a6-03a4-4e6d-a02c-eb309badc625 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.087499 Jun 17 15:04:11.664212 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: [pid: 103268|app: 0|req: 18/34] 10.222.0.48 () {64 vars in 1282 bytes} [Fri Jun 17 15:04:11 2022] POST /compute/v2.1/flavors => generated 408 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:04:11.676136 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi [None req-1900bf34-4617-4278-9224-05a603d27e2c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:04:11.700939 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: INFO nova.api.openstack.requestlog [None req-1900bf34-4617-4278-9224-05a603d27e2c admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028511 Jun 17 15:04:11.701517 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: [pid: 103267|app: 0|req: 17/35] 10.222.0.48 () {64 vars in 1332 bytes} [Fri Jun 17 15:04:11 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:04:35.984439 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-e65795a6-03a4-4e6d-a02c-eb309badc625 admin admin] Calling method '>' {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:04:35.985447 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.requestlog [None req-e65795a6-03a4-4e6d-a02c-eb309badc625 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Jun 17 15:04:35.985855 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: [pid: 103268|app: 0|req: 19/36] 10.222.0.48 () {54 vars in 930 bytes} [Fri Jun 17 15:04:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:04:35.996289 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG dbcounter [-] [103267] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:04:36.044850 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi [None req-2bae8986-1eb3-4904-9aa3-e7729bff2afb admin admin] Calling method '>' {{(pid=103267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:04:36.062134 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: INFO nova.api.openstack.requestlog [None req-2bae8986-1eb3-4904-9aa3-e7729bff2afb admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.070452 Jun 17 15:04:36.062676 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: [pid: 103267|app: 0|req: 18/37] 10.222.0.48 () {60 vars in 1291 bytes} [Fri Jun 17 15:04:35 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 15:04:37.037132 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-e65795a6-03a4-4e6d-a02c-eb309badc625 admin admin] Calling method '>' {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:04:37.038140 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.requestlog [None req-e65795a6-03a4-4e6d-a02c-eb309badc625 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Jun 17 15:04:37.038538 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: [pid: 103268|app: 0|req: 20/38] 10.222.0.48 () {56 vars in 1074 bytes} [Fri Jun 17 15:04:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:04:37.230641 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi [None req-5cdf52b4-41fb-4aa4-91fe-7ad7f758011c admin admin] Calling method '>' {{(pid=103267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:04:37.236865 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: INFO nova.api.openstack.wsgi [None req-5cdf52b4-41fb-4aa4-91fe-7ad7f758011c admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 17 15:04:37.240139 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi [None req-5cdf52b4-41fb-4aa4-91fe-7ad7f758011c admin admin] Request method failure captured: Jun 17 15:04:37.240139 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 17 15:04:37.240139 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: Accept: application/json Jun 17 15:04:37.240139 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: Accept-Encoding: gzip, deflate Jun 17 15:04:37.240139 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: Connection: keep-alive Jun 17 15:04:37.240139 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: Content-Length: 0 Jun 17 15:04:37.240139 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: Host: 10.222.0.48 Jun 17 15:04:37.240139 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: Openstack-Api-Version: compute 2.90 Jun 17 15:04:37.240139 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: Openstack-System-Scope: None Jun 17 15:04:37.240139 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: User-Agent: python-novaclient Jun 17 15:04:37.240139 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: X-Auth-Token: gAAAAABirJgFTaH-uzD1AW6_i-YOrq6U9-dxJhWh8Tr0YtaYWxXP-gv-4bIsAZ3koFqZYV1sro6H2oa7ldAQoTYKUIJX14cX2Rk-ywLu-5EyfEsLfLPKl6pmIpIw0n8VnOr08cSGHA5ykYTGfP5jJ3NOvGobUsXx-DMYYG_e1J3KvqoNV1xNMSs Jun 17 15:04:37.240139 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: X-Domain-Id: None Jun 17 15:04:37.240139 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: X-Domain-Name: None Jun 17 15:04:37.240139 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: X-Identity-Status: Confirmed Jun 17 15:04:37.240139 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: X-Is-Admin-Project: True Jun 17 15:04:37.240139 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: X-Openstack-Nova-Api-Version: 2.90 Jun 17 15:04:37.240139 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: X-Project-Domain-Id: default Jun 17 15:04:37.240139 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: X-Project-Domain-Name: Default Jun 17 15:04:37.240139 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: X-Project-Id: e8170670bd744777aac7421d1ea72468 Jun 17 15:04:37.240139 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: X-Project-Name: admin Jun 17 15:04:37.240139 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: X-Role: reader,admin,member Jun 17 15:04:37.240139 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: X-Roles: reader,admin,member Jun 17 15:04:37.241745 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e8170670bd744777aac7421d1ea72468", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e8170670bd744777aac7421d1ea72468"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e8170670bd744777aac7421d1ea72468"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e8170670bd744777aac7421d1ea72468"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Jun 17 15:04:37.241745 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: X-Tenant: admin Jun 17 15:04:37.241745 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: X-Tenant-Id: e8170670bd744777aac7421d1ea72468 Jun 17 15:04:37.241745 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: X-Tenant-Name: admin Jun 17 15:04:37.241745 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: X-User: admin Jun 17 15:04:37.241745 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: X-User-Domain-Id: default Jun 17 15:04:37.241745 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: X-User-Domain-Name: Default Jun 17 15:04:37.241745 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: X-User-Id: 8bbab6424bb2407795236617fbc21d36 Jun 17 15:04:37.241745 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: X-User-Name: admin Jun 17 15:04:37.241745 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: method: > Jun 17 15:04:37.241745 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: exception: Flavor 42 could not be found. Jun 17 15:04:37.241745 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: action_args: {'id': '42'} Jun 17 15:04:37.241745 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: {{(pid=103267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 15:04:37.241745 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:04:37.242827 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 17 15:04:37.242827 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 17 15:04:37.242827 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 17 15:04:37.242827 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 17 15:04:37.242827 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 17 15:04:37.242827 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 17 15:04:37.242827 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 17 15:04:37.242827 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 17 15:04:37.242827 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 17 15:04:37.242827 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 15:04:37.242827 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 17 15:04:37.242827 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 17 15:04:37.242827 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 17 15:04:37.242827 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi Jun 17 15:04:37.242827 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:04:37.242827 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi Jun 17 15:04:37.242827 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:04:37.242827 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:04:37.242827 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:04:37.244253 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 15:04:37.244253 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 15:04:37.244253 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 15:04:37.244253 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 15:04:37.244253 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 17 15:04:37.244253 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 17 15:04:37.244253 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 17 15:04:37.244253 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi Jun 17 15:04:37.244253 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:04:37.244253 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi Jun 17 15:04:37.244253 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:04:37.244253 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:04:37.244253 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:04:37.244253 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 15:04:37.244253 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 15:04:37.244253 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 17 15:04:37.244253 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi Jun 17 15:04:37.244253 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi [None req-5cdf52b4-41fb-4aa4-91fe-7ad7f758011c admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 15:04:37.245565 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: INFO nova.api.openstack.requestlog [None req-5cdf52b4-41fb-4aa4-91fe-7ad7f758011c admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.062181 Jun 17 15:04:37.245565 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: [pid: 103267|app: 0|req: 19/39] 10.222.0.48 () {60 vars in 1190 bytes} [Fri Jun 17 15:04:37 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 17 15:04:37.251699 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-252ad3e6-539e-48b5-8a01-e5eca84ae6c6 admin admin] Calling method '>' {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:04:37.254703 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG dbcounter [-] [103268] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:04:37.274348 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.requestlog [None req-252ad3e6-539e-48b5-8a01-e5eca84ae6c6 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026111 Jun 17 15:04:37.274913 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: [pid: 103268|app: 0|req: 21/40] 10.222.0.48 () {60 vars in 1210 bytes} [Fri Jun 17 15:04:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 15:04:37.284701 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi [None req-3277e166-1805-44a9-8ca4-b3c271367855 admin admin] Calling method '>' {{(pid=103267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:04:37.306538 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: INFO nova.api.openstack.requestlog [None req-3277e166-1805-44a9-8ca4-b3c271367855 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025321 Jun 17 15:04:37.307090 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: [pid: 103267|app: 0|req: 20/41] 10.222.0.48 () {60 vars in 1210 bytes} [Fri Jun 17 15:04:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:04:37.317425 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-af0fedfc-6f0a-459f-a379-3ca07cec39fc admin admin] Calling method '>' {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:04:37.324160 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.wsgi [None req-af0fedfc-6f0a-459f-a379-3ca07cec39fc admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 17 15:04:37.327564 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-af0fedfc-6f0a-459f-a379-3ca07cec39fc admin admin] Request method failure captured: Jun 17 15:04:37.327564 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 17 15:04:37.327564 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: Accept: application/json Jun 17 15:04:37.327564 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: Accept-Encoding: gzip, deflate Jun 17 15:04:37.327564 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: Connection: keep-alive Jun 17 15:04:37.327564 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: Content-Length: 0 Jun 17 15:04:37.327564 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: Host: 10.222.0.48 Jun 17 15:04:37.327564 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: Openstack-Api-Version: compute 2.90 Jun 17 15:04:37.327564 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: Openstack-System-Scope: None Jun 17 15:04:37.327564 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: User-Agent: python-novaclient Jun 17 15:04:37.327564 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: X-Auth-Token: gAAAAABirJgFTaH-uzD1AW6_i-YOrq6U9-dxJhWh8Tr0YtaYWxXP-gv-4bIsAZ3koFqZYV1sro6H2oa7ldAQoTYKUIJX14cX2Rk-ywLu-5EyfEsLfLPKl6pmIpIw0n8VnOr08cSGHA5ykYTGfP5jJ3NOvGobUsXx-DMYYG_e1J3KvqoNV1xNMSs Jun 17 15:04:37.327564 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: X-Domain-Id: None Jun 17 15:04:37.327564 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: X-Domain-Name: None Jun 17 15:04:37.327564 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: X-Identity-Status: Confirmed Jun 17 15:04:37.327564 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: X-Is-Admin-Project: True Jun 17 15:04:37.327564 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: X-Openstack-Nova-Api-Version: 2.90 Jun 17 15:04:37.327564 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: X-Project-Domain-Id: default Jun 17 15:04:37.327564 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: X-Project-Domain-Name: Default Jun 17 15:04:37.327564 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: X-Project-Id: e8170670bd744777aac7421d1ea72468 Jun 17 15:04:37.327564 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: X-Project-Name: admin Jun 17 15:04:37.327564 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: X-Role: reader,admin,member Jun 17 15:04:37.327564 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: X-Roles: reader,admin,member Jun 17 15:04:37.330109 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e8170670bd744777aac7421d1ea72468", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e8170670bd744777aac7421d1ea72468"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e8170670bd744777aac7421d1ea72468"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e8170670bd744777aac7421d1ea72468"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Jun 17 15:04:37.330109 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: X-Tenant: admin Jun 17 15:04:37.330109 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: X-Tenant-Id: e8170670bd744777aac7421d1ea72468 Jun 17 15:04:37.330109 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: X-Tenant-Name: admin Jun 17 15:04:37.330109 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: X-User: admin Jun 17 15:04:37.330109 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: X-User-Domain-Id: default Jun 17 15:04:37.330109 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: X-User-Domain-Name: Default Jun 17 15:04:37.330109 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: X-User-Id: 8bbab6424bb2407795236617fbc21d36 Jun 17 15:04:37.330109 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: X-User-Name: admin Jun 17 15:04:37.330109 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: method: > Jun 17 15:04:37.330109 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: exception: Flavor 42 could not be found. Jun 17 15:04:37.330109 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: action_args: {'id': '42'} Jun 17 15:04:37.330109 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 15:04:37.330109 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:04:37.331738 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 17 15:04:37.331738 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 17 15:04:37.331738 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 17 15:04:37.331738 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 17 15:04:37.331738 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 17 15:04:37.331738 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 17 15:04:37.331738 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 17 15:04:37.331738 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 17 15:04:37.331738 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 17 15:04:37.331738 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 15:04:37.331738 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 17 15:04:37.331738 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 17 15:04:37.331738 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 17 15:04:37.331738 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi Jun 17 15:04:37.331738 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:04:37.331738 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi Jun 17 15:04:37.331738 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:04:37.331738 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:04:37.331738 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:04:37.333820 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 15:04:37.333820 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 15:04:37.333820 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 15:04:37.333820 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 15:04:37.333820 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 17 15:04:37.333820 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 17 15:04:37.333820 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 17 15:04:37.333820 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi Jun 17 15:04:37.333820 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:04:37.333820 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi Jun 17 15:04:37.333820 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:04:37.333820 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:04:37.333820 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:04:37.333820 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 15:04:37.333820 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 15:04:37.333820 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 17 15:04:37.333820 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi Jun 17 15:04:37.333820 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-af0fedfc-6f0a-459f-a379-3ca07cec39fc admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 15:04:37.335624 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.requestlog [None req-af0fedfc-6f0a-459f-a379-3ca07cec39fc admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015376 Jun 17 15:04:37.335624 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: [pid: 103268|app: 0|req: 22/42] 10.222.0.48 () {60 vars in 1190 bytes} [Fri Jun 17 15:04:37 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 17 15:04:38.194995 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi [None req-3277e166-1805-44a9-8ca4-b3c271367855 admin admin] Calling method '>' {{(pid=103267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:04:38.195996 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: INFO nova.api.openstack.requestlog [None req-3277e166-1805-44a9-8ca4-b3c271367855 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Jun 17 15:04:38.196423 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: [pid: 103267|app: 0|req: 21/43] 10.222.0.48 () {56 vars in 1074 bytes} [Fri Jun 17 15:04:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:04:38.388269 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-86ecb7f1-27f2-4688-b9c5-88c95b4fa9f3 admin admin] Calling method '>' {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:04:38.393770 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.wsgi [None req-86ecb7f1-27f2-4688-b9c5-88c95b4fa9f3 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 17 15:04:38.395244 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-86ecb7f1-27f2-4688-b9c5-88c95b4fa9f3 admin admin] Request method failure captured: Jun 17 15:04:38.395244 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 17 15:04:38.395244 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: Accept: application/json Jun 17 15:04:38.395244 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: Accept-Encoding: gzip, deflate Jun 17 15:04:38.395244 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: Connection: keep-alive Jun 17 15:04:38.395244 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: Content-Length: 0 Jun 17 15:04:38.395244 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: Host: 10.222.0.48 Jun 17 15:04:38.395244 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: Openstack-Api-Version: compute 2.90 Jun 17 15:04:38.395244 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: Openstack-System-Scope: None Jun 17 15:04:38.395244 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: User-Agent: python-novaclient Jun 17 15:04:38.395244 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: X-Auth-Token: gAAAAABirJgGMacxSzLfn39xDT25Nwnp5venttH1u7_mAiz9RPpHxotU_pkohLkoKfahtfXU22VAwyeDf3SWtUEcLH-w4G82DR51qmUMmD9lreOznEh37bUgv8VdsKNRF8Ks_gPjadXz7Y9ePGOnhSesJwo5oTa7gMz5x0i8bvXvPKzHlr4RQyg Jun 17 15:04:38.395244 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: X-Domain-Id: None Jun 17 15:04:38.395244 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: X-Domain-Name: None Jun 17 15:04:38.395244 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: X-Identity-Status: Confirmed Jun 17 15:04:38.395244 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: X-Is-Admin-Project: True Jun 17 15:04:38.395244 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: X-Openstack-Nova-Api-Version: 2.90 Jun 17 15:04:38.395244 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: X-Project-Domain-Id: default Jun 17 15:04:38.395244 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: X-Project-Domain-Name: Default Jun 17 15:04:38.395244 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: X-Project-Id: e8170670bd744777aac7421d1ea72468 Jun 17 15:04:38.395244 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: X-Project-Name: admin Jun 17 15:04:38.395244 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: X-Role: reader,admin,member Jun 17 15:04:38.395244 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: X-Roles: reader,admin,member Jun 17 15:04:38.396725 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e8170670bd744777aac7421d1ea72468", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e8170670bd744777aac7421d1ea72468"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e8170670bd744777aac7421d1ea72468"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e8170670bd744777aac7421d1ea72468"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Jun 17 15:04:38.396725 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: X-Tenant: admin Jun 17 15:04:38.396725 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: X-Tenant-Id: e8170670bd744777aac7421d1ea72468 Jun 17 15:04:38.396725 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: X-Tenant-Name: admin Jun 17 15:04:38.396725 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: X-User: admin Jun 17 15:04:38.396725 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: X-User-Domain-Id: default Jun 17 15:04:38.396725 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: X-User-Domain-Name: Default Jun 17 15:04:38.396725 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: X-User-Id: 8bbab6424bb2407795236617fbc21d36 Jun 17 15:04:38.396725 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: X-User-Name: admin Jun 17 15:04:38.396725 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: method: > Jun 17 15:04:38.396725 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: exception: Flavor 84 could not be found. Jun 17 15:04:38.396725 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: action_args: {'id': '84'} Jun 17 15:04:38.396725 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 15:04:38.396725 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:04:38.397568 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 17 15:04:38.397568 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 17 15:04:38.397568 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 17 15:04:38.397568 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 17 15:04:38.397568 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 17 15:04:38.397568 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 17 15:04:38.397568 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 17 15:04:38.397568 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 17 15:04:38.397568 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 17 15:04:38.397568 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 15:04:38.397568 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 17 15:04:38.397568 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 17 15:04:38.397568 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 17 15:04:38.397568 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi Jun 17 15:04:38.397568 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:04:38.397568 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi Jun 17 15:04:38.397568 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:04:38.397568 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:04:38.397568 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:04:38.398608 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 15:04:38.398608 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 15:04:38.398608 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 15:04:38.398608 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 15:04:38.398608 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 17 15:04:38.398608 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 17 15:04:38.398608 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 17 15:04:38.398608 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi Jun 17 15:04:38.398608 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:04:38.398608 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi Jun 17 15:04:38.398608 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:04:38.398608 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:04:38.398608 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:04:38.398608 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 15:04:38.398608 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 15:04:38.398608 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 17 15:04:38.398608 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi Jun 17 15:04:38.398608 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-86ecb7f1-27f2-4688-b9c5-88c95b4fa9f3 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 15:04:38.399595 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.requestlog [None req-86ecb7f1-27f2-4688-b9c5-88c95b4fa9f3 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.061510 Jun 17 15:04:38.399595 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: [pid: 103268|app: 0|req: 23/44] 10.222.0.48 () {60 vars in 1190 bytes} [Fri Jun 17 15:04:38 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 17 15:04:38.406716 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi [None req-c72753e5-c9f3-48e1-bec3-3798a3b6d912 admin admin] Calling method '>' {{(pid=103267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:04:38.422264 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: INFO nova.api.openstack.requestlog [None req-c72753e5-c9f3-48e1-bec3-3798a3b6d912 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019615 Jun 17 15:04:38.422785 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: [pid: 103267|app: 0|req: 22/45] 10.222.0.48 () {60 vars in 1210 bytes} [Fri Jun 17 15:04:38 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:04:38.432928 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-34010245-9b7c-41f2-8c78-ad934258a120 admin admin] Calling method '>' {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:04:38.446458 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.requestlog [None req-34010245-9b7c-41f2-8c78-ad934258a120 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017111 Jun 17 15:04:38.446987 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: [pid: 103268|app: 0|req: 24/46] 10.222.0.48 () {60 vars in 1210 bytes} [Fri Jun 17 15:04:38 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 15:04:38.456200 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi [None req-8c3560ae-2fd9-48ea-910a-1504b02956eb admin admin] Calling method '>' {{(pid=103267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:04:38.461836 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: INFO nova.api.openstack.wsgi [None req-8c3560ae-2fd9-48ea-910a-1504b02956eb admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 17 15:04:38.463358 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi [None req-8c3560ae-2fd9-48ea-910a-1504b02956eb admin admin] Request method failure captured: Jun 17 15:04:38.463358 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 17 15:04:38.463358 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: Accept: application/json Jun 17 15:04:38.463358 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: Accept-Encoding: gzip, deflate Jun 17 15:04:38.463358 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: Connection: keep-alive Jun 17 15:04:38.463358 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: Content-Length: 0 Jun 17 15:04:38.463358 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: Host: 10.222.0.48 Jun 17 15:04:38.463358 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: Openstack-Api-Version: compute 2.90 Jun 17 15:04:38.463358 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: Openstack-System-Scope: None Jun 17 15:04:38.463358 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: User-Agent: python-novaclient Jun 17 15:04:38.463358 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: X-Auth-Token: gAAAAABirJgGMacxSzLfn39xDT25Nwnp5venttH1u7_mAiz9RPpHxotU_pkohLkoKfahtfXU22VAwyeDf3SWtUEcLH-w4G82DR51qmUMmD9lreOznEh37bUgv8VdsKNRF8Ks_gPjadXz7Y9ePGOnhSesJwo5oTa7gMz5x0i8bvXvPKzHlr4RQyg Jun 17 15:04:38.463358 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: X-Domain-Id: None Jun 17 15:04:38.463358 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: X-Domain-Name: None Jun 17 15:04:38.463358 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: X-Identity-Status: Confirmed Jun 17 15:04:38.463358 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: X-Is-Admin-Project: True Jun 17 15:04:38.463358 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: X-Openstack-Nova-Api-Version: 2.90 Jun 17 15:04:38.463358 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: X-Project-Domain-Id: default Jun 17 15:04:38.463358 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: X-Project-Domain-Name: Default Jun 17 15:04:38.463358 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: X-Project-Id: e8170670bd744777aac7421d1ea72468 Jun 17 15:04:38.463358 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: X-Project-Name: admin Jun 17 15:04:38.463358 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: X-Role: reader,admin,member Jun 17 15:04:38.463358 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: X-Roles: reader,admin,member Jun 17 15:04:38.464923 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e8170670bd744777aac7421d1ea72468", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e8170670bd744777aac7421d1ea72468"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e8170670bd744777aac7421d1ea72468"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e8170670bd744777aac7421d1ea72468"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Jun 17 15:04:38.464923 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: X-Tenant: admin Jun 17 15:04:38.464923 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: X-Tenant-Id: e8170670bd744777aac7421d1ea72468 Jun 17 15:04:38.464923 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: X-Tenant-Name: admin Jun 17 15:04:38.464923 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: X-User: admin Jun 17 15:04:38.464923 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: X-User-Domain-Id: default Jun 17 15:04:38.464923 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: X-User-Domain-Name: Default Jun 17 15:04:38.464923 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: X-User-Id: 8bbab6424bb2407795236617fbc21d36 Jun 17 15:04:38.464923 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: X-User-Name: admin Jun 17 15:04:38.464923 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: method: > Jun 17 15:04:38.464923 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: exception: Flavor 84 could not be found. Jun 17 15:04:38.464923 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: action_args: {'id': '84'} Jun 17 15:04:38.464923 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: {{(pid=103267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 15:04:38.464923 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:04:38.466439 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 17 15:04:38.466439 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 17 15:04:38.466439 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 17 15:04:38.466439 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 17 15:04:38.466439 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 17 15:04:38.466439 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 17 15:04:38.466439 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 17 15:04:38.466439 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 17 15:04:38.466439 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 17 15:04:38.466439 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 15:04:38.466439 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 17 15:04:38.466439 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 17 15:04:38.466439 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 17 15:04:38.466439 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi Jun 17 15:04:38.466439 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:04:38.466439 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi Jun 17 15:04:38.466439 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:04:38.466439 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:04:38.466439 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:04:38.467749 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 15:04:38.467749 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 15:04:38.467749 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 15:04:38.467749 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 15:04:38.467749 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 17 15:04:38.467749 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 17 15:04:38.467749 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 17 15:04:38.467749 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi Jun 17 15:04:38.467749 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:04:38.467749 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi Jun 17 15:04:38.467749 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:04:38.467749 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:04:38.467749 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:04:38.467749 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 15:04:38.467749 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 15:04:38.467749 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 17 15:04:38.467749 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi Jun 17 15:04:38.467749 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi [None req-8c3560ae-2fd9-48ea-910a-1504b02956eb admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 15:04:38.469031 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: INFO nova.api.openstack.requestlog [None req-8c3560ae-2fd9-48ea-910a-1504b02956eb admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012069 Jun 17 15:04:38.469031 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: [pid: 103267|app: 0|req: 23/47] 10.222.0.48 () {60 vars in 1190 bytes} [Fri Jun 17 15:04:38 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 17 15:04:39.337713 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-34010245-9b7c-41f2-8c78-ad934258a120 admin admin] Calling method '>' {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:04:39.338816 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.requestlog [None req-34010245-9b7c-41f2-8c78-ad934258a120 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Jun 17 15:04:39.339226 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: [pid: 103268|app: 0|req: 25/48] 10.222.0.48 () {56 vars in 1074 bytes} [Fri Jun 17 15:04:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:04:39.548722 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi [None req-e12f5c11-f2a6-4c05-8486-fedc1a54a649 admin admin] Calling method '>' {{(pid=103267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:04:39.554393 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: INFO nova.api.openstack.wsgi [None req-e12f5c11-f2a6-4c05-8486-fedc1a54a649 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 17 15:04:39.555860 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi [None req-e12f5c11-f2a6-4c05-8486-fedc1a54a649 admin admin] Request method failure captured: Jun 17 15:04:39.555860 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 17 15:04:39.555860 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: Accept: application/json Jun 17 15:04:39.555860 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: Accept-Encoding: gzip, deflate Jun 17 15:04:39.555860 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: Connection: keep-alive Jun 17 15:04:39.555860 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: Content-Length: 0 Jun 17 15:04:39.555860 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: Host: 10.222.0.48 Jun 17 15:04:39.555860 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: Openstack-Api-Version: compute 2.90 Jun 17 15:04:39.555860 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: Openstack-System-Scope: None Jun 17 15:04:39.555860 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: User-Agent: python-novaclient Jun 17 15:04:39.555860 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: X-Auth-Token: gAAAAABirJgHNJpAwy3IfWQM7pUgp8ueok0axI9Ijt2zEZ5glszLSyq_NMe9YTCbroN28f6AQ5y6Ez6giJCvxppTnA96nLqVsWxJkvOAVVv7bZoAqafcupz5t7F2Gonezk2y21ZiRP49vK-7ZiZRdyiB7vNFilnZYgaiA3aotuD70KaVi6DawPI Jun 17 15:04:39.555860 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: X-Domain-Id: None Jun 17 15:04:39.555860 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: X-Domain-Name: None Jun 17 15:04:39.555860 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: X-Identity-Status: Confirmed Jun 17 15:04:39.555860 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: X-Is-Admin-Project: True Jun 17 15:04:39.555860 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: X-Openstack-Nova-Api-Version: 2.90 Jun 17 15:04:39.555860 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: X-Project-Domain-Id: default Jun 17 15:04:39.555860 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: X-Project-Domain-Name: Default Jun 17 15:04:39.555860 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: X-Project-Id: e8170670bd744777aac7421d1ea72468 Jun 17 15:04:39.555860 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: X-Project-Name: admin Jun 17 15:04:39.555860 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: X-Role: reader,admin,member Jun 17 15:04:39.555860 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: X-Roles: reader,admin,member Jun 17 15:04:39.557332 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e8170670bd744777aac7421d1ea72468", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e8170670bd744777aac7421d1ea72468"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e8170670bd744777aac7421d1ea72468"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e8170670bd744777aac7421d1ea72468"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Jun 17 15:04:39.557332 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: X-Tenant: admin Jun 17 15:04:39.557332 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: X-Tenant-Id: e8170670bd744777aac7421d1ea72468 Jun 17 15:04:39.557332 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: X-Tenant-Name: admin Jun 17 15:04:39.557332 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: X-User: admin Jun 17 15:04:39.557332 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: X-User-Domain-Id: default Jun 17 15:04:39.557332 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: X-User-Domain-Name: Default Jun 17 15:04:39.557332 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: X-User-Id: 8bbab6424bb2407795236617fbc21d36 Jun 17 15:04:39.557332 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: X-User-Name: admin Jun 17 15:04:39.557332 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: method: > Jun 17 15:04:39.557332 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: exception: Flavor 451 could not be found. Jun 17 15:04:39.557332 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: action_args: {'id': '451'} Jun 17 15:04:39.557332 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: {{(pid=103267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 15:04:39.557332 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:04:39.558261 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 17 15:04:39.558261 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 17 15:04:39.558261 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 17 15:04:39.558261 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 17 15:04:39.558261 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 17 15:04:39.558261 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 17 15:04:39.558261 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 17 15:04:39.558261 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 17 15:04:39.558261 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 17 15:04:39.558261 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 15:04:39.558261 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 17 15:04:39.558261 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 17 15:04:39.558261 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 17 15:04:39.558261 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi Jun 17 15:04:39.558261 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:04:39.558261 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi Jun 17 15:04:39.558261 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:04:39.558261 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:04:39.558261 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:04:39.559463 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 15:04:39.559463 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 15:04:39.559463 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 15:04:39.559463 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 15:04:39.559463 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 17 15:04:39.559463 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 17 15:04:39.559463 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 17 15:04:39.559463 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi Jun 17 15:04:39.559463 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:04:39.559463 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi Jun 17 15:04:39.559463 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:04:39.559463 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:04:39.559463 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:04:39.559463 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 15:04:39.559463 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 15:04:39.559463 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 17 15:04:39.559463 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: ERROR nova.api.openstack.wsgi Jun 17 15:04:39.559463 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi [None req-e12f5c11-f2a6-4c05-8486-fedc1a54a649 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 15:04:39.560759 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: INFO nova.api.openstack.requestlog [None req-e12f5c11-f2a6-4c05-8486-fedc1a54a649 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.059249 Jun 17 15:04:39.560759 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: [pid: 103267|app: 0|req: 24/49] 10.222.0.48 () {60 vars in 1193 bytes} [Fri Jun 17 15:04:39 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 17 15:04:39.566636 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-68ee12b3-b563-48e1-98a1-ec8b24a17692 admin admin] Calling method '>' {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:04:39.580701 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.requestlog [None req-68ee12b3-b563-48e1-98a1-ec8b24a17692 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017509 Jun 17 15:04:39.581193 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: [pid: 103268|app: 0|req: 26/50] 10.222.0.48 () {60 vars in 1210 bytes} [Fri Jun 17 15:04:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:04:39.591212 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi [None req-c9e03fad-2fd7-43cd-b061-9d3c45d08362 admin admin] Calling method '>' {{(pid=103267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:04:39.604536 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: INFO nova.api.openstack.requestlog [None req-c9e03fad-2fd7-43cd-b061-9d3c45d08362 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017341 Jun 17 15:04:39.605054 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: [pid: 103267|app: 0|req: 25/51] 10.222.0.48 () {60 vars in 1210 bytes} [Fri Jun 17 15:04:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:04:39.614530 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-e51fcda0-e977-4604-bdcc-698c039f9e54 admin admin] Calling method '>' {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:04:39.619800 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.wsgi [None req-e51fcda0-e977-4604-bdcc-698c039f9e54 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 17 15:04:39.621306 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-e51fcda0-e977-4604-bdcc-698c039f9e54 admin admin] Request method failure captured: Jun 17 15:04:39.621306 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 17 15:04:39.621306 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: Accept: application/json Jun 17 15:04:39.621306 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: Accept-Encoding: gzip, deflate Jun 17 15:04:39.621306 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: Connection: keep-alive Jun 17 15:04:39.621306 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: Content-Length: 0 Jun 17 15:04:39.621306 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: Host: 10.222.0.48 Jun 17 15:04:39.621306 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: Openstack-Api-Version: compute 2.90 Jun 17 15:04:39.621306 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: Openstack-System-Scope: None Jun 17 15:04:39.621306 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: User-Agent: python-novaclient Jun 17 15:04:39.621306 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: X-Auth-Token: gAAAAABirJgHNJpAwy3IfWQM7pUgp8ueok0axI9Ijt2zEZ5glszLSyq_NMe9YTCbroN28f6AQ5y6Ez6giJCvxppTnA96nLqVsWxJkvOAVVv7bZoAqafcupz5t7F2Gonezk2y21ZiRP49vK-7ZiZRdyiB7vNFilnZYgaiA3aotuD70KaVi6DawPI Jun 17 15:04:39.621306 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: X-Domain-Id: None Jun 17 15:04:39.621306 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: X-Domain-Name: None Jun 17 15:04:39.621306 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: X-Identity-Status: Confirmed Jun 17 15:04:39.621306 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: X-Is-Admin-Project: True Jun 17 15:04:39.621306 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: X-Openstack-Nova-Api-Version: 2.90 Jun 17 15:04:39.621306 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: X-Project-Domain-Id: default Jun 17 15:04:39.621306 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: X-Project-Domain-Name: Default Jun 17 15:04:39.621306 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: X-Project-Id: e8170670bd744777aac7421d1ea72468 Jun 17 15:04:39.621306 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: X-Project-Name: admin Jun 17 15:04:39.621306 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: X-Role: reader,admin,member Jun 17 15:04:39.621306 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: X-Roles: reader,admin,member Jun 17 15:04:39.623354 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e8170670bd744777aac7421d1ea72468", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e8170670bd744777aac7421d1ea72468"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e8170670bd744777aac7421d1ea72468"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e8170670bd744777aac7421d1ea72468"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Jun 17 15:04:39.623354 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: X-Tenant: admin Jun 17 15:04:39.623354 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: X-Tenant-Id: e8170670bd744777aac7421d1ea72468 Jun 17 15:04:39.623354 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: X-Tenant-Name: admin Jun 17 15:04:39.623354 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: X-User: admin Jun 17 15:04:39.623354 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: X-User-Domain-Id: default Jun 17 15:04:39.623354 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: X-User-Domain-Name: Default Jun 17 15:04:39.623354 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: X-User-Id: 8bbab6424bb2407795236617fbc21d36 Jun 17 15:04:39.623354 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: X-User-Name: admin Jun 17 15:04:39.623354 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: method: > Jun 17 15:04:39.623354 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: exception: Flavor 451 could not be found. Jun 17 15:04:39.623354 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: action_args: {'id': '451'} Jun 17 15:04:39.623354 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 15:04:39.623354 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:04:39.624316 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 17 15:04:39.624316 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 17 15:04:39.624316 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 17 15:04:39.624316 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 17 15:04:39.624316 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 17 15:04:39.624316 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 17 15:04:39.624316 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 17 15:04:39.624316 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 17 15:04:39.624316 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 17 15:04:39.624316 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 15:04:39.624316 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 17 15:04:39.624316 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 17 15:04:39.624316 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 17 15:04:39.624316 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi Jun 17 15:04:39.624316 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:04:39.624316 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi Jun 17 15:04:39.624316 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:04:39.624316 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:04:39.624316 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:04:39.625583 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 15:04:39.625583 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 15:04:39.625583 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 15:04:39.625583 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 15:04:39.625583 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 17 15:04:39.625583 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 17 15:04:39.625583 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 17 15:04:39.625583 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi Jun 17 15:04:39.625583 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:04:39.625583 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi Jun 17 15:04:39.625583 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:04:39.625583 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:04:39.625583 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:04:39.625583 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 15:04:39.625583 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 15:04:39.625583 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 17 15:04:39.625583 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi Jun 17 15:04:39.625583 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-e51fcda0-e977-4604-bdcc-698c039f9e54 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 15:04:39.626992 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.requestlog [None req-e51fcda0-e977-4604-bdcc-698c039f9e54 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012141 Jun 17 15:04:39.626992 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: [pid: 103268|app: 0|req: 27/52] 10.222.0.48 () {60 vars in 1193 bytes} [Fri Jun 17 15:04:39 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 17 15:04:40.485677 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi [None req-c9e03fad-2fd7-43cd-b061-9d3c45d08362 admin admin] Calling method '>' {{(pid=103267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:04:40.486709 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: INFO nova.api.openstack.requestlog [None req-c9e03fad-2fd7-43cd-b061-9d3c45d08362 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001531 Jun 17 15:04:40.487098 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: [pid: 103267|app: 0|req: 26/53] 10.222.0.48 () {56 vars in 1074 bytes} [Fri Jun 17 15:04:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:04:40.676050 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-64069336-86c7-4916-bb3d-31ad5163ba32 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:04:40.695608 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.requestlog [None req-64069336-86c7-4916-bb3d-31ad5163ba32 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.070360 Jun 17 15:04:40.696149 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: [pid: 103268|app: 0|req: 28/54] 10.222.0.48 () {64 vars in 1235 bytes} [Fri Jun 17 15:04:40 2022] POST /compute/v2.1/flavors => generated 404 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:04:41.554989 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi [None req-c9e03fad-2fd7-43cd-b061-9d3c45d08362 admin admin] Calling method '>' {{(pid=103267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:04:41.555992 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: INFO nova.api.openstack.requestlog [None req-c9e03fad-2fd7-43cd-b061-9d3c45d08362 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001404 Jun 17 15:04:41.556483 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: [pid: 103267|app: 0|req: 27/55] 10.222.0.48 () {56 vars in 1074 bytes} [Fri Jun 17 15:04:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:04:41.746407 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-34541046-b307-44db-b940-823739817d2b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:04:41.764257 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.requestlog [None req-34541046-b307-44db-b940-823739817d2b admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.069126 Jun 17 15:04:41.764829 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: [pid: 103268|app: 0|req: 29/56] 10.222.0.48 () {64 vars in 1235 bytes} [Fri Jun 17 15:04:41 2022] POST /compute/v2.1/flavors => generated 405 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:04:42.635208 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi [None req-c9e03fad-2fd7-43cd-b061-9d3c45d08362 admin admin] Calling method '>' {{(pid=103267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:04:42.636212 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: INFO nova.api.openstack.requestlog [None req-c9e03fad-2fd7-43cd-b061-9d3c45d08362 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001410 Jun 17 15:04:42.636646 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: [pid: 103267|app: 0|req: 28/57] 10.222.0.48 () {56 vars in 1074 bytes} [Fri Jun 17 15:04:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:04:42.826628 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-a10ad85b-4e5d-484c-ade3-1b4a5bb2f909 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:04:42.844016 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.requestlog [None req-a10ad85b-4e5d-484c-ade3-1b4a5bb2f909 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.068918 Jun 17 15:04:42.844594 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: [pid: 103268|app: 0|req: 30/58] 10.222.0.48 () {64 vars in 1235 bytes} [Fri Jun 17 15:04:42 2022] POST /compute/v2.1/flavors => generated 407 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:04:43.720550 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi [None req-c9e03fad-2fd7-43cd-b061-9d3c45d08362 admin admin] Calling method '>' {{(pid=103267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:04:43.721580 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: INFO nova.api.openstack.requestlog [None req-c9e03fad-2fd7-43cd-b061-9d3c45d08362 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Jun 17 15:04:43.721980 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: [pid: 103267|app: 0|req: 29/59] 10.222.0.48 () {56 vars in 1074 bytes} [Fri Jun 17 15:04:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:04:43.918052 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-ed247e03-184e-4906-a2ed-4999a5a5e798 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:04:43.936357 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.requestlog [None req-ed247e03-184e-4906-a2ed-4999a5a5e798 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.075354 Jun 17 15:04:43.936820 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: [pid: 103268|app: 0|req: 31/60] 10.222.0.48 () {64 vars in 1235 bytes} [Fri Jun 17 15:04:43 2022] POST /compute/v2.1/flavors => generated 409 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:04:44.811047 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi [None req-c9e03fad-2fd7-43cd-b061-9d3c45d08362 admin admin] Calling method '>' {{(pid=103267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:04:44.812051 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: INFO nova.api.openstack.requestlog [None req-c9e03fad-2fd7-43cd-b061-9d3c45d08362 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Jun 17 15:04:44.812482 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: [pid: 103267|app: 0|req: 30/61] 10.222.0.48 () {56 vars in 1074 bytes} [Fri Jun 17 15:04:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:04:45.003721 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-4912d05f-5856-4ac5-b8b8-563282e05bbe admin admin] Calling method '>' {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:04:45.022667 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.requestlog [None req-4912d05f-5856-4ac5-b8b8-563282e05bbe admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.071162 Jun 17 15:04:45.023207 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: [pid: 103268|app: 0|req: 32/62] 10.222.0.48 () {60 vars in 1202 bytes} [Fri Jun 17 15:04:44 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:05:33.008417 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi [None req-c9e03fad-2fd7-43cd-b061-9d3c45d08362 admin admin] Calling method '>' {{(pid=103267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:05:33.009444 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: INFO nova.api.openstack.requestlog [None req-c9e03fad-2fd7-43cd-b061-9d3c45d08362 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001554 Jun 17 15:05:33.009839 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: [pid: 103267|app: 0|req: 31/63] 10.222.0.48 () {54 vars in 930 bytes} [Fri Jun 17 15:05:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:05:33.020612 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG dbcounter [-] [103268] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:05:33.073258 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-fa947cb4-7137-474c-892f-a5cf5d708739 admin admin] Calling method '>' {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:05:33.093040 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.requestlog [None req-fa947cb4-7137-474c-892f-a5cf5d708739 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.076857 Jun 17 15:05:33.093585 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: [pid: 103268|app: 0|req: 33/64] 10.222.0.48 () {60 vars in 1291 bytes} [Fri Jun 17 15:05:33 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:05:33.117852 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi [None req-8c3f7221-8bdf-4c3f-ba0c-c9891792737d admin admin] Calling method '>' {{(pid=103267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:05:33.121890 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG dbcounter [-] [103267] Writing DB stats nova_api:SELECT=14 {{(pid=103267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:05:33.127760 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: INFO nova.api.openstack.requestlog [None req-8c3f7221-8bdf-4c3f-ba0c-c9891792737d admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013468 Jun 17 15:05:33.128307 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: [pid: 103267|app: 0|req: 32/65] 10.222.0.48 () {60 vars in 1282 bytes} [Fri Jun 17 15:05:33 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:05:33.140375 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-a7978f9c-5b19-408f-8336-95ded0677a37 admin admin] Calling method '>' {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:05:33.148270 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.requestlog [None req-a7978f9c-5b19-408f-8336-95ded0677a37 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011724 Jun 17 15:05:33.148859 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: [pid: 103268|app: 0|req: 34/66] 10.222.0.48 () {60 vars in 1285 bytes} [Fri Jun 17 15:05:33 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:05:33.160561 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi [None req-2d538cb5-5802-41dd-8e85-48dcd6e99562 admin admin] Calling method '>' {{(pid=103267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:05:33.169094 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: INFO nova.api.openstack.requestlog [None req-2d538cb5-5802-41dd-8e85-48dcd6e99562 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012131 Jun 17 15:05:33.169798 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: [pid: 103267|app: 0|req: 33/67] 10.222.0.48 () {60 vars in 1285 bytes} [Fri Jun 17 15:05:33 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:05:33.181137 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-9fe518b3-6989-49f6-8d75-e831beb83218 admin admin] Calling method '>' {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:05:33.189525 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.requestlog [None req-9fe518b3-6989-49f6-8d75-e831beb83218 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011915 Jun 17 15:05:33.190070 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: [pid: 103268|app: 0|req: 35/68] 10.222.0.48 () {60 vars in 1282 bytes} [Fri Jun 17 15:05:33 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:08:59.598252 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi [None req-2d538cb5-5802-41dd-8e85-48dcd6e99562 admin admin] Calling method '>' {{(pid=103267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:08:59.599262 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: INFO nova.api.openstack.requestlog [None req-2d538cb5-5802-41dd-8e85-48dcd6e99562 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Jun 17 15:08:59.599666 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: [pid: 103267|app: 0|req: 34/69] 10.222.0.48 () {56 vars in 1074 bytes} [Fri Jun 17 15:08:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:08:59.756890 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG dbcounter [-] [103268] Writing DB stats nova_api:SELECT=6 {{(pid=103268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:08:59.871121 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-8513e828-a2ad-4362-b834-13465c219f3b admin admin] Calling method '>' {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:08:59.872285 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 17 15:08:59.872285 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: warnings.warn(msg) Jun 17 15:08:59.873534 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG oslo_concurrency.lockutils [None req-8513e828-a2ad-4362-b834-13465c219f3b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:08:59.873992 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG oslo_concurrency.lockutils [None req-8513e828-a2ad-4362-b834-13465c219f3b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:08:59.874764 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG oslo_concurrency.lockutils [None req-8513e828-a2ad-4362-b834-13465c219f3b admin admin] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:08:59.875183 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG oslo_concurrency.lockutils [None req-8513e828-a2ad-4362-b834-13465c219f3b admin admin] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:08:59.908873 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.requestlog [None req-8513e828-a2ad-4362-b834-13465c219f3b admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.153477 Jun 17 15:08:59.909424 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: [pid: 103268|app: 0|req: 36/70] 10.222.0.48 () {60 vars in 1193 bytes} [Fri Jun 17 15:08:59 2022] GET /compute/v2.1/os-services => generated 794 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:09:00.784772 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi [None req-2d538cb5-5802-41dd-8e85-48dcd6e99562 admin admin] Calling method '>' {{(pid=103267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:09:00.785776 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: INFO nova.api.openstack.requestlog [None req-2d538cb5-5802-41dd-8e85-48dcd6e99562 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Jun 17 15:09:00.786170 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: [pid: 103267|app: 0|req: 35/71] 10.222.0.48 () {56 vars in 1074 bytes} [Fri Jun 17 15:09:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:09:00.979669 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-d4978f15-ae35-4468-90fb-cfc62c0101f3 admin admin] Calling method '>' {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:09:00.981467 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 17 15:09:00.981467 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: warnings.warn(msg) Jun 17 15:09:00.982659 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG oslo_concurrency.lockutils [None req-d4978f15-ae35-4468-90fb-cfc62c0101f3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:09:00.983137 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG oslo_concurrency.lockutils [None req-d4978f15-ae35-4468-90fb-cfc62c0101f3 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:09:00.983950 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG oslo_concurrency.lockutils [None req-d4978f15-ae35-4468-90fb-cfc62c0101f3 admin admin] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:09:00.984406 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG oslo_concurrency.lockutils [None req-d4978f15-ae35-4468-90fb-cfc62c0101f3 admin admin] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:09:01.004491 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.requestlog [None req-d4978f15-ae35-4468-90fb-cfc62c0101f3 admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.078901 Jun 17 15:09:01.005050 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: [pid: 103268|app: 0|req: 37/72] 10.222.0.48 () {60 vars in 1193 bytes} [Fri Jun 17 15:09:00 2022] GET /compute/v2.1/os-services => generated 794 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:09:12.294180 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi [None req-2d538cb5-5802-41dd-8e85-48dcd6e99562 admin admin] Calling method '>' {{(pid=103267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:09:12.295184 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: INFO nova.api.openstack.requestlog [None req-2d538cb5-5802-41dd-8e85-48dcd6e99562 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001404 Jun 17 15:09:12.295576 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: [pid: 103267|app: 0|req: 36/73] 10.222.0.48 () {56 vars in 1074 bytes} [Fri Jun 17 15:09:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:09:12.438672 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG dbcounter [-] [103268] Writing DB stats nova_cell0:SELECT=4 {{(pid=103268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:09:12.439384 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG dbcounter [-] [103268] Writing DB stats nova_cell1:SELECT=4 {{(pid=103268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:09:12.440061 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG dbcounter [-] [103268] Writing DB stats nova_api:SELECT=8 {{(pid=103268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:09:12.491867 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-fd90e778-5eaf-41e5-bacf-b8690251c578 admin admin] Calling method '>' {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:09:12.493103 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 17 15:09:12.493103 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: warnings.warn(msg) Jun 17 15:09:12.494292 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG oslo_concurrency.lockutils [None req-fd90e778-5eaf-41e5-bacf-b8690251c578 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:09:12.494732 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG oslo_concurrency.lockutils [None req-fd90e778-5eaf-41e5-bacf-b8690251c578 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:09:12.495517 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG oslo_concurrency.lockutils [None req-fd90e778-5eaf-41e5-bacf-b8690251c578 admin admin] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:09:12.495946 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG oslo_concurrency.lockutils [None req-fd90e778-5eaf-41e5-bacf-b8690251c578 admin admin] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:09:12.520386 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.requestlog [None req-fd90e778-5eaf-41e5-bacf-b8690251c578 admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.086215 Jun 17 15:09:12.520862 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: [pid: 103268|app: 0|req: 38/74] 10.222.0.48 () {60 vars in 1193 bytes} [Fri Jun 17 15:09:12 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:09:13.407352 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: DEBUG nova.api.openstack.wsgi [None req-2d538cb5-5802-41dd-8e85-48dcd6e99562 admin admin] Calling method '>' {{(pid=103267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:09:13.408396 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: INFO nova.api.openstack.requestlog [None req-2d538cb5-5802-41dd-8e85-48dcd6e99562 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Jun 17 15:09:13.408793 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: [pid: 103267|app: 0|req: 37/75] 10.222.0.48 () {56 vars in 1074 bytes} [Fri Jun 17 15:09:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:09:13.599513 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-5d52d33b-0b4d-476f-858f-539c01e7e4a7 admin admin] Calling method '>' {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:09:13.600793 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 17 15:09:13.600793 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: warnings.warn(msg) Jun 17 15:09:13.601964 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG oslo_concurrency.lockutils [None req-5d52d33b-0b4d-476f-858f-539c01e7e4a7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:09:13.602401 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG oslo_concurrency.lockutils [None req-5d52d33b-0b4d-476f-858f-539c01e7e4a7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:09:13.603184 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG oslo_concurrency.lockutils [None req-5d52d33b-0b4d-476f-858f-539c01e7e4a7 admin admin] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:09:13.603608 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: DEBUG oslo_concurrency.lockutils [None req-5d52d33b-0b4d-476f-858f-539c01e7e4a7 admin admin] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:09:13.626778 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.requestlog [None req-5d52d33b-0b4d-476f-858f-539c01e7e4a7 admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.078610 Jun 17 15:09:13.627462 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: [pid: 103268|app: 0|req: 39/76] 10.222.0.48 () {60 vars in 1193 bytes} [Fri Jun 17 15:09:13 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:10:11.710103 dv-cinder-825492-23-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 17 15:10:11.711207 dv-cinder-825492-23-iscsi devstack@n-api.service[103266]: Fri Jun 17 15:10:11 2022 - graceful shutdown triggered... Jun 17 15:10:11.711690 dv-cinder-825492-23-iscsi devstack@n-api.service[103267]: Gracefully killing worker 1 (pid: 103267)... Jun 17 15:10:11.712080 dv-cinder-825492-23-iscsi devstack@n-api.service[103268]: Gracefully killing worker 2 (pid: 103268)... Jun 17 15:10:12.712273 dv-cinder-825492-23-iscsi devstack@n-api.service[103266]: worker 1 buried after 1 seconds Jun 17 15:10:12.712847 dv-cinder-825492-23-iscsi devstack@n-api.service[103266]: worker 2 buried after 1 seconds Jun 17 15:10:12.712847 dv-cinder-825492-23-iscsi devstack@n-api.service[103266]: goodbye to uWSGI. Jun 17 15:10:12.714523 dv-cinder-825492-23-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 17 15:10:12.715108 dv-cinder-825492-23-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 17 15:10:12.717925 dv-cinder-825492-23-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 17 15:10:12.727256 dv-cinder-825492-23-iscsi devstack@n-api.service[117628]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 17 15:10:12.729212 dv-cinder-825492-23-iscsi devstack@n-api.service[117628]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jun 17 15:10:12 2022] *** Jun 17 15:10:12.729212 dv-cinder-825492-23-iscsi devstack@n-api.service[117628]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 17 15:10:12.729212 dv-cinder-825492-23-iscsi devstack@n-api.service[117628]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 17 15:10:12.729212 dv-cinder-825492-23-iscsi devstack@n-api.service[117628]: nodename: dv-cinder-825492-23-iscsi Jun 17 15:10:12.729212 dv-cinder-825492-23-iscsi devstack@n-api.service[117628]: machine: x86_64 Jun 17 15:10:12.729212 dv-cinder-825492-23-iscsi devstack@n-api.service[117628]: clock source: unix Jun 17 15:10:12.729212 dv-cinder-825492-23-iscsi devstack@n-api.service[117628]: pcre jit disabled Jun 17 15:10:12.729212 dv-cinder-825492-23-iscsi devstack@n-api.service[117628]: detected number of CPU cores: 4 Jun 17 15:10:12.729212 dv-cinder-825492-23-iscsi devstack@n-api.service[117628]: current working directory: / Jun 17 15:10:12.729212 dv-cinder-825492-23-iscsi devstack@n-api.service[117628]: detected binary path: /usr/bin/uwsgi-core Jun 17 15:10:12.729212 dv-cinder-825492-23-iscsi devstack@n-api.service[117628]: your processes number limit is 47680 Jun 17 15:10:12.729914 dv-cinder-825492-23-iscsi devstack@n-api.service[117628]: your memory page size is 4096 bytes Jun 17 15:10:12.729914 dv-cinder-825492-23-iscsi devstack@n-api.service[117628]: detected max file descriptor number: 2048 Jun 17 15:10:12.729914 dv-cinder-825492-23-iscsi devstack@n-api.service[117628]: lock engine: pthread robust mutexes Jun 17 15:10:12.729914 dv-cinder-825492-23-iscsi devstack@n-api.service[117628]: thunder lock: enabled Jun 17 15:10:12.729914 dv-cinder-825492-23-iscsi devstack@n-api.service[117628]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 17 15:10:12.729914 dv-cinder-825492-23-iscsi devstack@n-api.service[117628]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 17 15:10:12.774391 dv-cinder-825492-23-iscsi devstack@n-api.service[117628]: Python main interpreter initialized at 0x5644d7bec9c0 Jun 17 15:10:12.774391 dv-cinder-825492-23-iscsi devstack@n-api.service[117628]: python threads support enabled Jun 17 15:10:12.774391 dv-cinder-825492-23-iscsi devstack@n-api.service[117628]: your server socket listen backlog is limited to 100 connections Jun 17 15:10:12.774391 dv-cinder-825492-23-iscsi devstack@n-api.service[117628]: your mercy for graceful operations on workers is 90 seconds Jun 17 15:10:12.774862 dv-cinder-825492-23-iscsi devstack@n-api.service[117628]: mapped 403077 bytes (393 KB) for 2 cores Jun 17 15:10:12.774862 dv-cinder-825492-23-iscsi devstack@n-api.service[117628]: *** Operational MODE: preforking *** Jun 17 15:10:12.775112 dv-cinder-825492-23-iscsi devstack@n-api.service[117628]: *** uWSGI is running in multiple interpreter mode *** Jun 17 15:10:12.775112 dv-cinder-825492-23-iscsi devstack@n-api.service[117628]: spawned uWSGI master process (pid: 117628) Jun 17 15:10:12.775320 dv-cinder-825492-23-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 17 15:10:12.780347 dv-cinder-825492-23-iscsi devstack@n-api.service[117628]: spawned uWSGI worker 1 (pid: 117649, cores: 1) Jun 17 15:10:12.780347 dv-cinder-825492-23-iscsi devstack@n-api.service[117628]: spawned uWSGI worker 2 (pid: 117650, cores: 1) Jun 17 15:10:12.780347 dv-cinder-825492-23-iscsi devstack@n-api.service[117628]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 17 15:10:13.445444 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 17 15:10:13.446441 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 17 15:10:14.699823 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 17 15:10:14.699823 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: from cryptography.utils import int_from_bytes Jun 17 15:10:14.700518 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 17 15:10:14.700518 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: from cryptography.utils import int_from_bytes Jun 17 15:10:14.701882 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 17 15:10:14.701882 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: from cryptography.utils import int_from_bytes Jun 17 15:10:14.702327 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 17 15:10:14.702327 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: from cryptography.utils import int_from_bytes Jun 17 15:10:17.096495 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 17 15:10:17.096993 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 17 15:10:17.097300 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 17 15:10:17.097667 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 17 15:10:17.097928 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 17 15:10:17.098322 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.098653 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.098978 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.099298 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.099630 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.099948 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.100282 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.100625 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.100952 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.101217 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.101532 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.101860 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-825492-23-iscsi {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.102198 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.102519 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.102817 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.103128 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.103428 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.103780 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.104110 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.105283 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.105753 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.106064 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.106377 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.106720 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.107035 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.107345 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.107667 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.107976 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.108306 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.108645 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.109052 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-825492-23-iscsi {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.109372 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.109686 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.110000 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.110420 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.110742 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.111050 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.111370 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.111695 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.111993 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 17 15:10:17.112446 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.112545 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 17 15:10:17.112630 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.112714 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.112826 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 17 15:10:17.112988 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.113199 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 17 15:10:17.113304 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.113468 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 17 15:10:17.113591 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.113860 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.113963 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.114190 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.114342 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.114490 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.114632 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.114800 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.114946 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.115090 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.115238 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.115386 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.115536 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.115686 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.115828 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.115988 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.116132 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.116272 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.116439 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.116592 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.116749 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.116888 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.117030 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.117188 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.117346 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-825492-23-iscsi {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.117497 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.117665 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.117811 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.117958 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.118108 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.118269 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.118371 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.118504 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.118600 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.118781 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.118900 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.119109 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.119215 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.119416 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.119507 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.119745 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.119953 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.120120 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.120270 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.120442 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.120607 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.120712 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.120923 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.121035 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.121264 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.121369 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.121577 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.121668 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.121892 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.121992 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.122217 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.122320 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.122530 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.122630 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.122860 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.122964 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.123179 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.123295 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.123483 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.123593 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-825492-23-iscsi {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.123827 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.124001 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.124141 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.124291 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.124530 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.124628 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.124745 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.124932 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.125052 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.125249 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.125356 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.125564 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.125692 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.125890 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.125993 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.126224 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.126388 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.126528 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.126639 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.127400 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.127581 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.127739 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.127905 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.130179 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.130377 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.130536 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.130917 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.131198 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.131467 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.131633 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.131760 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.131885 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.131998 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.132124 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.132238 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.132408 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.132538 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.132771 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.132934 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.133124 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.133276 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.133427 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.133571 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.133714 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.133816 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.133913 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.134000 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.134092 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.134177 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.134257 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.134403 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.134543 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.134656 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.134785 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.134946 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.135026 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.135162 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.135269 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.135269 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.135410 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.135992 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.136095 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.136190 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.136269 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.136470 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.136580 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.136580 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.136719 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.136795 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.136880 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.136960 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.137043 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.137185 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.137274 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.137414 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.137504 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.137597 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.137597 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.137743 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.137820 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.137898 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.137898 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.138098 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.138242 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.138338 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.138338 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.138522 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.138650 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.138854 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.138854 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.139164 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.139268 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.139342 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.139438 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.139518 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.139602 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.139673 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.139755 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.140042 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.140138 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.140454 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.140574 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.140795 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.140935 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.141162 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.141302 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.141485 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.141592 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.141903 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.142001 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.142220 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.142321 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.142519 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.142688 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.142887 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.143299 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.143457 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.143598 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.143687 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.143863 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.144062 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.144219 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.144576 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.144674 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.144902 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.145009 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.145242 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.145335 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.145552 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.145644 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.145866 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.145966 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.146179 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.146270 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.146490 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.146583 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.146802 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.146902 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.147115 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.147217 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.147426 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.147527 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.147733 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.147825 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.148053 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.148161 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.148398 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.148504 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.148716 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.148808 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.149028 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.149141 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.149337 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.149437 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.149648 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.149749 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.149959 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.150050 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.150269 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.150366 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.150582 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.150686 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.150908 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.150997 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.151277 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.151877 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.152082 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.152178 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.152431 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.152528 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.152747 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.152898 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.153063 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.153189 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.153386 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.153487 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.153691 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.153816 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.154004 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.154227 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.154331 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.154424 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.154619 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.154723 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.154928 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.155073 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.155233 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.155334 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.155538 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.155650 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.155845 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.155938 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.156152 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.156244 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.156480 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.156588 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.156787 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.156880 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.157091 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.157192 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.157415 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.157516 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.157730 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.157820 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.158043 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.158141 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.158355 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.158502 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.158662 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.158761 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.158975 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.159079 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 15:10:17.159291 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.159392 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.159605 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.159700 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.159912 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.160004 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.160221 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.160360 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.160553 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.160657 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.160865 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.160957 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.161171 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.161271 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.161496 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.161608 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.161821 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.161922 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.162130 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.162221 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.163178 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.163360 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.163520 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.163669 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.163824 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.163994 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.164245 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.164438 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.164600 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.164752 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.164910 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.165063 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.165208 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.165352 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.165494 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.165651 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.165797 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.165940 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.166082 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.167283 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.167391 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.167547 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.167638 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.167723 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.167806 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.167806 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.167975 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.168069 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.168155 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.168245 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.168366 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.168512 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.168633 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.168739 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.168826 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.168917 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.169041 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.169157 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.169261 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.169348 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.169432 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.169524 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.169660 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.169753 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.169851 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.169937 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.170020 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.170103 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.170193 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.170286 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.170380 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.170472 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.170611 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.170707 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.170927 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.171027 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.171286 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.171379 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.171600 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.171698 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.171909 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.172018 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.172216 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.172308 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.172549 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.172861 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.173168 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.173474 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.173634 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.173779 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.174000 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.174092 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.174344 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.174463 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.174674 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.174774 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.174989 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.175078 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.175296 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.175395 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.175599 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.175692 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.175904 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.175996 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.176247 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.176422 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.176579 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.176672 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.176892 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.176990 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.177212 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.177306 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.177526 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.177616 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.177858 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.177959 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.178171 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.178270 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.178488 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.178580 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.178801 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.178892 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.179114 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.179207 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.179427 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.179529 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.179741 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.179839 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.180057 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.180151 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.180390 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.180496 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.180710 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.180814 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.181020 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.181118 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.181331 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.181423 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.181646 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.181752 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.181965 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.182055 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.182271 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.182381 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.182616 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.182723 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.182932 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.183068 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.183246 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.183350 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.183565 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.183670 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.183888 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.183987 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.184206 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.184299 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.184552 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.184649 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.184864 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.184955 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.185180 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.185272 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.185493 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.185586 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.185805 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.185905 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.186127 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.186222 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.186439 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.186568 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.186758 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.186854 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.187069 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.187169 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.187395 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.187488 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.187705 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.187796 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.188021 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.188127 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.188399 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.188495 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.188662 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.188766 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.188980 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.189088 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.189291 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.189428 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.189606 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.189702 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.189917 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.190021 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.190224 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.190316 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.190535 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.190634 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.190843 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.190946 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.191152 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.191250 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.191459 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.191557 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.191769 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.191872 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.192078 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.192169 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.192419 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.192570 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.192733 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.192827 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.193042 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.193183 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.193350 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.193451 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.193664 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.193758 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.193977 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.194069 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.194281 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.194374 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.194584 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.194684 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.194897 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.194988 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.195220 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.195400 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.195532 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.195632 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.195854 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.195945 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.196174 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.196274 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.196506 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.196599 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.196813 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.196962 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.197138 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.197239 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.197443 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.197534 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.197748 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.197841 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.198562 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.198677 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.198869 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.199047 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.199211 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.199348 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.199522 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.199621 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.199824 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.199956 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.200140 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.200232 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.200487 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.200592 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.200799 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.200894 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.201115 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.201208 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.201426 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.201518 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.201739 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.201842 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.202060 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.202154 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.202376 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.202466 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.202691 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.203028 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.203353 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.203531 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.203700 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.203853 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.204014 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.204174 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.204349 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.204520 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.204680 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.204832 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.204989 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.205152 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.205302 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.205465 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.205622 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.205772 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.205921 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.206078 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.206229 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.206391 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.206541 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.206705 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.206855 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.207004 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.207163 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.207406 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.207572 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.207723 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.207881 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.208042 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.208201 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.208439 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.208599 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.208750 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.208898 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.209055 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.209198 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.209298 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.209385 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.209566 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.209703 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.209881 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.210057 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.210207 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.210311 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.210518 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.210619 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.210836 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.210930 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.211150 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.211233 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.211461 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.211553 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.211768 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.211875 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.212071 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.212152 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.212402 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.212499 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.212716 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.212810 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.213022 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.213116 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.213329 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.213430 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.213633 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.213782 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.214737 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.214875 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.215075 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.215174 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.215361 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.215462 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.215676 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.215780 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.215984 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.216080 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.216306 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.216401 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.216658 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.216756 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.216970 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.217073 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.217275 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.217368 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.217581 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.217687 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.217906 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.217998 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.218218 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.218316 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.218538 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.218673 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.218856 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.218952 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.219188 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.219298 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.219507 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.219636 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.219815 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.219936 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.220154 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.220295 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.220680 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.220785 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.221007 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.221135 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.221344 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.221450 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.221698 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.221802 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.221982 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.222083 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.222288 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.222380 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.222604 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.222705 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.222918 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.223002 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.223232 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.223329 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.223543 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.223644 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.223850 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.223978 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.224163 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.224499 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.224608 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.224825 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.224919 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.225138 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.225245 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.225444 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.225544 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.225750 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.225850 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.226063 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.226171 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.226373 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.226473 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.226677 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.226777 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.226986 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.227088 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.227294 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.227467 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.227617 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.227765 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.227926 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.228019 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.228232 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.228368 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.228554 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.228708 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.228914 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.229121 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.229220 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.229385 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.229487 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.229576 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.229802 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.229904 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.230110 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.230204 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.230417 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.230509 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.230722 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.230813 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.231032 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.231123 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.231340 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.231434 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.231654 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.231776 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.231970 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.232090 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.232283 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.232396 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.232627 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.232719 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.232945 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.233093 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.233244 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.233335 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.233548 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.233689 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.233855 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.234032 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.234159 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.234251 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.234469 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.234563 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.234779 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.234884 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.235083 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.235175 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.235386 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.235479 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.235690 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.235784 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.235994 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.236085 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.236316 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.236447 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.236719 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.236814 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.237027 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.237134 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.237332 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.237433 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.237635 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.237735 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.237945 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.238036 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.238256 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.238357 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.238573 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.238664 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.238892 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.239019 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.239210 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.239316 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.239527 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.239626 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.239844 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.239978 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.240157 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.240297 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.240504 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.240631 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.240797 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.240953 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.241116 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.241267 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.241431 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.241560 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.241745 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.241873 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.242052 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.242188 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.242358 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.242501 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.242682 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.242811 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.242997 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.243125 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.243311 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.243435 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.243635 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.243777 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.243959 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.244063 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.244284 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.244407 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.244621 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.244714 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.244960 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.245058 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.245276 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.245367 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.245588 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.245688 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.245901 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.245994 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.246212 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.246305 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.246525 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.246627 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.246835 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.246961 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.247148 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.247239 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.247462 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.247598 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.247774 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.247893 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.248080 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.248207 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.248425 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.248571 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.248730 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.248859 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.249061 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.249190 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.249353 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.249486 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.249664 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.249781 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.249973 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.250090 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.250280 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.250400 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.250586 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.250706 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.250893 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.251009 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.251196 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.251324 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.251503 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.251628 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.251812 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.251932 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.252122 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.252251 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.252479 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.252711 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.252819 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.253029 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.253146 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.253346 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.253444 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.253671 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.253831 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.253976 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.254069 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.254288 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.254391 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.254667 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.254759 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.254980 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.255075 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.255300 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.255392 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.255619 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.255717 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.255929 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.256030 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.256238 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.256359 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.256581 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.256891 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.257212 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.257524 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.257653 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.257844 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.257955 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.258163 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.258257 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.258474 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.258611 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.258794 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.258892 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.259187 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.259301 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.259428 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.259521 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.259751 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.259845 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.260078 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.260172 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.260443 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.261058 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.261272 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.261368 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.261598 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.261734 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.261915 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.262044 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.262233 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.262368 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.262549 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.262672 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.262867 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.262999 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.263185 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.263329 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.263506 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.263641 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.263825 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.263960 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.264142 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.264298 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.264483 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.264637 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.264800 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.264966 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.265116 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.265282 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.265431 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.265604 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.265741 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.265916 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.266072 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.266451 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.266546 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.266841 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.266944 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.267156 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.267258 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.267469 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.267562 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.267789 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.267889 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.268150 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.268259 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.268535 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.268630 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.268865 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.268956 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.269196 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.269358 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.269510 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.269610 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.269819 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.269927 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.270134 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.270230 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.270445 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.270539 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.270757 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.270850 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.271069 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.271164 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.271380 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.271487 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.271694 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.271801 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.272007 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.272100 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.272320 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.272439 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.272652 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.272746 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.272963 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.273056 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.273289 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.273383 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.273599 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.273694 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.273927 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.274020 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.274247 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.274405 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.274573 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.274789 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.274896 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.274983 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.275174 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.275275 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.275497 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.275591 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.275810 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.275903 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.276118 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.276280 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.276992 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.277085 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.277303 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.277502 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.277649 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.277822 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.277957 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.278139 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.278283 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.278469 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.278618 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.278800 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.278951 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.279137 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.279267 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.279468 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.279605 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.279791 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.279933 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.280109 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.280254 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.280465 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.280617 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.280798 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.280947 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.281260 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.281563 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.281875 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.281971 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.282184 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.282265 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.282489 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.282579 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.282796 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.282911 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.283108 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.283249 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.283413 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.283577 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.283716 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.283912 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.284026 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.285058 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.285183 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.285183 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.285368 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.285463 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.285550 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.285635 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.285726 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.285811 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.285905 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.285992 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.286076 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.286168 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.286262 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.286492 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.286595 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.286798 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.286899 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.287135 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.287234 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.287457 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.287559 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.287767 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.287867 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.288087 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.288181 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.288425 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.288559 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.288748 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.288855 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.289063 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.289160 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.289375 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.289493 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.289690 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.289791 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.290002 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.290096 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.290318 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.290410 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.290636 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.290731 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.290953 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.291047 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.291265 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.291360 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.291580 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.291681 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.291923 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.292160 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.292307 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.292481 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.292836 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.293175 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.293499 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.293823 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.294141 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.294462 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.294779 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.295098 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.295413 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.295727 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.296040 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.296398 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.296695 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.296827 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.297042 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.297169 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.297383 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.297504 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.297703 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.297831 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.298020 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.298148 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.298339 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.298458 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.298655 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.298775 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.299016 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.299148 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.299332 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.299452 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.299666 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.299806 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.299958 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.300078 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.300275 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.300476 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.300609 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.300736 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.300925 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.301046 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.301240 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.301359 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.301557 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.301691 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.301874 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.301994 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.302190 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.302310 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.302502 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.302624 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.302817 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.302944 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.303131 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.303250 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.303454 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.303574 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.303762 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.303891 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.304069 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.304188 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.304555 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.304720 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.304874 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.305036 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.305376 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.305576 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.305743 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.305896 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.306046 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.306204 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.306380 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.306545 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.306698 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.306856 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.307015 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.307166 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.307317 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.307525 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.307688 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.307847 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.308007 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.308158 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.308356 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.308534 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.308694 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.308845 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.309004 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.309170 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.309335 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.309494 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.309652 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.309895 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.310056 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.310223 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.310384 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.310560 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.310719 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.310877 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.311028 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.311186 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.311352 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.311509 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.311665 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.311665 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.311958 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.312110 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.312270 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.312465 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.312640 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.312800 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.312951 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.313115 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.313276 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.313276 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.313562 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.313712 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.313862 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.314026 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.314177 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.314328 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.314486 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.314648 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.314799 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.314960 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.315119 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.315363 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.315668 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.315835 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.315986 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.316144 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.316297 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.316488 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.316650 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.316812 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.316976 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.317135 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.317286 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.317438 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.317588 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.317738 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.317897 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.318048 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.318199 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.318350 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.318508 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.318659 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.318833 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.318993 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.319145 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.319294 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.319445 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.319674 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.319829 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.320072 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.320232 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.320442 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.320607 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.320607 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.320922 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.321073 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.321223 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.321381 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.321531 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.321699 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.321877 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.322039 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.322197 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.322355 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.322355 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.322662 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.322825 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.322982 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.323648 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.323799 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.323958 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.324109 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.324267 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.324444 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.324444 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.324732 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.324732 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.325030 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.325195 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.325363 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.325583 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.325748 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.325946 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.326136 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.326294 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.326479 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.326636 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.326802 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.326954 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.327133 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.327291 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.327458 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.327610 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.327770 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.328065 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.328221 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.328415 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.328575 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.328736 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.328898 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.329057 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.329217 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.329374 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.329532 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.329702 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.329854 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.330014 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.330256 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.330417 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.330575 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.330735 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.330894 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.331053 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.331206 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.331356 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.331513 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.331684 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.331842 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.331993 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.332151 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.332301 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.332494 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.332659 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.332811 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.332968 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.333128 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.333287 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.333447 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.333598 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.333762 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.333913 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.334062 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.334213 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.334213 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.334513 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.334670 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.334820 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.334969 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.335118 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.335282 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.335433 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.335683 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.335851 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.336011 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.336176 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.336350 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.336523 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.336674 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.336824 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.336982 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.337274 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.337442 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.337594 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.337743 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.337903 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.338054 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.338255 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.338423 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.338581 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.339533 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.339714 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.339871 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.340035 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.340188 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.340500 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.340669 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.340830 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.341008 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.341170 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.341322 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.341474 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.341625 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.341784 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.341945 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.342104 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.342255 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.342405 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.342557 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.342726 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.342899 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.343059 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.343225 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.343376 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.343533 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.343699 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.343850 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.344014 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.344014 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.344309 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.344497 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.344668 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.344828 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.344989 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.345138 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.345295 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.345520 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.345734 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.345902 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.346117 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.346281 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.346432 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.352676 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.352908 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.353086 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.353256 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.353436 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.353602 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.353771 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.353925 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.354077 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.354236 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.354423 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.354583 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.354747 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.354900 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.355050 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.355202 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.355358 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.355528 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.355690 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.355851 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.356009 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.356169 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.356169 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.356529 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.356529 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.356841 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.356994 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.357145 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.357296 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.357532 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.357532 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.357821 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.357980 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.358138 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.358298 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.358462 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.358622 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.358774 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.358924 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.358924 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.359207 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.359207 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.359514 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.359673 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.359824 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.360025 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.360184 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.360367 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.360525 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.360676 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.360836 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.360987 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.361146 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.361297 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.361469 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.361469 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.361469 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.361888 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.362047 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.362047 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.362349 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.362500 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.362667 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.362904 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.363079 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.363232 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.363383 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.363545 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.363696 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.363856 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.364006 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.364156 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.364312 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.364488 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.364650 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.364815 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.364975 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.365126 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.365276 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.365437 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.365597 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.365762 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.365922 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.366080 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.366230 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.366381 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.366542 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.366695 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.366860 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.367013 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.367163 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.367313 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.367490 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.367643 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.367794 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.367951 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.368102 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.368252 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.368436 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.368593 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.368751 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.368904 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.369069 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.369231 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.369400 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.369559 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.369709 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.369860 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.370056 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.370217 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.370368 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.370546 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.370546 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117650) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 17 15:10:17.370927 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.370927 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.370927 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.370927 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.370927 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.370927 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.370927 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.370927 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.377938 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.377938 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.377938 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.377938 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.377938 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.377938 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.377938 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.377938 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.379711 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.379711 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.379711 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.379711 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.379711 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.379711 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.379711 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.379711 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.380914 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.380914 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.380914 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.380914 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.380914 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.380914 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.380914 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.380914 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.382120 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.382120 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.382120 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.382120 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.382120 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.382120 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.382120 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.382120 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.383264 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.383264 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.383264 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.383264 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.383264 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.383264 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.383264 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.383264 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.384482 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.384482 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.384482 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.384482 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.384482 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.384482 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.384482 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.384482 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.386166 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.386166 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.386166 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.386166 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.386734 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.386734 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.387319 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.387716 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.387971 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.388285 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.388644 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.389282 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.389282 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.389603 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.389906 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.390234 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.390566 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.390878 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.391207 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.391588 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.391944 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.392443 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.392771 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.393105 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.393423 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.393736 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.394489 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 15:10:17.394489 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117649) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 17 15:10:17.428792 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO dbcounter [None req-1eddf530-25b9-47d9-ac64-83af71256401 None None] Registered counter for database nova_api Jun 17 15:10:17.449435 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_db.sqlalchemy.engines [None req-1eddf530-25b9-47d9-ac64-83af71256401 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117650) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 15:10:17.456103 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writer thread running {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 15:10:17.466963 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO dbcounter [None req-288b8ed9-c32c-4a0f-8d56-a54b8e0b99e7 None None] Registered counter for database nova_api Jun 17 15:10:17.489181 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_db.sqlalchemy.engines [None req-288b8ed9-c32c-4a0f-8d56-a54b8e0b99e7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117649) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 15:10:17.496587 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writer thread running {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 15:10:17.515018 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.context [None req-1eddf530-25b9-47d9-ac64-83af71256401 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b6b5fdf2-9eb8-4963-9495-5b73caa9f013(cell1) {{(pid=117650) load_cells /opt/stack/nova/nova/context.py:464}} Jun 17 15:10:17.519155 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1eddf530-25b9-47d9-ac64-83af71256401 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:10:17.520771 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1eddf530-25b9-47d9-ac64-83af71256401 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:10:17.521594 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1eddf530-25b9-47d9-ac64-83af71256401 None None] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:10:17.523553 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1eddf530-25b9-47d9-ac64-83af71256401 None None] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:10:17.525592 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO dbcounter [None req-1eddf530-25b9-47d9-ac64-83af71256401 None None] Registered counter for database nova_cell0 Jun 17 15:10:17.529535 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO dbcounter [None req-1eddf530-25b9-47d9-ac64-83af71256401 None None] Registered counter for database nova_cell1 Jun 17 15:10:17.537002 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_db.sqlalchemy.engines [None req-1eddf530-25b9-47d9-ac64-83af71256401 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117650) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 15:10:17.538277 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_db.sqlalchemy.engines [None req-1eddf530-25b9-47d9-ac64-83af71256401 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117650) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 15:10:17.545598 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writer thread running {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 15:10:17.545934 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writer thread running {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 15:10:17.555103 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.context [None req-288b8ed9-c32c-4a0f-8d56-a54b8e0b99e7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b6b5fdf2-9eb8-4963-9495-5b73caa9f013(cell1) {{(pid=117649) load_cells /opt/stack/nova/nova/context.py:464}} Jun 17 15:10:17.559844 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-288b8ed9-c32c-4a0f-8d56-a54b8e0b99e7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:10:17.561466 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-288b8ed9-c32c-4a0f-8d56-a54b8e0b99e7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:10:17.563130 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-288b8ed9-c32c-4a0f-8d56-a54b8e0b99e7 None None] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:10:17.564319 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-288b8ed9-c32c-4a0f-8d56-a54b8e0b99e7 None None] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:10:17.566361 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO dbcounter [None req-288b8ed9-c32c-4a0f-8d56-a54b8e0b99e7 None None] Registered counter for database nova_cell0 Jun 17 15:10:17.570351 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO dbcounter [None req-288b8ed9-c32c-4a0f-8d56-a54b8e0b99e7 None None] Registered counter for database nova_cell1 Jun 17 15:10:17.579505 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_db.sqlalchemy.engines [None req-288b8ed9-c32c-4a0f-8d56-a54b8e0b99e7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117649) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 15:10:17.580921 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_db.sqlalchemy.engines [None req-288b8ed9-c32c-4a0f-8d56-a54b8e0b99e7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117649) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 15:10:17.587344 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writer thread running {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 15:10:17.589876 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writer thread running {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 15:10:17.695221 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO dbcounter [None req-1eddf530-25b9-47d9-ac64-83af71256401 None None] Registered counter for database nova_cell0 Jun 17 15:10:17.702235 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_db.sqlalchemy.engines [None req-1eddf530-25b9-47d9-ac64-83af71256401 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117650) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 15:10:17.706676 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writer thread running {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 15:10:17.737721 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO dbcounter [None req-288b8ed9-c32c-4a0f-8d56-a54b8e0b99e7 None None] Registered counter for database nova_cell0 Jun 17 15:10:17.744392 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_db.sqlalchemy.engines [None req-288b8ed9-c32c-4a0f-8d56-a54b8e0b99e7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117649) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 15:10:17.749825 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writer thread running {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 15:10:18.028270 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: WARNING keystonemiddleware.auth_token [None req-1eddf530-25b9-47d9-ac64-83af71256401 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 17 15:10:18.035761 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: WARNING keystonemiddleware.auth_token [None req-1eddf530-25b9-47d9-ac64-83af71256401 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 17 15:10:18.074022 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: WARNING keystonemiddleware.auth_token [None req-288b8ed9-c32c-4a0f-8d56-a54b8e0b99e7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 17 15:10:18.081337 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: WARNING keystonemiddleware.auth_token [None req-288b8ed9-c32c-4a0f-8d56-a54b8e0b99e7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 17 15:10:18.379287 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: WARNING keystonemiddleware.auth_token [None req-1eddf530-25b9-47d9-ac64-83af71256401 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 17 15:10:18.385553 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: WARNING keystonemiddleware.auth_token [None req-1eddf530-25b9-47d9-ac64-83af71256401 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 17 15:10:18.391280 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5644d7bec9c0 pid: 117650 (default app) Jun 17 15:10:18.427721 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: WARNING keystonemiddleware.auth_token [None req-288b8ed9-c32c-4a0f-8d56-a54b8e0b99e7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 17 15:10:18.434273 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: WARNING keystonemiddleware.auth_token [None req-288b8ed9-c32c-4a0f-8d56-a54b8e0b99e7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 17 15:10:18.439600 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5644d7bec9c0 pid: 117649 (default app) Jun 17 15:10:58.610738 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_api:SELECT=3 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:10:58.613519 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell0:SELECT=3 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:10:58.614736 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=3 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:10:58.617580 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell0:SELECT=3 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:11:00.278451 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-8e8cf682-801b-4945-9464-7c4d95b853ae tempest-VolumesSnapshotsTestJSON-1909647846 tempest-VolumesSnapshotsTestJSON-1909647846-project] Action: 'create', calling method: .version_select at 0x7faf523558b0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-158404015"}} {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:11:03.416513 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-8e8cf682-801b-4945-9464-7c4d95b853ae tempest-VolumesSnapshotsTestJSON-1909647846 tempest-VolumesSnapshotsTestJSON-1909647846-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 4.823220 Jun 17 15:11:03.417176 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1/1] 10.222.0.48 () {60 vars in 1154 bytes} [Fri Jun 17 15:10:58 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 4826 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 17 15:11:04.179922 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-60086ac2-3752-4f44-a4cd-401cdcbc3a54 tempest-VolumesSnapshotsTestJSON-1909647846 tempest-VolumesSnapshotsTestJSON-1909647846-project] Calling method '.version_select at 0x7faf52d5da60>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:11:04.258479 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_api:SELECT=3 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:11:04.264779 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell1:SELECT=3 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:11:04.266800 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell0:SELECT=3 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:11:04.271002 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell0:SELECT=3 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:11:05.373780 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-60086ac2-3752-4f44-a4cd-401cdcbc3a54 tempest-VolumesSnapshotsTestJSON-1909647846 tempest-VolumesSnapshotsTestJSON-1909647846-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/fc4ae535-4c9a-41a9-8575-db28ba0d83a7" status: 200 len: 345 microversion: 2.1 time: 1.942599 Jun 17 15:11:05.382962 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1/2] 10.222.0.48 () {58 vars in 1244 bytes} [Fri Jun 17 15:11:03 2022] GET /compute/v2.1/os-volumes/fc4ae535-4c9a-41a9-8575-db28ba0d83a7 => generated 345 bytes in 1958 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:11:05.388571 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-c89028cc-3ded-40b6-972d-c392a0b7f5b4 tempest-VolumesSnapshotsTestJSON-1909647846 tempest-VolumesSnapshotsTestJSON-1909647846-project] Action: 'create', calling method: .version_select at 0x7faf5221e670>, body: {"snapshot": {"volume_id": "fc4ae535-4c9a-41a9-8575-db28ba0d83a7", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-144122622"}} {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:11:05.908817 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-c89028cc-3ded-40b6-972d-c392a0b7f5b4 tempest-VolumesSnapshotsTestJSON-1909647846 tempest-VolumesSnapshotsTestJSON-1909647846-project] 10.222.0.48 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.524804 Jun 17 15:11:05.909407 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 2/3] 10.222.0.48 () {60 vars in 1161 bytes} [Fri Jun 17 15:11:05 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:11:05.920219 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-980c97a0-7bf3-414a-a71d-6a8966104f62 tempest-VolumesSnapshotsTestJSON-1909647846 tempest-VolumesSnapshotsTestJSON-1909647846-project] Calling method '.version_select at 0x7faf52264670>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:11:06.111872 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-980c97a0-7bf3-414a-a71d-6a8966104f62 tempest-VolumesSnapshotsTestJSON-1909647846 tempest-VolumesSnapshotsTestJSON-1909647846-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/1ff48e90-dc02-4bbe-8a5d-a4cc65e67eb5" status: 200 len: 286 microversion: 2.1 time: 0.196176 Jun 17 15:11:06.116426 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 2/4] 10.222.0.48 () {58 vars in 1250 bytes} [Fri Jun 17 15:11:05 2022] GET /compute/v2.1/os-snapshots/1ff48e90-dc02-4bbe-8a5d-a4cc65e67eb5 => generated 286 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:11:06.122340 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-5c39c9d6-a00d-423b-8c14-c0796d80e8a1 tempest-VolumesSnapshotsTestJSON-1909647846 tempest-VolumesSnapshotsTestJSON-1909647846-project] Calling method '.version_select at 0x7faf5221e700>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:11:06.257634 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-5c39c9d6-a00d-423b-8c14-c0796d80e8a1 tempest-VolumesSnapshotsTestJSON-1909647846 tempest-VolumesSnapshotsTestJSON-1909647846-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.139101 Jun 17 15:11:06.258835 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 3/5] 10.222.0.48 () {58 vars in 1139 bytes} [Fri Jun 17 15:11:06 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:11:06.271601 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-dc289ac4-d874-45e5-a061-1e5195d47903 tempest-VolumesSnapshotsTestJSON-1909647846 tempest-VolumesSnapshotsTestJSON-1909647846-project] Calling method '.version_select at 0x7faf52264700>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:11:06.357456 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-dc289ac4-d874-45e5-a061-1e5195d47903 tempest-VolumesSnapshotsTestJSON-1909647846 tempest-VolumesSnapshotsTestJSON-1909647846-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/1ff48e90-dc02-4bbe-8a5d-a4cc65e67eb5" status: 200 len: 286 microversion: 2.1 time: 0.090678 Jun 17 15:11:06.358408 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 3/6] 10.222.0.48 () {58 vars in 1250 bytes} [Fri Jun 17 15:11:06 2022] GET /compute/v2.1/os-snapshots/1ff48e90-dc02-4bbe-8a5d-a4cc65e67eb5 => generated 286 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:11:07.374247 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-05f0a824-4869-47e8-b75f-3edfa066383b tempest-VolumesSnapshotsTestJSON-1909647846 tempest-VolumesSnapshotsTestJSON-1909647846-project] Calling method '.version_select at 0x7faf52231430>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:11:07.524606 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-05f0a824-4869-47e8-b75f-3edfa066383b tempest-VolumesSnapshotsTestJSON-1909647846 tempest-VolumesSnapshotsTestJSON-1909647846-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/1ff48e90-dc02-4bbe-8a5d-a4cc65e67eb5" status: 200 len: 286 microversion: 2.1 time: 0.158862 Jun 17 15:11:07.528606 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 4/7] 10.222.0.48 () {58 vars in 1250 bytes} [Fri Jun 17 15:11:07 2022] GET /compute/v2.1/os-snapshots/1ff48e90-dc02-4bbe-8a5d-a4cc65e67eb5 => generated 286 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:11:08.536131 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-ed9e1d00-180a-482d-aa2c-5be57e36d62f tempest-VolumesSnapshotsTestJSON-1909647846 tempest-VolumesSnapshotsTestJSON-1909647846-project] Calling method '.version_select at 0x7faf52264ee0>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:11:08.588010 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-ed9e1d00-180a-482d-aa2c-5be57e36d62f tempest-VolumesSnapshotsTestJSON-1909647846 tempest-VolumesSnapshotsTestJSON-1909647846-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/1ff48e90-dc02-4bbe-8a5d-a4cc65e67eb5" status: 200 len: 286 microversion: 2.1 time: 0.055206 Jun 17 15:11:08.588880 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 4/8] 10.222.0.48 () {58 vars in 1250 bytes} [Fri Jun 17 15:11:08 2022] GET /compute/v2.1/os-snapshots/1ff48e90-dc02-4bbe-8a5d-a4cc65e67eb5 => generated 286 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:11:09.600509 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-f6e8d919-c603-424d-bc4e-d70101f14c67 tempest-VolumesSnapshotsTestJSON-1909647846 tempest-VolumesSnapshotsTestJSON-1909647846-project] Calling method '.version_select at 0x7faf52231b80>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:11:09.673967 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-f6e8d919-c603-424d-bc4e-d70101f14c67 tempest-VolumesSnapshotsTestJSON-1909647846 tempest-VolumesSnapshotsTestJSON-1909647846-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/1ff48e90-dc02-4bbe-8a5d-a4cc65e67eb5" status: 200 len: 287 microversion: 2.1 time: 0.077248 Jun 17 15:11:09.679635 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 5/9] 10.222.0.48 () {58 vars in 1250 bytes} [Fri Jun 17 15:11:09 2022] GET /compute/v2.1/os-snapshots/1ff48e90-dc02-4bbe-8a5d-a4cc65e67eb5 => generated 287 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:11:09.688082 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-ac505e7a-8bc3-4099-b260-108c290b58e0 tempest-VolumesSnapshotsTestJSON-1909647846 tempest-VolumesSnapshotsTestJSON-1909647846-project] Calling method '.version_select at 0x7faf5222d5e0>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:11:09.927194 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-ac505e7a-8bc3-4099-b260-108c290b58e0 tempest-VolumesSnapshotsTestJSON-1909647846 tempest-VolumesSnapshotsTestJSON-1909647846-project] 10.222.0.48 "DELETE /compute/v2.1/os-snapshots/1ff48e90-dc02-4bbe-8a5d-a4cc65e67eb5" status: 202 len: 0 microversion: 2.1 time: 0.245828 Jun 17 15:11:09.928524 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 5/10] 10.222.0.48 () {58 vars in 1253 bytes} [Fri Jun 17 15:11:09 2022] DELETE /compute/v2.1/os-snapshots/1ff48e90-dc02-4bbe-8a5d-a4cc65e67eb5 => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 15:11:09.937730 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-a1f4b3a3-6c4a-4ca4-8722-ae1046c98fc0 tempest-VolumesSnapshotsTestJSON-1909647846 tempest-VolumesSnapshotsTestJSON-1909647846-project] Calling method '.version_select at 0x7faf5221ec10>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:11:10.010794 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-a1f4b3a3-6c4a-4ca4-8722-ae1046c98fc0 tempest-VolumesSnapshotsTestJSON-1909647846 tempest-VolumesSnapshotsTestJSON-1909647846-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/1ff48e90-dc02-4bbe-8a5d-a4cc65e67eb5" status: 200 len: 286 microversion: 2.1 time: 0.078506 Jun 17 15:11:10.011708 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 6/11] 10.222.0.48 () {58 vars in 1250 bytes} [Fri Jun 17 15:11:09 2022] GET /compute/v2.1/os-snapshots/1ff48e90-dc02-4bbe-8a5d-a4cc65e67eb5 => generated 286 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:11:11.023456 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-8749c809-53ac-44af-acae-03df0629a7aa tempest-VolumesSnapshotsTestJSON-1909647846 tempest-VolumesSnapshotsTestJSON-1909647846-project] Calling method '.version_select at 0x7faf5221e700>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:11:11.075381 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.wsgi [None req-8749c809-53ac-44af-acae-03df0629a7aa tempest-VolumesSnapshotsTestJSON-1909647846 tempest-VolumesSnapshotsTestJSON-1909647846-project] HTTP exception thrown: Snapshot 1ff48e90-dc02-4bbe-8a5d-a4cc65e67eb5 could not be found. Jun 17 15:11:11.080974 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-8749c809-53ac-44af-acae-03df0629a7aa tempest-VolumesSnapshotsTestJSON-1909647846 tempest-VolumesSnapshotsTestJSON-1909647846-project] Request method failure captured: Jun 17 15:11:11.080974 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: request: GET /compute/v2.1/os-snapshots/1ff48e90-dc02-4bbe-8a5d-a4cc65e67eb5 HTTP/1.1 Jun 17 15:11:11.080974 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Accept: application/json Jun 17 15:11:11.080974 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Accept-Encoding: identity Jun 17 15:11:11.080974 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Connection: close Jun 17 15:11:11.080974 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Content-Length: 0 Jun 17 15:11:11.080974 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Content-Type: application/json Jun 17 15:11:11.080974 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Host: 10.222.0.48 Jun 17 15:11:11.080974 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Openstack-System-Scope: None Jun 17 15:11:11.080974 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: User-Agent: python-urllib3/1.26.9 Jun 17 15:11:11.080974 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Auth-Token: gAAAAABirJmC_05x3D4Q3hh6q876rrmrpq3uceX0QsYVFXhSjPjc0ZDP23eO6GGvLPjrS4qKNHn0D3iVg02vV2jPyF0dnyfUQ3VTbdfFbKODT7gqlwKcc9-0jQ0dJgAU0CydjrvDhuNiZIdWhiN0Jh0x0UJPrIvsTvSlGux56Wt17cp-vIALRwg Jun 17 15:11:11.080974 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Domain-Id: None Jun 17 15:11:11.080974 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Domain-Name: None Jun 17 15:11:11.080974 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Identity-Status: Confirmed Jun 17 15:11:11.080974 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Is-Admin-Project: True Jun 17 15:11:11.080974 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Domain-Id: default Jun 17 15:11:11.080974 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Domain-Name: Default Jun 17 15:11:11.080974 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Id: e8a1a46d3acc486f8767b3642c2cdc16 Jun 17 15:11:11.080974 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1909647846 Jun 17 15:11:11.080974 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Role: reader,member Jun 17 15:11:11.080974 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Roles: reader,member Jun 17 15:11:11.082128 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e8a1a46d3acc486f8767b3642c2cdc16", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e8a1a46d3acc486f8767b3642c2cdc16"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e8a1a46d3acc486f8767b3642c2cdc16"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e8a1a46d3acc486f8767b3642c2cdc16"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Jun 17 15:11:11.082128 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1909647846 Jun 17 15:11:11.082128 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant-Id: e8a1a46d3acc486f8767b3642c2cdc16 Jun 17 15:11:11.082128 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1909647846 Jun 17 15:11:11.082128 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User: tempest-VolumesSnapshotsTestJSON-1909647846-project Jun 17 15:11:11.082128 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Domain-Id: default Jun 17 15:11:11.082128 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Domain-Name: Default Jun 17 15:11:11.082128 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Id: c1e34787cf0448329efd7548216041a7 Jun 17 15:11:11.082128 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1909647846-project Jun 17 15:11:11.082128 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: method: Jun 17 15:11:11.082128 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: exception: Snapshot 1ff48e90-dc02-4bbe-8a5d-a4cc65e67eb5 could not be found. Jun 17 15:11:11.082128 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: action_args: {'id': '1ff48e90-dc02-4bbe-8a5d-a4cc65e67eb5'} Jun 17 15:11:11.082128 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 15:11:11.082809 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:11:11.082809 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 17 15:11:11.082809 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 17 15:11:11.082809 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 17 15:11:11.082809 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 17 15:11:11.082809 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 17 15:11:11.082809 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 17 15:11:11.082809 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 17 15:11:11.082809 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 17 15:11:11.082809 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 17 15:11:11.082809 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 17 15:11:11.082809 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 15:11:11.082809 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 15:11:11.082809 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 15:11:11.082809 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 15:11:11.082809 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 1ff48e90-dc02-4bbe-8a5d-a4cc65e67eb5 could not be found. (HTTP 404) (Request-ID: req-3de69e84-111b-4b51-8686-8899ee727425) Jun 17 15:11:11.082809 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:11:11.082809 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:11:11.087149 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:11:11.087149 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:11:11.087149 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 17 15:11:11.087149 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 17 15:11:11.087149 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 15:11:11.087149 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 15:11:11.087149 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 17 15:11:11.087149 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 17 15:11:11.087149 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 15:11:11.087149 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 15:11:11.087149 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 17 15:11:11.087149 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 17 15:11:11.087149 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 17 15:11:11.087149 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 17 15:11:11.087149 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 17 15:11:11.087149 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 17 15:11:11.087149 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 17 15:11:11.087149 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 17 15:11:11.087149 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 17 15:11:11.088766 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 17 15:11:11.088766 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 15:11:11.088766 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 15:11:11.088766 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 15:11:11.088766 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 15:11:11.088766 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 1ff48e90-dc02-4bbe-8a5d-a4cc65e67eb5 could not be found. Jun 17 15:11:11.088766 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:11:11.088766 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:11:11.088766 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:11:11.088766 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:11:11.088766 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:11:11.088766 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:11:11.088766 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 15:11:11.088766 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 15:11:11.088766 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 17 15:11:11.088766 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 17 15:11:11.088766 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 15:11:11.088766 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 15:11:11.088766 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 17 15:11:11.088766 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 15:11:11.090258 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 1ff48e90-dc02-4bbe-8a5d-a4cc65e67eb5 could not be found. Jun 17 15:11:11.090258 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:11:11.090258 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:11:11.090258 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:11:11.090258 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:11:11.090258 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:11:11.090258 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:11:11.090258 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 15:11:11.090258 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 15:11:11.090258 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 1ff48e90-dc02-4bbe-8a5d-a4cc65e67eb5 could not be found. Jun 17 15:11:11.090258 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:11:11.090258 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-8749c809-53ac-44af-acae-03df0629a7aa tempest-VolumesSnapshotsTestJSON-1909647846 tempest-VolumesSnapshotsTestJSON-1909647846-project] Returning 404 to user: Snapshot 1ff48e90-dc02-4bbe-8a5d-a4cc65e67eb5 could not be found. {{(pid=117650) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 15:11:11.090258 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-8749c809-53ac-44af-acae-03df0629a7aa tempest-VolumesSnapshotsTestJSON-1909647846 tempest-VolumesSnapshotsTestJSON-1909647846-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/1ff48e90-dc02-4bbe-8a5d-a4cc65e67eb5" status: 404 len: 111 microversion: 2.1 time: 0.063532 Jun 17 15:11:11.091024 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 7/12] 10.222.0.48 () {58 vars in 1250 bytes} [Fri Jun 17 15:11:11 2022] GET /compute/v2.1/os-snapshots/1ff48e90-dc02-4bbe-8a5d-a4cc65e67eb5 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 17 15:11:11.099923 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-01fd79b9-a52a-4869-a8d3-4d5f6848d16a tempest-VolumesSnapshotsTestJSON-1909647846 tempest-VolumesSnapshotsTestJSON-1909647846-project] Calling method '.version_select at 0x7faf5219e040>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:11:11.236222 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-693c6cab-2a3f-493e-acfb-53a1c9d2f518 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Action: 'create', calling method: .version_select at 0x7faf52264d30>, body: {"keypair": {"name": "tempest-keypair-238480590", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMQi3jaEdsCzjz2GguaOpM6VRZtZvA994nyLwm3idxoLeYxs/OdsLmC1dzApwdfniOFjImQV06RVI9wXpl+UEbnSX2LfC2loJ2kT8MXqhBwF+UOvsKEnVMhVGFHNcXg4gQ=="}} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:11:11.294223 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-01fd79b9-a52a-4869-a8d3-4d5f6848d16a tempest-VolumesSnapshotsTestJSON-1909647846 tempest-VolumesSnapshotsTestJSON-1909647846-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/fc4ae535-4c9a-41a9-8575-db28ba0d83a7" status: 202 len: 0 microversion: 2.1 time: 0.201879 Jun 17 15:11:11.294794 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 8/13] 10.222.0.48 () {58 vars in 1247 bytes} [Fri Jun 17 15:11:11 2022] DELETE /compute/v2.1/os-volumes/fc4ae535-4c9a-41a9-8575-db28ba0d83a7 => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 15:11:11.305197 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-140809b6-87b3-4895-b0f9-3d56d8102e0e tempest-VolumesSnapshotsTestJSON-1909647846 tempest-VolumesSnapshotsTestJSON-1909647846-project] Calling method '.version_select at 0x7faf5219e700>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:11:11.392698 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.quota [None req-693c6cab-2a3f-493e-acfb-53a1c9d2f518 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Getting quotas for project 0c87a857ab3949459349d3528ed05775. Resources: {'key_pairs'} {{(pid=117649) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 15:11:11.422504 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-140809b6-87b3-4895-b0f9-3d56d8102e0e tempest-VolumesSnapshotsTestJSON-1909647846 tempest-VolumesSnapshotsTestJSON-1909647846-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/fc4ae535-4c9a-41a9-8575-db28ba0d83a7" status: 200 len: 344 microversion: 2.1 time: 0.122382 Jun 17 15:11:11.423616 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 9/14] 10.222.0.48 () {58 vars in 1244 bytes} [Fri Jun 17 15:11:11 2022] GET /compute/v2.1/os-volumes/fc4ae535-4c9a-41a9-8575-db28ba0d83a7 => generated 344 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:11:11.429446 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.quota [None req-693c6cab-2a3f-493e-acfb-53a1c9d2f518 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Getting quotas for user 9aaf800af45049739ed8f27979e90a9e and project 0c87a857ab3949459349d3528ed05775. Resources: {'key_pairs'} {{(pid=117649) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 15:11:11.543910 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-693c6cab-2a3f-493e-acfb-53a1c9d2f518 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.756870 Jun 17 15:11:11.544972 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 6/15] 10.222.0.48 () {62 vars in 1199 bytes} [Fri Jun 17 15:11:10 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 758 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 17 15:11:12.442163 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-2051e008-c2c1-4a12-8924-46796cf85ee9 tempest-VolumesSnapshotsTestJSON-1909647846 tempest-VolumesSnapshotsTestJSON-1909647846-project] Calling method '.version_select at 0x7faf5219edc0>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:11:12.525584 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.wsgi [None req-2051e008-c2c1-4a12-8924-46796cf85ee9 tempest-VolumesSnapshotsTestJSON-1909647846 tempest-VolumesSnapshotsTestJSON-1909647846-project] HTTP exception thrown: Volume fc4ae535-4c9a-41a9-8575-db28ba0d83a7 could not be found. Jun 17 15:11:12.529538 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-2051e008-c2c1-4a12-8924-46796cf85ee9 tempest-VolumesSnapshotsTestJSON-1909647846 tempest-VolumesSnapshotsTestJSON-1909647846-project] Request method failure captured: Jun 17 15:11:12.529538 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: request: GET /compute/v2.1/os-volumes/fc4ae535-4c9a-41a9-8575-db28ba0d83a7 HTTP/1.1 Jun 17 15:11:12.529538 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Accept: application/json Jun 17 15:11:12.529538 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Accept-Encoding: identity Jun 17 15:11:12.529538 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Connection: close Jun 17 15:11:12.529538 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Content-Length: 0 Jun 17 15:11:12.529538 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Content-Type: application/json Jun 17 15:11:12.529538 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Host: 10.222.0.48 Jun 17 15:11:12.529538 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Openstack-System-Scope: None Jun 17 15:11:12.529538 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: User-Agent: python-urllib3/1.26.9 Jun 17 15:11:12.529538 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Auth-Token: gAAAAABirJmC_05x3D4Q3hh6q876rrmrpq3uceX0QsYVFXhSjPjc0ZDP23eO6GGvLPjrS4qKNHn0D3iVg02vV2jPyF0dnyfUQ3VTbdfFbKODT7gqlwKcc9-0jQ0dJgAU0CydjrvDhuNiZIdWhiN0Jh0x0UJPrIvsTvSlGux56Wt17cp-vIALRwg Jun 17 15:11:12.529538 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Domain-Id: None Jun 17 15:11:12.529538 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Domain-Name: None Jun 17 15:11:12.529538 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Identity-Status: Confirmed Jun 17 15:11:12.529538 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Is-Admin-Project: True Jun 17 15:11:12.529538 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Domain-Id: default Jun 17 15:11:12.529538 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Domain-Name: Default Jun 17 15:11:12.529538 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Id: e8a1a46d3acc486f8767b3642c2cdc16 Jun 17 15:11:12.529538 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1909647846 Jun 17 15:11:12.529538 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Role: reader,member Jun 17 15:11:12.529538 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Roles: reader,member Jun 17 15:11:12.530628 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e8a1a46d3acc486f8767b3642c2cdc16", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e8a1a46d3acc486f8767b3642c2cdc16"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e8a1a46d3acc486f8767b3642c2cdc16"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e8a1a46d3acc486f8767b3642c2cdc16"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Jun 17 15:11:12.530628 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1909647846 Jun 17 15:11:12.530628 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant-Id: e8a1a46d3acc486f8767b3642c2cdc16 Jun 17 15:11:12.530628 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1909647846 Jun 17 15:11:12.530628 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User: tempest-VolumesSnapshotsTestJSON-1909647846-project Jun 17 15:11:12.530628 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Domain-Id: default Jun 17 15:11:12.530628 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Domain-Name: Default Jun 17 15:11:12.530628 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Id: c1e34787cf0448329efd7548216041a7 Jun 17 15:11:12.530628 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1909647846-project Jun 17 15:11:12.530628 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: method: Jun 17 15:11:12.530628 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: exception: Volume fc4ae535-4c9a-41a9-8575-db28ba0d83a7 could not be found. Jun 17 15:11:12.530628 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: action_args: {'id': 'fc4ae535-4c9a-41a9-8575-db28ba0d83a7'} Jun 17 15:11:12.530628 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 15:11:12.531248 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:11:12.531248 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 15:11:12.531248 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 15:11:12.531248 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 17 15:11:12.531248 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 17 15:11:12.531248 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 17 15:11:12.531248 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 17 15:11:12.531248 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 17 15:11:12.531248 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 17 15:11:12.531248 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 17 15:11:12.531248 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 17 15:11:12.531248 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 15:11:12.531248 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 15:11:12.531248 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 15:11:12.531248 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 15:11:12.531248 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume fc4ae535-4c9a-41a9-8575-db28ba0d83a7 could not be found. (HTTP 404) (Request-ID: req-9ea6a03e-72a2-4a0c-a6d7-110c90fcd991) Jun 17 15:11:12.531248 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:11:12.531248 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:11:12.531248 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:11:12.532113 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:11:12.532113 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 17 15:11:12.532113 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 17 15:11:12.532113 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 15:11:12.532113 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 15:11:12.532113 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 17 15:11:12.532113 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 17 15:11:12.532113 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 15:11:12.532113 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 15:11:12.532113 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 15:11:12.532113 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 15:11:12.532113 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 17 15:11:12.532113 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 17 15:11:12.532113 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 17 15:11:12.532113 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 17 15:11:12.532113 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 17 15:11:12.532113 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 17 15:11:12.532113 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 17 15:11:12.532113 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 17 15:11:12.534229 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 15:11:12.534229 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 15:11:12.534229 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 15:11:12.534229 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 15:11:12.534229 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume fc4ae535-4c9a-41a9-8575-db28ba0d83a7 could not be found. Jun 17 15:11:12.534229 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:11:12.534229 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:11:12.534229 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:11:12.534229 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:11:12.534229 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:11:12.534229 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:11:12.534229 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 15:11:12.534229 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 15:11:12.534229 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 17 15:11:12.534229 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 17 15:11:12.534229 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 15:11:12.534229 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 15:11:12.534229 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 17 15:11:12.534229 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 15:11:12.535124 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume fc4ae535-4c9a-41a9-8575-db28ba0d83a7 could not be found. Jun 17 15:11:12.535124 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:11:12.535124 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:11:12.535124 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:11:12.535124 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:11:12.535124 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:11:12.535124 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:11:12.535124 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 15:11:12.535124 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 15:11:12.535124 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume fc4ae535-4c9a-41a9-8575-db28ba0d83a7 could not be found. Jun 17 15:11:12.535124 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:11:12.535124 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-2051e008-c2c1-4a12-8924-46796cf85ee9 tempest-VolumesSnapshotsTestJSON-1909647846 tempest-VolumesSnapshotsTestJSON-1909647846-project] Returning 404 to user: Volume fc4ae535-4c9a-41a9-8575-db28ba0d83a7 could not be found. {{(pid=117650) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 15:11:12.535124 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-2051e008-c2c1-4a12-8924-46796cf85ee9 tempest-VolumesSnapshotsTestJSON-1909647846 tempest-VolumesSnapshotsTestJSON-1909647846-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/fc4ae535-4c9a-41a9-8575-db28ba0d83a7" status: 404 len: 109 microversion: 2.1 time: 0.098591 Jun 17 15:11:12.539116 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 10/16] 10.222.0.48 () {58 vars in 1244 bytes} [Fri Jun 17 15:11:12 2022] GET /compute/v2.1/os-volumes/fc4ae535-4c9a-41a9-8575-db28ba0d83a7 => generated 109 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 15:11:12.548435 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-b33a969e-eaa3-4a50-8c08-b346728e5133 tempest-VolumesSnapshotsTestJSON-1909647846 tempest-VolumesSnapshotsTestJSON-1909647846-project] Calling method '.version_select at 0x7faf5218de50>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:11:12.619055 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.wsgi [None req-b33a969e-eaa3-4a50-8c08-b346728e5133 tempest-VolumesSnapshotsTestJSON-1909647846 tempest-VolumesSnapshotsTestJSON-1909647846-project] HTTP exception thrown: Volume fc4ae535-4c9a-41a9-8575-db28ba0d83a7 could not be found. Jun 17 15:11:12.625075 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-b33a969e-eaa3-4a50-8c08-b346728e5133 tempest-VolumesSnapshotsTestJSON-1909647846 tempest-VolumesSnapshotsTestJSON-1909647846-project] Request method failure captured: Jun 17 15:11:12.625075 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: request: DELETE /compute/v2.1/os-volumes/fc4ae535-4c9a-41a9-8575-db28ba0d83a7 HTTP/1.1 Jun 17 15:11:12.625075 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Accept: application/json Jun 17 15:11:12.625075 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Accept-Encoding: identity Jun 17 15:11:12.625075 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Connection: close Jun 17 15:11:12.625075 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Content-Length: 0 Jun 17 15:11:12.625075 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Content-Type: application/json Jun 17 15:11:12.625075 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Host: 10.222.0.48 Jun 17 15:11:12.625075 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Openstack-System-Scope: None Jun 17 15:11:12.625075 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: User-Agent: python-urllib3/1.26.9 Jun 17 15:11:12.625075 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Auth-Token: gAAAAABirJmC_05x3D4Q3hh6q876rrmrpq3uceX0QsYVFXhSjPjc0ZDP23eO6GGvLPjrS4qKNHn0D3iVg02vV2jPyF0dnyfUQ3VTbdfFbKODT7gqlwKcc9-0jQ0dJgAU0CydjrvDhuNiZIdWhiN0Jh0x0UJPrIvsTvSlGux56Wt17cp-vIALRwg Jun 17 15:11:12.625075 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Domain-Id: None Jun 17 15:11:12.625075 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Domain-Name: None Jun 17 15:11:12.625075 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Identity-Status: Confirmed Jun 17 15:11:12.625075 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Is-Admin-Project: True Jun 17 15:11:12.625075 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Domain-Id: default Jun 17 15:11:12.625075 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Domain-Name: Default Jun 17 15:11:12.625075 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Id: e8a1a46d3acc486f8767b3642c2cdc16 Jun 17 15:11:12.625075 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1909647846 Jun 17 15:11:12.625075 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Role: reader,member Jun 17 15:11:12.625075 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Roles: reader,member Jun 17 15:11:12.626682 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e8a1a46d3acc486f8767b3642c2cdc16", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e8a1a46d3acc486f8767b3642c2cdc16"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e8a1a46d3acc486f8767b3642c2cdc16"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e8a1a46d3acc486f8767b3642c2cdc16"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Jun 17 15:11:12.626682 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1909647846 Jun 17 15:11:12.626682 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant-Id: e8a1a46d3acc486f8767b3642c2cdc16 Jun 17 15:11:12.626682 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1909647846 Jun 17 15:11:12.626682 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User: tempest-VolumesSnapshotsTestJSON-1909647846-project Jun 17 15:11:12.626682 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Domain-Id: default Jun 17 15:11:12.626682 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Domain-Name: Default Jun 17 15:11:12.626682 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Id: c1e34787cf0448329efd7548216041a7 Jun 17 15:11:12.626682 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1909647846-project Jun 17 15:11:12.626682 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: method: Jun 17 15:11:12.626682 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: exception: Volume fc4ae535-4c9a-41a9-8575-db28ba0d83a7 could not be found. Jun 17 15:11:12.626682 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: action_args: {'id': 'fc4ae535-4c9a-41a9-8575-db28ba0d83a7'} Jun 17 15:11:12.626682 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 15:11:12.627528 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:11:12.627528 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 15:11:12.627528 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 15:11:12.627528 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 17 15:11:12.627528 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 17 15:11:12.627528 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 17 15:11:12.627528 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 17 15:11:12.627528 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 17 15:11:12.627528 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 17 15:11:12.627528 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 17 15:11:12.627528 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 17 15:11:12.627528 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 15:11:12.627528 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 15:11:12.627528 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 15:11:12.627528 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 15:11:12.627528 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume fc4ae535-4c9a-41a9-8575-db28ba0d83a7 could not be found. (HTTP 404) (Request-ID: req-508e04f0-f1fb-4d45-b311-b0b7738a11bd) Jun 17 15:11:12.627528 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:11:12.627528 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:11:12.627528 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:11:12.628607 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:11:12.628607 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 17 15:11:12.628607 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 17 15:11:12.628607 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 15:11:12.628607 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 15:11:12.628607 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 17 15:11:12.628607 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 17 15:11:12.628607 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 15:11:12.628607 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 15:11:12.628607 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 15:11:12.628607 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 15:11:12.628607 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 17 15:11:12.628607 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 17 15:11:12.628607 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 17 15:11:12.628607 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 17 15:11:12.628607 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 17 15:11:12.628607 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 17 15:11:12.628607 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 17 15:11:12.628607 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 17 15:11:12.629648 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 15:11:12.629648 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 15:11:12.629648 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 15:11:12.629648 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 15:11:12.629648 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume fc4ae535-4c9a-41a9-8575-db28ba0d83a7 could not be found. Jun 17 15:11:12.629648 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:11:12.629648 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:11:12.629648 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:11:12.629648 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:11:12.629648 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:11:12.629648 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:11:12.629648 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 15:11:12.629648 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 15:11:12.629648 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 17 15:11:12.629648 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 17 15:11:12.629648 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 15:11:12.629648 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 15:11:12.629648 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 17 15:11:12.629648 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 15:11:12.630677 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume fc4ae535-4c9a-41a9-8575-db28ba0d83a7 could not be found. Jun 17 15:11:12.630677 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:11:12.630677 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:11:12.630677 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:11:12.630677 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:11:12.630677 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:11:12.630677 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:11:12.630677 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 15:11:12.630677 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 15:11:12.630677 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume fc4ae535-4c9a-41a9-8575-db28ba0d83a7 could not be found. Jun 17 15:11:12.630677 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:11:12.630677 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-b33a969e-eaa3-4a50-8c08-b346728e5133 tempest-VolumesSnapshotsTestJSON-1909647846 tempest-VolumesSnapshotsTestJSON-1909647846-project] Returning 404 to user: Volume fc4ae535-4c9a-41a9-8575-db28ba0d83a7 could not be found. {{(pid=117649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 15:11:12.630677 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-b33a969e-eaa3-4a50-8c08-b346728e5133 tempest-VolumesSnapshotsTestJSON-1909647846 tempest-VolumesSnapshotsTestJSON-1909647846-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/fc4ae535-4c9a-41a9-8575-db28ba0d83a7" status: 404 len: 109 microversion: 2.1 time: 0.087179 Jun 17 15:11:12.630677 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 7/17] 10.222.0.48 () {58 vars in 1247 bytes} [Fri Jun 17 15:11:12 2022] DELETE /compute/v2.1/os-volumes/fc4ae535-4c9a-41a9-8575-db28ba0d83a7 => generated 109 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 15:11:12.644459 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-6925ab45-4a03-400d-9d8b-c16c062c7672 tempest-VolumesSnapshotsTestJSON-1909647846 tempest-VolumesSnapshotsTestJSON-1909647846-project] Calling method '.version_select at 0x7faf5192e310>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:11:12.725680 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.wsgi [None req-6925ab45-4a03-400d-9d8b-c16c062c7672 tempest-VolumesSnapshotsTestJSON-1909647846 tempest-VolumesSnapshotsTestJSON-1909647846-project] HTTP exception thrown: Volume fc4ae535-4c9a-41a9-8575-db28ba0d83a7 could not be found. Jun 17 15:11:12.728447 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-6925ab45-4a03-400d-9d8b-c16c062c7672 tempest-VolumesSnapshotsTestJSON-1909647846 tempest-VolumesSnapshotsTestJSON-1909647846-project] Request method failure captured: Jun 17 15:11:12.728447 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: request: GET /compute/v2.1/os-volumes/fc4ae535-4c9a-41a9-8575-db28ba0d83a7 HTTP/1.1 Jun 17 15:11:12.728447 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Accept: application/json Jun 17 15:11:12.728447 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Accept-Encoding: identity Jun 17 15:11:12.728447 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Connection: close Jun 17 15:11:12.728447 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Content-Length: 0 Jun 17 15:11:12.728447 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Content-Type: application/json Jun 17 15:11:12.728447 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Host: 10.222.0.48 Jun 17 15:11:12.728447 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Openstack-System-Scope: None Jun 17 15:11:12.728447 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: User-Agent: python-urllib3/1.26.9 Jun 17 15:11:12.728447 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Auth-Token: gAAAAABirJmC_05x3D4Q3hh6q876rrmrpq3uceX0QsYVFXhSjPjc0ZDP23eO6GGvLPjrS4qKNHn0D3iVg02vV2jPyF0dnyfUQ3VTbdfFbKODT7gqlwKcc9-0jQ0dJgAU0CydjrvDhuNiZIdWhiN0Jh0x0UJPrIvsTvSlGux56Wt17cp-vIALRwg Jun 17 15:11:12.728447 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Domain-Id: None Jun 17 15:11:12.728447 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Domain-Name: None Jun 17 15:11:12.728447 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Identity-Status: Confirmed Jun 17 15:11:12.728447 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Is-Admin-Project: True Jun 17 15:11:12.728447 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Domain-Id: default Jun 17 15:11:12.728447 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Domain-Name: Default Jun 17 15:11:12.728447 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Id: e8a1a46d3acc486f8767b3642c2cdc16 Jun 17 15:11:12.728447 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1909647846 Jun 17 15:11:12.728447 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Role: reader,member Jun 17 15:11:12.728447 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Roles: reader,member Jun 17 15:11:12.729590 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e8a1a46d3acc486f8767b3642c2cdc16", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e8a1a46d3acc486f8767b3642c2cdc16"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e8a1a46d3acc486f8767b3642c2cdc16"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e8a1a46d3acc486f8767b3642c2cdc16"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Jun 17 15:11:12.729590 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1909647846 Jun 17 15:11:12.729590 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant-Id: e8a1a46d3acc486f8767b3642c2cdc16 Jun 17 15:11:12.729590 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1909647846 Jun 17 15:11:12.729590 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User: tempest-VolumesSnapshotsTestJSON-1909647846-project Jun 17 15:11:12.729590 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Domain-Id: default Jun 17 15:11:12.729590 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Domain-Name: Default Jun 17 15:11:12.729590 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Id: c1e34787cf0448329efd7548216041a7 Jun 17 15:11:12.729590 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1909647846-project Jun 17 15:11:12.729590 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: method: Jun 17 15:11:12.729590 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: exception: Volume fc4ae535-4c9a-41a9-8575-db28ba0d83a7 could not be found. Jun 17 15:11:12.729590 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: action_args: {'id': 'fc4ae535-4c9a-41a9-8575-db28ba0d83a7'} Jun 17 15:11:12.729590 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 15:11:12.730363 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:11:12.730363 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 15:11:12.730363 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 15:11:12.730363 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 17 15:11:12.730363 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 17 15:11:12.730363 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 17 15:11:12.730363 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 17 15:11:12.730363 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 17 15:11:12.730363 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 17 15:11:12.730363 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 17 15:11:12.730363 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 17 15:11:12.730363 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 15:11:12.730363 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 15:11:12.730363 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 15:11:12.730363 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 15:11:12.730363 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume fc4ae535-4c9a-41a9-8575-db28ba0d83a7 could not be found. (HTTP 404) (Request-ID: req-7b9c6e6e-62ce-4c51-b673-95ec84e6fe85) Jun 17 15:11:12.730363 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:11:12.730363 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:11:12.730363 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:11:12.731393 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:11:12.731393 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 17 15:11:12.731393 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 17 15:11:12.731393 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 15:11:12.731393 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 15:11:12.731393 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 17 15:11:12.731393 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 17 15:11:12.731393 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 15:11:12.731393 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 15:11:12.731393 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 15:11:12.731393 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 15:11:12.731393 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 17 15:11:12.731393 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 17 15:11:12.731393 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 17 15:11:12.731393 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 17 15:11:12.731393 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 17 15:11:12.731393 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 17 15:11:12.731393 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 17 15:11:12.731393 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 17 15:11:12.732299 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 15:11:12.732299 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 15:11:12.732299 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 15:11:12.732299 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 15:11:12.732299 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume fc4ae535-4c9a-41a9-8575-db28ba0d83a7 could not be found. Jun 17 15:11:12.732299 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:11:12.732299 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:11:12.732299 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:11:12.732299 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:11:12.732299 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:11:12.732299 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:11:12.732299 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 15:11:12.732299 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 15:11:12.732299 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 17 15:11:12.732299 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 17 15:11:12.732299 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 15:11:12.732299 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 15:11:12.732299 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 17 15:11:12.732299 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 15:11:12.733446 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume fc4ae535-4c9a-41a9-8575-db28ba0d83a7 could not be found. Jun 17 15:11:12.733446 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:11:12.733446 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:11:12.733446 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:11:12.733446 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:11:12.733446 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:11:12.733446 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:11:12.733446 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 15:11:12.733446 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 15:11:12.733446 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume fc4ae535-4c9a-41a9-8575-db28ba0d83a7 could not be found. Jun 17 15:11:12.733446 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:11:12.734909 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-6925ab45-4a03-400d-9d8b-c16c062c7672 tempest-VolumesSnapshotsTestJSON-1909647846 tempest-VolumesSnapshotsTestJSON-1909647846-project] Returning 404 to user: Volume fc4ae535-4c9a-41a9-8575-db28ba0d83a7 could not be found. {{(pid=117649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 15:11:12.735751 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-6925ab45-4a03-400d-9d8b-c16c062c7672 tempest-VolumesSnapshotsTestJSON-1909647846 tempest-VolumesSnapshotsTestJSON-1909647846-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/fc4ae535-4c9a-41a9-8575-db28ba0d83a7" status: 404 len: 109 microversion: 2.1 time: 0.103876 Jun 17 15:11:12.736448 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 8/18] 10.222.0.48 () {58 vars in 1244 bytes} [Fri Jun 17 15:11:12 2022] GET /compute/v2.1/os-volumes/fc4ae535-4c9a-41a9-8575-db28ba0d83a7 => generated 109 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 15:11:13.293962 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-39891620-2e9b-46cf-acfc-335edbd944df tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2009179905", "imageRef": "8c105ca4-6fe3-4e70-af71-b03c64fe1efe", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:11:13.551372 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.network.neutron [None req-39891620-2e9b-46cf-acfc-335edbd944df tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] validate_networks() for [('3a4e37db-e344-461b-88a0-74065462698f', None, None, None, None, None)] {{(pid=117650) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 15:11:15.723889 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-91f30fc4-b5fc-429b-9b68-0aba99559c8a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-435760854", "imageRef": "8c105ca4-6fe3-4e70-af71-b03c64fe1efe", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9464a8d4-29ca-4ca6-886d-c4dd585ea876"}], "security_groups": [{"name": "tempest-securitygroup--778211236"}], "key_name": "tempest-keypair-238480590", "user_data": "}} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:11:16.100429 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.network.neutron [None req-91f30fc4-b5fc-429b-9b68-0aba99559c8a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] validate_networks() for [('9464a8d4-29ca-4ca6-886d-c4dd585ea876', None, None, None, None, None)] {{(pid=117649) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 15:11:16.419072 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.virt.hardware [None req-39891620-2e9b-46cf-acfc-335edbd944df tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Flavor limits 0:0:0 {{(pid=117650) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 15:11:16.419576 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.virt.hardware [None req-39891620-2e9b-46cf-acfc-335edbd944df tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Image limits 0:0:0 {{(pid=117650) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 15:11:16.419955 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.virt.hardware [None req-39891620-2e9b-46cf-acfc-335edbd944df tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Flavor pref 0:0:0 {{(pid=117650) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 15:11:16.422132 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.virt.hardware [None req-39891620-2e9b-46cf-acfc-335edbd944df tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Image pref 0:0:0 {{(pid=117650) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 15:11:16.422693 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.virt.hardware [None req-39891620-2e9b-46cf-acfc-335edbd944df tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117650) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 15:11:16.466601 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-39891620-2e9b-46cf-acfc-335edbd944df tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:16.467052 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-39891620-2e9b-46cf-acfc-335edbd944df tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:16.467852 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-39891620-2e9b-46cf-acfc-335edbd944df tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:16.468289 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-39891620-2e9b-46cf-acfc-335edbd944df tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:16.562055 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.quota [None req-39891620-2e9b-46cf-acfc-335edbd944df tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Getting quotas for project 50408ec18fa04036a0abb6236343e258. Resources: {'cores', 'ram', 'instances'} {{(pid=117650) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 15:11:16.572569 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.quota [None req-39891620-2e9b-46cf-acfc-335edbd944df tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Getting quotas for user 562485deaf214fa29eac132464ef93e3 and project 50408ec18fa04036a0abb6236343e258. Resources: {'cores', 'ram', 'instances'} {{(pid=117650) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 15:11:16.592708 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-39891620-2e9b-46cf-acfc-335edbd944df tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Going to run 1 instances... {{(pid=117650) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 15:11:16.596572 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-39891620-2e9b-46cf-acfc-335edbd944df tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: 8f90be07-f969-4dc7-b8ab-a5a41f850645] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c105ca4-6fe3-4e70-af71-b03c64fe1efe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117650) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 15:11:16.728538 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-39891620-2e9b-46cf-acfc-335edbd944df tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.157867 Jun 17 15:11:16.737129 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 11/19] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Jun 17 15:11:12 2022] POST /compute/v2.1/servers => generated 383 bytes in 4168 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 17 15:11:17.323847 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-48b71e26-6c05-492e-9935-fe937570e694 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2010455456", "imageRef": "8c105ca4-6fe3-4e70-af71-b03c64fe1efe", "flavorRef": "452", "networks": [{"uuid": "2a94f04d-a03c-4af2-9ebd-666f6c00ddbd"}]}} {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:11:17.435169 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.network.neutron [None req-48b71e26-6c05-492e-9935-fe937570e694 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] validate_networks() for [('2a94f04d-a03c-4af2-9ebd-666f6c00ddbd', None, None, None, None, None)] {{(pid=117650) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 15:11:18.400698 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-91f30fc4-b5fc-429b-9b68-0aba99559c8a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Flavor limits 0:0:0 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 15:11:18.401254 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-91f30fc4-b5fc-429b-9b68-0aba99559c8a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Image limits 0:0:0 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 15:11:18.401809 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-91f30fc4-b5fc-429b-9b68-0aba99559c8a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Flavor pref 0:0:0 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 15:11:18.402417 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-91f30fc4-b5fc-429b-9b68-0aba99559c8a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Image pref 0:0:0 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 15:11:18.402940 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-91f30fc4-b5fc-429b-9b68-0aba99559c8a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 15:11:18.433968 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-91f30fc4-b5fc-429b-9b68-0aba99559c8a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:18.435582 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-91f30fc4-b5fc-429b-9b68-0aba99559c8a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:18.439539 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-91f30fc4-b5fc-429b-9b68-0aba99559c8a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:18.441745 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-91f30fc4-b5fc-429b-9b68-0aba99559c8a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:18.487051 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.virt.hardware [None req-48b71e26-6c05-492e-9935-fe937570e694 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Flavor limits 0:0:0 {{(pid=117650) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 15:11:18.488158 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.virt.hardware [None req-48b71e26-6c05-492e-9935-fe937570e694 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Image limits 0:0:0 {{(pid=117650) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 15:11:18.488951 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.virt.hardware [None req-48b71e26-6c05-492e-9935-fe937570e694 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Flavor pref 0:0:0 {{(pid=117650) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 15:11:18.489505 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.virt.hardware [None req-48b71e26-6c05-492e-9935-fe937570e694 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Image pref 0:0:0 {{(pid=117650) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 15:11:18.491065 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.virt.hardware [None req-48b71e26-6c05-492e-9935-fe937570e694 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117650) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 15:11:18.502056 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-48b71e26-6c05-492e-9935-fe937570e694 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:18.503222 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-48b71e26-6c05-492e-9935-fe937570e694 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:18.504179 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-48b71e26-6c05-492e-9935-fe937570e694 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:18.504822 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-48b71e26-6c05-492e-9935-fe937570e694 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:18.540078 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.quota [None req-91f30fc4-b5fc-429b-9b68-0aba99559c8a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Getting quotas for project 0c87a857ab3949459349d3528ed05775. Resources: {'cores', 'ram', 'instances'} {{(pid=117649) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 15:11:18.540945 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.quota [None req-48b71e26-6c05-492e-9935-fe937570e694 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Getting quotas for project fa9c2c0819ea44c491b641d564d4cec7. Resources: {'cores', 'ram', 'instances'} {{(pid=117650) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 15:11:18.546418 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.quota [None req-48b71e26-6c05-492e-9935-fe937570e694 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Getting quotas for user 384629ef0b104b8f8cbafdc56b16268b and project fa9c2c0819ea44c491b641d564d4cec7. Resources: {'cores', 'ram', 'instances'} {{(pid=117650) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 15:11:18.559200 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.quota [None req-91f30fc4-b5fc-429b-9b68-0aba99559c8a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Getting quotas for user 9aaf800af45049739ed8f27979e90a9e and project 0c87a857ab3949459349d3528ed05775. Resources: {'cores', 'ram', 'instances'} {{(pid=117649) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 15:11:18.564565 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-48b71e26-6c05-492e-9935-fe937570e694 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Going to run 1 instances... {{(pid=117650) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 15:11:18.566716 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-48b71e26-6c05-492e-9935-fe937570e694 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] [instance: 32c49b67-aa8e-4d47-81d1-89b815c998b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c105ca4-6fe3-4e70-af71-b03c64fe1efe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117650) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 15:11:18.601682 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-91f30fc4-b5fc-429b-9b68-0aba99559c8a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Going to run 1 instances... {{(pid=117649) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 15:11:18.609085 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-91f30fc4-b5fc-429b-9b68-0aba99559c8a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c105ca4-6fe3-4e70-af71-b03c64fe1efe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117649) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 15:11:18.661255 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-48b71e26-6c05-492e-9935-fe937570e694 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.919503 Jun 17 15:11:18.675403 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 12/20] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Jun 17 15:11:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1937 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 15:11:18.690228 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-75bacace-f5f9-4c1a-b4bb-74010de16687 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:11:18.695638 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-75bacace-f5f9-4c1a-b4bb-74010de16687 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: 8f90be07-f969-4dc7-b8ab-a5a41f850645] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:11:18.826925 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-91f30fc4-b5fc-429b-9b68-0aba99559c8a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 3.107767 Jun 17 15:11:18.827742 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 9/21] 10.222.0.48 () {62 vars in 1187 bytes} [Fri Jun 17 15:11:15 2022] POST /compute/v2.1/servers => generated 401 bytes in 3112 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 17 15:11:18.843263 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-b6755903-c7e8-4ebc-b900-044230a5c786 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:11:18.847756 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-b6755903-c7e8-4ebc-b900-044230a5c786 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] [instance: 32c49b67-aa8e-4d47-81d1-89b815c998b4] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:11:18.984057 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-75bacace-f5f9-4c1a-b4bb-74010de16687 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:19.031350 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-75bacace-f5f9-4c1a-b4bb-74010de16687 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/8f90be07-f969-4dc7-b8ab-a5a41f850645" status: 200 len: 1222 microversion: 2.1 time: 0.352015 Jun 17 15:11:19.060959 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 13/22] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:11:18 2022] GET /compute/v2.1/servers/8f90be07-f969-4dc7-b8ab-a5a41f850645 => generated 1222 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:11:19.068582 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-6dfa6496-27c0-44b5-b67d-a8a59dcb9854 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:11:19.069431 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-6dfa6496-27c0-44b5-b67d-a8a59dcb9854 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:11:19.178364 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-6dfa6496-27c0-44b5-b67d-a8a59dcb9854 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:19.191340 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-6dfa6496-27c0-44b5-b67d-a8a59dcb9854 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:19.195773 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-6dfa6496-27c0-44b5-b67d-a8a59dcb9854 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:19.197496 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-6dfa6496-27c0-44b5-b67d-a8a59dcb9854 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1280 microversion: 2.20 time: 0.134817 Jun 17 15:11:19.214337 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 14/23] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:11:19 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1280 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:11:19.230613 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-b6755903-c7e8-4ebc-b900-044230a5c786 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384629ef0b104b8f8cbafdc56b16268b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa9c2c0819ea44c491b641d564d4cec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:19.287826 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-b6755903-c7e8-4ebc-b900-044230a5c786 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] 10.222.0.48 "GET /compute/v2.1/servers/32c49b67-aa8e-4d47-81d1-89b815c998b4" status: 200 len: 1215 microversion: 2.1 time: 0.458585 Jun 17 15:11:19.301933 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 10/24] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:11:18 2022] GET /compute/v2.1/servers/32c49b67-aa8e-4d47-81d1-89b815c998b4 => generated 1215 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:11:20.041364 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-97545949-5910-4b85-a002-a571dc620ac3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-315280921", "imageRef": "8c105ca4-6fe3-4e70-af71-b03c64fe1efe", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:11:20.171594 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.network.neutron [None req-97545949-5910-4b85-a002-a571dc620ac3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] validate_networks() for [('3a4e37db-e344-461b-88a0-74065462698f', None, None, None, None, None)] {{(pid=117650) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 15:11:20.220782 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-d2f76bdf-73f9-4566-9d6b-0576b9161b1e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:11:20.221426 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-d2f76bdf-73f9-4566-9d6b-0576b9161b1e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:11:20.435874 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-d2f76bdf-73f9-4566-9d6b-0576b9161b1e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:20.452064 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-d2f76bdf-73f9-4566-9d6b-0576b9161b1e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:20.456479 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-d2f76bdf-73f9-4566-9d6b-0576b9161b1e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:20.460173 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-d2f76bdf-73f9-4566-9d6b-0576b9161b1e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1280 microversion: 2.20 time: 0.243731 Jun 17 15:11:20.466372 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 11/25] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:11:20 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1280 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:11:20.485523 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-7366d425-5975-42dd-bc5e-f27cb202dfd4 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:11:20.490276 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-7366d425-5975-42dd-bc5e-f27cb202dfd4 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] [instance: 32c49b67-aa8e-4d47-81d1-89b815c998b4] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:11:20.629529 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-7366d425-5975-42dd-bc5e-f27cb202dfd4 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384629ef0b104b8f8cbafdc56b16268b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa9c2c0819ea44c491b641d564d4cec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:20.638874 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-7366d425-5975-42dd-bc5e-f27cb202dfd4 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] 10.222.0.48 "GET /compute/v2.1/servers/32c49b67-aa8e-4d47-81d1-89b815c998b4" status: 200 len: 1215 microversion: 2.1 time: 0.171024 Jun 17 15:11:20.639469 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 12/26] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:11:20 2022] GET /compute/v2.1/servers/32c49b67-aa8e-4d47-81d1-89b815c998b4 => generated 1215 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:11:21.730686 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.virt.hardware [None req-97545949-5910-4b85-a002-a571dc620ac3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Flavor limits 0:0:0 {{(pid=117650) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 15:11:21.731792 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.virt.hardware [None req-97545949-5910-4b85-a002-a571dc620ac3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Image limits 0:0:0 {{(pid=117650) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 15:11:21.733105 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.virt.hardware [None req-97545949-5910-4b85-a002-a571dc620ac3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Flavor pref 0:0:0 {{(pid=117650) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 15:11:21.733545 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.virt.hardware [None req-97545949-5910-4b85-a002-a571dc620ac3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Image pref 0:0:0 {{(pid=117650) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 15:11:21.734036 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.virt.hardware [None req-97545949-5910-4b85-a002-a571dc620ac3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117650) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 15:11:21.768483 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-97545949-5910-4b85-a002-a571dc620ac3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:21.769997 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-97545949-5910-4b85-a002-a571dc620ac3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:21.773729 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-97545949-5910-4b85-a002-a571dc620ac3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:21.776193 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-97545949-5910-4b85-a002-a571dc620ac3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:21.882026 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.quota [None req-97545949-5910-4b85-a002-a571dc620ac3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Getting quotas for project 50408ec18fa04036a0abb6236343e258. Resources: {'cores', 'ram', 'instances'} {{(pid=117650) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 15:11:21.898852 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.quota [None req-97545949-5910-4b85-a002-a571dc620ac3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Getting quotas for user 562485deaf214fa29eac132464ef93e3 and project 50408ec18fa04036a0abb6236343e258. Resources: {'cores', 'ram', 'instances'} {{(pid=117650) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 15:11:22.000125 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-97545949-5910-4b85-a002-a571dc620ac3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Going to run 1 instances... {{(pid=117650) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 15:11:22.003228 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-97545949-5910-4b85-a002-a571dc620ac3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: 335fa25e-3f5c-45f0-9f85-f9c4681728b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c105ca4-6fe3-4e70-af71-b03c64fe1efe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117650) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 15:11:22.034912 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-7c246762-f6c8-4f3c-a9fb-1c411140246d tempest-VolumesGetTestJSON-1443827332 tempest-VolumesGetTestJSON-1443827332-project] Action: 'create', calling method: .version_select at 0x7faf51884af0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1079501704", "metadata": {"Type": "work"}}} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:11:22.141585 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-97545949-5910-4b85-a002-a571dc620ac3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.105234 Jun 17 15:11:22.149036 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 15/27] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Jun 17 15:11:20 2022] POST /compute/v2.1/servers => generated 383 bytes in 2114 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 15:11:22.175196 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-9ee8bdce-d284-485f-8090-e55acb361059 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:11:22.176033 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-9ee8bdce-d284-485f-8090-e55acb361059 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:11:22.211694 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9ee8bdce-d284-485f-8090-e55acb361059 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:22.212898 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9ee8bdce-d284-485f-8090-e55acb361059 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:22.215936 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9ee8bdce-d284-485f-8090-e55acb361059 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:22.219723 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9ee8bdce-d284-485f-8090-e55acb361059 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:22.935266 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-9ee8bdce-d284-485f-8090-e55acb361059 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:22.975106 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-9ee8bdce-d284-485f-8090-e55acb361059 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:22.986738 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-9ee8bdce-d284-485f-8090-e55acb361059 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:22.987925 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-9ee8bdce-d284-485f-8090-e55acb361059 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1332 microversion: 2.20 time: 0.836170 Jun 17 15:11:22.999394 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 16/28] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:11:22 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1332 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:11:23.016772 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-e20fd89c-44d4-4734-a66f-6dca854f27b5 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:11:23.022936 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-e20fd89c-44d4-4734-a66f-6dca854f27b5 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] [instance: 32c49b67-aa8e-4d47-81d1-89b815c998b4] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:11:23.064116 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e20fd89c-44d4-4734-a66f-6dca854f27b5 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:23.064688 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e20fd89c-44d4-4734-a66f-6dca854f27b5 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:23.076119 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e20fd89c-44d4-4734-a66f-6dca854f27b5 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:23.076871 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e20fd89c-44d4-4734-a66f-6dca854f27b5 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:23.178294 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-7c246762-f6c8-4f3c-a9fb-1c411140246d tempest-VolumesGetTestJSON-1443827332 tempest-VolumesGetTestJSON-1443827332-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.763448 Jun 17 15:11:23.179971 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 13/29] 10.222.0.48 () {60 vars in 1155 bytes} [Fri Jun 17 15:11:21 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 1766 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 17 15:11:23.186888 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-f0611595-3609-4f24-a91c-4b3bca117020 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:11:23.190249 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-f0611595-3609-4f24-a91c-4b3bca117020 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: 335fa25e-3f5c-45f0-9f85-f9c4681728b8] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:11:23.438490 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-f0611595-3609-4f24-a91c-4b3bca117020 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:23.453363 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-f0611595-3609-4f24-a91c-4b3bca117020 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/335fa25e-3f5c-45f0-9f85-f9c4681728b8" status: 200 len: 1221 microversion: 2.1 time: 0.270940 Jun 17 15:11:23.456714 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 14/30] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:11:23 2022] GET /compute/v2.1/servers/335fa25e-3f5c-45f0-9f85-f9c4681728b8 => generated 1221 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:11:23.470664 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-01ae5990-6da8-4a78-92d7-43c256658a0c tempest-VolumesGetTestJSON-1443827332 tempest-VolumesGetTestJSON-1443827332-project] Calling method '.version_select at 0x7faf51884280>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:11:23.671940 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-e20fd89c-44d4-4734-a66f-6dca854f27b5 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384629ef0b104b8f8cbafdc56b16268b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa9c2c0819ea44c491b641d564d4cec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:23.681290 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-e20fd89c-44d4-4734-a66f-6dca854f27b5 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] 10.222.0.48 "GET /compute/v2.1/servers/32c49b67-aa8e-4d47-81d1-89b815c998b4" status: 200 len: 1273 microversion: 2.1 time: 0.681092 Jun 17 15:11:23.681993 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 17/31] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:11:22 2022] GET /compute/v2.1/servers/32c49b67-aa8e-4d47-81d1-89b815c998b4 => generated 1273 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:11:23.795326 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-01ae5990-6da8-4a78-92d7-43c256658a0c tempest-VolumesGetTestJSON-1443827332 tempest-VolumesGetTestJSON-1443827332-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/43fd64fe-f98a-425b-bb9a-ce20d10cb32c" status: 200 len: 354 microversion: 2.1 time: 0.333542 Jun 17 15:11:23.796497 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 15/32] 10.222.0.48 () {58 vars in 1244 bytes} [Fri Jun 17 15:11:23 2022] GET /compute/v2.1/os-volumes/43fd64fe-f98a-425b-bb9a-ce20d10cb32c => generated 354 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:11:23.808482 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-7174664b-f9ab-4ff3-8c51-58653ab28b18 tempest-VolumesGetTestJSON-1443827332 tempest-VolumesGetTestJSON-1443827332-project] Calling method '.version_select at 0x7faf51000af0>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:11:24.007159 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-ffabc18f-787a-4402-bce7-418e731fb433 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:11:24.008316 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-ffabc18f-787a-4402-bce7-418e731fb433 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:11:24.042650 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ffabc18f-787a-4402-bce7-418e731fb433 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:24.044641 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ffabc18f-787a-4402-bce7-418e731fb433 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:24.047941 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ffabc18f-787a-4402-bce7-418e731fb433 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:24.049582 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ffabc18f-787a-4402-bce7-418e731fb433 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:24.380073 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-7174664b-f9ab-4ff3-8c51-58653ab28b18 tempest-VolumesGetTestJSON-1443827332 tempest-VolumesGetTestJSON-1443827332-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/43fd64fe-f98a-425b-bb9a-ce20d10cb32c" status: 200 len: 354 microversion: 2.1 time: 0.576507 Jun 17 15:11:24.382070 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 18/33] 10.222.0.48 () {58 vars in 1244 bytes} [Fri Jun 17 15:11:23 2022] GET /compute/v2.1/os-volumes/43fd64fe-f98a-425b-bb9a-ce20d10cb32c => generated 354 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:11:24.400273 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-a06c4fcc-491d-4e62-aa8e-41fa5d1809aa tempest-VolumesGetTestJSON-1443827332 tempest-VolumesGetTestJSON-1443827332-project] Calling method '.version_select at 0x7faf518ab040>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:11:24.731912 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-ffabc18f-787a-4402-bce7-418e731fb433 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:24.765370 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-ffabc18f-787a-4402-bce7-418e731fb433 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:24.775945 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-ffabc18f-787a-4402-bce7-418e731fb433 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:24.777402 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-ffabc18f-787a-4402-bce7-418e731fb433 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1338 microversion: 2.20 time: 0.774351 Jun 17 15:11:24.793491 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 16/34] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:11:24 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1338 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 15:11:24.812063 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-3079dd1c-bf3e-4b71-ab52-f7c04f2e2a7f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:11:24.824047 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-3079dd1c-bf3e-4b71-ab52-f7c04f2e2a7f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: 335fa25e-3f5c-45f0-9f85-f9c4681728b8] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:11:24.840528 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3079dd1c-bf3e-4b71-ab52-f7c04f2e2a7f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:24.849025 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3079dd1c-bf3e-4b71-ab52-f7c04f2e2a7f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:24.851251 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3079dd1c-bf3e-4b71-ab52-f7c04f2e2a7f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:24.857110 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3079dd1c-bf3e-4b71-ab52-f7c04f2e2a7f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:24.973180 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-a06c4fcc-491d-4e62-aa8e-41fa5d1809aa tempest-VolumesGetTestJSON-1443827332 tempest-VolumesGetTestJSON-1443827332-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/43fd64fe-f98a-425b-bb9a-ce20d10cb32c" status: 202 len: 0 microversion: 2.1 time: 0.577921 Jun 17 15:11:24.974159 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 19/35] 10.222.0.48 () {58 vars in 1247 bytes} [Fri Jun 17 15:11:24 2022] DELETE /compute/v2.1/os-volumes/43fd64fe-f98a-425b-bb9a-ce20d10cb32c => generated 0 bytes in 580 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 15:11:24.981070 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-38b8811b-b8c8-453c-95c2-0731c96e2a17 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:11:24.990048 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-38b8811b-b8c8-453c-95c2-0731c96e2a17 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] [instance: 32c49b67-aa8e-4d47-81d1-89b815c998b4] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:11:25.011031 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-38b8811b-b8c8-453c-95c2-0731c96e2a17 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:25.011492 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-38b8811b-b8c8-453c-95c2-0731c96e2a17 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:25.020826 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-38b8811b-b8c8-453c-95c2-0731c96e2a17 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:25.021287 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-38b8811b-b8c8-453c-95c2-0731c96e2a17 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:25.361784 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-38b8811b-b8c8-453c-95c2-0731c96e2a17 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384629ef0b104b8f8cbafdc56b16268b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa9c2c0819ea44c491b641d564d4cec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:25.388923 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-38b8811b-b8c8-453c-95c2-0731c96e2a17 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] 10.222.0.48 "GET /compute/v2.1/servers/32c49b67-aa8e-4d47-81d1-89b815c998b4" status: 200 len: 1273 microversion: 2.1 time: 0.410010 Jun 17 15:11:25.404233 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 20/36] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:11:24 2022] GET /compute/v2.1/servers/32c49b67-aa8e-4d47-81d1-89b815c998b4 => generated 1273 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:11:25.415826 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-7440b66a-b890-411a-b515-bda22bc3ddac tempest-VolumesGetTestJSON-1443827332 tempest-VolumesGetTestJSON-1443827332-project] Calling method '.version_select at 0x7faf5219e9d0>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:11:25.483454 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-3079dd1c-bf3e-4b71-ab52-f7c04f2e2a7f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:25.502713 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-3079dd1c-bf3e-4b71-ab52-f7c04f2e2a7f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/335fa25e-3f5c-45f0-9f85-f9c4681728b8" status: 200 len: 1279 microversion: 2.1 time: 0.705053 Jun 17 15:11:25.505179 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 17/37] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:11:24 2022] GET /compute/v2.1/servers/335fa25e-3f5c-45f0-9f85-f9c4681728b8 => generated 1279 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:11:25.512554 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.wsgi [None req-7440b66a-b890-411a-b515-bda22bc3ddac tempest-VolumesGetTestJSON-1443827332 tempest-VolumesGetTestJSON-1443827332-project] HTTP exception thrown: Volume 43fd64fe-f98a-425b-bb9a-ce20d10cb32c could not be found. Jun 17 15:11:25.514718 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-7440b66a-b890-411a-b515-bda22bc3ddac tempest-VolumesGetTestJSON-1443827332 tempest-VolumesGetTestJSON-1443827332-project] Request method failure captured: Jun 17 15:11:25.514718 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: request: GET /compute/v2.1/os-volumes/43fd64fe-f98a-425b-bb9a-ce20d10cb32c HTTP/1.1 Jun 17 15:11:25.514718 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Accept: application/json Jun 17 15:11:25.514718 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Accept-Encoding: identity Jun 17 15:11:25.514718 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Connection: close Jun 17 15:11:25.514718 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Content-Length: 0 Jun 17 15:11:25.514718 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Content-Type: application/json Jun 17 15:11:25.514718 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Host: 10.222.0.48 Jun 17 15:11:25.514718 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Openstack-System-Scope: None Jun 17 15:11:25.514718 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: User-Agent: python-urllib3/1.26.9 Jun 17 15:11:25.514718 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Auth-Token: gAAAAABirJmZhMR7c_L-nbUMJrFPcobCmfck2Pbr4Q4ZE6iMXS3EcWW7yZ7ZQ-MgG6surGBLrfPbB9j3z0yIYQKk-eYpZ722xGpYhZVv1Z6jUWneSGpssMSwesbKU4Naxf710SWLaJxwL9YQpgPaIPWBjpfrHHCZ7UqCWNQbipMcaHS0a6zkQWo Jun 17 15:11:25.514718 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Domain-Id: None Jun 17 15:11:25.514718 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Domain-Name: None Jun 17 15:11:25.514718 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Identity-Status: Confirmed Jun 17 15:11:25.514718 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Is-Admin-Project: True Jun 17 15:11:25.514718 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Domain-Id: default Jun 17 15:11:25.514718 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Domain-Name: Default Jun 17 15:11:25.514718 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Id: 65e43c15185942eb82c36be40d688744 Jun 17 15:11:25.514718 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Name: tempest-VolumesGetTestJSON-1443827332 Jun 17 15:11:25.514718 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Role: reader,member Jun 17 15:11:25.514718 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Roles: reader,member Jun 17 15:11:25.515899 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_65e43c15185942eb82c36be40d688744", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/65e43c15185942eb82c36be40d688744"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/65e43c15185942eb82c36be40d688744"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/65e43c15185942eb82c36be40d688744"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Jun 17 15:11:25.515899 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant: tempest-VolumesGetTestJSON-1443827332 Jun 17 15:11:25.515899 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant-Id: 65e43c15185942eb82c36be40d688744 Jun 17 15:11:25.515899 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant-Name: tempest-VolumesGetTestJSON-1443827332 Jun 17 15:11:25.515899 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User: tempest-VolumesGetTestJSON-1443827332-project Jun 17 15:11:25.515899 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Domain-Id: default Jun 17 15:11:25.515899 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Domain-Name: Default Jun 17 15:11:25.515899 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Id: 537bb557380c442ba597f2467e429ab5 Jun 17 15:11:25.515899 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Name: tempest-VolumesGetTestJSON-1443827332-project Jun 17 15:11:25.515899 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: method: Jun 17 15:11:25.515899 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: exception: Volume 43fd64fe-f98a-425b-bb9a-ce20d10cb32c could not be found. Jun 17 15:11:25.515899 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: action_args: {'id': '43fd64fe-f98a-425b-bb9a-ce20d10cb32c'} Jun 17 15:11:25.515899 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 15:11:25.517688 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:11:25.517688 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 15:11:25.517688 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 15:11:25.517688 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 17 15:11:25.517688 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 17 15:11:25.517688 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 17 15:11:25.517688 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 17 15:11:25.517688 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 17 15:11:25.517688 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 17 15:11:25.517688 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 17 15:11:25.517688 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 17 15:11:25.517688 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 15:11:25.517688 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 15:11:25.517688 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 15:11:25.517688 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 15:11:25.517688 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 43fd64fe-f98a-425b-bb9a-ce20d10cb32c could not be found. (HTTP 404) (Request-ID: req-3524f311-8508-4d86-9eac-5c86be0c8a0b) Jun 17 15:11:25.517688 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:11:25.517688 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:11:25.517688 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:11:25.518690 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:11:25.518690 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 17 15:11:25.518690 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 17 15:11:25.518690 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 15:11:25.518690 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 15:11:25.518690 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 17 15:11:25.518690 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 17 15:11:25.518690 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 15:11:25.518690 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 15:11:25.518690 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 15:11:25.518690 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 15:11:25.518690 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 17 15:11:25.518690 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 17 15:11:25.518690 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 17 15:11:25.518690 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 17 15:11:25.518690 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 17 15:11:25.518690 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 17 15:11:25.518690 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 17 15:11:25.518690 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 17 15:11:25.519637 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 15:11:25.519637 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 15:11:25.519637 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 15:11:25.519637 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 15:11:25.519637 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 43fd64fe-f98a-425b-bb9a-ce20d10cb32c could not be found. Jun 17 15:11:25.519637 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:11:25.519637 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:11:25.519637 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:11:25.519637 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:11:25.519637 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:11:25.519637 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:11:25.519637 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 15:11:25.519637 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 15:11:25.519637 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 17 15:11:25.519637 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 17 15:11:25.519637 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 15:11:25.519637 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 15:11:25.519637 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 17 15:11:25.519637 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 15:11:25.523669 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 43fd64fe-f98a-425b-bb9a-ce20d10cb32c could not be found. Jun 17 15:11:25.523669 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:11:25.523669 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:11:25.523669 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:11:25.523669 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:11:25.523669 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:11:25.523669 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:11:25.523669 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 15:11:25.523669 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 15:11:25.523669 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 43fd64fe-f98a-425b-bb9a-ce20d10cb32c could not be found. Jun 17 15:11:25.523669 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:11:25.523669 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-7440b66a-b890-411a-b515-bda22bc3ddac tempest-VolumesGetTestJSON-1443827332 tempest-VolumesGetTestJSON-1443827332-project] Returning 404 to user: Volume 43fd64fe-f98a-425b-bb9a-ce20d10cb32c could not be found. {{(pid=117650) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 15:11:25.523669 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-7440b66a-b890-411a-b515-bda22bc3ddac tempest-VolumesGetTestJSON-1443827332 tempest-VolumesGetTestJSON-1443827332-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/43fd64fe-f98a-425b-bb9a-ce20d10cb32c" status: 404 len: 109 microversion: 2.1 time: 0.110804 Jun 17 15:11:25.523669 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 21/38] 10.222.0.48 () {58 vars in 1244 bytes} [Fri Jun 17 15:11:25 2022] GET /compute/v2.1/os-volumes/43fd64fe-f98a-425b-bb9a-ce20d10cb32c => generated 109 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 15:11:25.800791 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-89f1c6a8-dcb9-470f-9b45-20b002856018 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:11:25.802366 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-89f1c6a8-dcb9-470f-9b45-20b002856018 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:11:25.815210 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-89f1c6a8-dcb9-470f-9b45-20b002856018 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:25.825946 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-89f1c6a8-dcb9-470f-9b45-20b002856018 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:25.827701 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-89f1c6a8-dcb9-470f-9b45-20b002856018 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:25.847733 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-89f1c6a8-dcb9-470f-9b45-20b002856018 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:26.088058 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-89f1c6a8-dcb9-470f-9b45-20b002856018 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:26.102755 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-89f1c6a8-dcb9-470f-9b45-20b002856018 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:26.104844 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-89f1c6a8-dcb9-470f-9b45-20b002856018 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:26.106001 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-89f1c6a8-dcb9-470f-9b45-20b002856018 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1338 microversion: 2.20 time: 0.310709 Jun 17 15:11:26.106865 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 18/39] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:11:25 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1338 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:11:26.409427 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-e0b345e4-56ec-464b-9e8f-06b50279a2f9 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:11:26.410067 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-e0b345e4-56ec-464b-9e8f-06b50279a2f9 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] [instance: 32c49b67-aa8e-4d47-81d1-89b815c998b4] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:11:26.420250 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e0b345e4-56ec-464b-9e8f-06b50279a2f9 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:26.421165 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e0b345e4-56ec-464b-9e8f-06b50279a2f9 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:26.422210 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e0b345e4-56ec-464b-9e8f-06b50279a2f9 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:26.422981 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e0b345e4-56ec-464b-9e8f-06b50279a2f9 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:26.523474 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-a7ca8cf0-1dfd-4f1a-834f-c09ba249a105 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:11:26.524231 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-a7ca8cf0-1dfd-4f1a-834f-c09ba249a105 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: 335fa25e-3f5c-45f0-9f85-f9c4681728b8] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:11:26.530959 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a7ca8cf0-1dfd-4f1a-834f-c09ba249a105 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:26.531417 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a7ca8cf0-1dfd-4f1a-834f-c09ba249a105 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:26.532321 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a7ca8cf0-1dfd-4f1a-834f-c09ba249a105 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:26.532780 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a7ca8cf0-1dfd-4f1a-834f-c09ba249a105 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:26.629562 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-a7ca8cf0-1dfd-4f1a-834f-c09ba249a105 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:26.639383 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-a7ca8cf0-1dfd-4f1a-834f-c09ba249a105 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/335fa25e-3f5c-45f0-9f85-f9c4681728b8" status: 200 len: 1279 microversion: 2.1 time: 0.120186 Jun 17 15:11:26.657990 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 19/40] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:11:26 2022] GET /compute/v2.1/servers/335fa25e-3f5c-45f0-9f85-f9c4681728b8 => generated 1279 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:11:27.032516 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-e0b345e4-56ec-464b-9e8f-06b50279a2f9 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384629ef0b104b8f8cbafdc56b16268b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa9c2c0819ea44c491b641d564d4cec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:27.046189 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-e0b345e4-56ec-464b-9e8f-06b50279a2f9 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] 10.222.0.48 "GET /compute/v2.1/servers/32c49b67-aa8e-4d47-81d1-89b815c998b4" status: 200 len: 1315 microversion: 2.1 time: 0.643211 Jun 17 15:11:27.046775 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 22/41] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:11:26 2022] GET /compute/v2.1/servers/32c49b67-aa8e-4d47-81d1-89b815c998b4 => generated 1315 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:11:27.123819 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-0a8c9de6-69c2-41a9-b26f-2450fc0148b2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:11:27.125622 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-0a8c9de6-69c2-41a9-b26f-2450fc0148b2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:11:27.134252 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0a8c9de6-69c2-41a9-b26f-2450fc0148b2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:27.134893 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0a8c9de6-69c2-41a9-b26f-2450fc0148b2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:27.135898 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0a8c9de6-69c2-41a9-b26f-2450fc0148b2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:27.136664 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0a8c9de6-69c2-41a9-b26f-2450fc0148b2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:27.543714 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-0a8c9de6-69c2-41a9-b26f-2450fc0148b2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:27.558691 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-0a8c9de6-69c2-41a9-b26f-2450fc0148b2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:27.560311 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-0a8c9de6-69c2-41a9-b26f-2450fc0148b2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:27.561479 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-0a8c9de6-69c2-41a9-b26f-2450fc0148b2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1405 microversion: 2.20 time: 0.442290 Jun 17 15:11:27.562037 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 20/42] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:11:27 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1405 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:11:27.658430 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-73de2b17-3296-48e4-93f5-8aa94c251ebf tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:11:27.659082 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-73de2b17-3296-48e4-93f5-8aa94c251ebf tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: 335fa25e-3f5c-45f0-9f85-f9c4681728b8] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:11:27.670298 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-73de2b17-3296-48e4-93f5-8aa94c251ebf tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:27.672306 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-73de2b17-3296-48e4-93f5-8aa94c251ebf tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:27.673408 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-73de2b17-3296-48e4-93f5-8aa94c251ebf tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:27.673860 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-73de2b17-3296-48e4-93f5-8aa94c251ebf tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:27.847950 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-73de2b17-3296-48e4-93f5-8aa94c251ebf tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:27.862080 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-73de2b17-3296-48e4-93f5-8aa94c251ebf tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/335fa25e-3f5c-45f0-9f85-f9c4681728b8" status: 200 len: 1279 microversion: 2.1 time: 0.207774 Jun 17 15:11:27.862855 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 23/43] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:11:27 2022] GET /compute/v2.1/servers/335fa25e-3f5c-45f0-9f85-f9c4681728b8 => generated 1279 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:11:28.065310 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-7e2f23e5-4c24-405f-aacd-b555ada09a82 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:11:28.065902 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-7e2f23e5-4c24-405f-aacd-b555ada09a82 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] [instance: 32c49b67-aa8e-4d47-81d1-89b815c998b4] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:11:28.086724 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7e2f23e5-4c24-405f-aacd-b555ada09a82 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:28.087994 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7e2f23e5-4c24-405f-aacd-b555ada09a82 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:28.089250 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7e2f23e5-4c24-405f-aacd-b555ada09a82 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:28.090436 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7e2f23e5-4c24-405f-aacd-b555ada09a82 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:28.407936 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-7e2f23e5-4c24-405f-aacd-b555ada09a82 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384629ef0b104b8f8cbafdc56b16268b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa9c2c0819ea44c491b641d564d4cec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:28.419318 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-7e2f23e5-4c24-405f-aacd-b555ada09a82 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] 10.222.0.48 "GET /compute/v2.1/servers/32c49b67-aa8e-4d47-81d1-89b815c998b4" status: 200 len: 1315 microversion: 2.1 time: 0.359509 Jun 17 15:11:28.420075 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 21/44] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:11:28 2022] GET /compute/v2.1/servers/32c49b67-aa8e-4d47-81d1-89b815c998b4 => generated 1315 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:11:28.579641 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-384597b6-029e-4f1c-8e22-71162a45887c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:11:28.580460 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-384597b6-029e-4f1c-8e22-71162a45887c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:11:28.597206 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-384597b6-029e-4f1c-8e22-71162a45887c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:28.597738 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-384597b6-029e-4f1c-8e22-71162a45887c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:28.598584 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-384597b6-029e-4f1c-8e22-71162a45887c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:28.599035 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-384597b6-029e-4f1c-8e22-71162a45887c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:28.880174 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-591193aa-b787-457c-ae64-2568368955f1 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:11:28.880842 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-591193aa-b787-457c-ae64-2568368955f1 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: 335fa25e-3f5c-45f0-9f85-f9c4681728b8] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:11:28.884679 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell0:SELECT=2 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:11:28.903406 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-591193aa-b787-457c-ae64-2568368955f1 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:28.905549 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-591193aa-b787-457c-ae64-2568368955f1 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:28.906847 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-591193aa-b787-457c-ae64-2568368955f1 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:28.913895 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-591193aa-b787-457c-ae64-2568368955f1 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:28.921749 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-384597b6-029e-4f1c-8e22-71162a45887c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:28.932119 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-384597b6-029e-4f1c-8e22-71162a45887c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:28.933690 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-384597b6-029e-4f1c-8e22-71162a45887c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:28.942599 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-384597b6-029e-4f1c-8e22-71162a45887c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1405 microversion: 2.20 time: 0.367158 Jun 17 15:11:28.945019 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 24/45] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:11:28 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1405 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:11:29.085530 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-591193aa-b787-457c-ae64-2568368955f1 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:29.096263 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-591193aa-b787-457c-ae64-2568368955f1 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/335fa25e-3f5c-45f0-9f85-f9c4681728b8" status: 200 len: 1279 microversion: 2.1 time: 0.221062 Jun 17 15:11:29.103055 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 22/46] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:11:28 2022] GET /compute/v2.1/servers/335fa25e-3f5c-45f0-9f85-f9c4681728b8 => generated 1279 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:11:29.440799 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-4a9d3e6c-81c8-43ae-9547-5e52afeea85e tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:11:29.440799 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-4a9d3e6c-81c8-43ae-9547-5e52afeea85e tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] [instance: 32c49b67-aa8e-4d47-81d1-89b815c998b4] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:11:29.450608 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4a9d3e6c-81c8-43ae-9547-5e52afeea85e tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:29.451135 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4a9d3e6c-81c8-43ae-9547-5e52afeea85e tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:29.452136 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4a9d3e6c-81c8-43ae-9547-5e52afeea85e tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:29.452845 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4a9d3e6c-81c8-43ae-9547-5e52afeea85e tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:29.780744 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-4a9d3e6c-81c8-43ae-9547-5e52afeea85e tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384629ef0b104b8f8cbafdc56b16268b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa9c2c0819ea44c491b641d564d4cec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:29.799707 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-4a9d3e6c-81c8-43ae-9547-5e52afeea85e tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] 10.222.0.48 "GET /compute/v2.1/servers/32c49b67-aa8e-4d47-81d1-89b815c998b4" status: 200 len: 1315 microversion: 2.1 time: 0.365232 Jun 17 15:11:29.810966 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 25/47] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:11:29 2022] GET /compute/v2.1/servers/32c49b67-aa8e-4d47-81d1-89b815c998b4 => generated 1315 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:11:29.965016 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-8d6117bd-4e50-41bc-b809-1c4d4cfab5a3 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:11:29.965638 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-8d6117bd-4e50-41bc-b809-1c4d4cfab5a3 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:11:29.976015 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8d6117bd-4e50-41bc-b809-1c4d4cfab5a3 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:29.976546 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8d6117bd-4e50-41bc-b809-1c4d4cfab5a3 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:29.977337 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8d6117bd-4e50-41bc-b809-1c4d4cfab5a3 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:29.978325 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8d6117bd-4e50-41bc-b809-1c4d4cfab5a3 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:30.119722 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-9dd7b7cf-e2c3-4db9-bd0a-b27f312bafea tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:11:30.120606 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-9dd7b7cf-e2c3-4db9-bd0a-b27f312bafea tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: 335fa25e-3f5c-45f0-9f85-f9c4681728b8] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:11:30.137963 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9dd7b7cf-e2c3-4db9-bd0a-b27f312bafea tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:30.138627 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9dd7b7cf-e2c3-4db9-bd0a-b27f312bafea tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:30.139619 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9dd7b7cf-e2c3-4db9-bd0a-b27f312bafea tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:30.140525 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9dd7b7cf-e2c3-4db9-bd0a-b27f312bafea tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:30.314839 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-9dd7b7cf-e2c3-4db9-bd0a-b27f312bafea tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:30.331182 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-9dd7b7cf-e2c3-4db9-bd0a-b27f312bafea tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/335fa25e-3f5c-45f0-9f85-f9c4681728b8" status: 200 len: 1279 microversion: 2.1 time: 0.217489 Jun 17 15:11:30.332043 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 26/48] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:11:30 2022] GET /compute/v2.1/servers/335fa25e-3f5c-45f0-9f85-f9c4681728b8 => generated 1279 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:11:30.354764 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-8d6117bd-4e50-41bc-b809-1c4d4cfab5a3 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:30.393291 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-8d6117bd-4e50-41bc-b809-1c4d4cfab5a3 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:30.396029 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-8d6117bd-4e50-41bc-b809-1c4d4cfab5a3 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:30.401758 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-8d6117bd-4e50-41bc-b809-1c4d4cfab5a3 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1405 microversion: 2.20 time: 0.442286 Jun 17 15:11:30.414371 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 23/49] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:11:29 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1405 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:11:30.832637 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-88193a75-fef9-4d57-a2d7-cc76bae2ba85 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:11:30.833901 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-88193a75-fef9-4d57-a2d7-cc76bae2ba85 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] [instance: 32c49b67-aa8e-4d47-81d1-89b815c998b4] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:11:30.847617 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-88193a75-fef9-4d57-a2d7-cc76bae2ba85 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:30.848764 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-88193a75-fef9-4d57-a2d7-cc76bae2ba85 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:30.850823 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-88193a75-fef9-4d57-a2d7-cc76bae2ba85 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:30.852440 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-88193a75-fef9-4d57-a2d7-cc76bae2ba85 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:31.350004 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-78966fbc-95dc-4aa1-9ce1-56e15946be3f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:11:31.352269 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-78966fbc-95dc-4aa1-9ce1-56e15946be3f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: 335fa25e-3f5c-45f0-9f85-f9c4681728b8] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:11:31.368858 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-78966fbc-95dc-4aa1-9ce1-56e15946be3f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:31.371660 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-78966fbc-95dc-4aa1-9ce1-56e15946be3f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:31.374005 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-78966fbc-95dc-4aa1-9ce1-56e15946be3f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:31.380750 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-78966fbc-95dc-4aa1-9ce1-56e15946be3f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:31.494159 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-88193a75-fef9-4d57-a2d7-cc76bae2ba85 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384629ef0b104b8f8cbafdc56b16268b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa9c2c0819ea44c491b641d564d4cec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:31.510315 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-88193a75-fef9-4d57-a2d7-cc76bae2ba85 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] 10.222.0.48 "GET /compute/v2.1/servers/32c49b67-aa8e-4d47-81d1-89b815c998b4" status: 200 len: 1315 microversion: 2.1 time: 0.694164 Jun 17 15:11:31.518708 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 27/50] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:11:30 2022] GET /compute/v2.1/servers/32c49b67-aa8e-4d47-81d1-89b815c998b4 => generated 1315 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:11:31.565382 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-bb86aa3e-8b45-4cb5-ac45-788533552dd3 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:11:31.574516 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-bb86aa3e-8b45-4cb5-ac45-788533552dd3 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:11:31.589198 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bb86aa3e-8b45-4cb5-ac45-788533552dd3 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:31.590296 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bb86aa3e-8b45-4cb5-ac45-788533552dd3 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:31.591560 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bb86aa3e-8b45-4cb5-ac45-788533552dd3 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:31.592012 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bb86aa3e-8b45-4cb5-ac45-788533552dd3 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:31.808203 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell0:SELECT=6 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:11:31.901247 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-78966fbc-95dc-4aa1-9ce1-56e15946be3f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:31.914241 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-78966fbc-95dc-4aa1-9ce1-56e15946be3f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/335fa25e-3f5c-45f0-9f85-f9c4681728b8" status: 200 len: 1279 microversion: 2.1 time: 0.566997 Jun 17 15:11:31.932566 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 24/51] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:11:31 2022] GET /compute/v2.1/servers/335fa25e-3f5c-45f0-9f85-f9c4681728b8 => generated 1279 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:11:31.953379 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell0:SELECT=22 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:11:32.538484 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-ce248f5d-5af6-4aef-9336-9a1e7a293923 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:11:32.539109 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-ce248f5d-5af6-4aef-9336-9a1e7a293923 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] [instance: 32c49b67-aa8e-4d47-81d1-89b815c998b4] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:11:32.559384 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ce248f5d-5af6-4aef-9336-9a1e7a293923 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:32.559851 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ce248f5d-5af6-4aef-9336-9a1e7a293923 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:32.560669 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ce248f5d-5af6-4aef-9336-9a1e7a293923 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:32.561116 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ce248f5d-5af6-4aef-9336-9a1e7a293923 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:32.620756 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-bb86aa3e-8b45-4cb5-ac45-788533552dd3 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:32.640639 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-bb86aa3e-8b45-4cb5-ac45-788533552dd3 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:32.658959 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-bb86aa3e-8b45-4cb5-ac45-788533552dd3 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:32.664701 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-bb86aa3e-8b45-4cb5-ac45-788533552dd3 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1405 microversion: 2.20 time: 1.139846 Jun 17 15:11:32.666625 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 28/52] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:11:31 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1405 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:11:32.961184 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-dd9f3610-7fbb-45fb-8fd4-24a369b114c3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:11:32.962448 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-dd9f3610-7fbb-45fb-8fd4-24a369b114c3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: 335fa25e-3f5c-45f0-9f85-f9c4681728b8] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:11:32.984259 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-dd9f3610-7fbb-45fb-8fd4-24a369b114c3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:32.984836 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-dd9f3610-7fbb-45fb-8fd4-24a369b114c3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:32.985819 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-dd9f3610-7fbb-45fb-8fd4-24a369b114c3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:32.986378 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-dd9f3610-7fbb-45fb-8fd4-24a369b114c3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:33.450033 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell0:SELECT=18 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:11:33.887128 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-ce248f5d-5af6-4aef-9336-9a1e7a293923 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384629ef0b104b8f8cbafdc56b16268b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa9c2c0819ea44c491b641d564d4cec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:33.899415 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-ce248f5d-5af6-4aef-9336-9a1e7a293923 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] 10.222.0.48 "GET /compute/v2.1/servers/32c49b67-aa8e-4d47-81d1-89b815c998b4" status: 200 len: 1315 microversion: 2.1 time: 1.365366 Jun 17 15:11:33.900218 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 25/53] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:11:32 2022] GET /compute/v2.1/servers/32c49b67-aa8e-4d47-81d1-89b815c998b4 => generated 1315 bytes in 1367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:11:33.927241 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-49ef184a-f798-4ca0-86d5-4a78fdc9221d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:11:33.927948 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-49ef184a-f798-4ca0-86d5-4a78fdc9221d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:11:33.960958 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-49ef184a-f798-4ca0-86d5-4a78fdc9221d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:33.961827 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-49ef184a-f798-4ca0-86d5-4a78fdc9221d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:33.969064 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-49ef184a-f798-4ca0-86d5-4a78fdc9221d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:33.970150 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-49ef184a-f798-4ca0-86d5-4a78fdc9221d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:34.694995 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-dd9f3610-7fbb-45fb-8fd4-24a369b114c3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:34.718912 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-dd9f3610-7fbb-45fb-8fd4-24a369b114c3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/335fa25e-3f5c-45f0-9f85-f9c4681728b8" status: 200 len: 1321 microversion: 2.1 time: 1.758248 Jun 17 15:11:34.720580 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 29/54] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:11:32 2022] GET /compute/v2.1/servers/335fa25e-3f5c-45f0-9f85-f9c4681728b8 => generated 1321 bytes in 1772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:11:34.912232 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [req-a0c7311d-6c38-4e47-b28c-bf7e45bbad8b req-0c09c0e7-afe5-4a80-b55d-505854a63984 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e97df352-5cee-41f7-ae51-f55cd9e85869", "tag": "ff5c90be-6727-43d1-841f-760f94168fc6"}]} {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:11:34.997424 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [req-a0c7311d-6c38-4e47-b28c-bf7e45bbad8b req-0c09c0e7-afe5-4a80-b55d-505854a63984 service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:35.000896 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [req-a0c7311d-6c38-4e47-b28c-bf7e45bbad8b req-0c09c0e7-afe5-4a80-b55d-505854a63984 service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:35.116931 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.compute.server_external_events [req-a0c7311d-6c38-4e47-b28c-bf7e45bbad8b req-0c09c0e7-afe5-4a80-b55d-505854a63984 service nova] Creating event network-changed:ff5c90be-6727-43d1-841f-760f94168fc6 for instance e97df352-5cee-41f7-ae51-f55cd9e85869 on hv-cinder-82549 Jun 17 15:11:35.119263 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [req-a0c7311d-6c38-4e47-b28c-bf7e45bbad8b req-0c09c0e7-afe5-4a80-b55d-505854a63984 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117650) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 17 15:11:35.131125 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-05de8aa6-dca0-4f57-adeb-b5a9b302ff90 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:35.133052 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-05de8aa6-dca0-4f57-adeb-b5a9b302ff90 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:35.139848 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-05de8aa6-dca0-4f57-adeb-b5a9b302ff90 None None] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:35.142283 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-05de8aa6-dca0-4f57-adeb-b5a9b302ff90 None None] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:35.192670 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-49ef184a-f798-4ca0-86d5-4a78fdc9221d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:35.212508 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-49ef184a-f798-4ca0-86d5-4a78fdc9221d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:35.215623 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.compute.rpcapi [None req-05de8aa6-dca0-4f57-adeb-b5a9b302ff90 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 17 15:11:35.219105 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-05de8aa6-dca0-4f57-adeb-b5a9b302ff90 None None] Releasing lock "compute-rpcapi-router" {{(pid=117650) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 17 15:11:35.221147 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-49ef184a-f798-4ca0-86d5-4a78fdc9221d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:35.230946 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-49ef184a-f798-4ca0-86d5-4a78fdc9221d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1405 microversion: 2.20 time: 1.325638 Jun 17 15:11:35.233605 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 26/55] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:11:33 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1405 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:11:35.277121 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-05de8aa6-dca0-4f57-adeb-b5a9b302ff90 None None] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.539165 Jun 17 15:11:35.278161 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 30/56] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 15:11:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:11:35.293477 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-4b087411-1b86-4cd9-a7dd-f2f96d15e52e tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:11:35.297379 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-4b087411-1b86-4cd9-a7dd-f2f96d15e52e tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] [instance: 32c49b67-aa8e-4d47-81d1-89b815c998b4] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:11:35.371041 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=4 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:11:35.373688 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4b087411-1b86-4cd9-a7dd-f2f96d15e52e tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:35.399741 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4b087411-1b86-4cd9-a7dd-f2f96d15e52e tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:35.401272 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4b087411-1b86-4cd9-a7dd-f2f96d15e52e tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:35.410840 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4b087411-1b86-4cd9-a7dd-f2f96d15e52e tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:35.755607 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-1df547c5-bd77-4274-955b-1db8f5ac8863 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:11:35.757988 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-1df547c5-bd77-4274-955b-1db8f5ac8863 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: 335fa25e-3f5c-45f0-9f85-f9c4681728b8] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:11:35.780960 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1df547c5-bd77-4274-955b-1db8f5ac8863 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:35.782134 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1df547c5-bd77-4274-955b-1db8f5ac8863 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:35.784465 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1df547c5-bd77-4274-955b-1db8f5ac8863 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:35.786372 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1df547c5-bd77-4274-955b-1db8f5ac8863 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:36.155321 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-1df547c5-bd77-4274-955b-1db8f5ac8863 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:36.170482 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-1df547c5-bd77-4274-955b-1db8f5ac8863 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/335fa25e-3f5c-45f0-9f85-f9c4681728b8" status: 200 len: 1321 microversion: 2.1 time: 0.430997 Jun 17 15:11:36.172291 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 31/57] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:11:35 2022] GET /compute/v2.1/servers/335fa25e-3f5c-45f0-9f85-f9c4681728b8 => generated 1321 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:11:36.285765 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [req-b722bee5-6f46-4a4f-bce7-70651fd11f98 req-d03472cc-ef89-408c-a72b-1b8d7e2bc16a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f90be07-f969-4dc7-b8ab-a5a41f850645", "tag": "8f8f8dbb-e00e-4a7d-91ca-f20e554d9b8c"}]} {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:11:36.303572 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [req-b722bee5-6f46-4a4f-bce7-70651fd11f98 req-d03472cc-ef89-408c-a72b-1b8d7e2bc16a service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:36.304270 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [req-b722bee5-6f46-4a4f-bce7-70651fd11f98 req-d03472cc-ef89-408c-a72b-1b8d7e2bc16a service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:36.318079 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.compute.server_external_events [req-b722bee5-6f46-4a4f-bce7-70651fd11f98 req-d03472cc-ef89-408c-a72b-1b8d7e2bc16a service nova] Creating event network-changed:8f8f8dbb-e00e-4a7d-91ca-f20e554d9b8c for instance 8f90be07-f969-4dc7-b8ab-a5a41f850645 on hv-cinder-82549 Jun 17 15:11:36.337377 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [req-b722bee5-6f46-4a4f-bce7-70651fd11f98 req-d03472cc-ef89-408c-a72b-1b8d7e2bc16a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.162453 Jun 17 15:11:36.338355 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 32/58] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 15:11:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:11:36.353683 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-c91e47ac-7928-4e62-9954-ce534471af93 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:11:36.355940 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-c91e47ac-7928-4e62-9954-ce534471af93 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:11:36.374172 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c91e47ac-7928-4e62-9954-ce534471af93 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:36.374988 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c91e47ac-7928-4e62-9954-ce534471af93 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:36.376008 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c91e47ac-7928-4e62-9954-ce534471af93 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:36.376706 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c91e47ac-7928-4e62-9954-ce534471af93 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:36.613344 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-4b087411-1b86-4cd9-a7dd-f2f96d15e52e tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384629ef0b104b8f8cbafdc56b16268b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa9c2c0819ea44c491b641d564d4cec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:36.626795 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-4b087411-1b86-4cd9-a7dd-f2f96d15e52e tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] 10.222.0.48 "GET /compute/v2.1/servers/32c49b67-aa8e-4d47-81d1-89b815c998b4" status: 200 len: 1315 microversion: 2.1 time: 1.390158 Jun 17 15:11:36.637127 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 27/59] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:11:35 2022] GET /compute/v2.1/servers/32c49b67-aa8e-4d47-81d1-89b815c998b4 => generated 1315 bytes in 1403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:11:36.726047 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-c91e47ac-7928-4e62-9954-ce534471af93 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:36.743840 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-c91e47ac-7928-4e62-9954-ce534471af93 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:36.747180 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-c91e47ac-7928-4e62-9954-ce534471af93 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:36.752776 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-c91e47ac-7928-4e62-9954-ce534471af93 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1405 microversion: 2.20 time: 0.411052 Jun 17 15:11:36.753964 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 33/60] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:11:36 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1405 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:11:37.191963 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-9001cce7-d98c-458b-9ae6-594907dac35e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:11:37.193124 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-9001cce7-d98c-458b-9ae6-594907dac35e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: 335fa25e-3f5c-45f0-9f85-f9c4681728b8] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:11:37.207214 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9001cce7-d98c-458b-9ae6-594907dac35e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:37.213465 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9001cce7-d98c-458b-9ae6-594907dac35e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:37.216340 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9001cce7-d98c-458b-9ae6-594907dac35e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:37.217596 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9001cce7-d98c-458b-9ae6-594907dac35e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:37.318056 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [req-0d0a27fe-1623-4db3-8f78-ef7f95f745e5 req-8b2a3df8-da36-4dc8-b191-9782a2db8a80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32c49b67-aa8e-4d47-81d1-89b815c998b4", "tag": "ad1f3f82-6070-4ea5-8bfa-96f8667f63d9"}]} {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:11:37.344591 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [req-0d0a27fe-1623-4db3-8f78-ef7f95f745e5 req-8b2a3df8-da36-4dc8-b191-9782a2db8a80 service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:37.366248 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [req-0d0a27fe-1623-4db3-8f78-ef7f95f745e5 req-8b2a3df8-da36-4dc8-b191-9782a2db8a80 service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:37.434977 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.compute.server_external_events [req-0d0a27fe-1623-4db3-8f78-ef7f95f745e5 req-8b2a3df8-da36-4dc8-b191-9782a2db8a80 service nova] Creating event network-changed:ad1f3f82-6070-4ea5-8bfa-96f8667f63d9 for instance 32c49b67-aa8e-4d47-81d1-89b815c998b4 on hv-cinder-82549 Jun 17 15:11:37.444042 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [req-0d0a27fe-1623-4db3-8f78-ef7f95f745e5 req-8b2a3df8-da36-4dc8-b191-9782a2db8a80 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131131 Jun 17 15:11:37.451462 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 34/61] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 15:11:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:11:37.648025 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-89f80711-6ee2-4641-a38f-cac85e612b3e tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:11:37.649235 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-89f80711-6ee2-4641-a38f-cac85e612b3e tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] [instance: 32c49b67-aa8e-4d47-81d1-89b815c998b4] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:11:37.664415 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-89f80711-6ee2-4641-a38f-cac85e612b3e tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:37.665315 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-89f80711-6ee2-4641-a38f-cac85e612b3e tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:37.673547 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-89f80711-6ee2-4641-a38f-cac85e612b3e tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:37.674180 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-89f80711-6ee2-4641-a38f-cac85e612b3e tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:38.055452 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-89f80711-6ee2-4641-a38f-cac85e612b3e tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384629ef0b104b8f8cbafdc56b16268b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa9c2c0819ea44c491b641d564d4cec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:38.068989 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-89f80711-6ee2-4641-a38f-cac85e612b3e tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] 10.222.0.48 "GET /compute/v2.1/servers/32c49b67-aa8e-4d47-81d1-89b815c998b4" status: 200 len: 1315 microversion: 2.1 time: 0.425525 Jun 17 15:11:38.069816 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 35/62] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:11:37 2022] GET /compute/v2.1/servers/32c49b67-aa8e-4d47-81d1-89b815c998b4 => generated 1315 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:11:38.074999 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-55275d93-5d8f-4dae-997f-3d9f1a7ce303 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:11:38.081828 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-55275d93-5d8f-4dae-997f-3d9f1a7ce303 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:11:38.093811 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-55275d93-5d8f-4dae-997f-3d9f1a7ce303 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:38.096000 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-55275d93-5d8f-4dae-997f-3d9f1a7ce303 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:38.099077 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-55275d93-5d8f-4dae-997f-3d9f1a7ce303 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:38.099849 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-55275d93-5d8f-4dae-997f-3d9f1a7ce303 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:38.113019 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=100 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:11:38.312280 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-9001cce7-d98c-458b-9ae6-594907dac35e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:38.325237 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-9001cce7-d98c-458b-9ae6-594907dac35e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/335fa25e-3f5c-45f0-9f85-f9c4681728b8" status: 200 len: 1321 microversion: 2.1 time: 1.137540 Jun 17 15:11:38.327835 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 28/63] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:11:37 2022] GET /compute/v2.1/servers/335fa25e-3f5c-45f0-9f85-f9c4681728b8 => generated 1321 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:11:38.330753 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-55275d93-5d8f-4dae-997f-3d9f1a7ce303 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:38.340674 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-55275d93-5d8f-4dae-997f-3d9f1a7ce303 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:38.343370 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-55275d93-5d8f-4dae-997f-3d9f1a7ce303 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:38.344559 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-55275d93-5d8f-4dae-997f-3d9f1a7ce303 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1405 microversion: 2.20 time: 0.273616 Jun 17 15:11:38.345659 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 36/64] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:11:38 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1405 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:11:38.667132 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [req-d82dba8f-7270-4b39-a06c-153f88c1d9f7 req-7026dc2a-05de-499a-866f-d8480d383869 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "335fa25e-3f5c-45f0-9f85-f9c4681728b8", "tag": "a005990c-f75a-4864-aa74-da43c2a3e0a6"}]} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:11:38.681892 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-d82dba8f-7270-4b39-a06c-153f88c1d9f7 req-7026dc2a-05de-499a-866f-d8480d383869 service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:38.682581 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-d82dba8f-7270-4b39-a06c-153f88c1d9f7 req-7026dc2a-05de-499a-866f-d8480d383869 service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:38.703870 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.compute.server_external_events [req-d82dba8f-7270-4b39-a06c-153f88c1d9f7 req-7026dc2a-05de-499a-866f-d8480d383869 service nova] Creating event network-changed:a005990c-f75a-4864-aa74-da43c2a3e0a6 for instance 335fa25e-3f5c-45f0-9f85-f9c4681728b8 on hv-cinder-82549 Jun 17 15:11:38.704582 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-d82dba8f-7270-4b39-a06c-153f88c1d9f7 req-7026dc2a-05de-499a-866f-d8480d383869 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117649) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 17 15:11:38.706098 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-92372961-5d10-48e7-a4bf-d2f0885129d2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:38.706321 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-92372961-5d10-48e7-a4bf-d2f0885129d2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:38.707297 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-92372961-5d10-48e7-a4bf-d2f0885129d2 None None] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:38.707729 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-92372961-5d10-48e7-a4bf-d2f0885129d2 None None] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:38.718067 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.compute.rpcapi [None req-92372961-5d10-48e7-a4bf-d2f0885129d2 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 17 15:11:38.719189 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-92372961-5d10-48e7-a4bf-d2f0885129d2 None None] Releasing lock "compute-rpcapi-router" {{(pid=117649) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 17 15:11:38.745759 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-92372961-5d10-48e7-a4bf-d2f0885129d2 None None] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084509 Jun 17 15:11:38.748114 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 29/65] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 15:11:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:11:39.090977 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-f277f950-4210-4eb5-a484-3ad9df8e15ca tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:11:39.090977 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-f277f950-4210-4eb5-a484-3ad9df8e15ca tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] [instance: 32c49b67-aa8e-4d47-81d1-89b815c998b4] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:11:39.099871 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f277f950-4210-4eb5-a484-3ad9df8e15ca tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:39.100406 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f277f950-4210-4eb5-a484-3ad9df8e15ca tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:39.101820 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f277f950-4210-4eb5-a484-3ad9df8e15ca tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:39.103149 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f277f950-4210-4eb5-a484-3ad9df8e15ca tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:39.346388 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-c7dd87ab-f1a7-4cfe-8377-66043359e613 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:11:39.348062 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-c7dd87ab-f1a7-4cfe-8377-66043359e613 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: 335fa25e-3f5c-45f0-9f85-f9c4681728b8] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:11:39.355782 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c7dd87ab-f1a7-4cfe-8377-66043359e613 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:39.359655 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c7dd87ab-f1a7-4cfe-8377-66043359e613 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:39.360743 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c7dd87ab-f1a7-4cfe-8377-66043359e613 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:39.361401 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c7dd87ab-f1a7-4cfe-8377-66043359e613 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:39.413687 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-f277f950-4210-4eb5-a484-3ad9df8e15ca tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384629ef0b104b8f8cbafdc56b16268b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa9c2c0819ea44c491b641d564d4cec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:39.423733 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-f277f950-4210-4eb5-a484-3ad9df8e15ca tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] 10.222.0.48 "GET /compute/v2.1/servers/32c49b67-aa8e-4d47-81d1-89b815c998b4" status: 200 len: 1315 microversion: 2.1 time: 0.337209 Jun 17 15:11:39.433763 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 37/66] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:11:39 2022] GET /compute/v2.1/servers/32c49b67-aa8e-4d47-81d1-89b815c998b4 => generated 1315 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:11:39.440435 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-f9bfe0fe-bf78-4439-9234-0878677460f9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:11:39.441066 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-f9bfe0fe-bf78-4439-9234-0878677460f9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:11:39.453832 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f9bfe0fe-bf78-4439-9234-0878677460f9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:39.454833 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f9bfe0fe-bf78-4439-9234-0878677460f9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:39.456666 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f9bfe0fe-bf78-4439-9234-0878677460f9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:39.456939 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f9bfe0fe-bf78-4439-9234-0878677460f9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:39.625511 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-c7dd87ab-f1a7-4cfe-8377-66043359e613 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:39.643365 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-c7dd87ab-f1a7-4cfe-8377-66043359e613 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/335fa25e-3f5c-45f0-9f85-f9c4681728b8" status: 200 len: 1321 microversion: 2.1 time: 0.302121 Jun 17 15:11:39.644792 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 30/67] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:11:39 2022] GET /compute/v2.1/servers/335fa25e-3f5c-45f0-9f85-f9c4681728b8 => generated 1321 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:11:39.692855 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-f9bfe0fe-bf78-4439-9234-0878677460f9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:39.705683 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-f9bfe0fe-bf78-4439-9234-0878677460f9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:39.708790 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-f9bfe0fe-bf78-4439-9234-0878677460f9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:39.710584 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-f9bfe0fe-bf78-4439-9234-0878677460f9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1405 microversion: 2.20 time: 0.275525 Jun 17 15:11:39.711257 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 38/68] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:11:39 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1405 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:11:40.449623 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-7fb4d510-dc7f-47c1-be90-1c2a9256147e tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:11:40.451283 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-7fb4d510-dc7f-47c1-be90-1c2a9256147e tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] [instance: 32c49b67-aa8e-4d47-81d1-89b815c998b4] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:11:40.471382 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7fb4d510-dc7f-47c1-be90-1c2a9256147e tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:40.473474 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7fb4d510-dc7f-47c1-be90-1c2a9256147e tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:40.476318 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7fb4d510-dc7f-47c1-be90-1c2a9256147e tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:40.477081 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7fb4d510-dc7f-47c1-be90-1c2a9256147e tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:40.671573 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-0a7bcc6f-6441-4c90-8a6f-796a120a600d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:11:40.675023 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-0a7bcc6f-6441-4c90-8a6f-796a120a600d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: 335fa25e-3f5c-45f0-9f85-f9c4681728b8] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:11:40.679521 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=9 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:11:40.692051 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0a7bcc6f-6441-4c90-8a6f-796a120a600d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:40.693932 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0a7bcc6f-6441-4c90-8a6f-796a120a600d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:40.695585 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0a7bcc6f-6441-4c90-8a6f-796a120a600d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:40.696228 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0a7bcc6f-6441-4c90-8a6f-796a120a600d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:40.839142 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-7fb4d510-dc7f-47c1-be90-1c2a9256147e tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384629ef0b104b8f8cbafdc56b16268b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa9c2c0819ea44c491b641d564d4cec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:40.859892 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-7fb4d510-dc7f-47c1-be90-1c2a9256147e tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] 10.222.0.48 "GET /compute/v2.1/servers/32c49b67-aa8e-4d47-81d1-89b815c998b4" status: 200 len: 1315 microversion: 2.1 time: 0.419843 Jun 17 15:11:40.861779 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 31/69] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:11:40 2022] GET /compute/v2.1/servers/32c49b67-aa8e-4d47-81d1-89b815c998b4 => generated 1315 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:11:40.868695 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-21bfff1c-454d-4590-9cc4-9d077a7e3fe6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:11:40.869705 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-21bfff1c-454d-4590-9cc4-9d077a7e3fe6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:11:40.900189 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-21bfff1c-454d-4590-9cc4-9d077a7e3fe6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:40.901044 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-21bfff1c-454d-4590-9cc4-9d077a7e3fe6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:40.902181 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-21bfff1c-454d-4590-9cc4-9d077a7e3fe6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:40.906102 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-21bfff1c-454d-4590-9cc4-9d077a7e3fe6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:40.974160 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell1:SELECT=100 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:11:40.982470 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-0a7bcc6f-6441-4c90-8a6f-796a120a600d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:40.993185 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-0a7bcc6f-6441-4c90-8a6f-796a120a600d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/335fa25e-3f5c-45f0-9f85-f9c4681728b8" status: 200 len: 1321 microversion: 2.1 time: 0.335363 Jun 17 15:11:40.993781 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 39/70] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:11:40 2022] GET /compute/v2.1/servers/335fa25e-3f5c-45f0-9f85-f9c4681728b8 => generated 1321 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:11:41.327598 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-21bfff1c-454d-4590-9cc4-9d077a7e3fe6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:41.337705 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-21bfff1c-454d-4590-9cc4-9d077a7e3fe6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:41.349245 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-21bfff1c-454d-4590-9cc4-9d077a7e3fe6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:41.350682 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-21bfff1c-454d-4590-9cc4-9d077a7e3fe6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1405 microversion: 2.20 time: 0.487243 Jun 17 15:11:41.351765 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 32/71] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:11:40 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1405 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:11:41.878519 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-e0fd7b08-e8c9-4fb3-89a8-42a261af8fa7 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:11:41.879932 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-e0fd7b08-e8c9-4fb3-89a8-42a261af8fa7 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] [instance: 32c49b67-aa8e-4d47-81d1-89b815c998b4] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:11:41.892013 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e0fd7b08-e8c9-4fb3-89a8-42a261af8fa7 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:41.893584 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e0fd7b08-e8c9-4fb3-89a8-42a261af8fa7 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:41.895203 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e0fd7b08-e8c9-4fb3-89a8-42a261af8fa7 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:41.896318 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e0fd7b08-e8c9-4fb3-89a8-42a261af8fa7 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:42.010955 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-3649b8a0-819e-4a4f-b3fe-029815b0b570 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:11:42.011751 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-3649b8a0-819e-4a4f-b3fe-029815b0b570 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: 335fa25e-3f5c-45f0-9f85-f9c4681728b8] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:11:42.056413 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3649b8a0-819e-4a4f-b3fe-029815b0b570 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:42.060448 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3649b8a0-819e-4a4f-b3fe-029815b0b570 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:42.062083 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3649b8a0-819e-4a4f-b3fe-029815b0b570 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:42.063389 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3649b8a0-819e-4a4f-b3fe-029815b0b570 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:42.503317 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-e0fd7b08-e8c9-4fb3-89a8-42a261af8fa7 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384629ef0b104b8f8cbafdc56b16268b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa9c2c0819ea44c491b641d564d4cec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:42.515099 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-e0fd7b08-e8c9-4fb3-89a8-42a261af8fa7 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] 10.222.0.48 "GET /compute/v2.1/servers/32c49b67-aa8e-4d47-81d1-89b815c998b4" status: 200 len: 1315 microversion: 2.1 time: 0.641464 Jun 17 15:11:42.517936 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 40/72] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:11:41 2022] GET /compute/v2.1/servers/32c49b67-aa8e-4d47-81d1-89b815c998b4 => generated 1315 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:11:42.536079 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-ff2ae453-cba4-4f0a-8193-6009a87bd565 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:11:42.540181 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-ff2ae453-cba4-4f0a-8193-6009a87bd565 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:11:42.559969 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ff2ae453-cba4-4f0a-8193-6009a87bd565 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:42.561076 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ff2ae453-cba4-4f0a-8193-6009a87bd565 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:42.563803 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ff2ae453-cba4-4f0a-8193-6009a87bd565 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:42.564580 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ff2ae453-cba4-4f0a-8193-6009a87bd565 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:42.572282 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-3649b8a0-819e-4a4f-b3fe-029815b0b570 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:42.585446 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-3649b8a0-819e-4a4f-b3fe-029815b0b570 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/335fa25e-3f5c-45f0-9f85-f9c4681728b8" status: 200 len: 1321 microversion: 2.1 time: 0.573694 Jun 17 15:11:42.585446 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 33/73] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:11:42 2022] GET /compute/v2.1/servers/335fa25e-3f5c-45f0-9f85-f9c4681728b8 => generated 1321 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:11:42.811154 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-ff2ae453-cba4-4f0a-8193-6009a87bd565 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:42.837731 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-ff2ae453-cba4-4f0a-8193-6009a87bd565 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:42.844874 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-ff2ae453-cba4-4f0a-8193-6009a87bd565 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:42.848704 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-ff2ae453-cba4-4f0a-8193-6009a87bd565 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1405 microversion: 2.20 time: 0.319540 Jun 17 15:11:42.851678 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 41/74] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:11:42 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1405 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:11:43.540665 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-2bd53f76-1dc8-436a-afab-26a2ee252b39 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:11:43.541896 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-2bd53f76-1dc8-436a-afab-26a2ee252b39 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] [instance: 32c49b67-aa8e-4d47-81d1-89b815c998b4] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:11:43.550918 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2bd53f76-1dc8-436a-afab-26a2ee252b39 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:43.554139 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2bd53f76-1dc8-436a-afab-26a2ee252b39 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:43.555117 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2bd53f76-1dc8-436a-afab-26a2ee252b39 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:43.555652 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2bd53f76-1dc8-436a-afab-26a2ee252b39 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:43.602008 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-46a82b8d-d4cf-4494-a5ca-89aa90239ad3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:11:43.603922 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-46a82b8d-d4cf-4494-a5ca-89aa90239ad3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: 335fa25e-3f5c-45f0-9f85-f9c4681728b8] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:11:43.615339 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-46a82b8d-d4cf-4494-a5ca-89aa90239ad3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:43.618396 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-46a82b8d-d4cf-4494-a5ca-89aa90239ad3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:43.620198 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-46a82b8d-d4cf-4494-a5ca-89aa90239ad3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:43.623102 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-46a82b8d-d4cf-4494-a5ca-89aa90239ad3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:43.915475 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-2bd53f76-1dc8-436a-afab-26a2ee252b39 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384629ef0b104b8f8cbafdc56b16268b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa9c2c0819ea44c491b641d564d4cec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:43.935236 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-2bd53f76-1dc8-436a-afab-26a2ee252b39 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] 10.222.0.48 "GET /compute/v2.1/servers/32c49b67-aa8e-4d47-81d1-89b815c998b4" status: 200 len: 1315 microversion: 2.1 time: 0.401047 Jun 17 15:11:43.937180 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 34/75] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:11:43 2022] GET /compute/v2.1/servers/32c49b67-aa8e-4d47-81d1-89b815c998b4 => generated 1315 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:11:43.951401 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-2c3b363f-4fbc-4d80-962c-794fd1117c74 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:11:43.953677 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-2c3b363f-4fbc-4d80-962c-794fd1117c74 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:11:43.967069 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2c3b363f-4fbc-4d80-962c-794fd1117c74 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:43.967746 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2c3b363f-4fbc-4d80-962c-794fd1117c74 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:43.968774 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2c3b363f-4fbc-4d80-962c-794fd1117c74 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:43.969308 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2c3b363f-4fbc-4d80-962c-794fd1117c74 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:44.074296 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-46a82b8d-d4cf-4494-a5ca-89aa90239ad3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:44.114425 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-46a82b8d-d4cf-4494-a5ca-89aa90239ad3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/335fa25e-3f5c-45f0-9f85-f9c4681728b8" status: 200 len: 1321 microversion: 2.1 time: 0.513518 Jun 17 15:11:44.128421 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 42/76] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:11:43 2022] GET /compute/v2.1/servers/335fa25e-3f5c-45f0-9f85-f9c4681728b8 => generated 1321 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:11:44.271091 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-2c3b363f-4fbc-4d80-962c-794fd1117c74 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:44.282962 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-2c3b363f-4fbc-4d80-962c-794fd1117c74 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:44.287089 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-2c3b363f-4fbc-4d80-962c-794fd1117c74 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:44.289765 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-2c3b363f-4fbc-4d80-962c-794fd1117c74 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1405 microversion: 2.20 time: 0.351397 Jun 17 15:11:44.290352 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 35/77] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:11:43 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1405 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:11:44.953181 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-c0116727-ab3d-4c30-9952-bb08e1586e39 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:11:44.954695 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-c0116727-ab3d-4c30-9952-bb08e1586e39 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] [instance: 32c49b67-aa8e-4d47-81d1-89b815c998b4] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:11:44.964541 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c0116727-ab3d-4c30-9952-bb08e1586e39 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:44.965253 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c0116727-ab3d-4c30-9952-bb08e1586e39 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:44.966047 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c0116727-ab3d-4c30-9952-bb08e1586e39 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:44.966479 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c0116727-ab3d-4c30-9952-bb08e1586e39 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:45.133941 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-ff82bea0-002d-4904-be9a-4710f5289418 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:11:45.134612 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-ff82bea0-002d-4904-be9a-4710f5289418 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: 335fa25e-3f5c-45f0-9f85-f9c4681728b8] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:11:45.143761 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ff82bea0-002d-4904-be9a-4710f5289418 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:45.151217 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ff82bea0-002d-4904-be9a-4710f5289418 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:45.154071 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ff82bea0-002d-4904-be9a-4710f5289418 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:45.154780 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ff82bea0-002d-4904-be9a-4710f5289418 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:45.156479 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-c0116727-ab3d-4c30-9952-bb08e1586e39 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384629ef0b104b8f8cbafdc56b16268b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa9c2c0819ea44c491b641d564d4cec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:45.165367 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-c0116727-ab3d-4c30-9952-bb08e1586e39 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] 10.222.0.48 "GET /compute/v2.1/servers/32c49b67-aa8e-4d47-81d1-89b815c998b4" status: 200 len: 1315 microversion: 2.1 time: 0.215826 Jun 17 15:11:45.174716 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 43/78] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:11:44 2022] GET /compute/v2.1/servers/32c49b67-aa8e-4d47-81d1-89b815c998b4 => generated 1315 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:11:45.304683 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell0:SELECT=2 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:11:45.315954 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-8f66107f-be10-4f1f-b3b0-451c85318df6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:11:45.317088 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-8f66107f-be10-4f1f-b3b0-451c85318df6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:11:45.328210 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8f66107f-be10-4f1f-b3b0-451c85318df6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:45.329375 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8f66107f-be10-4f1f-b3b0-451c85318df6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:45.330452 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8f66107f-be10-4f1f-b3b0-451c85318df6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:45.331105 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8f66107f-be10-4f1f-b3b0-451c85318df6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:45.439041 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-ff82bea0-002d-4904-be9a-4710f5289418 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:45.453539 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-ff82bea0-002d-4904-be9a-4710f5289418 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/335fa25e-3f5c-45f0-9f85-f9c4681728b8" status: 200 len: 1321 microversion: 2.1 time: 0.325279 Jun 17 15:11:45.457874 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 36/79] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:11:45 2022] GET /compute/v2.1/servers/335fa25e-3f5c-45f0-9f85-f9c4681728b8 => generated 1321 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:11:45.639570 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-8f66107f-be10-4f1f-b3b0-451c85318df6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:45.652318 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-8f66107f-be10-4f1f-b3b0-451c85318df6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:45.654453 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-8f66107f-be10-4f1f-b3b0-451c85318df6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:45.655774 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-8f66107f-be10-4f1f-b3b0-451c85318df6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1405 microversion: 2.20 time: 0.352263 Jun 17 15:11:45.656865 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 44/80] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:11:45 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1405 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:11:46.183585 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-b8220810-8b45-49df-95ef-fc9e1fd469ae tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:11:46.184342 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-b8220810-8b45-49df-95ef-fc9e1fd469ae tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] [instance: 32c49b67-aa8e-4d47-81d1-89b815c998b4] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:11:46.191392 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b8220810-8b45-49df-95ef-fc9e1fd469ae tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:46.192035 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b8220810-8b45-49df-95ef-fc9e1fd469ae tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:46.192847 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b8220810-8b45-49df-95ef-fc9e1fd469ae tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:46.196792 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b8220810-8b45-49df-95ef-fc9e1fd469ae tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:46.384923 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-b8220810-8b45-49df-95ef-fc9e1fd469ae tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384629ef0b104b8f8cbafdc56b16268b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa9c2c0819ea44c491b641d564d4cec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:46.396810 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-b8220810-8b45-49df-95ef-fc9e1fd469ae tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] 10.222.0.48 "GET /compute/v2.1/servers/32c49b67-aa8e-4d47-81d1-89b815c998b4" status: 200 len: 1315 microversion: 2.1 time: 0.218356 Jun 17 15:11:46.407551 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 37/81] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:11:46 2022] GET /compute/v2.1/servers/32c49b67-aa8e-4d47-81d1-89b815c998b4 => generated 1315 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:11:46.480588 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-f6c9d966-ad19-4bb1-8614-17c7d79a3038 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:11:46.483105 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-f6c9d966-ad19-4bb1-8614-17c7d79a3038 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: 335fa25e-3f5c-45f0-9f85-f9c4681728b8] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:11:46.496358 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f6c9d966-ad19-4bb1-8614-17c7d79a3038 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:46.497155 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f6c9d966-ad19-4bb1-8614-17c7d79a3038 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:46.498955 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f6c9d966-ad19-4bb1-8614-17c7d79a3038 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:46.499917 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f6c9d966-ad19-4bb1-8614-17c7d79a3038 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:46.683379 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-bec9097d-90af-4c8e-8448-4758c7ef0250 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:11:46.684652 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-bec9097d-90af-4c8e-8448-4758c7ef0250 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:11:46.691869 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-f6c9d966-ad19-4bb1-8614-17c7d79a3038 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:46.701849 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-f6c9d966-ad19-4bb1-8614-17c7d79a3038 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/335fa25e-3f5c-45f0-9f85-f9c4681728b8" status: 200 len: 1321 microversion: 2.1 time: 0.230150 Jun 17 15:11:46.704611 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 45/82] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:11:46 2022] GET /compute/v2.1/servers/335fa25e-3f5c-45f0-9f85-f9c4681728b8 => generated 1321 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:11:46.709606 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bec9097d-90af-4c8e-8448-4758c7ef0250 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:46.710733 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bec9097d-90af-4c8e-8448-4758c7ef0250 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:46.711567 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bec9097d-90af-4c8e-8448-4758c7ef0250 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:46.711998 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bec9097d-90af-4c8e-8448-4758c7ef0250 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:46.957175 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-bec9097d-90af-4c8e-8448-4758c7ef0250 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:46.975808 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-bec9097d-90af-4c8e-8448-4758c7ef0250 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:46.988321 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-bec9097d-90af-4c8e-8448-4758c7ef0250 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:46.989666 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-bec9097d-90af-4c8e-8448-4758c7ef0250 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1405 microversion: 2.20 time: 0.318985 Jun 17 15:11:46.992217 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 38/83] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:11:46 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1405 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:11:47.423063 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-08280a5e-18f7-4d48-97e9-70647b3a9c6c tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:11:47.425930 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-08280a5e-18f7-4d48-97e9-70647b3a9c6c tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] [instance: 32c49b67-aa8e-4d47-81d1-89b815c998b4] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:11:47.456110 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-08280a5e-18f7-4d48-97e9-70647b3a9c6c tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:47.456969 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-08280a5e-18f7-4d48-97e9-70647b3a9c6c tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:47.460833 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-08280a5e-18f7-4d48-97e9-70647b3a9c6c tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:47.462385 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-08280a5e-18f7-4d48-97e9-70647b3a9c6c tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:47.490354 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [req-4a592152-1f10-4c0e-ba08-8fbb0c70432d req-62b89e11-1f50-43ee-af90-47c539f59b63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32c49b67-aa8e-4d47-81d1-89b815c998b4", "name": "network-vif-plugged", "status": "completed", "tag": "ad1f3f82-6070-4ea5-8bfa-96f8667f63d9"}]} {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:11:47.538751 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [req-4a592152-1f10-4c0e-ba08-8fbb0c70432d req-62b89e11-1f50-43ee-af90-47c539f59b63 service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:47.539478 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [req-4a592152-1f10-4c0e-ba08-8fbb0c70432d req-62b89e11-1f50-43ee-af90-47c539f59b63 service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:47.591071 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.compute.server_external_events [req-4a592152-1f10-4c0e-ba08-8fbb0c70432d req-62b89e11-1f50-43ee-af90-47c539f59b63 service nova] Creating event network-vif-plugged:ad1f3f82-6070-4ea5-8bfa-96f8667f63d9 for instance 32c49b67-aa8e-4d47-81d1-89b815c998b4 on hv-cinder-82549 Jun 17 15:11:47.598990 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [req-4a592152-1f10-4c0e-ba08-8fbb0c70432d req-62b89e11-1f50-43ee-af90-47c539f59b63 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.512204 Jun 17 15:11:47.600207 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 46/84] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 15:11:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:11:47.724848 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-cdba9f05-803f-4062-af9c-312228205a70 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:11:47.725554 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-cdba9f05-803f-4062-af9c-312228205a70 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: 335fa25e-3f5c-45f0-9f85-f9c4681728b8] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:11:47.762230 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cdba9f05-803f-4062-af9c-312228205a70 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:47.779684 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cdba9f05-803f-4062-af9c-312228205a70 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:47.780944 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cdba9f05-803f-4062-af9c-312228205a70 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:47.781397 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cdba9f05-803f-4062-af9c-312228205a70 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:47.806227 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-08280a5e-18f7-4d48-97e9-70647b3a9c6c tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384629ef0b104b8f8cbafdc56b16268b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa9c2c0819ea44c491b641d564d4cec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:47.814515 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-08280a5e-18f7-4d48-97e9-70647b3a9c6c tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] 10.222.0.48 "GET /compute/v2.1/servers/32c49b67-aa8e-4d47-81d1-89b815c998b4" status: 200 len: 1315 microversion: 2.1 time: 0.402233 Jun 17 15:11:47.820544 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 39/85] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:11:47 2022] GET /compute/v2.1/servers/32c49b67-aa8e-4d47-81d1-89b815c998b4 => generated 1315 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:11:48.014378 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-2abf4266-ed19-47c9-80f5-74e433da40e4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:11:48.014995 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-2abf4266-ed19-47c9-80f5-74e433da40e4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:11:48.027137 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2abf4266-ed19-47c9-80f5-74e433da40e4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:48.027592 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2abf4266-ed19-47c9-80f5-74e433da40e4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:48.028403 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2abf4266-ed19-47c9-80f5-74e433da40e4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:48.028845 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2abf4266-ed19-47c9-80f5-74e433da40e4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:48.137046 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-cdba9f05-803f-4062-af9c-312228205a70 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:48.170720 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-cdba9f05-803f-4062-af9c-312228205a70 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/335fa25e-3f5c-45f0-9f85-f9c4681728b8" status: 200 len: 1321 microversion: 2.1 time: 0.450159 Jun 17 15:11:48.172748 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 47/86] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:11:47 2022] GET /compute/v2.1/servers/335fa25e-3f5c-45f0-9f85-f9c4681728b8 => generated 1321 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:11:48.348595 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-2abf4266-ed19-47c9-80f5-74e433da40e4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:48.361158 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-2abf4266-ed19-47c9-80f5-74e433da40e4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:48.362862 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-2abf4266-ed19-47c9-80f5-74e433da40e4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:48.364288 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-2abf4266-ed19-47c9-80f5-74e433da40e4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1405 microversion: 2.20 time: 0.355031 Jun 17 15:11:48.375303 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 40/87] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:11:48 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1405 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:11:48.843760 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-18158d9e-a32f-424a-8df6-f6765136cdb8 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:11:48.845168 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-18158d9e-a32f-424a-8df6-f6765136cdb8 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] [instance: 32c49b67-aa8e-4d47-81d1-89b815c998b4] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:11:48.853594 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-18158d9e-a32f-424a-8df6-f6765136cdb8 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:48.854826 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-18158d9e-a32f-424a-8df6-f6765136cdb8 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:48.858004 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-18158d9e-a32f-424a-8df6-f6765136cdb8 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:48.868034 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-18158d9e-a32f-424a-8df6-f6765136cdb8 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:49.097040 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-18158d9e-a32f-424a-8df6-f6765136cdb8 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384629ef0b104b8f8cbafdc56b16268b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa9c2c0819ea44c491b641d564d4cec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:49.104860 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-18158d9e-a32f-424a-8df6-f6765136cdb8 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] 10.222.0.48 "GET /compute/v2.1/servers/32c49b67-aa8e-4d47-81d1-89b815c998b4" status: 200 len: 1315 microversion: 2.1 time: 0.265527 Jun 17 15:11:49.114578 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 48/88] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:11:48 2022] GET /compute/v2.1/servers/32c49b67-aa8e-4d47-81d1-89b815c998b4 => generated 1315 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:11:49.189646 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-6c3b83d1-d6c6-4320-8c98-502a8417d674 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:11:49.190258 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-6c3b83d1-d6c6-4320-8c98-502a8417d674 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: 335fa25e-3f5c-45f0-9f85-f9c4681728b8] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:11:49.193159 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell0:SELECT=2 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:11:49.197177 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6c3b83d1-d6c6-4320-8c98-502a8417d674 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:49.197626 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6c3b83d1-d6c6-4320-8c98-502a8417d674 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:49.198389 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6c3b83d1-d6c6-4320-8c98-502a8417d674 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:49.198827 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6c3b83d1-d6c6-4320-8c98-502a8417d674 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:49.344548 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-6c3b83d1-d6c6-4320-8c98-502a8417d674 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:49.354057 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-6c3b83d1-d6c6-4320-8c98-502a8417d674 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/335fa25e-3f5c-45f0-9f85-f9c4681728b8" status: 200 len: 1321 microversion: 2.1 time: 0.167912 Jun 17 15:11:49.362899 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 41/89] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:11:49 2022] GET /compute/v2.1/servers/335fa25e-3f5c-45f0-9f85-f9c4681728b8 => generated 1321 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:11:49.386424 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-4902852a-7240-4226-9f6b-2cd548571d80 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:11:49.388428 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-4902852a-7240-4226-9f6b-2cd548571d80 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:11:49.398492 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4902852a-7240-4226-9f6b-2cd548571d80 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:49.399893 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4902852a-7240-4226-9f6b-2cd548571d80 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:49.401307 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4902852a-7240-4226-9f6b-2cd548571d80 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:49.402281 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4902852a-7240-4226-9f6b-2cd548571d80 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:49.590924 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-4902852a-7240-4226-9f6b-2cd548571d80 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:49.600363 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-4902852a-7240-4226-9f6b-2cd548571d80 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:49.603550 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-4902852a-7240-4226-9f6b-2cd548571d80 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:49.605032 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-4902852a-7240-4226-9f6b-2cd548571d80 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1405 microversion: 2.20 time: 0.224947 Jun 17 15:11:49.606332 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 49/90] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:11:49 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1405 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:11:49.665654 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [req-ac03a888-59fe-471b-90b9-b663a856b431 req-8c16b708-5881-47ac-acfd-6284139f2f10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f90be07-f969-4dc7-b8ab-a5a41f850645", "name": "network-vif-plugged", "status": "completed", "tag": "8f8f8dbb-e00e-4a7d-91ca-f20e554d9b8c"}, {"server_uuid": "e97df352-5cee-41f7-ae51-f55cd9e85869", "name": "network-vif-plugged", "status": "completed", "tag": "ff5c90be-6727-43d1-841f-760f94168fc6"}, {"server_uuid": "335fa25e-3f5c-45f0-9f85-f9c4681728b8", "name": "network-vif-plugged", "status": "completed", "tag": "a005990c-f75a-4864-aa74-da43c2a3e0a6"}]} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:11:49.689644 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-ac03a888-59fe-471b-90b9-b663a856b431 req-8c16b708-5881-47ac-acfd-6284139f2f10 service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:49.690254 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-ac03a888-59fe-471b-90b9-b663a856b431 req-8c16b708-5881-47ac-acfd-6284139f2f10 service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:49.714315 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.compute.server_external_events [req-ac03a888-59fe-471b-90b9-b663a856b431 req-8c16b708-5881-47ac-acfd-6284139f2f10 service nova] Creating event network-vif-plugged:8f8f8dbb-e00e-4a7d-91ca-f20e554d9b8c for instance 8f90be07-f969-4dc7-b8ab-a5a41f850645 on hv-cinder-82549 Jun 17 15:11:49.716148 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.compute.server_external_events [req-ac03a888-59fe-471b-90b9-b663a856b431 req-8c16b708-5881-47ac-acfd-6284139f2f10 service nova] Creating event network-vif-plugged:ff5c90be-6727-43d1-841f-760f94168fc6 for instance e97df352-5cee-41f7-ae51-f55cd9e85869 on hv-cinder-82549 Jun 17 15:11:49.717465 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.compute.server_external_events [req-ac03a888-59fe-471b-90b9-b663a856b431 req-8c16b708-5881-47ac-acfd-6284139f2f10 service nova] Creating event network-vif-plugged:a005990c-f75a-4864-aa74-da43c2a3e0a6 for instance 335fa25e-3f5c-45f0-9f85-f9c4681728b8 on hv-cinder-82549 Jun 17 15:11:49.731578 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [req-ac03a888-59fe-471b-90b9-b663a856b431 req-8c16b708-5881-47ac-acfd-6284139f2f10 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.072583 Jun 17 15:11:49.735327 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 42/91] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 15:11:49 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:11:50.123480 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-a08ed8d4-5444-42b0-af67-e0b8ac4f15bb tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:11:50.124658 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-a08ed8d4-5444-42b0-af67-e0b8ac4f15bb tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] [instance: 32c49b67-aa8e-4d47-81d1-89b815c998b4] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:11:50.130689 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a08ed8d4-5444-42b0-af67-e0b8ac4f15bb tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:50.131137 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a08ed8d4-5444-42b0-af67-e0b8ac4f15bb tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:50.131902 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a08ed8d4-5444-42b0-af67-e0b8ac4f15bb tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:50.132416 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a08ed8d4-5444-42b0-af67-e0b8ac4f15bb tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:50.307373 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-a08ed8d4-5444-42b0-af67-e0b8ac4f15bb tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384629ef0b104b8f8cbafdc56b16268b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa9c2c0819ea44c491b641d564d4cec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:50.316025 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-a08ed8d4-5444-42b0-af67-e0b8ac4f15bb tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] 10.222.0.48 "GET /compute/v2.1/servers/32c49b67-aa8e-4d47-81d1-89b815c998b4" status: 200 len: 1315 microversion: 2.1 time: 0.196920 Jun 17 15:11:50.316890 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 50/92] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:11:50 2022] GET /compute/v2.1/servers/32c49b67-aa8e-4d47-81d1-89b815c998b4 => generated 1315 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:11:50.371626 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-1ea281a6-7b06-4096-8d59-84a62e0c9b1e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:11:50.374530 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-1ea281a6-7b06-4096-8d59-84a62e0c9b1e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: 335fa25e-3f5c-45f0-9f85-f9c4681728b8] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:11:50.384281 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1ea281a6-7b06-4096-8d59-84a62e0c9b1e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:50.385254 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1ea281a6-7b06-4096-8d59-84a62e0c9b1e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:50.386747 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1ea281a6-7b06-4096-8d59-84a62e0c9b1e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:50.387639 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1ea281a6-7b06-4096-8d59-84a62e0c9b1e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:50.596801 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-1ea281a6-7b06-4096-8d59-84a62e0c9b1e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:50.609806 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-1ea281a6-7b06-4096-8d59-84a62e0c9b1e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/335fa25e-3f5c-45f0-9f85-f9c4681728b8" status: 200 len: 1321 microversion: 2.1 time: 0.242394 Jun 17 15:11:50.610856 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 43/93] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:11:50 2022] GET /compute/v2.1/servers/335fa25e-3f5c-45f0-9f85-f9c4681728b8 => generated 1321 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:11:50.626944 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-51c00a38-2d01-4ffa-826d-10031ca75f97 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:11:50.628974 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-51c00a38-2d01-4ffa-826d-10031ca75f97 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:11:50.642098 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-51c00a38-2d01-4ffa-826d-10031ca75f97 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:50.643400 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-51c00a38-2d01-4ffa-826d-10031ca75f97 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:50.645896 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-51c00a38-2d01-4ffa-826d-10031ca75f97 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:50.646538 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-51c00a38-2d01-4ffa-826d-10031ca75f97 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:50.899790 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-51c00a38-2d01-4ffa-826d-10031ca75f97 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:50.920010 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-51c00a38-2d01-4ffa-826d-10031ca75f97 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:50.921563 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-51c00a38-2d01-4ffa-826d-10031ca75f97 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:50.923346 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-51c00a38-2d01-4ffa-826d-10031ca75f97 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1405 microversion: 2.20 time: 0.302757 Jun 17 15:11:50.924377 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 51/94] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:11:50 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1405 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:11:51.334932 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-1de07c74-2945-41b2-a7f5-3fc4a56a5e86 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:11:51.335704 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-1de07c74-2945-41b2-a7f5-3fc4a56a5e86 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] [instance: 32c49b67-aa8e-4d47-81d1-89b815c998b4] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:11:51.343517 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1de07c74-2945-41b2-a7f5-3fc4a56a5e86 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:51.344044 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1de07c74-2945-41b2-a7f5-3fc4a56a5e86 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:51.345066 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1de07c74-2945-41b2-a7f5-3fc4a56a5e86 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:51.345512 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1de07c74-2945-41b2-a7f5-3fc4a56a5e86 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:51.497819 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-1de07c74-2945-41b2-a7f5-3fc4a56a5e86 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384629ef0b104b8f8cbafdc56b16268b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa9c2c0819ea44c491b641d564d4cec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:51.512970 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-1de07c74-2945-41b2-a7f5-3fc4a56a5e86 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] 10.222.0.48 "GET /compute/v2.1/servers/32c49b67-aa8e-4d47-81d1-89b815c998b4" status: 200 len: 1315 microversion: 2.1 time: 0.182089 Jun 17 15:11:51.513883 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 44/95] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:11:51 2022] GET /compute/v2.1/servers/32c49b67-aa8e-4d47-81d1-89b815c998b4 => generated 1315 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:11:51.626508 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-94353ad2-64b2-4755-903a-7ebf2b73819d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:11:51.627258 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-94353ad2-64b2-4755-903a-7ebf2b73819d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: 335fa25e-3f5c-45f0-9f85-f9c4681728b8] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:11:51.634147 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-94353ad2-64b2-4755-903a-7ebf2b73819d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:51.634602 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-94353ad2-64b2-4755-903a-7ebf2b73819d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:51.635369 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-94353ad2-64b2-4755-903a-7ebf2b73819d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:51.635800 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-94353ad2-64b2-4755-903a-7ebf2b73819d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:51.798974 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-94353ad2-64b2-4755-903a-7ebf2b73819d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:51.806812 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-94353ad2-64b2-4755-903a-7ebf2b73819d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/335fa25e-3f5c-45f0-9f85-f9c4681728b8" status: 200 len: 1321 microversion: 2.1 time: 0.184059 Jun 17 15:11:51.807386 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 52/96] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:11:51 2022] GET /compute/v2.1/servers/335fa25e-3f5c-45f0-9f85-f9c4681728b8 => generated 1321 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:11:51.944566 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-a900a3a6-ead8-4ed2-ba52-0d0eb1c90414 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:11:51.945372 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-a900a3a6-ead8-4ed2-ba52-0d0eb1c90414 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:11:51.962637 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a900a3a6-ead8-4ed2-ba52-0d0eb1c90414 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:51.963150 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a900a3a6-ead8-4ed2-ba52-0d0eb1c90414 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:51.964251 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a900a3a6-ead8-4ed2-ba52-0d0eb1c90414 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:51.968370 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a900a3a6-ead8-4ed2-ba52-0d0eb1c90414 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:52.397904 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-a900a3a6-ead8-4ed2-ba52-0d0eb1c90414 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:52.411538 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-a900a3a6-ead8-4ed2-ba52-0d0eb1c90414 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:52.413827 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-a900a3a6-ead8-4ed2-ba52-0d0eb1c90414 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:52.415885 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-a900a3a6-ead8-4ed2-ba52-0d0eb1c90414 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1405 microversion: 2.20 time: 0.478315 Jun 17 15:11:52.427363 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 45/97] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:11:51 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1405 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:11:52.532063 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-8e9539d1-e102-45ba-858f-1b3fd259f832 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:11:52.533425 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-8e9539d1-e102-45ba-858f-1b3fd259f832 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] [instance: 32c49b67-aa8e-4d47-81d1-89b815c998b4] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:11:52.542204 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8e9539d1-e102-45ba-858f-1b3fd259f832 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:52.542901 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8e9539d1-e102-45ba-858f-1b3fd259f832 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:52.543870 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8e9539d1-e102-45ba-858f-1b3fd259f832 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:52.544311 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8e9539d1-e102-45ba-858f-1b3fd259f832 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:52.566879 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=100 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:11:52.713820 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-8e9539d1-e102-45ba-858f-1b3fd259f832 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384629ef0b104b8f8cbafdc56b16268b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa9c2c0819ea44c491b641d564d4cec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:52.722704 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-8e9539d1-e102-45ba-858f-1b3fd259f832 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] 10.222.0.48 "GET /compute/v2.1/servers/32c49b67-aa8e-4d47-81d1-89b815c998b4" status: 200 len: 1315 microversion: 2.1 time: 0.196493 Jun 17 15:11:52.723479 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 53/98] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:11:52 2022] GET /compute/v2.1/servers/32c49b67-aa8e-4d47-81d1-89b815c998b4 => generated 1315 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:11:52.822986 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-bbdc5a18-2abc-48fb-920b-4f2658ab2966 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:11:52.823641 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-bbdc5a18-2abc-48fb-920b-4f2658ab2966 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: 335fa25e-3f5c-45f0-9f85-f9c4681728b8] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:11:52.830579 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bbdc5a18-2abc-48fb-920b-4f2658ab2966 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:52.831331 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bbdc5a18-2abc-48fb-920b-4f2658ab2966 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:52.832318 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bbdc5a18-2abc-48fb-920b-4f2658ab2966 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:52.832783 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bbdc5a18-2abc-48fb-920b-4f2658ab2966 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:52.993697 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-bbdc5a18-2abc-48fb-920b-4f2658ab2966 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:53.002082 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-bbdc5a18-2abc-48fb-920b-4f2658ab2966 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/335fa25e-3f5c-45f0-9f85-f9c4681728b8" status: 200 len: 1321 microversion: 2.1 time: 0.182984 Jun 17 15:11:53.002884 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 46/99] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:11:52 2022] GET /compute/v2.1/servers/335fa25e-3f5c-45f0-9f85-f9c4681728b8 => generated 1321 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:11:53.435115 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-bb5967fb-c53f-4016-808b-7116b5702dab tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:11:53.436046 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-bb5967fb-c53f-4016-808b-7116b5702dab tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:11:53.444485 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bb5967fb-c53f-4016-808b-7116b5702dab tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:53.445159 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bb5967fb-c53f-4016-808b-7116b5702dab tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:53.446722 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bb5967fb-c53f-4016-808b-7116b5702dab tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:53.447368 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bb5967fb-c53f-4016-808b-7116b5702dab tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:53.740598 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-8e56026f-af15-4d97-9cb0-79c1a41392bf tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:11:53.741185 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-8e56026f-af15-4d97-9cb0-79c1a41392bf tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] [instance: 32c49b67-aa8e-4d47-81d1-89b815c998b4] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:11:53.748349 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8e56026f-af15-4d97-9cb0-79c1a41392bf tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:53.749011 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8e56026f-af15-4d97-9cb0-79c1a41392bf tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:53.749941 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8e56026f-af15-4d97-9cb0-79c1a41392bf tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:53.750526 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8e56026f-af15-4d97-9cb0-79c1a41392bf tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:53.822338 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-bb5967fb-c53f-4016-808b-7116b5702dab tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:53.837072 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-bb5967fb-c53f-4016-808b-7116b5702dab tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:53.838749 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-bb5967fb-c53f-4016-808b-7116b5702dab tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:53.839975 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-bb5967fb-c53f-4016-808b-7116b5702dab tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1405 microversion: 2.20 time: 0.409355 Jun 17 15:11:53.840659 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 54/100] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:11:53 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1405 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:11:53.961092 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-8e56026f-af15-4d97-9cb0-79c1a41392bf tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384629ef0b104b8f8cbafdc56b16268b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa9c2c0819ea44c491b641d564d4cec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:53.970790 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-8e56026f-af15-4d97-9cb0-79c1a41392bf tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] 10.222.0.48 "GET /compute/v2.1/servers/32c49b67-aa8e-4d47-81d1-89b815c998b4" status: 200 len: 1503 microversion: 2.1 time: 0.234697 Jun 17 15:11:53.972125 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 47/101] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:11:53 2022] GET /compute/v2.1/servers/32c49b67-aa8e-4d47-81d1-89b815c998b4 => generated 1503 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:11:54.020845 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-d693dcc2-9ea7-47b1-8ca2-cb9c2af872c3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:11:54.021741 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-d693dcc2-9ea7-47b1-8ca2-cb9c2af872c3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: 335fa25e-3f5c-45f0-9f85-f9c4681728b8] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:11:54.032737 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d693dcc2-9ea7-47b1-8ca2-cb9c2af872c3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:54.033440 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d693dcc2-9ea7-47b1-8ca2-cb9c2af872c3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:54.034643 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d693dcc2-9ea7-47b1-8ca2-cb9c2af872c3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:54.035270 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d693dcc2-9ea7-47b1-8ca2-cb9c2af872c3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:54.241008 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-d693dcc2-9ea7-47b1-8ca2-cb9c2af872c3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:54.263492 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-d693dcc2-9ea7-47b1-8ca2-cb9c2af872c3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/335fa25e-3f5c-45f0-9f85-f9c4681728b8" status: 200 len: 1321 microversion: 2.1 time: 0.248110 Jun 17 15:11:54.265757 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 55/102] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:11:54 2022] GET /compute/v2.1/servers/335fa25e-3f5c-45f0-9f85-f9c4681728b8 => generated 1321 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:11:54.858848 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-ff469005-a444-4800-ab53-680a9623739b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:11:54.859707 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-ff469005-a444-4800-ab53-680a9623739b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:11:54.867942 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ff469005-a444-4800-ab53-680a9623739b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:54.871613 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ff469005-a444-4800-ab53-680a9623739b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:54.872871 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ff469005-a444-4800-ab53-680a9623739b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:54.873470 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ff469005-a444-4800-ab53-680a9623739b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:55.102883 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-ff469005-a444-4800-ab53-680a9623739b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:55.112318 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-ff469005-a444-4800-ab53-680a9623739b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:55.113885 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-ff469005-a444-4800-ab53-680a9623739b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:55.115307 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-ff469005-a444-4800-ab53-680a9623739b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1596 microversion: 2.20 time: 0.260865 Jun 17 15:11:55.116090 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 48/103] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:11:54 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1596 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:11:55.136237 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-8fa14e50-c8b2-46bb-b6ca-0f6a8de3b58f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:11:55.138159 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-8fa14e50-c8b2-46bb-b6ca-0f6a8de3b58f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:11:55.148192 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8fa14e50-c8b2-46bb-b6ca-0f6a8de3b58f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:55.149600 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8fa14e50-c8b2-46bb-b6ca-0f6a8de3b58f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:55.150801 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8fa14e50-c8b2-46bb-b6ca-0f6a8de3b58f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:55.151386 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8fa14e50-c8b2-46bb-b6ca-0f6a8de3b58f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:55.288438 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-b0410a5d-2173-4693-ad7f-a5af76d0bcf9 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:11:55.289399 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-b0410a5d-2173-4693-ad7f-a5af76d0bcf9 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: 335fa25e-3f5c-45f0-9f85-f9c4681728b8] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:11:55.290859 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-8fa14e50-c8b2-46bb-b6ca-0f6a8de3b58f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.159301 Jun 17 15:11:55.291443 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 56/104] 10.222.0.48 () {60 vars in 1315 bytes} [Fri Jun 17 15:11:55 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-interface => generated 284 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:11:55.296173 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b0410a5d-2173-4693-ad7f-a5af76d0bcf9 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:55.296653 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b0410a5d-2173-4693-ad7f-a5af76d0bcf9 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:55.297491 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b0410a5d-2173-4693-ad7f-a5af76d0bcf9 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:55.297934 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b0410a5d-2173-4693-ad7f-a5af76d0bcf9 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:55.524296 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-1a8e66e9-1db9-4378-bd5b-ca979d6d4a36 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "55e832fc-7266-43e1-9257-5dfcaa697482"}} {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:11:55.525569 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-1a8e66e9-1db9-4378-bd5b-ca979d6d4a36 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] [instance: 32c49b67-aa8e-4d47-81d1-89b815c998b4] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:11:55.535151 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1a8e66e9-1db9-4378-bd5b-ca979d6d4a36 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:55.536711 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1a8e66e9-1db9-4378-bd5b-ca979d6d4a36 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:55.538975 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1a8e66e9-1db9-4378-bd5b-ca979d6d4a36 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:55.540259 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1a8e66e9-1db9-4378-bd5b-ca979d6d4a36 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:55.643649 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-b0410a5d-2173-4693-ad7f-a5af76d0bcf9 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:55.648160 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell1:SELECT=100 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:11:55.655175 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-b0410a5d-2173-4693-ad7f-a5af76d0bcf9 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/335fa25e-3f5c-45f0-9f85-f9c4681728b8" status: 200 len: 1321 microversion: 2.1 time: 0.370848 Jun 17 15:11:55.655767 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 49/105] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:11:55 2022] GET /compute/v2.1/servers/335fa25e-3f5c-45f0-9f85-f9c4681728b8 => generated 1321 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:11:56.678776 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-c0d6da64-fc00-4788-812e-36383daef490 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:11:56.681657 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-c0d6da64-fc00-4788-812e-36383daef490 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: 335fa25e-3f5c-45f0-9f85-f9c4681728b8] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:11:56.692772 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c0d6da64-fc00-4788-812e-36383daef490 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:56.694445 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c0d6da64-fc00-4788-812e-36383daef490 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:56.695567 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c0d6da64-fc00-4788-812e-36383daef490 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:56.696257 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c0d6da64-fc00-4788-812e-36383daef490 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:56.975935 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-c0d6da64-fc00-4788-812e-36383daef490 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:56.994626 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-c0d6da64-fc00-4788-812e-36383daef490 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/335fa25e-3f5c-45f0-9f85-f9c4681728b8" status: 200 len: 1321 microversion: 2.1 time: 0.324408 Jun 17 15:11:56.996221 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 50/106] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:11:56 2022] GET /compute/v2.1/servers/335fa25e-3f5c-45f0-9f85-f9c4681728b8 => generated 1321 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:11:57.325228 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-1a8e66e9-1db9-4378-bd5b-ca979d6d4a36 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] 10.222.0.48 "POST /compute/v2.1/servers/32c49b67-aa8e-4d47-81d1-89b815c998b4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.791799 Jun 17 15:11:57.327115 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 57/107] 10.222.0.48 () {60 vars in 1322 bytes} [Fri Jun 17 15:11:55 2022] POST /compute/v2.1/servers/32c49b67-aa8e-4d47-81d1-89b815c998b4/os-volume_attachments => generated 194 bytes in 1809 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:11:57.342085 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [req-e3f009c8-18c5-4df5-8bfa-f2da8687b9f9 req-94977b5c-260c-43d4-a48a-5ad80623028f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e97df352-5cee-41f7-ae51-f55cd9e85869", "tag": "ff5c90be-6727-43d1-841f-760f94168fc6"}]} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:11:57.368767 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-e3f009c8-18c5-4df5-8bfa-f2da8687b9f9 req-94977b5c-260c-43d4-a48a-5ad80623028f service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:57.370634 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-e3f009c8-18c5-4df5-8bfa-f2da8687b9f9 req-94977b5c-260c-43d4-a48a-5ad80623028f service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:57.427618 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.compute.server_external_events [req-e3f009c8-18c5-4df5-8bfa-f2da8687b9f9 req-94977b5c-260c-43d4-a48a-5ad80623028f service nova] Creating event network-changed:ff5c90be-6727-43d1-841f-760f94168fc6 for instance e97df352-5cee-41f7-ae51-f55cd9e85869 on hv-cinder-82549 Jun 17 15:11:57.444078 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [req-e3f009c8-18c5-4df5-8bfa-f2da8687b9f9 req-94977b5c-260c-43d4-a48a-5ad80623028f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108032 Jun 17 15:11:57.451760 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 51/108] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 15:11:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:11:58.022114 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-1fb63bec-22a5-41ff-9860-d3b4b8258e2d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:11:58.024164 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-1fb63bec-22a5-41ff-9860-d3b4b8258e2d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: 335fa25e-3f5c-45f0-9f85-f9c4681728b8] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:11:58.039961 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1fb63bec-22a5-41ff-9860-d3b4b8258e2d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:58.040707 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1fb63bec-22a5-41ff-9860-d3b4b8258e2d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:58.041723 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1fb63bec-22a5-41ff-9860-d3b4b8258e2d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:58.042429 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1fb63bec-22a5-41ff-9860-d3b4b8258e2d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:58.475104 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-1fb63bec-22a5-41ff-9860-d3b4b8258e2d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:58.489227 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-1fb63bec-22a5-41ff-9860-d3b4b8258e2d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/335fa25e-3f5c-45f0-9f85-f9c4681728b8" status: 200 len: 1512 microversion: 2.1 time: 0.479700 Jun 17 15:11:58.490337 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 58/109] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:11:58 2022] GET /compute/v2.1/servers/335fa25e-3f5c-45f0-9f85-f9c4681728b8 => generated 1512 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:11:58.512458 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-bbd92cb0-74c1-4d46-bd6d-f1aa420d002f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:11:58.516391 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-bbd92cb0-74c1-4d46-bd6d-f1aa420d002f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: 335fa25e-3f5c-45f0-9f85-f9c4681728b8] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:11:58.533104 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bbd92cb0-74c1-4d46-bd6d-f1aa420d002f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:58.535973 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bbd92cb0-74c1-4d46-bd6d-f1aa420d002f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:58.538632 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bbd92cb0-74c1-4d46-bd6d-f1aa420d002f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:58.540220 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bbd92cb0-74c1-4d46-bd6d-f1aa420d002f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:58.716760 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.objects.instance [None req-bbd92cb0-74c1-4d46-bd6d-f1aa420d002f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lazy-loading 'flavor' on Instance uuid 335fa25e-3f5c-45f0-9f85-f9c4681728b8 {{(pid=117649) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 15:11:58.901327 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-bbd92cb0-74c1-4d46-bd6d-f1aa420d002f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "POST /compute/v2.1/servers/335fa25e-3f5c-45f0-9f85-f9c4681728b8/action" status: 200 len: 32 microversion: 2.1 time: 0.395624 Jun 17 15:11:58.903563 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 52/110] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jun 17 15:11:58 2022] POST /compute/v2.1/servers/335fa25e-3f5c-45f0-9f85-f9c4681728b8/action => generated 32 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 17 15:11:58.913130 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-03114182-96cf-4d52-88e4-2d0189e395c7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:11:58.914114 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-03114182-96cf-4d52-88e4-2d0189e395c7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: 335fa25e-3f5c-45f0-9f85-f9c4681728b8] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:11:58.927236 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-03114182-96cf-4d52-88e4-2d0189e395c7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:58.931137 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-03114182-96cf-4d52-88e4-2d0189e395c7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:58.935185 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-03114182-96cf-4d52-88e4-2d0189e395c7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:11:58.935705 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-03114182-96cf-4d52-88e4-2d0189e395c7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:11:59.266088 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-03114182-96cf-4d52-88e4-2d0189e395c7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:11:59.279272 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-03114182-96cf-4d52-88e4-2d0189e395c7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/335fa25e-3f5c-45f0-9f85-f9c4681728b8" status: 200 len: 1518 microversion: 2.1 time: 0.370688 Jun 17 15:11:59.280646 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 59/111] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:11:58 2022] GET /compute/v2.1/servers/335fa25e-3f5c-45f0-9f85-f9c4681728b8 => generated 1518 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:12:00.300112 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-579317e3-547d-49ab-9722-2ddd14f328e7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:12:00.301829 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-579317e3-547d-49ab-9722-2ddd14f328e7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: 335fa25e-3f5c-45f0-9f85-f9c4681728b8] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:12:00.315188 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-579317e3-547d-49ab-9722-2ddd14f328e7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:00.315651 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-579317e3-547d-49ab-9722-2ddd14f328e7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:00.316481 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-579317e3-547d-49ab-9722-2ddd14f328e7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:00.316932 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-579317e3-547d-49ab-9722-2ddd14f328e7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:00.496877 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-579317e3-547d-49ab-9722-2ddd14f328e7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:12:00.504702 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-579317e3-547d-49ab-9722-2ddd14f328e7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/335fa25e-3f5c-45f0-9f85-f9c4681728b8" status: 200 len: 1518 microversion: 2.1 time: 0.209233 Jun 17 15:12:00.505402 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 53/112] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:12:00 2022] GET /compute/v2.1/servers/335fa25e-3f5c-45f0-9f85-f9c4681728b8 => generated 1518 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:12:01.528364 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-f41f10b1-ccc9-48a4-9096-073c15b53e0e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:12:01.531279 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-f41f10b1-ccc9-48a4-9096-073c15b53e0e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: 335fa25e-3f5c-45f0-9f85-f9c4681728b8] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:12:01.539770 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f41f10b1-ccc9-48a4-9096-073c15b53e0e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:01.540753 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f41f10b1-ccc9-48a4-9096-073c15b53e0e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:01.541600 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f41f10b1-ccc9-48a4-9096-073c15b53e0e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:01.542252 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f41f10b1-ccc9-48a4-9096-073c15b53e0e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:01.709764 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-f41f10b1-ccc9-48a4-9096-073c15b53e0e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:12:01.720978 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-f41f10b1-ccc9-48a4-9096-073c15b53e0e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/335fa25e-3f5c-45f0-9f85-f9c4681728b8" status: 200 len: 1518 microversion: 2.1 time: 0.200112 Jun 17 15:12:01.732455 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 60/113] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:12:01 2022] GET /compute/v2.1/servers/335fa25e-3f5c-45f0-9f85-f9c4681728b8 => generated 1518 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:12:02.739796 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-75d2290e-2b7f-457e-90a3-7732a1fb12ba tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:12:02.739796 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-75d2290e-2b7f-457e-90a3-7732a1fb12ba tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: 335fa25e-3f5c-45f0-9f85-f9c4681728b8] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:12:02.746865 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-75d2290e-2b7f-457e-90a3-7732a1fb12ba tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:02.748174 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-75d2290e-2b7f-457e-90a3-7732a1fb12ba tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:02.748987 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-75d2290e-2b7f-457e-90a3-7732a1fb12ba tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:02.749423 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-75d2290e-2b7f-457e-90a3-7732a1fb12ba tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:02.984597 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-75d2290e-2b7f-457e-90a3-7732a1fb12ba tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:12:02.993013 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-75d2290e-2b7f-457e-90a3-7732a1fb12ba tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/335fa25e-3f5c-45f0-9f85-f9c4681728b8" status: 200 len: 1518 microversion: 2.1 time: 0.257843 Jun 17 15:12:03.003872 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 54/114] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:12:02 2022] GET /compute/v2.1/servers/335fa25e-3f5c-45f0-9f85-f9c4681728b8 => generated 1518 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:12:04.009356 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-70213ab6-5d42-4550-bec8-acc12af98d24 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:12:04.009896 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-70213ab6-5d42-4550-bec8-acc12af98d24 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: 335fa25e-3f5c-45f0-9f85-f9c4681728b8] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:12:04.018798 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-70213ab6-5d42-4550-bec8-acc12af98d24 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:04.019565 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-70213ab6-5d42-4550-bec8-acc12af98d24 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:04.020493 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-70213ab6-5d42-4550-bec8-acc12af98d24 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:04.020921 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-70213ab6-5d42-4550-bec8-acc12af98d24 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:04.211398 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-70213ab6-5d42-4550-bec8-acc12af98d24 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:12:04.223906 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-70213ab6-5d42-4550-bec8-acc12af98d24 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/335fa25e-3f5c-45f0-9f85-f9c4681728b8" status: 200 len: 1518 microversion: 2.1 time: 0.218354 Jun 17 15:12:04.224821 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 61/115] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:12:04 2022] GET /compute/v2.1/servers/335fa25e-3f5c-45f0-9f85-f9c4681728b8 => generated 1518 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:12:05.247755 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-5bf2ad97-0b6e-4728-9cf1-08e9ad155f8a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:12:05.248423 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-5bf2ad97-0b6e-4728-9cf1-08e9ad155f8a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: 335fa25e-3f5c-45f0-9f85-f9c4681728b8] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:12:05.254593 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5bf2ad97-0b6e-4728-9cf1-08e9ad155f8a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:05.255039 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5bf2ad97-0b6e-4728-9cf1-08e9ad155f8a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:05.255788 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5bf2ad97-0b6e-4728-9cf1-08e9ad155f8a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:05.256216 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5bf2ad97-0b6e-4728-9cf1-08e9ad155f8a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:05.392810 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-5bf2ad97-0b6e-4728-9cf1-08e9ad155f8a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:12:05.400786 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-5bf2ad97-0b6e-4728-9cf1-08e9ad155f8a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/335fa25e-3f5c-45f0-9f85-f9c4681728b8" status: 200 len: 1518 microversion: 2.1 time: 0.163239 Jun 17 15:12:05.401343 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 55/116] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:12:05 2022] GET /compute/v2.1/servers/335fa25e-3f5c-45f0-9f85-f9c4681728b8 => generated 1518 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:12:06.417411 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-962d6bd3-bade-480b-a3cc-a0817c73d751 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:12:06.418019 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-962d6bd3-bade-480b-a3cc-a0817c73d751 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: 335fa25e-3f5c-45f0-9f85-f9c4681728b8] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:12:06.425253 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-962d6bd3-bade-480b-a3cc-a0817c73d751 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:06.425910 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-962d6bd3-bade-480b-a3cc-a0817c73d751 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:06.426718 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-962d6bd3-bade-480b-a3cc-a0817c73d751 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:06.427251 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-962d6bd3-bade-480b-a3cc-a0817c73d751 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:06.563169 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-962d6bd3-bade-480b-a3cc-a0817c73d751 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:12:06.571196 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-962d6bd3-bade-480b-a3cc-a0817c73d751 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/335fa25e-3f5c-45f0-9f85-f9c4681728b8" status: 200 len: 1518 microversion: 2.1 time: 0.156905 Jun 17 15:12:06.571760 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 62/117] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:12:06 2022] GET /compute/v2.1/servers/335fa25e-3f5c-45f0-9f85-f9c4681728b8 => generated 1518 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:12:07.587357 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-92b7f6eb-be79-4f8d-9e96-ea21f43b5d9d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:12:07.587985 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-92b7f6eb-be79-4f8d-9e96-ea21f43b5d9d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: 335fa25e-3f5c-45f0-9f85-f9c4681728b8] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:12:07.590211 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_api:SELECT=58 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:12:07.595147 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-92b7f6eb-be79-4f8d-9e96-ea21f43b5d9d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:07.595594 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-92b7f6eb-be79-4f8d-9e96-ea21f43b5d9d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:07.596402 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-92b7f6eb-be79-4f8d-9e96-ea21f43b5d9d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:07.596815 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-92b7f6eb-be79-4f8d-9e96-ea21f43b5d9d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:07.806337 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-92b7f6eb-be79-4f8d-9e96-ea21f43b5d9d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:12:07.813881 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-92b7f6eb-be79-4f8d-9e96-ea21f43b5d9d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/335fa25e-3f5c-45f0-9f85-f9c4681728b8" status: 200 len: 1518 microversion: 2.1 time: 0.230856 Jun 17 15:12:07.814445 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 56/118] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:12:07 2022] GET /compute/v2.1/servers/335fa25e-3f5c-45f0-9f85-f9c4681728b8 => generated 1518 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:12:08.835264 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-081e3825-d534-413a-886c-4abd367d6144 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:12:08.835264 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-081e3825-d534-413a-886c-4abd367d6144 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: 335fa25e-3f5c-45f0-9f85-f9c4681728b8] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:12:08.839570 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-081e3825-d534-413a-886c-4abd367d6144 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:08.840444 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-081e3825-d534-413a-886c-4abd367d6144 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:08.841596 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-081e3825-d534-413a-886c-4abd367d6144 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:08.841944 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-acfed9ae-c392-471b-9f52-05481be71e26 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:12:08.842490 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-081e3825-d534-413a-886c-4abd367d6144 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:08.842586 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-acfed9ae-c392-471b-9f52-05481be71e26 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] [instance: 32c49b67-aa8e-4d47-81d1-89b815c998b4] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:12:08.853972 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-acfed9ae-c392-471b-9f52-05481be71e26 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:08.854578 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-acfed9ae-c392-471b-9f52-05481be71e26 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:08.855355 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-acfed9ae-c392-471b-9f52-05481be71e26 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:08.855838 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-acfed9ae-c392-471b-9f52-05481be71e26 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:08.901280 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-acfed9ae-c392-471b-9f52-05481be71e26 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] [instance: 32c49b67-aa8e-4d47-81d1-89b815c998b4] Going to try to terminate instance {{(pid=117649) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 15:12:09.082649 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-acfed9ae-c392-471b-9f52-05481be71e26 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] 10.222.0.48 "DELETE /compute/v2.1/servers/32c49b67-aa8e-4d47-81d1-89b815c998b4" status: 204 len: 0 microversion: 2.1 time: 0.245520 Jun 17 15:12:09.083254 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 57/119] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jun 17 15:12:08 2022] DELETE /compute/v2.1/servers/32c49b67-aa8e-4d47-81d1-89b815c998b4 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 17 15:12:09.092607 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-fd293572-b46c-413e-a637-1fbf86a1049d tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:12:09.093371 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-fd293572-b46c-413e-a637-1fbf86a1049d tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] [instance: 32c49b67-aa8e-4d47-81d1-89b815c998b4] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:12:09.102439 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-081e3825-d534-413a-886c-4abd367d6144 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:12:09.104394 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fd293572-b46c-413e-a637-1fbf86a1049d tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:09.105048 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fd293572-b46c-413e-a637-1fbf86a1049d tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:09.106026 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fd293572-b46c-413e-a637-1fbf86a1049d tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:09.106627 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fd293572-b46c-413e-a637-1fbf86a1049d tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:09.113615 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-081e3825-d534-413a-886c-4abd367d6144 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/335fa25e-3f5c-45f0-9f85-f9c4681728b8" status: 200 len: 1518 microversion: 2.1 time: 0.286577 Jun 17 15:12:09.124574 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 63/120] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:12:08 2022] GET /compute/v2.1/servers/335fa25e-3f5c-45f0-9f85-f9c4681728b8 => generated 1518 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:12:09.317629 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-fd293572-b46c-413e-a637-1fbf86a1049d tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384629ef0b104b8f8cbafdc56b16268b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa9c2c0819ea44c491b641d564d4cec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:12:09.326038 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-fd293572-b46c-413e-a637-1fbf86a1049d tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] 10.222.0.48 "GET /compute/v2.1/servers/32c49b67-aa8e-4d47-81d1-89b815c998b4" status: 200 len: 1555 microversion: 2.1 time: 0.238139 Jun 17 15:12:09.327279 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 58/121] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:12:09 2022] GET /compute/v2.1/servers/32c49b67-aa8e-4d47-81d1-89b815c998b4 => generated 1555 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:12:10.132556 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-d61f9dee-a555-404e-be64-591e31774eb4 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:12:10.133889 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-d61f9dee-a555-404e-be64-591e31774eb4 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: 335fa25e-3f5c-45f0-9f85-f9c4681728b8] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:12:10.140419 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d61f9dee-a555-404e-be64-591e31774eb4 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:10.140967 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d61f9dee-a555-404e-be64-591e31774eb4 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:10.141824 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d61f9dee-a555-404e-be64-591e31774eb4 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:10.142374 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d61f9dee-a555-404e-be64-591e31774eb4 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:10.333305 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-d61f9dee-a555-404e-be64-591e31774eb4 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:12:10.341953 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-d61f9dee-a555-404e-be64-591e31774eb4 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/335fa25e-3f5c-45f0-9f85-f9c4681728b8" status: 200 len: 1518 microversion: 2.1 time: 0.213556 Jun 17 15:12:10.342577 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 64/122] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:12:10 2022] GET /compute/v2.1/servers/335fa25e-3f5c-45f0-9f85-f9c4681728b8 => generated 1518 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:12:10.345976 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-8b5d250c-2d5c-4403-9b6a-0464cb25eedd tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:12:10.351321 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-8b5d250c-2d5c-4403-9b6a-0464cb25eedd tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] [instance: 32c49b67-aa8e-4d47-81d1-89b815c998b4] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:12:10.358225 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8b5d250c-2d5c-4403-9b6a-0464cb25eedd tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:10.358571 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8b5d250c-2d5c-4403-9b6a-0464cb25eedd tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:10.359332 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8b5d250c-2d5c-4403-9b6a-0464cb25eedd tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:10.359766 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8b5d250c-2d5c-4403-9b6a-0464cb25eedd tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:10.506653 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-8b5d250c-2d5c-4403-9b6a-0464cb25eedd tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384629ef0b104b8f8cbafdc56b16268b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa9c2c0819ea44c491b641d564d4cec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:12:10.514689 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-8b5d250c-2d5c-4403-9b6a-0464cb25eedd tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] 10.222.0.48 "GET /compute/v2.1/servers/32c49b67-aa8e-4d47-81d1-89b815c998b4" status: 200 len: 1555 microversion: 2.1 time: 0.174261 Jun 17 15:12:10.515432 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 59/123] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:12:10 2022] GET /compute/v2.1/servers/32c49b67-aa8e-4d47-81d1-89b815c998b4 => generated 1555 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:12:11.359994 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-efd2898b-b943-4aec-a501-a4fb6347736f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:12:11.361511 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-efd2898b-b943-4aec-a501-a4fb6347736f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: 335fa25e-3f5c-45f0-9f85-f9c4681728b8] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:12:11.378993 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_api:SELECT=52 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:12:11.380828 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-efd2898b-b943-4aec-a501-a4fb6347736f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:11.381509 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-efd2898b-b943-4aec-a501-a4fb6347736f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:11.382453 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-efd2898b-b943-4aec-a501-a4fb6347736f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:11.383260 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-efd2898b-b943-4aec-a501-a4fb6347736f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:11.531144 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-892275ff-6728-465d-9833-bc482fd56152 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:12:11.531750 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-892275ff-6728-465d-9833-bc482fd56152 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] [instance: 32c49b67-aa8e-4d47-81d1-89b815c998b4] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:12:11.539746 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-892275ff-6728-465d-9833-bc482fd56152 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:11.540297 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-892275ff-6728-465d-9833-bc482fd56152 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:11.541083 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-892275ff-6728-465d-9833-bc482fd56152 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:11.541870 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-892275ff-6728-465d-9833-bc482fd56152 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:11.555694 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-efd2898b-b943-4aec-a501-a4fb6347736f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:12:11.565560 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-efd2898b-b943-4aec-a501-a4fb6347736f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/335fa25e-3f5c-45f0-9f85-f9c4681728b8" status: 200 len: 1518 microversion: 2.1 time: 0.209912 Jun 17 15:12:11.575857 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 65/124] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:12:11 2022] GET /compute/v2.1/servers/335fa25e-3f5c-45f0-9f85-f9c4681728b8 => generated 1518 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:12:11.816698 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-892275ff-6728-465d-9833-bc482fd56152 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384629ef0b104b8f8cbafdc56b16268b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa9c2c0819ea44c491b641d564d4cec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:12:11.824919 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-892275ff-6728-465d-9833-bc482fd56152 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] 10.222.0.48 "GET /compute/v2.1/servers/32c49b67-aa8e-4d47-81d1-89b815c998b4" status: 200 len: 1555 microversion: 2.1 time: 0.297800 Jun 17 15:12:11.825573 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 60/125] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:12:11 2022] GET /compute/v2.1/servers/32c49b67-aa8e-4d47-81d1-89b815c998b4 => generated 1555 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:12:12.156842 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [req-cc6f4f81-9be0-4f1b-818a-8122ad9c9b09 req-0673d817-1ada-4fd5-97f6-367755bcff48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32c49b67-aa8e-4d47-81d1-89b815c998b4", "name": "network-vif-deleted", "tag": "ad1f3f82-6070-4ea5-8bfa-96f8667f63d9"}]} {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:12:12.188285 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [req-cc6f4f81-9be0-4f1b-818a-8122ad9c9b09 req-0673d817-1ada-4fd5-97f6-367755bcff48 service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:12.188753 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [req-cc6f4f81-9be0-4f1b-818a-8122ad9c9b09 req-0673d817-1ada-4fd5-97f6-367755bcff48 service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:12.209895 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.compute.server_external_events [req-cc6f4f81-9be0-4f1b-818a-8122ad9c9b09 req-0673d817-1ada-4fd5-97f6-367755bcff48 service nova] Creating event network-vif-deleted:ad1f3f82-6070-4ea5-8bfa-96f8667f63d9 for instance 32c49b67-aa8e-4d47-81d1-89b815c998b4 on hv-cinder-82549 Jun 17 15:12:12.218546 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [req-cc6f4f81-9be0-4f1b-818a-8122ad9c9b09 req-0673d817-1ada-4fd5-97f6-367755bcff48 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066625 Jun 17 15:12:12.219637 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 66/126] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 15:12:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:12:12.582450 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-b509f974-f4cd-4456-a67b-2fabd9ccddf7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:12:12.583840 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-b509f974-f4cd-4456-a67b-2fabd9ccddf7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: 335fa25e-3f5c-45f0-9f85-f9c4681728b8] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:12:12.595516 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b509f974-f4cd-4456-a67b-2fabd9ccddf7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:12.596190 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b509f974-f4cd-4456-a67b-2fabd9ccddf7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:12.597739 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b509f974-f4cd-4456-a67b-2fabd9ccddf7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:12.598208 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b509f974-f4cd-4456-a67b-2fabd9ccddf7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:12.846768 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-cd5d8122-836c-44fd-a364-00b15f4f6f5d tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:12:12.849183 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-cd5d8122-836c-44fd-a364-00b15f4f6f5d tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] [instance: 32c49b67-aa8e-4d47-81d1-89b815c998b4] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:12:12.860871 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cd5d8122-836c-44fd-a364-00b15f4f6f5d tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:12.862128 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cd5d8122-836c-44fd-a364-00b15f4f6f5d tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:12.863870 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cd5d8122-836c-44fd-a364-00b15f4f6f5d tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:12.864504 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cd5d8122-836c-44fd-a364-00b15f4f6f5d tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:12.921771 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-b509f974-f4cd-4456-a67b-2fabd9ccddf7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:12:12.929573 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cd5d8122-836c-44fd-a364-00b15f4f6f5d tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:12.931449 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cd5d8122-836c-44fd-a364-00b15f4f6f5d tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:12.932097 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.objects.instance [None req-cd5d8122-836c-44fd-a364-00b15f4f6f5d tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lazy-loading 'fault' on Instance uuid 32c49b67-aa8e-4d47-81d1-89b815c998b4 {{(pid=117650) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 15:12:12.937404 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-b509f974-f4cd-4456-a67b-2fabd9ccddf7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/335fa25e-3f5c-45f0-9f85-f9c4681728b8" status: 200 len: 1518 microversion: 2.1 time: 0.357582 Jun 17 15:12:12.951405 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 61/127] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:12:12 2022] GET /compute/v2.1/servers/335fa25e-3f5c-45f0-9f85-f9c4681728b8 => generated 1518 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:12:13.016098 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-cd5d8122-836c-44fd-a364-00b15f4f6f5d tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '384629ef0b104b8f8cbafdc56b16268b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa9c2c0819ea44c491b641d564d4cec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:12:13.034244 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-cd5d8122-836c-44fd-a364-00b15f4f6f5d tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] 10.222.0.48 "GET /compute/v2.1/servers/32c49b67-aa8e-4d47-81d1-89b815c998b4" status: 200 len: 1351 microversion: 2.1 time: 0.194257 Jun 17 15:12:13.036117 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 67/128] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:12:12 2022] GET /compute/v2.1/servers/32c49b67-aa8e-4d47-81d1-89b815c998b4 => generated 1351 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:12:13.958568 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-f5ee1ecd-05dd-4acd-90ed-5bde2d16a4df tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:12:13.959288 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-f5ee1ecd-05dd-4acd-90ed-5bde2d16a4df tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: 335fa25e-3f5c-45f0-9f85-f9c4681728b8] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:12:13.967373 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f5ee1ecd-05dd-4acd-90ed-5bde2d16a4df tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:13.967942 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f5ee1ecd-05dd-4acd-90ed-5bde2d16a4df tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:13.969019 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f5ee1ecd-05dd-4acd-90ed-5bde2d16a4df tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:13.969689 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f5ee1ecd-05dd-4acd-90ed-5bde2d16a4df tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:14.054349 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-5aa1c8d3-fa7f-4599-b3cb-fcfa32b34205 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:12:14.056169 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-5aa1c8d3-fa7f-4599-b3cb-fcfa32b34205 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] [instance: 32c49b67-aa8e-4d47-81d1-89b815c998b4] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:12:14.069657 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5aa1c8d3-fa7f-4599-b3cb-fcfa32b34205 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:14.071082 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5aa1c8d3-fa7f-4599-b3cb-fcfa32b34205 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:14.076820 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5aa1c8d3-fa7f-4599-b3cb-fcfa32b34205 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:14.077291 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5aa1c8d3-fa7f-4599-b3cb-fcfa32b34205 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:14.120097 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.wsgi [None req-5aa1c8d3-fa7f-4599-b3cb-fcfa32b34205 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] HTTP exception thrown: Instance 32c49b67-aa8e-4d47-81d1-89b815c998b4 could not be found. Jun 17 15:12:14.132283 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-5aa1c8d3-fa7f-4599-b3cb-fcfa32b34205 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Request method failure captured: Jun 17 15:12:14.132283 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: request: GET /compute/v2.1/servers/32c49b67-aa8e-4d47-81d1-89b815c998b4 HTTP/1.1 Jun 17 15:12:14.132283 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Accept: application/json Jun 17 15:12:14.132283 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Accept-Encoding: identity Jun 17 15:12:14.132283 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Connection: close Jun 17 15:12:14.132283 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Content-Length: 0 Jun 17 15:12:14.132283 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Content-Type: application/json Jun 17 15:12:14.132283 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Host: 10.222.0.48 Jun 17 15:12:14.132283 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Openstack-System-Scope: None Jun 17 15:12:14.132283 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: User-Agent: python-urllib3/1.26.9 Jun 17 15:12:14.132283 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Auth-Token: gAAAAABirJmTONpd1HCLhvASZugifaAIFbjdYA09i4fMg4S_9XoC4kUa35EHAFtfgbjATyjxPpNEDiYo-NnOZcsnkVUb9L-YISjbsgB5SS65Ka9QniiEm4KmdrcuFF4A4kMeQhsgDt3QKocTZQMUJlk2LlgYQTIAZOg6MddU45i1y5eGDlTWjr0 Jun 17 15:12:14.132283 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Domain-Id: None Jun 17 15:12:14.132283 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Domain-Name: None Jun 17 15:12:14.132283 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Identity-Status: Confirmed Jun 17 15:12:14.132283 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Is-Admin-Project: True Jun 17 15:12:14.132283 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Domain-Id: default Jun 17 15:12:14.132283 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Domain-Name: Default Jun 17 15:12:14.132283 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Id: fa9c2c0819ea44c491b641d564d4cec7 Jun 17 15:12:14.132283 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Name: tempest-DeleteServersTestJSON-1669331410 Jun 17 15:12:14.132283 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Role: reader,member Jun 17 15:12:14.132283 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Roles: reader,member Jun 17 15:12:14.134481 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_fa9c2c0819ea44c491b641d564d4cec7", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/fa9c2c0819ea44c491b641d564d4cec7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fa9c2c0819ea44c491b641d564d4cec7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fa9c2c0819ea44c491b641d564d4cec7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Jun 17 15:12:14.134481 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant: tempest-DeleteServersTestJSON-1669331410 Jun 17 15:12:14.134481 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant-Id: fa9c2c0819ea44c491b641d564d4cec7 Jun 17 15:12:14.134481 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant-Name: tempest-DeleteServersTestJSON-1669331410 Jun 17 15:12:14.134481 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User: tempest-DeleteServersTestJSON-1669331410-project Jun 17 15:12:14.134481 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Domain-Id: default Jun 17 15:12:14.134481 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Domain-Name: Default Jun 17 15:12:14.134481 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Id: 384629ef0b104b8f8cbafdc56b16268b Jun 17 15:12:14.134481 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Name: tempest-DeleteServersTestJSON-1669331410-project Jun 17 15:12:14.134481 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: method: > Jun 17 15:12:14.134481 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: exception: Instance 32c49b67-aa8e-4d47-81d1-89b815c998b4 could not be found. Jun 17 15:12:14.134481 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: action_args: {'id': '32c49b67-aa8e-4d47-81d1-89b815c998b4'} Jun 17 15:12:14.135294 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 15:12:14.135294 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:12:14.135294 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 15:12:14.135294 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 15:12:14.135294 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 15:12:14.135294 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 15:12:14.135294 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 15:12:14.135294 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 15:12:14.135294 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 15:12:14.135294 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 15:12:14.135294 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32c49b67-aa8e-4d47-81d1-89b815c998b4 could not be found. Jun 17 15:12:14.135294 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:12:14.135294 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:12:14.135294 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:12:14.135294 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:12:14.135294 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:12:14.135294 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:12:14.135294 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 15:12:14.135294 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 15:12:14.135294 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 15:12:14.136667 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 15:12:14.136667 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 15:12:14.136667 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 15:12:14.136667 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 15:12:14.136667 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 15:12:14.136667 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 15:12:14.136667 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 15:12:14.136667 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32c49b67-aa8e-4d47-81d1-89b815c998b4 could not be found. Jun 17 15:12:14.136667 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:12:14.136667 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:12:14.136667 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:12:14.136667 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:12:14.136667 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:12:14.136667 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:12:14.136667 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 15:12:14.136667 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 15:12:14.136667 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32c49b67-aa8e-4d47-81d1-89b815c998b4 could not be found. Jun 17 15:12:14.136667 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:12:14.137750 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-5aa1c8d3-fa7f-4599-b3cb-fcfa32b34205 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Returning 404 to user: Instance 32c49b67-aa8e-4d47-81d1-89b815c998b4 could not be found. {{(pid=117650) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 15:12:14.137750 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-5aa1c8d3-fa7f-4599-b3cb-fcfa32b34205 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] 10.222.0.48 "GET /compute/v2.1/servers/32c49b67-aa8e-4d47-81d1-89b815c998b4" status: 404 len: 111 microversion: 2.1 time: 0.085487 Jun 17 15:12:14.141446 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 68/129] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:12:14 2022] GET /compute/v2.1/servers/32c49b67-aa8e-4d47-81d1-89b815c998b4 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 15:12:14.192820 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-f5ee1ecd-05dd-4acd-90ed-5bde2d16a4df tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:12:14.208635 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-f5ee1ecd-05dd-4acd-90ed-5bde2d16a4df tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/335fa25e-3f5c-45f0-9f85-f9c4681728b8" status: 200 len: 1518 microversion: 2.1 time: 0.252768 Jun 17 15:12:14.212506 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 62/130] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:12:13 2022] GET /compute/v2.1/servers/335fa25e-3f5c-45f0-9f85-f9c4681728b8 => generated 1518 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:12:14.333488 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-ec66101c-108c-4ebb-a6b8-8b5640c03f00 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:12:14.334853 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-ec66101c-108c-4ebb-a6b8-8b5640c03f00 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] [instance: 32c49b67-aa8e-4d47-81d1-89b815c998b4] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:12:14.346966 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ec66101c-108c-4ebb-a6b8-8b5640c03f00 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:14.348541 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ec66101c-108c-4ebb-a6b8-8b5640c03f00 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:14.350111 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ec66101c-108c-4ebb-a6b8-8b5640c03f00 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:14.351086 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ec66101c-108c-4ebb-a6b8-8b5640c03f00 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:14.382091 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.wsgi [None req-ec66101c-108c-4ebb-a6b8-8b5640c03f00 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] HTTP exception thrown: Instance 32c49b67-aa8e-4d47-81d1-89b815c998b4 could not be found. Jun 17 15:12:14.390798 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-ec66101c-108c-4ebb-a6b8-8b5640c03f00 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Request method failure captured: Jun 17 15:12:14.390798 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: request: GET /compute/v2.1/servers/32c49b67-aa8e-4d47-81d1-89b815c998b4/os-volume_attachments HTTP/1.1 Jun 17 15:12:14.390798 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Accept: application/json Jun 17 15:12:14.390798 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Accept-Encoding: identity Jun 17 15:12:14.390798 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Connection: close Jun 17 15:12:14.390798 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Content-Length: 0 Jun 17 15:12:14.390798 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Content-Type: application/json Jun 17 15:12:14.390798 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Host: 10.222.0.48 Jun 17 15:12:14.390798 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Openstack-System-Scope: None Jun 17 15:12:14.390798 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: User-Agent: python-urllib3/1.26.9 Jun 17 15:12:14.390798 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Auth-Token: gAAAAABirJmTONpd1HCLhvASZugifaAIFbjdYA09i4fMg4S_9XoC4kUa35EHAFtfgbjATyjxPpNEDiYo-NnOZcsnkVUb9L-YISjbsgB5SS65Ka9QniiEm4KmdrcuFF4A4kMeQhsgDt3QKocTZQMUJlk2LlgYQTIAZOg6MddU45i1y5eGDlTWjr0 Jun 17 15:12:14.390798 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Domain-Id: None Jun 17 15:12:14.390798 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Domain-Name: None Jun 17 15:12:14.390798 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Identity-Status: Confirmed Jun 17 15:12:14.390798 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Is-Admin-Project: True Jun 17 15:12:14.390798 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Domain-Id: default Jun 17 15:12:14.390798 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Domain-Name: Default Jun 17 15:12:14.390798 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Id: fa9c2c0819ea44c491b641d564d4cec7 Jun 17 15:12:14.390798 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Name: tempest-DeleteServersTestJSON-1669331410 Jun 17 15:12:14.390798 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Role: reader,member Jun 17 15:12:14.390798 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Roles: reader,member Jun 17 15:12:14.392366 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_fa9c2c0819ea44c491b641d564d4cec7", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/fa9c2c0819ea44c491b641d564d4cec7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fa9c2c0819ea44c491b641d564d4cec7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fa9c2c0819ea44c491b641d564d4cec7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Jun 17 15:12:14.392366 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant: tempest-DeleteServersTestJSON-1669331410 Jun 17 15:12:14.392366 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant-Id: fa9c2c0819ea44c491b641d564d4cec7 Jun 17 15:12:14.392366 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant-Name: tempest-DeleteServersTestJSON-1669331410 Jun 17 15:12:14.392366 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User: tempest-DeleteServersTestJSON-1669331410-project Jun 17 15:12:14.392366 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Domain-Id: default Jun 17 15:12:14.392366 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Domain-Name: Default Jun 17 15:12:14.392366 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Id: 384629ef0b104b8f8cbafdc56b16268b Jun 17 15:12:14.392366 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Name: tempest-DeleteServersTestJSON-1669331410-project Jun 17 15:12:14.392366 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: method: > Jun 17 15:12:14.392366 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: exception: Instance 32c49b67-aa8e-4d47-81d1-89b815c998b4 could not be found. Jun 17 15:12:14.392366 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: action_args: {'server_id': '32c49b67-aa8e-4d47-81d1-89b815c998b4'} Jun 17 15:12:14.393159 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 15:12:14.393159 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:12:14.393159 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 15:12:14.393159 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 15:12:14.393159 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 15:12:14.393159 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 15:12:14.393159 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 15:12:14.393159 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 15:12:14.393159 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 15:12:14.393159 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 15:12:14.393159 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32c49b67-aa8e-4d47-81d1-89b815c998b4 could not be found. Jun 17 15:12:14.393159 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:12:14.393159 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:12:14.393159 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:12:14.393159 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:12:14.393159 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:12:14.393159 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:12:14.393159 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 15:12:14.393159 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 15:12:14.393159 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 15:12:14.394321 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 15:12:14.394321 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 17 15:12:14.394321 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 17 15:12:14.394321 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 17 15:12:14.394321 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 17 15:12:14.394321 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 17 15:12:14.394321 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 17 15:12:14.394321 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 15:12:14.394321 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 15:12:14.394321 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32c49b67-aa8e-4d47-81d1-89b815c998b4 could not be found. Jun 17 15:12:14.394321 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:12:14.394321 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:12:14.394321 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:12:14.394321 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:12:14.394321 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:12:14.394321 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:12:14.394321 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 15:12:14.394321 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 15:12:14.394321 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32c49b67-aa8e-4d47-81d1-89b815c998b4 could not be found. Jun 17 15:12:14.394321 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:12:14.397252 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-ec66101c-108c-4ebb-a6b8-8b5640c03f00 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Returning 404 to user: Instance 32c49b67-aa8e-4d47-81d1-89b815c998b4 could not be found. {{(pid=117650) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 15:12:14.399776 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-ec66101c-108c-4ebb-a6b8-8b5640c03f00 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] 10.222.0.48 "GET /compute/v2.1/servers/32c49b67-aa8e-4d47-81d1-89b815c998b4/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.071344 Jun 17 15:12:14.402304 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 69/131] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:12:14 2022] GET /compute/v2.1/servers/32c49b67-aa8e-4d47-81d1-89b815c998b4/os-volume_attachments => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 15:12:15.227287 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-6348e83e-63c9-4edf-9179-13d14e83081a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:12:15.228360 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-6348e83e-63c9-4edf-9179-13d14e83081a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: 335fa25e-3f5c-45f0-9f85-f9c4681728b8] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:12:15.234622 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6348e83e-63c9-4edf-9179-13d14e83081a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:15.235067 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6348e83e-63c9-4edf-9179-13d14e83081a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:15.235917 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6348e83e-63c9-4edf-9179-13d14e83081a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:15.236355 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6348e83e-63c9-4edf-9179-13d14e83081a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:15.256674 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:12:15.488997 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-6348e83e-63c9-4edf-9179-13d14e83081a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:12:15.499600 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-6348e83e-63c9-4edf-9179-13d14e83081a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/335fa25e-3f5c-45f0-9f85-f9c4681728b8" status: 200 len: 1518 microversion: 2.1 time: 0.276144 Jun 17 15:12:15.500667 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 63/132] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:12:15 2022] GET /compute/v2.1/servers/335fa25e-3f5c-45f0-9f85-f9c4681728b8 => generated 1518 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:12:15.747376 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-afe52805-4907-4a92-bb30-e0f55dba1b45 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:12:15.748623 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-afe52805-4907-4a92-bb30-e0f55dba1b45 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] [instance: 32c49b67-aa8e-4d47-81d1-89b815c998b4] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:12:15.758173 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-afe52805-4907-4a92-bb30-e0f55dba1b45 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:15.758677 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-afe52805-4907-4a92-bb30-e0f55dba1b45 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:15.759917 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-afe52805-4907-4a92-bb30-e0f55dba1b45 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:15.760749 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-afe52805-4907-4a92-bb30-e0f55dba1b45 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:15.779698 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.wsgi [None req-afe52805-4907-4a92-bb30-e0f55dba1b45 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] HTTP exception thrown: Instance 32c49b67-aa8e-4d47-81d1-89b815c998b4 could not be found. Jun 17 15:12:15.781737 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-afe52805-4907-4a92-bb30-e0f55dba1b45 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Request method failure captured: Jun 17 15:12:15.781737 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: request: DELETE /compute/v2.1/servers/32c49b67-aa8e-4d47-81d1-89b815c998b4 HTTP/1.1 Jun 17 15:12:15.781737 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Accept: application/json Jun 17 15:12:15.781737 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Accept-Encoding: identity Jun 17 15:12:15.781737 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Connection: close Jun 17 15:12:15.781737 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Content-Length: 0 Jun 17 15:12:15.781737 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Content-Type: application/json Jun 17 15:12:15.781737 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Host: 10.222.0.48 Jun 17 15:12:15.781737 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Openstack-System-Scope: None Jun 17 15:12:15.781737 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: User-Agent: python-urllib3/1.26.9 Jun 17 15:12:15.781737 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Auth-Token: gAAAAABirJmTONpd1HCLhvASZugifaAIFbjdYA09i4fMg4S_9XoC4kUa35EHAFtfgbjATyjxPpNEDiYo-NnOZcsnkVUb9L-YISjbsgB5SS65Ka9QniiEm4KmdrcuFF4A4kMeQhsgDt3QKocTZQMUJlk2LlgYQTIAZOg6MddU45i1y5eGDlTWjr0 Jun 17 15:12:15.781737 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Domain-Id: None Jun 17 15:12:15.781737 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Domain-Name: None Jun 17 15:12:15.781737 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Identity-Status: Confirmed Jun 17 15:12:15.781737 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Is-Admin-Project: True Jun 17 15:12:15.781737 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Domain-Id: default Jun 17 15:12:15.781737 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Domain-Name: Default Jun 17 15:12:15.781737 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Id: fa9c2c0819ea44c491b641d564d4cec7 Jun 17 15:12:15.781737 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Name: tempest-DeleteServersTestJSON-1669331410 Jun 17 15:12:15.781737 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Role: reader,member Jun 17 15:12:15.781737 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Roles: reader,member Jun 17 15:12:15.783144 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_fa9c2c0819ea44c491b641d564d4cec7", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/fa9c2c0819ea44c491b641d564d4cec7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fa9c2c0819ea44c491b641d564d4cec7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fa9c2c0819ea44c491b641d564d4cec7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Jun 17 15:12:15.783144 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant: tempest-DeleteServersTestJSON-1669331410 Jun 17 15:12:15.783144 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant-Id: fa9c2c0819ea44c491b641d564d4cec7 Jun 17 15:12:15.783144 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant-Name: tempest-DeleteServersTestJSON-1669331410 Jun 17 15:12:15.783144 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User: tempest-DeleteServersTestJSON-1669331410-project Jun 17 15:12:15.783144 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Domain-Id: default Jun 17 15:12:15.783144 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Domain-Name: Default Jun 17 15:12:15.783144 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Id: 384629ef0b104b8f8cbafdc56b16268b Jun 17 15:12:15.783144 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Name: tempest-DeleteServersTestJSON-1669331410-project Jun 17 15:12:15.783144 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: method: > Jun 17 15:12:15.783144 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: exception: Instance 32c49b67-aa8e-4d47-81d1-89b815c998b4 could not be found. Jun 17 15:12:15.783144 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: action_args: {'id': '32c49b67-aa8e-4d47-81d1-89b815c998b4'} Jun 17 15:12:15.783916 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 15:12:15.783916 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:12:15.783916 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 15:12:15.783916 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 15:12:15.783916 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 15:12:15.783916 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 15:12:15.783916 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 15:12:15.783916 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 15:12:15.783916 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 15:12:15.783916 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 15:12:15.783916 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32c49b67-aa8e-4d47-81d1-89b815c998b4 could not be found. Jun 17 15:12:15.783916 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:12:15.783916 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:12:15.783916 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:12:15.783916 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:12:15.783916 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:12:15.783916 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:12:15.783916 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 15:12:15.783916 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 15:12:15.783916 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 15:12:15.785248 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 15:12:15.785248 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 17 15:12:15.785248 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 17 15:12:15.785248 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 17 15:12:15.785248 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 17 15:12:15.785248 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 15:12:15.785248 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 15:12:15.785248 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 15:12:15.785248 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 15:12:15.785248 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32c49b67-aa8e-4d47-81d1-89b815c998b4 could not be found. Jun 17 15:12:15.785248 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:12:15.785248 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:12:15.785248 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:12:15.785248 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:12:15.785248 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:12:15.785248 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:12:15.785248 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 15:12:15.785248 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 15:12:15.785248 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32c49b67-aa8e-4d47-81d1-89b815c998b4 could not be found. Jun 17 15:12:15.785248 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:12:15.790385 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-afe52805-4907-4a92-bb30-e0f55dba1b45 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Returning 404 to user: Instance 32c49b67-aa8e-4d47-81d1-89b815c998b4 could not be found. {{(pid=117650) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 15:12:15.793276 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-afe52805-4907-4a92-bb30-e0f55dba1b45 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] 10.222.0.48 "DELETE /compute/v2.1/servers/32c49b67-aa8e-4d47-81d1-89b815c998b4" status: 404 len: 111 microversion: 2.1 time: 0.048455 Jun 17 15:12:15.794038 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 70/133] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jun 17 15:12:15 2022] DELETE /compute/v2.1/servers/32c49b67-aa8e-4d47-81d1-89b815c998b4 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 17 15:12:15.807055 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-81074434-24f7-4f08-8736-2142bbe1fd95 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:12:15.808089 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-81074434-24f7-4f08-8736-2142bbe1fd95 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] [instance: 32c49b67-aa8e-4d47-81d1-89b815c998b4] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:12:15.816933 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-81074434-24f7-4f08-8736-2142bbe1fd95 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:15.817881 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-81074434-24f7-4f08-8736-2142bbe1fd95 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:15.818813 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-81074434-24f7-4f08-8736-2142bbe1fd95 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:15.819403 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-81074434-24f7-4f08-8736-2142bbe1fd95 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:15.835314 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.wsgi [None req-81074434-24f7-4f08-8736-2142bbe1fd95 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] HTTP exception thrown: Instance 32c49b67-aa8e-4d47-81d1-89b815c998b4 could not be found. Jun 17 15:12:15.841184 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-81074434-24f7-4f08-8736-2142bbe1fd95 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Request method failure captured: Jun 17 15:12:15.841184 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: request: GET /compute/v2.1/servers/32c49b67-aa8e-4d47-81d1-89b815c998b4 HTTP/1.1 Jun 17 15:12:15.841184 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Accept: application/json Jun 17 15:12:15.841184 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Accept-Encoding: identity Jun 17 15:12:15.841184 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Connection: close Jun 17 15:12:15.841184 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Content-Length: 0 Jun 17 15:12:15.841184 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Content-Type: application/json Jun 17 15:12:15.841184 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Host: 10.222.0.48 Jun 17 15:12:15.841184 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Openstack-System-Scope: None Jun 17 15:12:15.841184 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: User-Agent: python-urllib3/1.26.9 Jun 17 15:12:15.841184 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Auth-Token: gAAAAABirJmTONpd1HCLhvASZugifaAIFbjdYA09i4fMg4S_9XoC4kUa35EHAFtfgbjATyjxPpNEDiYo-NnOZcsnkVUb9L-YISjbsgB5SS65Ka9QniiEm4KmdrcuFF4A4kMeQhsgDt3QKocTZQMUJlk2LlgYQTIAZOg6MddU45i1y5eGDlTWjr0 Jun 17 15:12:15.841184 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Domain-Id: None Jun 17 15:12:15.841184 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Domain-Name: None Jun 17 15:12:15.841184 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Identity-Status: Confirmed Jun 17 15:12:15.841184 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Is-Admin-Project: True Jun 17 15:12:15.841184 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Domain-Id: default Jun 17 15:12:15.841184 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Domain-Name: Default Jun 17 15:12:15.841184 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Id: fa9c2c0819ea44c491b641d564d4cec7 Jun 17 15:12:15.841184 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Name: tempest-DeleteServersTestJSON-1669331410 Jun 17 15:12:15.841184 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Role: reader,member Jun 17 15:12:15.841184 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Roles: reader,member Jun 17 15:12:15.842654 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_fa9c2c0819ea44c491b641d564d4cec7", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/fa9c2c0819ea44c491b641d564d4cec7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fa9c2c0819ea44c491b641d564d4cec7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fa9c2c0819ea44c491b641d564d4cec7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Jun 17 15:12:15.842654 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant: tempest-DeleteServersTestJSON-1669331410 Jun 17 15:12:15.842654 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant-Id: fa9c2c0819ea44c491b641d564d4cec7 Jun 17 15:12:15.842654 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant-Name: tempest-DeleteServersTestJSON-1669331410 Jun 17 15:12:15.842654 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User: tempest-DeleteServersTestJSON-1669331410-project Jun 17 15:12:15.842654 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Domain-Id: default Jun 17 15:12:15.842654 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Domain-Name: Default Jun 17 15:12:15.842654 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Id: 384629ef0b104b8f8cbafdc56b16268b Jun 17 15:12:15.842654 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Name: tempest-DeleteServersTestJSON-1669331410-project Jun 17 15:12:15.842654 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: method: > Jun 17 15:12:15.842654 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: exception: Instance 32c49b67-aa8e-4d47-81d1-89b815c998b4 could not be found. Jun 17 15:12:15.842654 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: action_args: {'id': '32c49b67-aa8e-4d47-81d1-89b815c998b4'} Jun 17 15:12:15.843284 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 15:12:15.843284 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:12:15.843284 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 15:12:15.843284 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 15:12:15.843284 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 15:12:15.843284 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 15:12:15.843284 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 15:12:15.843284 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 15:12:15.843284 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 15:12:15.843284 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 15:12:15.843284 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32c49b67-aa8e-4d47-81d1-89b815c998b4 could not be found. Jun 17 15:12:15.843284 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:12:15.843284 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:12:15.843284 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:12:15.843284 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:12:15.843284 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:12:15.843284 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:12:15.843284 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 15:12:15.843284 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 15:12:15.843284 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 15:12:15.848118 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 15:12:15.848118 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 15:12:15.848118 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 15:12:15.848118 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 15:12:15.848118 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 15:12:15.848118 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 15:12:15.848118 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 15:12:15.848118 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32c49b67-aa8e-4d47-81d1-89b815c998b4 could not be found. Jun 17 15:12:15.848118 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:12:15.848118 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:12:15.848118 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:12:15.848118 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:12:15.848118 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:12:15.848118 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:12:15.848118 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 15:12:15.848118 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 15:12:15.848118 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32c49b67-aa8e-4d47-81d1-89b815c998b4 could not be found. Jun 17 15:12:15.848118 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:12:15.849500 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-81074434-24f7-4f08-8736-2142bbe1fd95 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] Returning 404 to user: Instance 32c49b67-aa8e-4d47-81d1-89b815c998b4 could not be found. {{(pid=117649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 15:12:15.849500 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-81074434-24f7-4f08-8736-2142bbe1fd95 tempest-DeleteServersTestJSON-1669331410 tempest-DeleteServersTestJSON-1669331410-project] 10.222.0.48 "GET /compute/v2.1/servers/32c49b67-aa8e-4d47-81d1-89b815c998b4" status: 404 len: 111 microversion: 2.1 time: 0.042489 Jun 17 15:12:15.849500 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 64/134] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:12:15 2022] GET /compute/v2.1/servers/32c49b67-aa8e-4d47-81d1-89b815c998b4 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 15:12:16.521080 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-f672b597-34f8-4d21-b45a-a055312e0b61 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:12:16.522145 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-f672b597-34f8-4d21-b45a-a055312e0b61 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: 335fa25e-3f5c-45f0-9f85-f9c4681728b8] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:12:16.530104 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f672b597-34f8-4d21-b45a-a055312e0b61 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:16.530983 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f672b597-34f8-4d21-b45a-a055312e0b61 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:16.531980 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f672b597-34f8-4d21-b45a-a055312e0b61 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:16.532722 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f672b597-34f8-4d21-b45a-a055312e0b61 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:16.560057 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:12:16.947529 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-f672b597-34f8-4d21-b45a-a055312e0b61 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:12:16.955134 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-f672b597-34f8-4d21-b45a-a055312e0b61 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/335fa25e-3f5c-45f0-9f85-f9c4681728b8" status: 200 len: 1518 microversion: 2.1 time: 0.439860 Jun 17 15:12:16.956062 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 71/135] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:12:16 2022] GET /compute/v2.1/servers/335fa25e-3f5c-45f0-9f85-f9c4681728b8 => generated 1518 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:12:17.973314 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-4c5d602f-d3bb-4b2a-97ac-71d77230340b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:12:17.974542 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-4c5d602f-d3bb-4b2a-97ac-71d77230340b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: 335fa25e-3f5c-45f0-9f85-f9c4681728b8] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:12:17.987636 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4c5d602f-d3bb-4b2a-97ac-71d77230340b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:17.988467 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4c5d602f-d3bb-4b2a-97ac-71d77230340b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:17.989427 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4c5d602f-d3bb-4b2a-97ac-71d77230340b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:17.990009 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4c5d602f-d3bb-4b2a-97ac-71d77230340b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:18.599332 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-4c5d602f-d3bb-4b2a-97ac-71d77230340b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:12:18.620551 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-4c5d602f-d3bb-4b2a-97ac-71d77230340b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/335fa25e-3f5c-45f0-9f85-f9c4681728b8" status: 200 len: 1518 microversion: 2.1 time: 0.646377 Jun 17 15:12:18.626439 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 65/136] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:12:17 2022] GET /compute/v2.1/servers/335fa25e-3f5c-45f0-9f85-f9c4681728b8 => generated 1518 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:12:19.640680 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-72d0d6e8-ccdd-47bc-b896-a0e838a972c1 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:12:19.647696 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-72d0d6e8-ccdd-47bc-b896-a0e838a972c1 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: 335fa25e-3f5c-45f0-9f85-f9c4681728b8] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:12:19.659302 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-72d0d6e8-ccdd-47bc-b896-a0e838a972c1 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:19.660708 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-72d0d6e8-ccdd-47bc-b896-a0e838a972c1 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:19.661742 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-72d0d6e8-ccdd-47bc-b896-a0e838a972c1 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:19.662529 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-72d0d6e8-ccdd-47bc-b896-a0e838a972c1 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:20.376121 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-72d0d6e8-ccdd-47bc-b896-a0e838a972c1 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:12:20.388804 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-72d0d6e8-ccdd-47bc-b896-a0e838a972c1 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/335fa25e-3f5c-45f0-9f85-f9c4681728b8" status: 200 len: 1518 microversion: 2.1 time: 0.754448 Jun 17 15:12:20.405456 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 72/137] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:12:19 2022] GET /compute/v2.1/servers/335fa25e-3f5c-45f0-9f85-f9c4681728b8 => generated 1518 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:12:21.410811 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-48287652-8c0b-477d-9d30-9c86dcdf9dbe tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:12:21.411419 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-48287652-8c0b-477d-9d30-9c86dcdf9dbe tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: 335fa25e-3f5c-45f0-9f85-f9c4681728b8] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:12:21.423546 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-48287652-8c0b-477d-9d30-9c86dcdf9dbe tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:21.423991 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-48287652-8c0b-477d-9d30-9c86dcdf9dbe tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:21.424798 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-48287652-8c0b-477d-9d30-9c86dcdf9dbe tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:21.425214 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-48287652-8c0b-477d-9d30-9c86dcdf9dbe tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:22.189617 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-48287652-8c0b-477d-9d30-9c86dcdf9dbe tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:12:22.197903 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-48287652-8c0b-477d-9d30-9c86dcdf9dbe tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/335fa25e-3f5c-45f0-9f85-f9c4681728b8" status: 200 len: 1518 microversion: 2.1 time: 0.790776 Jun 17 15:12:22.199043 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 66/138] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:12:21 2022] GET /compute/v2.1/servers/335fa25e-3f5c-45f0-9f85-f9c4681728b8 => generated 1518 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:12:22.997154 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-6345cdc6-a3d9-4949-bdb7-0a264a829276 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2010327485", "imageRef": "8c105ca4-6fe3-4e70-af71-b03c64fe1efe", "flavorRef": "452", "networks": [{"uuid": "29b80c37-5e37-4711-8585-ce014e95e3e0"}]}} {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:12:23.060952 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.network.neutron [None req-6345cdc6-a3d9-4949-bdb7-0a264a829276 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] validate_networks() for [('29b80c37-5e37-4711-8585-ce014e95e3e0', None, None, None, None, None)] {{(pid=117650) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 15:12:23.223663 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-8432a299-2164-45b9-88f8-009b634b89de tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:12:23.224904 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-8432a299-2164-45b9-88f8-009b634b89de tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: 335fa25e-3f5c-45f0-9f85-f9c4681728b8] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:12:23.235381 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8432a299-2164-45b9-88f8-009b634b89de tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:23.235925 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8432a299-2164-45b9-88f8-009b634b89de tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:23.238569 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8432a299-2164-45b9-88f8-009b634b89de tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:23.239646 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8432a299-2164-45b9-88f8-009b634b89de tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:23.603765 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-8432a299-2164-45b9-88f8-009b634b89de tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:12:23.615529 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-8432a299-2164-45b9-88f8-009b634b89de tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/335fa25e-3f5c-45f0-9f85-f9c4681728b8" status: 200 len: 1518 microversion: 2.1 time: 0.402639 Jun 17 15:12:23.617943 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 67/139] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:12:23 2022] GET /compute/v2.1/servers/335fa25e-3f5c-45f0-9f85-f9c4681728b8 => generated 1518 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:12:23.656738 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.virt.hardware [None req-6345cdc6-a3d9-4949-bdb7-0a264a829276 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Flavor limits 0:0:0 {{(pid=117650) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 15:12:23.657233 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.virt.hardware [None req-6345cdc6-a3d9-4949-bdb7-0a264a829276 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Image limits 0:0:0 {{(pid=117650) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 15:12:23.658060 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.virt.hardware [None req-6345cdc6-a3d9-4949-bdb7-0a264a829276 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Flavor pref 0:0:0 {{(pid=117650) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 15:12:23.658819 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.virt.hardware [None req-6345cdc6-a3d9-4949-bdb7-0a264a829276 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Image pref 0:0:0 {{(pid=117650) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 15:12:23.659446 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.virt.hardware [None req-6345cdc6-a3d9-4949-bdb7-0a264a829276 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117650) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 15:12:23.671178 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6345cdc6-a3d9-4949-bdb7-0a264a829276 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:23.678086 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6345cdc6-a3d9-4949-bdb7-0a264a829276 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:23.679647 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6345cdc6-a3d9-4949-bdb7-0a264a829276 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:23.680098 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6345cdc6-a3d9-4949-bdb7-0a264a829276 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:23.698657 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.quota [None req-6345cdc6-a3d9-4949-bdb7-0a264a829276 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Getting quotas for project 5de3212eec024eb7b1319357c96f0c01. Resources: {'cores', 'ram', 'instances'} {{(pid=117650) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 15:12:23.705230 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.quota [None req-6345cdc6-a3d9-4949-bdb7-0a264a829276 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Getting quotas for user fd12373903ae4f059464f026f2c18581 and project 5de3212eec024eb7b1319357c96f0c01. Resources: {'cores', 'ram', 'instances'} {{(pid=117650) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 15:12:23.717682 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-6345cdc6-a3d9-4949-bdb7-0a264a829276 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Going to run 1 instances... {{(pid=117650) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 15:12:23.720718 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-6345cdc6-a3d9-4949-bdb7-0a264a829276 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] [instance: 277bb65d-ad0a-4439-8972-bd32346dead3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c105ca4-6fe3-4e70-af71-b03c64fe1efe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117650) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 15:12:23.783029 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-6345cdc6-a3d9-4949-bdb7-0a264a829276 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.789588 Jun 17 15:12:23.784529 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 73/140] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Jun 17 15:12:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 792 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 15:12:23.797269 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-c4036573-7b2a-4e3b-a46a-44ae21219b3c tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:12:23.798034 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-c4036573-7b2a-4e3b-a46a-44ae21219b3c tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] [instance: 277bb65d-ad0a-4439-8972-bd32346dead3] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:12:23.981998 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-c4036573-7b2a-4e3b-a46a-44ae21219b3c tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd12373903ae4f059464f026f2c18581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de3212eec024eb7b1319357c96f0c01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:12:23.989215 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-c4036573-7b2a-4e3b-a46a-44ae21219b3c tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] 10.222.0.48 "GET /compute/v2.1/servers/277bb65d-ad0a-4439-8972-bd32346dead3" status: 200 len: 1214 microversion: 2.1 time: 0.198295 Jun 17 15:12:23.990883 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 68/141] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:12:23 2022] GET /compute/v2.1/servers/277bb65d-ad0a-4439-8972-bd32346dead3 => generated 1214 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:12:24.637224 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-7592f495-21a2-4fa4-a0be-c6c52e9a5caa tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:12:24.638839 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-7592f495-21a2-4fa4-a0be-c6c52e9a5caa tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: 335fa25e-3f5c-45f0-9f85-f9c4681728b8] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:12:24.673144 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7592f495-21a2-4fa4-a0be-c6c52e9a5caa tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:24.676292 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7592f495-21a2-4fa4-a0be-c6c52e9a5caa tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:24.678184 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7592f495-21a2-4fa4-a0be-c6c52e9a5caa tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:24.681462 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7592f495-21a2-4fa4-a0be-c6c52e9a5caa tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:24.962453 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-7592f495-21a2-4fa4-a0be-c6c52e9a5caa tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:12:24.972794 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-7592f495-21a2-4fa4-a0be-c6c52e9a5caa tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/335fa25e-3f5c-45f0-9f85-f9c4681728b8" status: 200 len: 1518 microversion: 2.1 time: 0.339950 Jun 17 15:12:24.985574 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 74/142] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:12:24 2022] GET /compute/v2.1/servers/335fa25e-3f5c-45f0-9f85-f9c4681728b8 => generated 1518 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:12:25.010632 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-25687332-f742-419d-a172-bdec6c09dbd4 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:12:25.011933 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-25687332-f742-419d-a172-bdec6c09dbd4 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] [instance: 277bb65d-ad0a-4439-8972-bd32346dead3] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:12:25.047930 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-25687332-f742-419d-a172-bdec6c09dbd4 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:25.050725 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-25687332-f742-419d-a172-bdec6c09dbd4 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:25.054394 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-25687332-f742-419d-a172-bdec6c09dbd4 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:25.055426 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-25687332-f742-419d-a172-bdec6c09dbd4 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:25.190250 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-25687332-f742-419d-a172-bdec6c09dbd4 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd12373903ae4f059464f026f2c18581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de3212eec024eb7b1319357c96f0c01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:12:25.209188 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-25687332-f742-419d-a172-bdec6c09dbd4 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] 10.222.0.48 "GET /compute/v2.1/servers/277bb65d-ad0a-4439-8972-bd32346dead3" status: 200 len: 1266 microversion: 2.1 time: 0.204365 Jun 17 15:12:25.219839 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 69/143] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:12:25 2022] GET /compute/v2.1/servers/277bb65d-ad0a-4439-8972-bd32346dead3 => generated 1266 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:12:25.994229 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-c3a45f94-8121-4cdd-812a-c2b381ec4d04 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:12:25.995014 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-c3a45f94-8121-4cdd-812a-c2b381ec4d04 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: 335fa25e-3f5c-45f0-9f85-f9c4681728b8] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:12:26.008970 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c3a45f94-8121-4cdd-812a-c2b381ec4d04 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:26.009425 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c3a45f94-8121-4cdd-812a-c2b381ec4d04 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:26.010483 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c3a45f94-8121-4cdd-812a-c2b381ec4d04 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:26.010949 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c3a45f94-8121-4cdd-812a-c2b381ec4d04 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:26.230050 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-dd580ed4-bd6f-4346-8270-cdc09e4b82bf tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:12:26.231344 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-dd580ed4-bd6f-4346-8270-cdc09e4b82bf tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] [instance: 277bb65d-ad0a-4439-8972-bd32346dead3] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:12:26.242596 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-dd580ed4-bd6f-4346-8270-cdc09e4b82bf tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:26.243285 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-dd580ed4-bd6f-4346-8270-cdc09e4b82bf tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:26.245816 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-dd580ed4-bd6f-4346-8270-cdc09e4b82bf tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:26.252990 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-dd580ed4-bd6f-4346-8270-cdc09e4b82bf tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:26.407588 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-dd580ed4-bd6f-4346-8270-cdc09e4b82bf tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd12373903ae4f059464f026f2c18581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de3212eec024eb7b1319357c96f0c01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:12:26.421030 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-dd580ed4-bd6f-4346-8270-cdc09e4b82bf tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] 10.222.0.48 "GET /compute/v2.1/servers/277bb65d-ad0a-4439-8972-bd32346dead3" status: 200 len: 1272 microversion: 2.1 time: 0.195945 Jun 17 15:12:26.428056 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 70/144] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:12:26 2022] GET /compute/v2.1/servers/277bb65d-ad0a-4439-8972-bd32346dead3 => generated 1272 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:12:26.565942 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-c3a45f94-8121-4cdd-812a-c2b381ec4d04 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:12:26.576775 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-c3a45f94-8121-4cdd-812a-c2b381ec4d04 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/335fa25e-3f5c-45f0-9f85-f9c4681728b8" status: 200 len: 1518 microversion: 2.1 time: 0.587673 Jun 17 15:12:26.577368 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 75/145] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:12:25 2022] GET /compute/v2.1/servers/335fa25e-3f5c-45f0-9f85-f9c4681728b8 => generated 1518 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:12:27.447458 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-cc9a64a4-aced-4f64-88b3-3b61b95d4ea0 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:12:27.448224 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-cc9a64a4-aced-4f64-88b3-3b61b95d4ea0 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] [instance: 277bb65d-ad0a-4439-8972-bd32346dead3] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:12:27.459737 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cc9a64a4-aced-4f64-88b3-3b61b95d4ea0 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:27.460358 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cc9a64a4-aced-4f64-88b3-3b61b95d4ea0 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:27.461306 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cc9a64a4-aced-4f64-88b3-3b61b95d4ea0 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:27.468870 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cc9a64a4-aced-4f64-88b3-3b61b95d4ea0 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:27.595343 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-e1b27f2c-8659-4fd0-94c8-dd048b4530b8 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:12:27.596052 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-e1b27f2c-8659-4fd0-94c8-dd048b4530b8 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: 335fa25e-3f5c-45f0-9f85-f9c4681728b8] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:12:27.611859 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e1b27f2c-8659-4fd0-94c8-dd048b4530b8 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:27.614509 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e1b27f2c-8659-4fd0-94c8-dd048b4530b8 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:27.616141 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e1b27f2c-8659-4fd0-94c8-dd048b4530b8 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:27.627820 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e1b27f2c-8659-4fd0-94c8-dd048b4530b8 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:28.026288 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-e1b27f2c-8659-4fd0-94c8-dd048b4530b8 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:12:28.037237 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-e1b27f2c-8659-4fd0-94c8-dd048b4530b8 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/335fa25e-3f5c-45f0-9f85-f9c4681728b8" status: 200 len: 1518 microversion: 2.1 time: 0.447254 Jun 17 15:12:28.041434 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 76/146] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:12:27 2022] GET /compute/v2.1/servers/335fa25e-3f5c-45f0-9f85-f9c4681728b8 => generated 1518 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:12:28.233471 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-cc9a64a4-aced-4f64-88b3-3b61b95d4ea0 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd12373903ae4f059464f026f2c18581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de3212eec024eb7b1319357c96f0c01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:12:28.246667 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-cc9a64a4-aced-4f64-88b3-3b61b95d4ea0 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] 10.222.0.48 "GET /compute/v2.1/servers/277bb65d-ad0a-4439-8972-bd32346dead3" status: 200 len: 1314 microversion: 2.1 time: 0.800266 Jun 17 15:12:28.247773 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 71/147] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:12:27 2022] GET /compute/v2.1/servers/277bb65d-ad0a-4439-8972-bd32346dead3 => generated 1314 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:12:28.751583 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-e772647f-afe9-4af6-ab9e-691256d7e005 tempest-VolumesTestJSON-2090364052 tempest-VolumesTestJSON-2090364052-project] Calling method '.version_select at 0x7faf50dbd550>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:12:28.854589 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-e772647f-afe9-4af6-ab9e-691256d7e005 tempest-VolumesTestJSON-2090364052 tempest-VolumesTestJSON-2090364052-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/76d7696f-fbea-4557-9123-8c4c804372c8" status: 200 len: 351 microversion: 2.1 time: 0.110960 Jun 17 15:12:28.855158 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 77/148] 10.222.0.48 () {58 vars in 1244 bytes} [Fri Jun 17 15:12:28 2022] GET /compute/v2.1/os-volumes/76d7696f-fbea-4557-9123-8c4c804372c8 => generated 351 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:12:29.023397 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [req-030d15c6-85a1-4955-809c-d6b52c7d4844 req-544a5a47-054b-4f56-a737-a32648bb090c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "277bb65d-ad0a-4439-8972-bd32346dead3", "tag": "5e125bd9-3023-4490-97c6-1b5070c87c45"}]} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:12:29.046364 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-030d15c6-85a1-4955-809c-d6b52c7d4844 req-544a5a47-054b-4f56-a737-a32648bb090c service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:29.053114 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-030d15c6-85a1-4955-809c-d6b52c7d4844 req-544a5a47-054b-4f56-a737-a32648bb090c service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:29.058049 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-3ff0f422-ad02-4b45-bbfe-30104e6e7c35 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:12:29.059276 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-3ff0f422-ad02-4b45-bbfe-30104e6e7c35 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: 335fa25e-3f5c-45f0-9f85-f9c4681728b8] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:12:29.069034 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3ff0f422-ad02-4b45-bbfe-30104e6e7c35 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:29.069467 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3ff0f422-ad02-4b45-bbfe-30104e6e7c35 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:29.070277 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3ff0f422-ad02-4b45-bbfe-30104e6e7c35 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:29.072039 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3ff0f422-ad02-4b45-bbfe-30104e6e7c35 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:29.097779 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.compute.server_external_events [req-030d15c6-85a1-4955-809c-d6b52c7d4844 req-544a5a47-054b-4f56-a737-a32648bb090c service nova] Creating event network-changed:5e125bd9-3023-4490-97c6-1b5070c87c45 for instance 277bb65d-ad0a-4439-8972-bd32346dead3 on hv-cinder-82549 Jun 17 15:12:29.110020 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [req-030d15c6-85a1-4955-809c-d6b52c7d4844 req-544a5a47-054b-4f56-a737-a32648bb090c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091826 Jun 17 15:12:29.114257 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 72/149] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 15:12:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:12:29.265341 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-4fe6e2d6-f3aa-4377-839c-cb1729aeefca tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:12:29.266755 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-4fe6e2d6-f3aa-4377-839c-cb1729aeefca tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] [instance: 277bb65d-ad0a-4439-8972-bd32346dead3] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:12:29.278502 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4fe6e2d6-f3aa-4377-839c-cb1729aeefca tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:29.281088 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4fe6e2d6-f3aa-4377-839c-cb1729aeefca tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:29.282650 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4fe6e2d6-f3aa-4377-839c-cb1729aeefca tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:29.283247 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4fe6e2d6-f3aa-4377-839c-cb1729aeefca tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:29.337144 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-3ff0f422-ad02-4b45-bbfe-30104e6e7c35 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:12:29.349468 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-3ff0f422-ad02-4b45-bbfe-30104e6e7c35 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/335fa25e-3f5c-45f0-9f85-f9c4681728b8" status: 200 len: 1518 microversion: 2.1 time: 0.295331 Jun 17 15:12:29.353397 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 78/150] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:12:29 2022] GET /compute/v2.1/servers/335fa25e-3f5c-45f0-9f85-f9c4681728b8 => generated 1518 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:12:29.648034 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-4fe6e2d6-f3aa-4377-839c-cb1729aeefca tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd12373903ae4f059464f026f2c18581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de3212eec024eb7b1319357c96f0c01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:12:29.659436 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-4fe6e2d6-f3aa-4377-839c-cb1729aeefca tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] 10.222.0.48 "GET /compute/v2.1/servers/277bb65d-ad0a-4439-8972-bd32346dead3" status: 200 len: 1314 microversion: 2.1 time: 0.398042 Jun 17 15:12:29.660200 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 73/151] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:12:29 2022] GET /compute/v2.1/servers/277bb65d-ad0a-4439-8972-bd32346dead3 => generated 1314 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:12:30.372998 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-dc24839a-50cb-405a-a117-fdecfa89576b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:12:30.372998 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-dc24839a-50cb-405a-a117-fdecfa89576b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: 335fa25e-3f5c-45f0-9f85-f9c4681728b8] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:12:30.384432 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-dc24839a-50cb-405a-a117-fdecfa89576b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:30.384913 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-dc24839a-50cb-405a-a117-fdecfa89576b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:30.385629 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-dc24839a-50cb-405a-a117-fdecfa89576b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:30.386058 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-dc24839a-50cb-405a-a117-fdecfa89576b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:30.456148 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-ea3bf509-bedf-4ee8-94dd-431c20f36d0a tempest-VolumesTestJSON-2090364052 tempest-VolumesTestJSON-2090364052-project] Calling method '.version_select at 0x7faf50525670>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:12:30.527721 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-ea3bf509-bedf-4ee8-94dd-431c20f36d0a tempest-VolumesTestJSON-2090364052 tempest-VolumesTestJSON-2090364052-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/babd6f41-7a76-4023-a223-1318b1a81304" status: 200 len: 351 microversion: 2.1 time: 0.077039 Jun 17 15:12:30.528646 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 74/152] 10.222.0.48 () {58 vars in 1244 bytes} [Fri Jun 17 15:12:30 2022] GET /compute/v2.1/os-volumes/babd6f41-7a76-4023-a223-1318b1a81304 => generated 351 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:12:30.676695 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-9266629a-98cd-4177-b90c-729ecba5ffd9 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:12:30.677303 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-9266629a-98cd-4177-b90c-729ecba5ffd9 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] [instance: 277bb65d-ad0a-4439-8972-bd32346dead3] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:12:30.692956 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9266629a-98cd-4177-b90c-729ecba5ffd9 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:30.696265 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9266629a-98cd-4177-b90c-729ecba5ffd9 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:30.697908 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9266629a-98cd-4177-b90c-729ecba5ffd9 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:30.699824 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9266629a-98cd-4177-b90c-729ecba5ffd9 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:30.766484 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-dc24839a-50cb-405a-a117-fdecfa89576b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:12:30.780639 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-dc24839a-50cb-405a-a117-fdecfa89576b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/335fa25e-3f5c-45f0-9f85-f9c4681728b8" status: 200 len: 1518 microversion: 2.1 time: 0.411416 Jun 17 15:12:30.791513 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 79/153] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:12:30 2022] GET /compute/v2.1/servers/335fa25e-3f5c-45f0-9f85-f9c4681728b8 => generated 1518 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:12:31.093070 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-9266629a-98cd-4177-b90c-729ecba5ffd9 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd12373903ae4f059464f026f2c18581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de3212eec024eb7b1319357c96f0c01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:12:31.104655 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-9266629a-98cd-4177-b90c-729ecba5ffd9 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] 10.222.0.48 "GET /compute/v2.1/servers/277bb65d-ad0a-4439-8972-bd32346dead3" status: 200 len: 1314 microversion: 2.1 time: 0.432231 Jun 17 15:12:31.105242 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 75/154] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:12:30 2022] GET /compute/v2.1/servers/277bb65d-ad0a-4439-8972-bd32346dead3 => generated 1314 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:12:31.798976 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-a1181757-5fb2-43b8-a13a-7ec8054d32d0 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:12:31.801875 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-a1181757-5fb2-43b8-a13a-7ec8054d32d0 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: 335fa25e-3f5c-45f0-9f85-f9c4681728b8] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:12:31.810711 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a1181757-5fb2-43b8-a13a-7ec8054d32d0 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:31.811414 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a1181757-5fb2-43b8-a13a-7ec8054d32d0 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:31.812199 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a1181757-5fb2-43b8-a13a-7ec8054d32d0 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:31.812657 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a1181757-5fb2-43b8-a13a-7ec8054d32d0 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:32.088215 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-6faf80f8-cf8f-4fd2-96ae-66d1d92f7c5d tempest-VolumesTestJSON-2090364052 tempest-VolumesTestJSON-2090364052-project] Calling method '.version_select at 0x7faf50525430>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:12:32.094107 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-a1181757-5fb2-43b8-a13a-7ec8054d32d0 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:12:32.102275 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-a1181757-5fb2-43b8-a13a-7ec8054d32d0 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/335fa25e-3f5c-45f0-9f85-f9c4681728b8" status: 200 len: 1518 microversion: 2.1 time: 0.307478 Jun 17 15:12:32.103079 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 80/155] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:12:31 2022] GET /compute/v2.1/servers/335fa25e-3f5c-45f0-9f85-f9c4681728b8 => generated 1518 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:12:32.128345 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-00948189-ba4f-4417-ba50-bccc1f258479 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:12:32.129263 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-00948189-ba4f-4417-ba50-bccc1f258479 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] [instance: 277bb65d-ad0a-4439-8972-bd32346dead3] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:12:32.140293 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-00948189-ba4f-4417-ba50-bccc1f258479 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:32.146940 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-00948189-ba4f-4417-ba50-bccc1f258479 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:32.149082 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-00948189-ba4f-4417-ba50-bccc1f258479 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:32.150800 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-00948189-ba4f-4417-ba50-bccc1f258479 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:32.219130 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-6faf80f8-cf8f-4fd2-96ae-66d1d92f7c5d tempest-VolumesTestJSON-2090364052 tempest-VolumesTestJSON-2090364052-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/3e673fb6-b0a8-4f6a-a3f4-0f6a60505eec" status: 200 len: 351 microversion: 2.1 time: 0.134725 Jun 17 15:12:32.227540 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 76/156] 10.222.0.48 () {58 vars in 1244 bytes} [Fri Jun 17 15:12:32 2022] GET /compute/v2.1/os-volumes/3e673fb6-b0a8-4f6a-a3f4-0f6a60505eec => generated 351 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:12:32.232882 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-3a49b048-b7e6-4f98-8fcf-992b62cbf6ce tempest-VolumesTestJSON-2090364052 tempest-VolumesTestJSON-2090364052-project] Calling method '.version_select at 0x7faf50584dc0>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:12:32.345473 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-3a49b048-b7e6-4f98-8fcf-992b62cbf6ce tempest-VolumesTestJSON-2090364052 tempest-VolumesTestJSON-2090364052-project] 10.222.0.48 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.116419 Jun 17 15:12:32.357247 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 77/157] 10.222.0.48 () {58 vars in 1133 bytes} [Fri Jun 17 15:12:32 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:12:32.363123 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-61640f9d-a8c2-465b-8bb1-a1a03a075b4f tempest-VolumesTestJSON-2090364052 tempest-VolumesTestJSON-2090364052-project] Calling method '.version_select at 0x7faf5052af70>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:12:32.494732 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-61640f9d-a8c2-465b-8bb1-a1a03a075b4f tempest-VolumesTestJSON-2090364052 tempest-VolumesTestJSON-2090364052-project] 10.222.0.48 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.135659 Jun 17 15:12:32.495897 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 78/158] 10.222.0.48 () {58 vars in 1148 bytes} [Fri Jun 17 15:12:32 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:12:32.509840 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-4567e12b-37b3-432c-82f6-02f9116ba4de tempest-VolumesTestJSON-2090364052 tempest-VolumesTestJSON-2090364052-project] Calling method '.version_select at 0x7faf50584af0>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:12:32.525976 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-00948189-ba4f-4417-ba50-bccc1f258479 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd12373903ae4f059464f026f2c18581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de3212eec024eb7b1319357c96f0c01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:12:32.539011 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-00948189-ba4f-4417-ba50-bccc1f258479 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] 10.222.0.48 "GET /compute/v2.1/servers/277bb65d-ad0a-4439-8972-bd32346dead3" status: 200 len: 1314 microversion: 2.1 time: 0.413254 Jun 17 15:12:32.540133 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 81/159] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:12:32 2022] GET /compute/v2.1/servers/277bb65d-ad0a-4439-8972-bd32346dead3 => generated 1314 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:12:32.657302 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-4567e12b-37b3-432c-82f6-02f9116ba4de tempest-VolumesTestJSON-2090364052 tempest-VolumesTestJSON-2090364052-project] 10.222.0.48 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.151463 Jun 17 15:12:32.659918 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 79/160] 10.222.0.48 () {58 vars in 1133 bytes} [Fri Jun 17 15:12:32 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:12:32.676841 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-c4794544-9492-4fd7-8007-852e9ea5672c tempest-VolumesTestJSON-2090364052 tempest-VolumesTestJSON-2090364052-project] Calling method '.version_select at 0x7faf50dc3670>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:12:32.788022 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-c4794544-9492-4fd7-8007-852e9ea5672c tempest-VolumesTestJSON-2090364052 tempest-VolumesTestJSON-2090364052-project] 10.222.0.48 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.119349 Jun 17 15:12:32.789981 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 82/161] 10.222.0.48 () {58 vars in 1166 bytes} [Fri Jun 17 15:12:32 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:12:32.802441 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-ac54c497-fe5f-4f3e-b5cd-7de98a9ae524 tempest-VolumesTestJSON-2090364052 tempest-VolumesTestJSON-2090364052-project] Calling method '.version_select at 0x7faf50525940>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:12:32.921597 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-ac54c497-fe5f-4f3e-b5cd-7de98a9ae524 tempest-VolumesTestJSON-2090364052 tempest-VolumesTestJSON-2090364052-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.121588 Jun 17 15:12:32.931969 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 80/162] 10.222.0.48 () {58 vars in 1169 bytes} [Fri Jun 17 15:12:32 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:12:32.937834 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-e2207747-8949-499e-a504-bbb155aa101c tempest-VolumesTestJSON-2090364052 tempest-VolumesTestJSON-2090364052-project] Calling method '.version_select at 0x7faf50db6ca0>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:12:33.119050 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-6766d1f5-2233-4fad-b91c-b3eaaa7a8c01 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:12:33.119659 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-6766d1f5-2233-4fad-b91c-b3eaaa7a8c01 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: 335fa25e-3f5c-45f0-9f85-f9c4681728b8] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:12:33.126607 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6766d1f5-2233-4fad-b91c-b3eaaa7a8c01 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:33.133370 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6766d1f5-2233-4fad-b91c-b3eaaa7a8c01 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:33.134625 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6766d1f5-2233-4fad-b91c-b3eaaa7a8c01 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:33.135283 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6766d1f5-2233-4fad-b91c-b3eaaa7a8c01 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:33.303106 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-e2207747-8949-499e-a504-bbb155aa101c tempest-VolumesTestJSON-2090364052 tempest-VolumesTestJSON-2090364052-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.370298 Jun 17 15:12:33.309807 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 83/163] 10.222.0.48 () {58 vars in 1154 bytes} [Fri Jun 17 15:12:32 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:12:33.314902 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-f336fb22-011e-440b-a47c-11f6936d0a47 tempest-VolumesTestJSON-2090364052 tempest-VolumesTestJSON-2090364052-project] Calling method '.version_select at 0x7faf50dc3dc0>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:12:33.415040 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-f336fb22-011e-440b-a47c-11f6936d0a47 tempest-VolumesTestJSON-2090364052 tempest-VolumesTestJSON-2090364052-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.103687 Jun 17 15:12:33.416021 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 84/164] 10.222.0.48 () {58 vars in 1187 bytes} [Fri Jun 17 15:12:33 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:12:33.430014 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-01388553-d0b9-4b56-a98d-9ad6ebbeedf0 tempest-VolumesTestJSON-2090364052 tempest-VolumesTestJSON-2090364052-project] Calling method '.version_select at 0x7faf50d9e700>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:12:33.432940 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-6766d1f5-2233-4fad-b91c-b3eaaa7a8c01 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:12:33.446717 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-6766d1f5-2233-4fad-b91c-b3eaaa7a8c01 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/335fa25e-3f5c-45f0-9f85-f9c4681728b8" status: 200 len: 1518 microversion: 2.1 time: 0.331554 Jun 17 15:12:33.448215 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 81/165] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:12:33 2022] GET /compute/v2.1/servers/335fa25e-3f5c-45f0-9f85-f9c4681728b8 => generated 1518 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:12:33.538873 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-01388553-d0b9-4b56-a98d-9ad6ebbeedf0 tempest-VolumesTestJSON-2090364052 tempest-VolumesTestJSON-2090364052-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.112511 Jun 17 15:12:33.539726 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 85/166] 10.222.0.48 () {58 vars in 1154 bytes} [Fri Jun 17 15:12:33 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:12:33.557465 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-ec019b91-e51f-4a45-90c2-ad436750c267 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:12:33.558354 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-ec019b91-e51f-4a45-90c2-ad436750c267 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] [instance: 277bb65d-ad0a-4439-8972-bd32346dead3] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:12:33.576136 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ec019b91-e51f-4a45-90c2-ad436750c267 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:33.577765 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ec019b91-e51f-4a45-90c2-ad436750c267 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:33.580176 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ec019b91-e51f-4a45-90c2-ad436750c267 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:33.582421 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ec019b91-e51f-4a45-90c2-ad436750c267 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:33.953123 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-ec019b91-e51f-4a45-90c2-ad436750c267 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd12373903ae4f059464f026f2c18581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de3212eec024eb7b1319357c96f0c01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:12:33.963160 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-ec019b91-e51f-4a45-90c2-ad436750c267 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] 10.222.0.48 "GET /compute/v2.1/servers/277bb65d-ad0a-4439-8972-bd32346dead3" status: 200 len: 1314 microversion: 2.1 time: 0.410628 Jun 17 15:12:33.965283 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 82/167] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:12:33 2022] GET /compute/v2.1/servers/277bb65d-ad0a-4439-8972-bd32346dead3 => generated 1314 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:12:34.464071 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell0:SELECT=2 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:12:34.465041 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell0:SELECT=6 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:12:34.473188 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-eb038e30-053e-4681-840d-9f5583012a6f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:12:34.477632 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-eb038e30-053e-4681-840d-9f5583012a6f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: 335fa25e-3f5c-45f0-9f85-f9c4681728b8] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:12:34.492137 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-eb038e30-053e-4681-840d-9f5583012a6f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:34.492870 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-eb038e30-053e-4681-840d-9f5583012a6f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:34.493851 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-eb038e30-053e-4681-840d-9f5583012a6f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:34.494619 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-eb038e30-053e-4681-840d-9f5583012a6f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:34.757495 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-eb038e30-053e-4681-840d-9f5583012a6f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:12:34.767386 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-eb038e30-053e-4681-840d-9f5583012a6f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/335fa25e-3f5c-45f0-9f85-f9c4681728b8" status: 200 len: 1498 microversion: 2.1 time: 0.304379 Jun 17 15:12:34.768620 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 86/168] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:12:34 2022] GET /compute/v2.1/servers/335fa25e-3f5c-45f0-9f85-f9c4681728b8 => generated 1498 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:12:34.786541 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-281f59e6-3626-4933-aa85-13f8c9a290c6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:12:34.787581 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-281f59e6-3626-4933-aa85-13f8c9a290c6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: 8f90be07-f969-4dc7-b8ab-a5a41f850645] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:12:34.795697 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell0:SELECT=2 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:12:34.798873 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-281f59e6-3626-4933-aa85-13f8c9a290c6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:34.799624 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-281f59e6-3626-4933-aa85-13f8c9a290c6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:34.800664 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-281f59e6-3626-4933-aa85-13f8c9a290c6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:34.801305 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-281f59e6-3626-4933-aa85-13f8c9a290c6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:34.982901 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-cc6cde08-5a5e-497b-9d55-20e5f0529e7f tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:12:34.983407 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-cc6cde08-5a5e-497b-9d55-20e5f0529e7f tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] [instance: 277bb65d-ad0a-4439-8972-bd32346dead3] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:12:35.001936 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cc6cde08-5a5e-497b-9d55-20e5f0529e7f tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:35.016552 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cc6cde08-5a5e-497b-9d55-20e5f0529e7f tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:35.023142 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cc6cde08-5a5e-497b-9d55-20e5f0529e7f tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:35.025618 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cc6cde08-5a5e-497b-9d55-20e5f0529e7f tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:35.057094 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-281f59e6-3626-4933-aa85-13f8c9a290c6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:12:35.078603 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-281f59e6-3626-4933-aa85-13f8c9a290c6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/8f90be07-f969-4dc7-b8ab-a5a41f850645" status: 200 len: 1513 microversion: 2.1 time: 0.297767 Jun 17 15:12:35.084406 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 83/169] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:12:34 2022] GET /compute/v2.1/servers/8f90be07-f969-4dc7-b8ab-a5a41f850645 => generated 1513 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:12:35.204891 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [req-8f35c0c9-6773-4b8d-8c5a-4e8aa891e5f0 req-ba2c181d-08d1-4f3a-81f1-8583111098fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "277bb65d-ad0a-4439-8972-bd32346dead3", "name": "network-vif-plugged", "status": "completed", "tag": "5e125bd9-3023-4490-97c6-1b5070c87c45"}]} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:12:35.219176 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-8f35c0c9-6773-4b8d-8c5a-4e8aa891e5f0 req-ba2c181d-08d1-4f3a-81f1-8583111098fd service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:35.219979 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-8f35c0c9-6773-4b8d-8c5a-4e8aa891e5f0 req-ba2c181d-08d1-4f3a-81f1-8583111098fd service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:35.246674 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.compute.server_external_events [req-8f35c0c9-6773-4b8d-8c5a-4e8aa891e5f0 req-ba2c181d-08d1-4f3a-81f1-8583111098fd service nova] Creating event network-vif-plugged:5e125bd9-3023-4490-97c6-1b5070c87c45 for instance 277bb65d-ad0a-4439-8972-bd32346dead3 on hv-cinder-82549 Jun 17 15:12:35.261359 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [req-8f35c0c9-6773-4b8d-8c5a-4e8aa891e5f0 req-ba2c181d-08d1-4f3a-81f1-8583111098fd service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059955 Jun 17 15:12:35.265779 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 84/170] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 15:12:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:12:35.404367 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-cc6cde08-5a5e-497b-9d55-20e5f0529e7f tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd12373903ae4f059464f026f2c18581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de3212eec024eb7b1319357c96f0c01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:12:35.416721 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-cc6cde08-5a5e-497b-9d55-20e5f0529e7f tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] 10.222.0.48 "GET /compute/v2.1/servers/277bb65d-ad0a-4439-8972-bd32346dead3" status: 200 len: 1314 microversion: 2.1 time: 0.438125 Jun 17 15:12:35.421331 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 87/171] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:12:34 2022] GET /compute/v2.1/servers/277bb65d-ad0a-4439-8972-bd32346dead3 => generated 1314 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:12:36.436461 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-efc53148-a350-4be3-a7d8-23e2a6d4c077 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:12:36.443633 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-efc53148-a350-4be3-a7d8-23e2a6d4c077 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] [instance: 277bb65d-ad0a-4439-8972-bd32346dead3] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:12:36.457305 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-efc53148-a350-4be3-a7d8-23e2a6d4c077 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:36.458050 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-efc53148-a350-4be3-a7d8-23e2a6d4c077 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:36.460830 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-efc53148-a350-4be3-a7d8-23e2a6d4c077 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:36.462080 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-efc53148-a350-4be3-a7d8-23e2a6d4c077 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:36.633723 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-efc53148-a350-4be3-a7d8-23e2a6d4c077 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd12373903ae4f059464f026f2c18581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de3212eec024eb7b1319357c96f0c01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:12:36.641872 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-efc53148-a350-4be3-a7d8-23e2a6d4c077 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] 10.222.0.48 "GET /compute/v2.1/servers/277bb65d-ad0a-4439-8972-bd32346dead3" status: 200 len: 1314 microversion: 2.1 time: 0.211768 Jun 17 15:12:36.651959 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 85/172] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:12:36 2022] GET /compute/v2.1/servers/277bb65d-ad0a-4439-8972-bd32346dead3 => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:12:36.836672 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-433cc374-1125-47b6-a12f-678aa6e28e33 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:12:36.838730 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-433cc374-1125-47b6-a12f-678aa6e28e33 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: 8f90be07-f969-4dc7-b8ab-a5a41f850645] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:12:36.852794 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-433cc374-1125-47b6-a12f-678aa6e28e33 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:36.855837 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-433cc374-1125-47b6-a12f-678aa6e28e33 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:36.857180 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-433cc374-1125-47b6-a12f-678aa6e28e33 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:36.857774 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-433cc374-1125-47b6-a12f-678aa6e28e33 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:36.904248 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.objects.instance [None req-433cc374-1125-47b6-a12f-678aa6e28e33 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lazy-loading 'flavor' on Instance uuid 8f90be07-f969-4dc7-b8ab-a5a41f850645 {{(pid=117650) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 15:12:37.125279 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-433cc374-1125-47b6-a12f-678aa6e28e33 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "POST /compute/v2.1/servers/8f90be07-f969-4dc7-b8ab-a5a41f850645/action" status: 200 len: 32 microversion: 2.1 time: 0.300019 Jun 17 15:12:37.127056 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 88/173] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jun 17 15:12:36 2022] POST /compute/v2.1/servers/8f90be07-f969-4dc7-b8ab-a5a41f850645/action => generated 32 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 17 15:12:37.141887 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-d239931d-2f02-42fa-b442-76420ae331ae tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:12:37.143221 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-d239931d-2f02-42fa-b442-76420ae331ae tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: 8f90be07-f969-4dc7-b8ab-a5a41f850645] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:12:37.159381 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d239931d-2f02-42fa-b442-76420ae331ae tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:37.160532 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d239931d-2f02-42fa-b442-76420ae331ae tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:37.167784 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d239931d-2f02-42fa-b442-76420ae331ae tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:37.168544 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d239931d-2f02-42fa-b442-76420ae331ae tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:37.456919 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-d239931d-2f02-42fa-b442-76420ae331ae tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:12:37.468248 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-d239931d-2f02-42fa-b442-76420ae331ae tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/8f90be07-f969-4dc7-b8ab-a5a41f850645" status: 200 len: 1519 microversion: 2.1 time: 0.336089 Jun 17 15:12:37.471878 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 86/174] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:12:37 2022] GET /compute/v2.1/servers/8f90be07-f969-4dc7-b8ab-a5a41f850645 => generated 1519 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:12:37.659943 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-bacb8b92-ada2-42d2-9068-2bd4812f45c5 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:12:37.661076 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-bacb8b92-ada2-42d2-9068-2bd4812f45c5 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] [instance: 277bb65d-ad0a-4439-8972-bd32346dead3] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:12:37.679469 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bacb8b92-ada2-42d2-9068-2bd4812f45c5 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:37.681159 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bacb8b92-ada2-42d2-9068-2bd4812f45c5 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:37.682362 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bacb8b92-ada2-42d2-9068-2bd4812f45c5 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:37.686372 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bacb8b92-ada2-42d2-9068-2bd4812f45c5 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:38.085867 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-bacb8b92-ada2-42d2-9068-2bd4812f45c5 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd12373903ae4f059464f026f2c18581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de3212eec024eb7b1319357c96f0c01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:12:38.096655 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-bacb8b92-ada2-42d2-9068-2bd4812f45c5 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] 10.222.0.48 "GET /compute/v2.1/servers/277bb65d-ad0a-4439-8972-bd32346dead3" status: 200 len: 1314 microversion: 2.1 time: 0.441257 Jun 17 15:12:38.097541 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 89/175] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:12:37 2022] GET /compute/v2.1/servers/277bb65d-ad0a-4439-8972-bd32346dead3 => generated 1314 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:12:38.498332 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-c127145c-12ae-4c89-b691-3f3d3c7694b5 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:12:38.498948 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-c127145c-12ae-4c89-b691-3f3d3c7694b5 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: 8f90be07-f969-4dc7-b8ab-a5a41f850645] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:12:38.508943 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:12:38.524298 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c127145c-12ae-4c89-b691-3f3d3c7694b5 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:38.524784 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c127145c-12ae-4c89-b691-3f3d3c7694b5 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:38.525604 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c127145c-12ae-4c89-b691-3f3d3c7694b5 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:38.526127 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c127145c-12ae-4c89-b691-3f3d3c7694b5 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:38.783399 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-c127145c-12ae-4c89-b691-3f3d3c7694b5 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:12:38.799457 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-c127145c-12ae-4c89-b691-3f3d3c7694b5 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/8f90be07-f969-4dc7-b8ab-a5a41f850645" status: 200 len: 1519 microversion: 2.1 time: 0.298766 Jun 17 15:12:38.805340 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 87/176] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:12:38 2022] GET /compute/v2.1/servers/8f90be07-f969-4dc7-b8ab-a5a41f850645 => generated 1519 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:12:39.113551 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-dd155078-fecf-4289-a27d-f93689c8740c tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:12:39.114770 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-dd155078-fecf-4289-a27d-f93689c8740c tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] [instance: 277bb65d-ad0a-4439-8972-bd32346dead3] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:12:39.126525 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-dd155078-fecf-4289-a27d-f93689c8740c tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:39.127817 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-dd155078-fecf-4289-a27d-f93689c8740c tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:39.129448 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-dd155078-fecf-4289-a27d-f93689c8740c tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:39.130136 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-dd155078-fecf-4289-a27d-f93689c8740c tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:39.399110 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-dd155078-fecf-4289-a27d-f93689c8740c tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd12373903ae4f059464f026f2c18581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de3212eec024eb7b1319357c96f0c01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:12:39.408576 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-dd155078-fecf-4289-a27d-f93689c8740c tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] 10.222.0.48 "GET /compute/v2.1/servers/277bb65d-ad0a-4439-8972-bd32346dead3" status: 200 len: 1314 microversion: 2.1 time: 0.298916 Jun 17 15:12:39.409716 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 90/177] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:12:39 2022] GET /compute/v2.1/servers/277bb65d-ad0a-4439-8972-bd32346dead3 => generated 1314 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:12:39.822394 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-ad3e2e3d-872b-4c7d-9c08-994fa9352114 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:12:39.823696 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-ad3e2e3d-872b-4c7d-9c08-994fa9352114 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: 8f90be07-f969-4dc7-b8ab-a5a41f850645] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:12:39.835853 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ad3e2e3d-872b-4c7d-9c08-994fa9352114 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:39.838181 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ad3e2e3d-872b-4c7d-9c08-994fa9352114 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:39.840202 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ad3e2e3d-872b-4c7d-9c08-994fa9352114 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:39.842326 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ad3e2e3d-872b-4c7d-9c08-994fa9352114 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:40.111955 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-ad3e2e3d-872b-4c7d-9c08-994fa9352114 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:12:40.121019 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-ad3e2e3d-872b-4c7d-9c08-994fa9352114 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/8f90be07-f969-4dc7-b8ab-a5a41f850645" status: 200 len: 1519 microversion: 2.1 time: 0.303334 Jun 17 15:12:40.122152 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 88/178] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:12:39 2022] GET /compute/v2.1/servers/8f90be07-f969-4dc7-b8ab-a5a41f850645 => generated 1519 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:12:40.430430 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-e9157ab6-0eae-4ffb-9521-234009d7ca62 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:12:40.431960 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-e9157ab6-0eae-4ffb-9521-234009d7ca62 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] [instance: 277bb65d-ad0a-4439-8972-bd32346dead3] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:12:40.440151 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e9157ab6-0eae-4ffb-9521-234009d7ca62 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:40.441012 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e9157ab6-0eae-4ffb-9521-234009d7ca62 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:40.441982 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e9157ab6-0eae-4ffb-9521-234009d7ca62 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:40.442798 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e9157ab6-0eae-4ffb-9521-234009d7ca62 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:40.650696 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-e9157ab6-0eae-4ffb-9521-234009d7ca62 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd12373903ae4f059464f026f2c18581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de3212eec024eb7b1319357c96f0c01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:12:40.656631 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:12:40.662376 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-e9157ab6-0eae-4ffb-9521-234009d7ca62 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] 10.222.0.48 "GET /compute/v2.1/servers/277bb65d-ad0a-4439-8972-bd32346dead3" status: 200 len: 1497 microversion: 2.1 time: 0.236151 Jun 17 15:12:40.679566 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 91/179] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:12:40 2022] GET /compute/v2.1/servers/277bb65d-ad0a-4439-8972-bd32346dead3 => generated 1497 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:12:41.146166 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-5b277e11-7fb8-4cdc-981f-4dd662adde67 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:12:41.151943 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-5b277e11-7fb8-4cdc-981f-4dd662adde67 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: 8f90be07-f969-4dc7-b8ab-a5a41f850645] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:12:41.191881 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5b277e11-7fb8-4cdc-981f-4dd662adde67 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:41.193579 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5b277e11-7fb8-4cdc-981f-4dd662adde67 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:41.200230 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5b277e11-7fb8-4cdc-981f-4dd662adde67 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:41.202724 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5b277e11-7fb8-4cdc-981f-4dd662adde67 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:41.307265 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell1:SELECT=100 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:12:41.344024 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-56bc2c8d-e64a-4ed9-9f8d-b09994a64c73 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:12:41.344835 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-56bc2c8d-e64a-4ed9-9f8d-b09994a64c73 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] [instance: 277bb65d-ad0a-4439-8972-bd32346dead3] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:12:41.368183 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-56bc2c8d-e64a-4ed9-9f8d-b09994a64c73 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:41.369442 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-56bc2c8d-e64a-4ed9-9f8d-b09994a64c73 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:41.373330 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-56bc2c8d-e64a-4ed9-9f8d-b09994a64c73 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:41.374192 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-56bc2c8d-e64a-4ed9-9f8d-b09994a64c73 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:41.427082 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-56bc2c8d-e64a-4ed9-9f8d-b09994a64c73 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] [instance: 277bb65d-ad0a-4439-8972-bd32346dead3] Going to try to terminate instance {{(pid=117650) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 15:12:41.607513 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:12:41.646663 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-56bc2c8d-e64a-4ed9-9f8d-b09994a64c73 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] 10.222.0.48 "DELETE /compute/v2.1/servers/277bb65d-ad0a-4439-8972-bd32346dead3" status: 204 len: 0 microversion: 2.1 time: 0.306866 Jun 17 15:12:41.648374 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 92/180] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jun 17 15:12:41 2022] DELETE /compute/v2.1/servers/277bb65d-ad0a-4439-8972-bd32346dead3 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 15:12:41.655450 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-86341010-c5bd-4ff9-b13e-2ee7673efabf tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:12:41.656389 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-86341010-c5bd-4ff9-b13e-2ee7673efabf tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:12:41.665054 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-86341010-c5bd-4ff9-b13e-2ee7673efabf tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:41.665836 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-86341010-c5bd-4ff9-b13e-2ee7673efabf tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:41.667605 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-86341010-c5bd-4ff9-b13e-2ee7673efabf tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:41.668229 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-86341010-c5bd-4ff9-b13e-2ee7673efabf tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:41.738519 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-86341010-c5bd-4ff9-b13e-2ee7673efabf tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/ips" status: 200 len: 151 microversion: 2.20 time: 0.088540 Jun 17 15:12:41.739101 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 93/181] 10.222.0.48 () {60 vars in 1288 bytes} [Fri Jun 17 15:12:41 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/ips => generated 151 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:12:41.774046 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-91b8e76d-b599-48f4-8928-34d3f2a43114 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:12:41.776967 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-91b8e76d-b599-48f4-8928-34d3f2a43114 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] [instance: 277bb65d-ad0a-4439-8972-bd32346dead3] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:12:41.800422 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-91b8e76d-b599-48f4-8928-34d3f2a43114 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:41.801824 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-91b8e76d-b599-48f4-8928-34d3f2a43114 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:41.803226 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-91b8e76d-b599-48f4-8928-34d3f2a43114 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:41.807262 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-91b8e76d-b599-48f4-8928-34d3f2a43114 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:42.251074 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-91b8e76d-b599-48f4-8928-34d3f2a43114 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd12373903ae4f059464f026f2c18581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de3212eec024eb7b1319357c96f0c01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:12:42.264138 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-91b8e76d-b599-48f4-8928-34d3f2a43114 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] 10.222.0.48 "GET /compute/v2.1/servers/277bb65d-ad0a-4439-8972-bd32346dead3" status: 200 len: 1503 microversion: 2.1 time: 0.504275 Jun 17 15:12:42.266364 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 94/182] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:12:41 2022] GET /compute/v2.1/servers/277bb65d-ad0a-4439-8972-bd32346dead3 => generated 1503 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:12:42.273322 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-5b277e11-7fb8-4cdc-981f-4dd662adde67 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:12:42.282130 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-5b277e11-7fb8-4cdc-981f-4dd662adde67 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/8f90be07-f969-4dc7-b8ab-a5a41f850645" status: 200 len: 1519 microversion: 2.1 time: 1.146486 Jun 17 15:12:42.297664 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 89/183] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:12:41 2022] GET /compute/v2.1/servers/8f90be07-f969-4dc7-b8ab-a5a41f850645 => generated 1519 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:12:43.282422 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-a7b2f830-cca3-44cf-b056-5e8e9e1b4000 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:12:43.283504 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-a7b2f830-cca3-44cf-b056-5e8e9e1b4000 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] [instance: 277bb65d-ad0a-4439-8972-bd32346dead3] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:12:43.297710 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a7b2f830-cca3-44cf-b056-5e8e9e1b4000 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:43.298339 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a7b2f830-cca3-44cf-b056-5e8e9e1b4000 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:43.299259 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a7b2f830-cca3-44cf-b056-5e8e9e1b4000 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:43.305378 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-09d43ed9-4e4d-4e1b-80c4-a7ce8fbdcd72 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:12:43.305992 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-09d43ed9-4e4d-4e1b-80c4-a7ce8fbdcd72 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: 8f90be07-f969-4dc7-b8ab-a5a41f850645] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:12:43.313244 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a7b2f830-cca3-44cf-b056-5e8e9e1b4000 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:43.321344 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-09d43ed9-4e4d-4e1b-80c4-a7ce8fbdcd72 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:43.323242 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-09d43ed9-4e4d-4e1b-80c4-a7ce8fbdcd72 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:43.327922 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-09d43ed9-4e4d-4e1b-80c4-a7ce8fbdcd72 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:43.332436 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-09d43ed9-4e4d-4e1b-80c4-a7ce8fbdcd72 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:43.611257 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-a7b2f830-cca3-44cf-b056-5e8e9e1b4000 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd12373903ae4f059464f026f2c18581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de3212eec024eb7b1319357c96f0c01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:12:43.623541 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-a7b2f830-cca3-44cf-b056-5e8e9e1b4000 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] 10.222.0.48 "GET /compute/v2.1/servers/277bb65d-ad0a-4439-8972-bd32346dead3" status: 200 len: 1503 microversion: 2.1 time: 0.345018 Jun 17 15:12:43.625624 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 95/184] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:12:43 2022] GET /compute/v2.1/servers/277bb65d-ad0a-4439-8972-bd32346dead3 => generated 1503 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:12:43.862856 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-09d43ed9-4e4d-4e1b-80c4-a7ce8fbdcd72 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:12:43.873244 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-09d43ed9-4e4d-4e1b-80c4-a7ce8fbdcd72 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/8f90be07-f969-4dc7-b8ab-a5a41f850645" status: 200 len: 1519 microversion: 2.1 time: 0.572559 Jun 17 15:12:43.889024 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 90/185] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:12:43 2022] GET /compute/v2.1/servers/8f90be07-f969-4dc7-b8ab-a5a41f850645 => generated 1519 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:12:44.165550 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-07df9690-c347-49dc-8871-9df6251a8068 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:12:44.166482 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-07df9690-c347-49dc-8871-9df6251a8068 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:12:44.201545 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-07df9690-c347-49dc-8871-9df6251a8068 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:44.202003 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-07df9690-c347-49dc-8871-9df6251a8068 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:44.202795 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-07df9690-c347-49dc-8871-9df6251a8068 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:44.203227 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-07df9690-c347-49dc-8871-9df6251a8068 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:44.273907 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.objects.instance [None req-07df9690-c347-49dc-8871-9df6251a8068 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lazy-loading 'flavor' on Instance uuid e97df352-5cee-41f7-ae51-f55cd9e85869 {{(pid=117650) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 15:12:44.640976 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-b8c88ed8-2f9e-4701-b41f-765321ba3170 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:12:44.645671 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-b8c88ed8-2f9e-4701-b41f-765321ba3170 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] [instance: 277bb65d-ad0a-4439-8972-bd32346dead3] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:12:44.659045 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b8c88ed8-2f9e-4701-b41f-765321ba3170 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:44.662995 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b8c88ed8-2f9e-4701-b41f-765321ba3170 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:44.666378 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b8c88ed8-2f9e-4701-b41f-765321ba3170 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:44.666980 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b8c88ed8-2f9e-4701-b41f-765321ba3170 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:44.846200 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-b8c88ed8-2f9e-4701-b41f-765321ba3170 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd12373903ae4f059464f026f2c18581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de3212eec024eb7b1319357c96f0c01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:12:44.865624 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-b8c88ed8-2f9e-4701-b41f-765321ba3170 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] 10.222.0.48 "GET /compute/v2.1/servers/277bb65d-ad0a-4439-8972-bd32346dead3" status: 200 len: 1461 microversion: 2.1 time: 0.228416 Jun 17 15:12:44.882368 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 91/186] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:12:44 2022] GET /compute/v2.1/servers/277bb65d-ad0a-4439-8972-bd32346dead3 => generated 1461 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:12:44.887923 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [req-e05bb48c-d67f-4063-ae2c-a405ca2559e3 req-a94c8c1f-942a-47f9-ac47-7669dca4e168 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "277bb65d-ad0a-4439-8972-bd32346dead3", "name": "network-vif-deleted", "tag": "5e125bd9-3023-4490-97c6-1b5070c87c45"}]} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:12:44.906513 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-e05bb48c-d67f-4063-ae2c-a405ca2559e3 req-a94c8c1f-942a-47f9-ac47-7669dca4e168 service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:44.911764 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-e05bb48c-d67f-4063-ae2c-a405ca2559e3 req-a94c8c1f-942a-47f9-ac47-7669dca4e168 service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:44.939212 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.compute.server_external_events [req-e05bb48c-d67f-4063-ae2c-a405ca2559e3 req-a94c8c1f-942a-47f9-ac47-7669dca4e168 service nova] Creating event network-vif-deleted:5e125bd9-3023-4490-97c6-1b5070c87c45 for instance 277bb65d-ad0a-4439-8972-bd32346dead3 on hv-cinder-82549 Jun 17 15:12:44.950102 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [req-e05bb48c-d67f-4063-ae2c-a405ca2559e3 req-a94c8c1f-942a-47f9-ac47-7669dca4e168 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065644 Jun 17 15:12:44.957099 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 92/187] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 15:12:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:12:44.966563 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-3411a699-bec1-420d-88d1-ee2aaf9c6f91 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:12:44.972319 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-3411a699-bec1-420d-88d1-ee2aaf9c6f91 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: 8f90be07-f969-4dc7-b8ab-a5a41f850645] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:12:44.984284 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3411a699-bec1-420d-88d1-ee2aaf9c6f91 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:44.988857 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3411a699-bec1-420d-88d1-ee2aaf9c6f91 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:44.989947 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3411a699-bec1-420d-88d1-ee2aaf9c6f91 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:44.992822 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3411a699-bec1-420d-88d1-ee2aaf9c6f91 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:45.111341 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-07df9690-c347-49dc-8871-9df6251a8068 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "POST /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/action" status: 202 len: 0 microversion: 2.20 time: 0.951662 Jun 17 15:12:45.114948 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 96/188] 10.222.0.48 () {62 vars in 1318 bytes} [Fri Jun 17 15:12:44 2022] POST /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/action => generated 0 bytes in 956 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 17 15:12:45.123465 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-7c767ef8-dac4-48b3-b976-585a6dcf86a6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:12:45.124899 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-7c767ef8-dac4-48b3-b976-585a6dcf86a6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:12:45.141266 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7c767ef8-dac4-48b3-b976-585a6dcf86a6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:45.142451 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7c767ef8-dac4-48b3-b976-585a6dcf86a6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:45.145457 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7c767ef8-dac4-48b3-b976-585a6dcf86a6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:45.146550 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7c767ef8-dac4-48b3-b976-585a6dcf86a6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:45.326620 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-3411a699-bec1-420d-88d1-ee2aaf9c6f91 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:12:45.342079 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-3411a699-bec1-420d-88d1-ee2aaf9c6f91 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/8f90be07-f969-4dc7-b8ab-a5a41f850645" status: 200 len: 1519 microversion: 2.1 time: 0.381418 Jun 17 15:12:45.343518 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 93/189] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:12:44 2022] GET /compute/v2.1/servers/8f90be07-f969-4dc7-b8ab-a5a41f850645 => generated 1519 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:12:45.559074 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-7c767ef8-dac4-48b3-b976-585a6dcf86a6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:12:45.580567 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-7c767ef8-dac4-48b3-b976-585a6dcf86a6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:12:45.582598 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-7c767ef8-dac4-48b3-b976-585a6dcf86a6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:12:45.588727 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-7c767ef8-dac4-48b3-b976-585a6dcf86a6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1721 microversion: 2.20 time: 0.468483 Jun 17 15:12:45.600651 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 97/190] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:12:45 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1721 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:12:45.901416 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-691f36a7-4217-42b0-b914-85eb30ab1edc tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:12:45.903236 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-691f36a7-4217-42b0-b914-85eb30ab1edc tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] [instance: 277bb65d-ad0a-4439-8972-bd32346dead3] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:12:45.916212 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-691f36a7-4217-42b0-b914-85eb30ab1edc tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:45.916645 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-691f36a7-4217-42b0-b914-85eb30ab1edc tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:45.919069 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-691f36a7-4217-42b0-b914-85eb30ab1edc tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:45.920485 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-691f36a7-4217-42b0-b914-85eb30ab1edc tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:45.948677 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.wsgi [None req-691f36a7-4217-42b0-b914-85eb30ab1edc tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] HTTP exception thrown: Instance 277bb65d-ad0a-4439-8972-bd32346dead3 could not be found. Jun 17 15:12:45.950807 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-691f36a7-4217-42b0-b914-85eb30ab1edc tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Request method failure captured: Jun 17 15:12:45.950807 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: request: GET /compute/v2.1/servers/277bb65d-ad0a-4439-8972-bd32346dead3 HTTP/1.1 Jun 17 15:12:45.950807 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Accept: application/json Jun 17 15:12:45.950807 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Accept-Encoding: identity Jun 17 15:12:45.950807 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Connection: close Jun 17 15:12:45.950807 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Content-Length: 0 Jun 17 15:12:45.950807 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Content-Type: application/json Jun 17 15:12:45.950807 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Host: 10.222.0.48 Jun 17 15:12:45.950807 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Openstack-System-Scope: None Jun 17 15:12:45.950807 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: User-Agent: python-urllib3/1.26.9 Jun 17 15:12:45.950807 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Auth-Token: gAAAAABirJnV-H_bjNw4OzE2GGzJYccJh1Lqx8LKMqUAH_x-U80LBH6_2ZEoOYsCGg8KVjs37A3UTfUbd5Z1rXEkWm9JKCcovQE3jpwdviDGFjn-la78i52cNdtqcP9m1CwbUOtcpeuHX2SyolE0s5lohNU1_eKha1nI76oe8km0u72o0sq6qu4 Jun 17 15:12:45.950807 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Domain-Id: None Jun 17 15:12:45.950807 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Domain-Name: None Jun 17 15:12:45.950807 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Identity-Status: Confirmed Jun 17 15:12:45.950807 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Is-Admin-Project: True Jun 17 15:12:45.950807 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Domain-Id: default Jun 17 15:12:45.950807 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Domain-Name: Default Jun 17 15:12:45.950807 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Id: 5de3212eec024eb7b1319357c96f0c01 Jun 17 15:12:45.950807 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Name: tempest-VolumesActionsTest-2011511006 Jun 17 15:12:45.950807 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Role: reader,member Jun 17 15:12:45.950807 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Roles: reader,member Jun 17 15:12:45.952068 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_5de3212eec024eb7b1319357c96f0c01", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/5de3212eec024eb7b1319357c96f0c01"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5de3212eec024eb7b1319357c96f0c01"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5de3212eec024eb7b1319357c96f0c01"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Jun 17 15:12:45.952068 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant: tempest-VolumesActionsTest-2011511006 Jun 17 15:12:45.952068 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant-Id: 5de3212eec024eb7b1319357c96f0c01 Jun 17 15:12:45.952068 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant-Name: tempest-VolumesActionsTest-2011511006 Jun 17 15:12:45.952068 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User: tempest-VolumesActionsTest-2011511006-project Jun 17 15:12:45.952068 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Domain-Id: default Jun 17 15:12:45.952068 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Domain-Name: Default Jun 17 15:12:45.952068 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Id: fd12373903ae4f059464f026f2c18581 Jun 17 15:12:45.952068 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Name: tempest-VolumesActionsTest-2011511006-project Jun 17 15:12:45.952068 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: method: > Jun 17 15:12:45.952068 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: exception: Instance 277bb65d-ad0a-4439-8972-bd32346dead3 could not be found. Jun 17 15:12:45.952068 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: action_args: {'id': '277bb65d-ad0a-4439-8972-bd32346dead3'} Jun 17 15:12:45.952864 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 15:12:45.952864 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:12:45.952864 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 15:12:45.952864 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 15:12:45.952864 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 15:12:45.952864 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 15:12:45.952864 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 15:12:45.952864 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 15:12:45.952864 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 15:12:45.952864 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 15:12:45.952864 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 277bb65d-ad0a-4439-8972-bd32346dead3 could not be found. Jun 17 15:12:45.952864 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:12:45.952864 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:12:45.952864 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:12:45.952864 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:12:45.952864 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:12:45.952864 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:12:45.952864 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 15:12:45.952864 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 15:12:45.952864 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 15:12:45.954069 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 15:12:45.954069 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 15:12:45.954069 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 15:12:45.954069 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 15:12:45.954069 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 15:12:45.954069 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 15:12:45.954069 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 15:12:45.954069 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 277bb65d-ad0a-4439-8972-bd32346dead3 could not be found. Jun 17 15:12:45.954069 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:12:45.954069 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:12:45.954069 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:12:45.954069 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:12:45.954069 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:12:45.954069 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:12:45.954069 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 15:12:45.954069 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 15:12:45.954069 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 277bb65d-ad0a-4439-8972-bd32346dead3 could not be found. Jun 17 15:12:45.954069 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:12:45.956984 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-691f36a7-4217-42b0-b914-85eb30ab1edc tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Returning 404 to user: Instance 277bb65d-ad0a-4439-8972-bd32346dead3 could not be found. {{(pid=117649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 15:12:45.958017 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-691f36a7-4217-42b0-b914-85eb30ab1edc tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] 10.222.0.48 "GET /compute/v2.1/servers/277bb65d-ad0a-4439-8972-bd32346dead3" status: 404 len: 111 microversion: 2.1 time: 0.062738 Jun 17 15:12:45.958771 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 94/191] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:12:45 2022] GET /compute/v2.1/servers/277bb65d-ad0a-4439-8972-bd32346dead3 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 15:12:46.223160 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-d89273b0-d2c3-4aa0-ac0d-4f0425e90851 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1797457142", "imageRef": "8c105ca4-6fe3-4e70-af71-b03c64fe1efe", "flavorRef": "452", "networks": [{"uuid": "29b80c37-5e37-4711-8585-ce014e95e3e0"}]}} {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:12:46.349484 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.network.neutron [None req-d89273b0-d2c3-4aa0-ac0d-4f0425e90851 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] validate_networks() for [('29b80c37-5e37-4711-8585-ce014e95e3e0', None, None, None, None, None)] {{(pid=117650) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 15:12:46.364115 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-3258ff39-1945-4c08-a4e1-0bd0020fafb1 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:12:46.364548 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-3258ff39-1945-4c08-a4e1-0bd0020fafb1 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: 8f90be07-f969-4dc7-b8ab-a5a41f850645] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:12:46.374517 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3258ff39-1945-4c08-a4e1-0bd0020fafb1 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:46.374973 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3258ff39-1945-4c08-a4e1-0bd0020fafb1 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:46.375750 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3258ff39-1945-4c08-a4e1-0bd0020fafb1 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:46.376188 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3258ff39-1945-4c08-a4e1-0bd0020fafb1 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:46.653340 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-3258ff39-1945-4c08-a4e1-0bd0020fafb1 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:12:46.674391 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-3258ff39-1945-4c08-a4e1-0bd0020fafb1 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/8f90be07-f969-4dc7-b8ab-a5a41f850645" status: 200 len: 1519 microversion: 2.1 time: 0.311158 Jun 17 15:12:46.675514 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 95/192] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:12:46 2022] GET /compute/v2.1/servers/8f90be07-f969-4dc7-b8ab-a5a41f850645 => generated 1519 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:12:46.680587 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-99baa584-1246-4a20-afc9-bec683042574 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:12:46.681395 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-99baa584-1246-4a20-afc9-bec683042574 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:12:46.695760 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-99baa584-1246-4a20-afc9-bec683042574 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:46.696202 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-99baa584-1246-4a20-afc9-bec683042574 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:46.697192 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-99baa584-1246-4a20-afc9-bec683042574 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:46.703279 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-99baa584-1246-4a20-afc9-bec683042574 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:47.008952 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-99baa584-1246-4a20-afc9-bec683042574 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:12:47.026885 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-99baa584-1246-4a20-afc9-bec683042574 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:12:47.028666 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-99baa584-1246-4a20-afc9-bec683042574 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:12:47.030111 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-99baa584-1246-4a20-afc9-bec683042574 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1721 microversion: 2.20 time: 0.353457 Jun 17 15:12:47.035351 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 96/193] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:12:46 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1721 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:12:47.614865 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.virt.hardware [None req-d89273b0-d2c3-4aa0-ac0d-4f0425e90851 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Flavor limits 0:0:0 {{(pid=117650) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 15:12:47.620212 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.virt.hardware [None req-d89273b0-d2c3-4aa0-ac0d-4f0425e90851 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Image limits 0:0:0 {{(pid=117650) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 15:12:47.621108 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.virt.hardware [None req-d89273b0-d2c3-4aa0-ac0d-4f0425e90851 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Flavor pref 0:0:0 {{(pid=117650) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 15:12:47.621793 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.virt.hardware [None req-d89273b0-d2c3-4aa0-ac0d-4f0425e90851 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Image pref 0:0:0 {{(pid=117650) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 15:12:47.622363 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.virt.hardware [None req-d89273b0-d2c3-4aa0-ac0d-4f0425e90851 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117650) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 15:12:47.650067 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d89273b0-d2c3-4aa0-ac0d-4f0425e90851 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:47.650799 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d89273b0-d2c3-4aa0-ac0d-4f0425e90851 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:47.651869 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d89273b0-d2c3-4aa0-ac0d-4f0425e90851 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:47.652579 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d89273b0-d2c3-4aa0-ac0d-4f0425e90851 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:47.672870 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.quota [None req-d89273b0-d2c3-4aa0-ac0d-4f0425e90851 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Getting quotas for project 5de3212eec024eb7b1319357c96f0c01. Resources: {'cores', 'ram', 'instances'} {{(pid=117650) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 15:12:47.681173 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.quota [None req-d89273b0-d2c3-4aa0-ac0d-4f0425e90851 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Getting quotas for user fd12373903ae4f059464f026f2c18581 and project 5de3212eec024eb7b1319357c96f0c01. Resources: {'cores', 'ram', 'instances'} {{(pid=117650) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 15:12:47.691037 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-222e0896-6999-4806-8be2-73bdf3ddafa8 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:12:47.691728 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-222e0896-6999-4806-8be2-73bdf3ddafa8 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: 8f90be07-f969-4dc7-b8ab-a5a41f850645] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:12:47.702494 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-222e0896-6999-4806-8be2-73bdf3ddafa8 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:47.703071 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-222e0896-6999-4806-8be2-73bdf3ddafa8 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:47.704196 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-222e0896-6999-4806-8be2-73bdf3ddafa8 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:47.704988 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-222e0896-6999-4806-8be2-73bdf3ddafa8 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:47.726888 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-d89273b0-d2c3-4aa0-ac0d-4f0425e90851 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Going to run 1 instances... {{(pid=117650) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 15:12:47.734609 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-d89273b0-d2c3-4aa0-ac0d-4f0425e90851 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] [instance: cbcfcb21-8a77-48d2-b889-85680b966a8e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c105ca4-6fe3-4e70-af71-b03c64fe1efe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117650) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 15:12:47.847975 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-d89273b0-d2c3-4aa0-ac0d-4f0425e90851 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.636715 Jun 17 15:12:47.861173 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 98/194] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Jun 17 15:12:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1652 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 15:12:47.883497 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-407214ae-32e5-4936-9dc3-7021fd18684d tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:12:47.884269 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-407214ae-32e5-4936-9dc3-7021fd18684d tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] [instance: cbcfcb21-8a77-48d2-b889-85680b966a8e] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:12:48.094803 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-222e0896-6999-4806-8be2-73bdf3ddafa8 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:12:48.129614 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-222e0896-6999-4806-8be2-73bdf3ddafa8 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/8f90be07-f969-4dc7-b8ab-a5a41f850645" status: 200 len: 1519 microversion: 2.1 time: 0.439894 Jun 17 15:12:48.136368 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 97/195] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:12:47 2022] GET /compute/v2.1/servers/8f90be07-f969-4dc7-b8ab-a5a41f850645 => generated 1519 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:12:48.149896 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-407214ae-32e5-4936-9dc3-7021fd18684d tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd12373903ae4f059464f026f2c18581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de3212eec024eb7b1319357c96f0c01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:12:48.160183 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-4e865212-8a38-4ced-b6c8-befb981546bb tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:12:48.175457 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-4e865212-8a38-4ced-b6c8-befb981546bb tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:12:48.203342 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4e865212-8a38-4ced-b6c8-befb981546bb tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:48.211314 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4e865212-8a38-4ced-b6c8-befb981546bb tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:48.212407 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4e865212-8a38-4ced-b6c8-befb981546bb tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:48.215878 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4e865212-8a38-4ced-b6c8-befb981546bb tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:48.673600 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-407214ae-32e5-4936-9dc3-7021fd18684d tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] 10.222.0.48 "GET /compute/v2.1/servers/cbcfcb21-8a77-48d2-b889-85680b966a8e" status: 200 len: 1214 microversion: 2.1 time: 0.811290 Jun 17 15:12:48.680640 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 99/196] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:12:47 2022] GET /compute/v2.1/servers/cbcfcb21-8a77-48d2-b889-85680b966a8e => generated 1214 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:12:48.845052 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-4e865212-8a38-4ced-b6c8-befb981546bb tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:12:48.857828 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-4e865212-8a38-4ced-b6c8-befb981546bb tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:12:48.859714 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-4e865212-8a38-4ced-b6c8-befb981546bb tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:12:48.861134 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-4e865212-8a38-4ced-b6c8-befb981546bb tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1721 microversion: 2.20 time: 0.723716 Jun 17 15:12:48.873560 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 98/197] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:12:48 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1721 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:12:49.163493 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-65e51fec-95ff-4a86-9cf9-b04c052a4bf8 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:12:49.164263 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-65e51fec-95ff-4a86-9cf9-b04c052a4bf8 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: 8f90be07-f969-4dc7-b8ab-a5a41f850645] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:12:49.177752 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-65e51fec-95ff-4a86-9cf9-b04c052a4bf8 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:49.178397 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-65e51fec-95ff-4a86-9cf9-b04c052a4bf8 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:49.179894 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-65e51fec-95ff-4a86-9cf9-b04c052a4bf8 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:49.180527 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-65e51fec-95ff-4a86-9cf9-b04c052a4bf8 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:49.511222 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-65e51fec-95ff-4a86-9cf9-b04c052a4bf8 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:12:49.519731 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-65e51fec-95ff-4a86-9cf9-b04c052a4bf8 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/8f90be07-f969-4dc7-b8ab-a5a41f850645" status: 200 len: 1519 microversion: 2.1 time: 0.371772 Jun 17 15:12:49.535942 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 100/198] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:12:49 2022] GET /compute/v2.1/servers/8f90be07-f969-4dc7-b8ab-a5a41f850645 => generated 1519 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:12:49.697741 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-12a998c9-e1b8-40bb-9f59-0abfe446d3cb tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:12:49.699049 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-12a998c9-e1b8-40bb-9f59-0abfe446d3cb tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] [instance: cbcfcb21-8a77-48d2-b889-85680b966a8e] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:12:49.710386 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-12a998c9-e1b8-40bb-9f59-0abfe446d3cb tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:49.711207 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-12a998c9-e1b8-40bb-9f59-0abfe446d3cb tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:49.717426 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-12a998c9-e1b8-40bb-9f59-0abfe446d3cb tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:49.718097 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-12a998c9-e1b8-40bb-9f59-0abfe446d3cb tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:49.849758 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-12a998c9-e1b8-40bb-9f59-0abfe446d3cb tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd12373903ae4f059464f026f2c18581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de3212eec024eb7b1319357c96f0c01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:12:49.871716 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-12a998c9-e1b8-40bb-9f59-0abfe446d3cb tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] 10.222.0.48 "GET /compute/v2.1/servers/cbcfcb21-8a77-48d2-b889-85680b966a8e" status: 200 len: 1266 microversion: 2.1 time: 0.177981 Jun 17 15:12:49.879455 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 99/199] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:12:49 2022] GET /compute/v2.1/servers/cbcfcb21-8a77-48d2-b889-85680b966a8e => generated 1266 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:12:49.880216 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-77f643ef-cf62-4d19-88b0-1818c44f739f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:12:49.881446 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-77f643ef-cf62-4d19-88b0-1818c44f739f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:12:49.891900 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-77f643ef-cf62-4d19-88b0-1818c44f739f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:49.892685 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-77f643ef-cf62-4d19-88b0-1818c44f739f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:49.893913 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-77f643ef-cf62-4d19-88b0-1818c44f739f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:49.894994 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-77f643ef-cf62-4d19-88b0-1818c44f739f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:50.141477 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-77f643ef-cf62-4d19-88b0-1818c44f739f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:12:50.156340 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-77f643ef-cf62-4d19-88b0-1818c44f739f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:12:50.161867 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-77f643ef-cf62-4d19-88b0-1818c44f739f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:12:50.166295 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-77f643ef-cf62-4d19-88b0-1818c44f739f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1721 microversion: 2.20 time: 0.290074 Jun 17 15:12:50.169652 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 101/200] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:12:49 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1721 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 15:12:50.535671 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-bb41ffc4-6879-4238-adfe-4cdab4ad19b7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:12:50.536289 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-bb41ffc4-6879-4238-adfe-4cdab4ad19b7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: 8f90be07-f969-4dc7-b8ab-a5a41f850645] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:12:50.549410 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bb41ffc4-6879-4238-adfe-4cdab4ad19b7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:50.549875 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bb41ffc4-6879-4238-adfe-4cdab4ad19b7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:50.550653 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bb41ffc4-6879-4238-adfe-4cdab4ad19b7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:50.551191 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bb41ffc4-6879-4238-adfe-4cdab4ad19b7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:50.895730 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-3dbb6a20-104a-417d-82a2-a4e49e79f5e0 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:12:50.896384 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-3dbb6a20-104a-417d-82a2-a4e49e79f5e0 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] [instance: cbcfcb21-8a77-48d2-b889-85680b966a8e] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:12:50.914466 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3dbb6a20-104a-417d-82a2-a4e49e79f5e0 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:50.919833 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3dbb6a20-104a-417d-82a2-a4e49e79f5e0 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:50.921962 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3dbb6a20-104a-417d-82a2-a4e49e79f5e0 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:50.927516 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3dbb6a20-104a-417d-82a2-a4e49e79f5e0 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:50.994678 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-bb41ffc4-6879-4238-adfe-4cdab4ad19b7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:12:51.009241 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-bb41ffc4-6879-4238-adfe-4cdab4ad19b7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/8f90be07-f969-4dc7-b8ab-a5a41f850645" status: 200 len: 1519 microversion: 2.1 time: 0.472442 Jun 17 15:12:51.014106 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 100/201] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:12:50 2022] GET /compute/v2.1/servers/8f90be07-f969-4dc7-b8ab-a5a41f850645 => generated 1519 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:12:51.209703 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-56986048-3a2f-40c6-a579-bad5a1501342 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:12:51.211372 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-56986048-3a2f-40c6-a579-bad5a1501342 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:12:51.231577 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-56986048-3a2f-40c6-a579-bad5a1501342 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:51.232558 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-56986048-3a2f-40c6-a579-bad5a1501342 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:51.233949 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-56986048-3a2f-40c6-a579-bad5a1501342 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:51.234568 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-56986048-3a2f-40c6-a579-bad5a1501342 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:51.736485 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-56986048-3a2f-40c6-a579-bad5a1501342 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:12:51.759150 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-56986048-3a2f-40c6-a579-bad5a1501342 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:12:51.763157 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-56986048-3a2f-40c6-a579-bad5a1501342 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:12:51.764407 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-56986048-3a2f-40c6-a579-bad5a1501342 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1721 microversion: 2.20 time: 0.573309 Jun 17 15:12:51.769940 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 101/202] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:12:51 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1721 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:12:51.776924 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-3dbb6a20-104a-417d-82a2-a4e49e79f5e0 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd12373903ae4f059464f026f2c18581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de3212eec024eb7b1319357c96f0c01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:12:51.789405 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-3dbb6a20-104a-417d-82a2-a4e49e79f5e0 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] 10.222.0.48 "GET /compute/v2.1/servers/cbcfcb21-8a77-48d2-b889-85680b966a8e" status: 200 len: 1272 microversion: 2.1 time: 0.897421 Jun 17 15:12:51.792366 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 102/203] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:12:50 2022] GET /compute/v2.1/servers/cbcfcb21-8a77-48d2-b889-85680b966a8e => generated 1272 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:12:52.027733 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-5b41ff10-e1e2-4050-8157-0a69b76ca362 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:12:52.029524 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-5b41ff10-e1e2-4050-8157-0a69b76ca362 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: 8f90be07-f969-4dc7-b8ab-a5a41f850645] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:12:52.038288 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5b41ff10-e1e2-4050-8157-0a69b76ca362 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:52.047281 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5b41ff10-e1e2-4050-8157-0a69b76ca362 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:52.057761 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5b41ff10-e1e2-4050-8157-0a69b76ca362 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:52.058601 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5b41ff10-e1e2-4050-8157-0a69b76ca362 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:52.689545 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-5b41ff10-e1e2-4050-8157-0a69b76ca362 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:12:52.713288 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-5b41ff10-e1e2-4050-8157-0a69b76ca362 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/8f90be07-f969-4dc7-b8ab-a5a41f850645" status: 200 len: 1519 microversion: 2.1 time: 0.688336 Jun 17 15:12:52.719284 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 102/204] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:12:52 2022] GET /compute/v2.1/servers/8f90be07-f969-4dc7-b8ab-a5a41f850645 => generated 1519 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:12:52.794991 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-2b96df58-3558-466b-bfe3-7c33f69a0b50 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:12:52.797198 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-2b96df58-3558-466b-bfe3-7c33f69a0b50 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:12:52.815369 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-ffa61fc3-f01e-4681-9b17-7c6a2a718d5c tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:12:52.815989 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-ffa61fc3-f01e-4681-9b17-7c6a2a718d5c tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] [instance: cbcfcb21-8a77-48d2-b889-85680b966a8e] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:12:52.827719 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2b96df58-3558-466b-bfe3-7c33f69a0b50 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:52.834646 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ffa61fc3-f01e-4681-9b17-7c6a2a718d5c tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:52.835088 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ffa61fc3-f01e-4681-9b17-7c6a2a718d5c tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:52.836666 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2b96df58-3558-466b-bfe3-7c33f69a0b50 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:52.837695 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2b96df58-3558-466b-bfe3-7c33f69a0b50 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:52.841483 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ffa61fc3-f01e-4681-9b17-7c6a2a718d5c tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:52.842251 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2b96df58-3558-466b-bfe3-7c33f69a0b50 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:52.847800 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ffa61fc3-f01e-4681-9b17-7c6a2a718d5c tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:53.700729 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-2b96df58-3558-466b-bfe3-7c33f69a0b50 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:12:53.711843 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-2b96df58-3558-466b-bfe3-7c33f69a0b50 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:12:53.718638 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-2b96df58-3558-466b-bfe3-7c33f69a0b50 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:12:53.721911 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-2b96df58-3558-466b-bfe3-7c33f69a0b50 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1721 microversion: 2.20 time: 0.936786 Jun 17 15:12:53.735931 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 103/205] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:12:52 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1721 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:12:53.752613 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-cf3d6fb1-754c-46bc-bc9e-56a89aa83d2d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:12:53.759840 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-cf3d6fb1-754c-46bc-bc9e-56a89aa83d2d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: 8f90be07-f969-4dc7-b8ab-a5a41f850645] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:12:53.779171 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cf3d6fb1-754c-46bc-bc9e-56a89aa83d2d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:53.780908 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cf3d6fb1-754c-46bc-bc9e-56a89aa83d2d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:53.782810 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cf3d6fb1-754c-46bc-bc9e-56a89aa83d2d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:53.784925 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cf3d6fb1-754c-46bc-bc9e-56a89aa83d2d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:53.856579 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-ffa61fc3-f01e-4681-9b17-7c6a2a718d5c tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd12373903ae4f059464f026f2c18581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de3212eec024eb7b1319357c96f0c01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:12:53.890433 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-ffa61fc3-f01e-4681-9b17-7c6a2a718d5c tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] 10.222.0.48 "GET /compute/v2.1/servers/cbcfcb21-8a77-48d2-b889-85680b966a8e" status: 200 len: 1314 microversion: 2.1 time: 1.079276 Jun 17 15:12:53.897477 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 103/206] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:12:52 2022] GET /compute/v2.1/servers/cbcfcb21-8a77-48d2-b889-85680b966a8e => generated 1314 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:12:54.478738 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-cf3d6fb1-754c-46bc-bc9e-56a89aa83d2d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:12:54.488798 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-cf3d6fb1-754c-46bc-bc9e-56a89aa83d2d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/8f90be07-f969-4dc7-b8ab-a5a41f850645" status: 200 len: 1519 microversion: 2.1 time: 0.751597 Jun 17 15:12:54.489393 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 104/207] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:12:53 2022] GET /compute/v2.1/servers/8f90be07-f969-4dc7-b8ab-a5a41f850645 => generated 1519 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:12:54.710564 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [req-9a62d1b6-3a11-489f-8729-60fba233d38e req-6575ab1f-ec07-4f87-8046-92fd88383e73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbcfcb21-8a77-48d2-b889-85680b966a8e", "tag": "bbd07444-a505-419c-9b36-e04c1807b663"}]} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:12:54.722108 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-9a62d1b6-3a11-489f-8729-60fba233d38e req-6575ab1f-ec07-4f87-8046-92fd88383e73 service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:54.723793 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-9a62d1b6-3a11-489f-8729-60fba233d38e req-6575ab1f-ec07-4f87-8046-92fd88383e73 service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:54.743940 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.compute.server_external_events [req-9a62d1b6-3a11-489f-8729-60fba233d38e req-6575ab1f-ec07-4f87-8046-92fd88383e73 service nova] Creating event network-changed:bbd07444-a505-419c-9b36-e04c1807b663 for instance cbcfcb21-8a77-48d2-b889-85680b966a8e on hv-cinder-82549 Jun 17 15:12:54.750748 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [req-9a62d1b6-3a11-489f-8729-60fba233d38e req-6575ab1f-ec07-4f87-8046-92fd88383e73 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044971 Jun 17 15:12:54.757692 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 104/208] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 15:12:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:12:54.762368 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-a91dba10-2209-4dae-b252-da79d22e5b16 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:12:54.763189 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-a91dba10-2209-4dae-b252-da79d22e5b16 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:12:54.787303 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a91dba10-2209-4dae-b252-da79d22e5b16 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:54.790140 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a91dba10-2209-4dae-b252-da79d22e5b16 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:54.808738 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a91dba10-2209-4dae-b252-da79d22e5b16 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:54.809237 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a91dba10-2209-4dae-b252-da79d22e5b16 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:54.918327 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-76d60eb9-158c-44c3-8a0c-c3f326081059 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:12:54.919034 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-76d60eb9-158c-44c3-8a0c-c3f326081059 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] [instance: cbcfcb21-8a77-48d2-b889-85680b966a8e] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:12:54.938510 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-76d60eb9-158c-44c3-8a0c-c3f326081059 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:54.942704 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-76d60eb9-158c-44c3-8a0c-c3f326081059 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:54.946799 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-76d60eb9-158c-44c3-8a0c-c3f326081059 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:54.947498 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-76d60eb9-158c-44c3-8a0c-c3f326081059 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:55.173004 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-a91dba10-2209-4dae-b252-da79d22e5b16 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:12:55.185436 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-a91dba10-2209-4dae-b252-da79d22e5b16 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:12:55.191817 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-a91dba10-2209-4dae-b252-da79d22e5b16 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:12:55.199094 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-a91dba10-2209-4dae-b252-da79d22e5b16 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1721 microversion: 2.20 time: 0.462038 Jun 17 15:12:55.200617 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 105/209] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:12:54 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1721 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:12:55.216239 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-5ebb492b-7412-42cc-bc90-eaa93da8baae tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Action: 'create', calling method: .version_select at 0x7faf50d4c940>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1719715338", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF6Jv+mtD0ITzklt89OjFpz6fbgOGWXxlrO3PPMIX9rCtOitKphXczSiRSn1JBnYpACx1rTGJ/qqezGI6SzPjVzulOIsGwYzXllPvwOq82WLFHT9Jzmi77Aru8Vuck/wTQ=="}} {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:12:55.264276 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.quota [None req-5ebb492b-7412-42cc-bc90-eaa93da8baae tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Getting quotas for project 77979ae6c7c440fab7bbce5fbe452210. Resources: {'key_pairs'} {{(pid=117650) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 15:12:55.273396 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.quota [None req-5ebb492b-7412-42cc-bc90-eaa93da8baae tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Getting quotas for user 6cd3f00536bf479ab15bb968985ea32a and project 77979ae6c7c440fab7bbce5fbe452210. Resources: {'key_pairs'} {{(pid=117650) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 15:12:55.394119 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-5ebb492b-7412-42cc-bc90-eaa93da8baae tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.192151 Jun 17 15:12:55.395186 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 106/210] 10.222.0.48 () {60 vars in 1158 bytes} [Fri Jun 17 15:12:55 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:12:55.458190 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-76d60eb9-158c-44c3-8a0c-c3f326081059 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd12373903ae4f059464f026f2c18581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de3212eec024eb7b1319357c96f0c01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:12:55.467116 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-76d60eb9-158c-44c3-8a0c-c3f326081059 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] 10.222.0.48 "GET /compute/v2.1/servers/cbcfcb21-8a77-48d2-b889-85680b966a8e" status: 200 len: 1314 microversion: 2.1 time: 0.554301 Jun 17 15:12:55.480663 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 105/211] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:12:54 2022] GET /compute/v2.1/servers/cbcfcb21-8a77-48d2-b889-85680b966a8e => generated 1314 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:12:55.506040 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-001cb460-fe72-4ea8-bacc-65c41dae952d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:12:55.507524 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-001cb460-fe72-4ea8-bacc-65c41dae952d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: 8f90be07-f969-4dc7-b8ab-a5a41f850645] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:12:55.516152 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-001cb460-fe72-4ea8-bacc-65c41dae952d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:55.517093 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-001cb460-fe72-4ea8-bacc-65c41dae952d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:55.518332 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-001cb460-fe72-4ea8-bacc-65c41dae952d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:55.519126 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-001cb460-fe72-4ea8-bacc-65c41dae952d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:55.605504 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-66fff2a0-8960-435c-be16-1671748604f2 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-498630085", "imageRef": "e65cc882-88f9-441e-922f-ebb1c35711b3", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1719715338", "networks": [{"uuid": "032b3b9f-891f-48ee-b230-5cd6f0bd6ccd"}]}} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:12:55.691816 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.network.neutron [None req-66fff2a0-8960-435c-be16-1671748604f2 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] validate_networks() for [('032b3b9f-891f-48ee-b230-5cd6f0bd6ccd', None, None, None, None, None)] {{(pid=117649) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 15:12:56.171840 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-001cb460-fe72-4ea8-bacc-65c41dae952d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:12:56.175727 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:12:56.187133 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-001cb460-fe72-4ea8-bacc-65c41dae952d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/8f90be07-f969-4dc7-b8ab-a5a41f850645" status: 200 len: 1519 microversion: 2.1 time: 0.684936 Jun 17 15:12:56.188003 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 107/212] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:12:55 2022] GET /compute/v2.1/servers/8f90be07-f969-4dc7-b8ab-a5a41f850645 => generated 1519 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:12:56.220827 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-989dc03b-893b-450d-ab50-0f304959cc66 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:12:56.222005 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-989dc03b-893b-450d-ab50-0f304959cc66 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:12:56.238256 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-989dc03b-893b-450d-ab50-0f304959cc66 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:56.240247 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-989dc03b-893b-450d-ab50-0f304959cc66 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:56.243253 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-989dc03b-893b-450d-ab50-0f304959cc66 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:56.243908 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-989dc03b-893b-450d-ab50-0f304959cc66 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:56.541974 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-989dc03b-893b-450d-ab50-0f304959cc66 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:12:56.551159 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-989dc03b-893b-450d-ab50-0f304959cc66 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:12:56.552942 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-989dc03b-893b-450d-ab50-0f304959cc66 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:12:56.554235 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-989dc03b-893b-450d-ab50-0f304959cc66 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1721 microversion: 2.20 time: 0.338394 Jun 17 15:12:56.555011 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 108/213] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:12:56 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1721 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 15:12:56.560964 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-56d6b044-26a3-4e27-8433-b53b41507e41 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:12:56.561833 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-56d6b044-26a3-4e27-8433-b53b41507e41 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] [instance: cbcfcb21-8a77-48d2-b889-85680b966a8e] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:12:56.571398 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-56d6b044-26a3-4e27-8433-b53b41507e41 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:56.572943 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-56d6b044-26a3-4e27-8433-b53b41507e41 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:56.574414 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-56d6b044-26a3-4e27-8433-b53b41507e41 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:56.575170 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-56d6b044-26a3-4e27-8433-b53b41507e41 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:56.671079 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-66fff2a0-8960-435c-be16-1671748604f2 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Flavor limits 0:0:0 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 15:12:56.671691 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-66fff2a0-8960-435c-be16-1671748604f2 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Image limits 0:0:0 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 15:12:56.672043 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-66fff2a0-8960-435c-be16-1671748604f2 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Flavor pref 0:0:0 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 15:12:56.672494 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-66fff2a0-8960-435c-be16-1671748604f2 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Image pref 0:0:0 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 15:12:56.672917 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-66fff2a0-8960-435c-be16-1671748604f2 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 15:12:56.684305 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-66fff2a0-8960-435c-be16-1671748604f2 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:56.685069 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-66fff2a0-8960-435c-be16-1671748604f2 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:56.686579 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-66fff2a0-8960-435c-be16-1671748604f2 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:56.687544 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-66fff2a0-8960-435c-be16-1671748604f2 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:56.711398 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.quota [None req-66fff2a0-8960-435c-be16-1671748604f2 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Getting quotas for project 77979ae6c7c440fab7bbce5fbe452210. Resources: {'cores', 'ram', 'instances'} {{(pid=117649) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 15:12:56.716863 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.quota [None req-66fff2a0-8960-435c-be16-1671748604f2 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Getting quotas for user 6cd3f00536bf479ab15bb968985ea32a and project 77979ae6c7c440fab7bbce5fbe452210. Resources: {'cores', 'ram', 'instances'} {{(pid=117649) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 15:12:56.731391 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-66fff2a0-8960-435c-be16-1671748604f2 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Going to run 1 instances... {{(pid=117649) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 15:12:56.733908 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-66fff2a0-8960-435c-be16-1671748604f2 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e65cc882-88f9-441e-922f-ebb1c35711b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117649) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 15:12:56.794807 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-66fff2a0-8960-435c-be16-1671748604f2 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.194865 Jun 17 15:12:56.795646 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 106/214] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Jun 17 15:12:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1197 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 15:12:56.806667 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-3eca1106-70e8-4c94-9020-7fa756b53f0f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:12:56.811415 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-3eca1106-70e8-4c94-9020-7fa756b53f0f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:12:56.873236 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-56d6b044-26a3-4e27-8433-b53b41507e41 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd12373903ae4f059464f026f2c18581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de3212eec024eb7b1319357c96f0c01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:12:56.891219 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-56d6b044-26a3-4e27-8433-b53b41507e41 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] 10.222.0.48 "GET /compute/v2.1/servers/cbcfcb21-8a77-48d2-b889-85680b966a8e" status: 200 len: 1314 microversion: 2.1 time: 0.334370 Jun 17 15:12:56.901088 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 109/215] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:12:56 2022] GET /compute/v2.1/servers/cbcfcb21-8a77-48d2-b889-85680b966a8e => generated 1314 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:12:56.906563 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-3eca1106-70e8-4c94-9020-7fa756b53f0f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:12:56.914914 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-3eca1106-70e8-4c94-9020-7fa756b53f0f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1258 microversion: 2.1 time: 0.113145 Jun 17 15:12:56.921865 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 107/216] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:12:56 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1258 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:12:57.232284 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-82f06036-8b91-4caf-93cb-67fd2abe5bd7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:12:57.234294 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-82f06036-8b91-4caf-93cb-67fd2abe5bd7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: 8f90be07-f969-4dc7-b8ab-a5a41f850645] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:12:57.258244 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-82f06036-8b91-4caf-93cb-67fd2abe5bd7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:57.266026 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-82f06036-8b91-4caf-93cb-67fd2abe5bd7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:57.267265 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-82f06036-8b91-4caf-93cb-67fd2abe5bd7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:57.269391 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-82f06036-8b91-4caf-93cb-67fd2abe5bd7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:57.586581 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-4ad43e8f-44e8-420d-8e0f-7bc26178ce20 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:12:57.589574 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-4ad43e8f-44e8-420d-8e0f-7bc26178ce20 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:12:57.598647 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4ad43e8f-44e8-420d-8e0f-7bc26178ce20 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:57.599365 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4ad43e8f-44e8-420d-8e0f-7bc26178ce20 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:57.601274 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4ad43e8f-44e8-420d-8e0f-7bc26178ce20 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:57.601888 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4ad43e8f-44e8-420d-8e0f-7bc26178ce20 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:57.662719 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell0:SELECT=2 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:12:57.861449 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-4ad43e8f-44e8-420d-8e0f-7bc26178ce20 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:12:57.873072 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-4ad43e8f-44e8-420d-8e0f-7bc26178ce20 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:12:57.874620 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-4ad43e8f-44e8-420d-8e0f-7bc26178ce20 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:12:57.877712 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-4ad43e8f-44e8-420d-8e0f-7bc26178ce20 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1721 microversion: 2.20 time: 0.306932 Jun 17 15:12:57.881907 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 108/217] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:12:57 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1721 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:12:57.914066 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-2586abe2-8d27-43ab-a29e-f330da7dc4be tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:12:57.914911 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-2586abe2-8d27-43ab-a29e-f330da7dc4be tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] [instance: cbcfcb21-8a77-48d2-b889-85680b966a8e] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:12:57.941858 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2586abe2-8d27-43ab-a29e-f330da7dc4be tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:57.942326 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2586abe2-8d27-43ab-a29e-f330da7dc4be tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:57.945831 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2586abe2-8d27-43ab-a29e-f330da7dc4be tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:57.946914 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2586abe2-8d27-43ab-a29e-f330da7dc4be tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:58.034583 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-82f06036-8b91-4caf-93cb-67fd2abe5bd7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:12:58.047035 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-82f06036-8b91-4caf-93cb-67fd2abe5bd7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/8f90be07-f969-4dc7-b8ab-a5a41f850645" status: 200 len: 1519 microversion: 2.1 time: 0.837200 Jun 17 15:12:58.047877 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 110/218] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:12:57 2022] GET /compute/v2.1/servers/8f90be07-f969-4dc7-b8ab-a5a41f850645 => generated 1519 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:12:58.058687 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-f55c76e0-686a-450c-8dc4-7278e1ccb659 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:12:58.059313 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-f55c76e0-686a-450c-8dc4-7278e1ccb659 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:12:58.089094 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f55c76e0-686a-450c-8dc4-7278e1ccb659 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:58.089368 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f55c76e0-686a-450c-8dc4-7278e1ccb659 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:58.090909 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f55c76e0-686a-450c-8dc4-7278e1ccb659 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:58.091584 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f55c76e0-686a-450c-8dc4-7278e1ccb659 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:58.245445 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-f55c76e0-686a-450c-8dc4-7278e1ccb659 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:12:58.255715 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-f55c76e0-686a-450c-8dc4-7278e1ccb659 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1310 microversion: 2.1 time: 0.206494 Jun 17 15:12:58.260019 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 111/219] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:12:58 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1310 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:12:58.263650 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell1:SELECT=100 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:12:58.625008 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-2586abe2-8d27-43ab-a29e-f330da7dc4be tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd12373903ae4f059464f026f2c18581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de3212eec024eb7b1319357c96f0c01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:12:58.641175 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-2586abe2-8d27-43ab-a29e-f330da7dc4be tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] 10.222.0.48 "GET /compute/v2.1/servers/cbcfcb21-8a77-48d2-b889-85680b966a8e" status: 200 len: 1314 microversion: 2.1 time: 0.731453 Jun 17 15:12:58.642269 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 109/220] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:12:57 2022] GET /compute/v2.1/servers/cbcfcb21-8a77-48d2-b889-85680b966a8e => generated 1314 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:12:58.905324 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-d3460128-995f-4ca2-986a-47af06357707 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:12:58.906050 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-d3460128-995f-4ca2-986a-47af06357707 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:12:58.917067 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d3460128-995f-4ca2-986a-47af06357707 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:58.917523 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d3460128-995f-4ca2-986a-47af06357707 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:58.918322 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d3460128-995f-4ca2-986a-47af06357707 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:58.918761 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d3460128-995f-4ca2-986a-47af06357707 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:59.193764 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-d3460128-995f-4ca2-986a-47af06357707 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:12:59.206378 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-d3460128-995f-4ca2-986a-47af06357707 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:12:59.208390 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-d3460128-995f-4ca2-986a-47af06357707 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:12:59.211262 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-d3460128-995f-4ca2-986a-47af06357707 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1721 microversion: 2.20 time: 0.316111 Jun 17 15:12:59.216090 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 112/221] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:12:58 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1721 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:12:59.236703 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-1fe61e3c-0a5e-4de0-957b-5720ce2f5b90 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:12:59.237505 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-1fe61e3c-0a5e-4de0-957b-5720ce2f5b90 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: 8f90be07-f969-4dc7-b8ab-a5a41f850645] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:12:59.257230 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1fe61e3c-0a5e-4de0-957b-5720ce2f5b90 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:59.258143 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1fe61e3c-0a5e-4de0-957b-5720ce2f5b90 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:59.259004 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1fe61e3c-0a5e-4de0-957b-5720ce2f5b90 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:59.259509 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1fe61e3c-0a5e-4de0-957b-5720ce2f5b90 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:59.370277 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-79b25b6f-5101-4eb3-a8cc-3379600a5694 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Action: 'create', calling method: .version_select at 0x7faf5061cee0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1574553842", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKaHtKoMZ19HuLik4jCC8aPTUqGENjBb9xSWzU9hvNSdoQf4iuf0XNdJvoO/rGPrW98DyPnhhJKGzOJNOhqrEvCqSTzMQA3JiXRR9/3SRDuu23CViyeUR4lq16vFo0Lk5Q=="}} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:12:59.402919 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.quota [None req-79b25b6f-5101-4eb3-a8cc-3379600a5694 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Getting quotas for project 8e2a6034ec6b445cbe590f51bf4e419f. Resources: {'key_pairs'} {{(pid=117649) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 15:12:59.433341 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.quota [None req-79b25b6f-5101-4eb3-a8cc-3379600a5694 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Getting quotas for user 717db70ce2734d169aee71912f18ba8a and project 8e2a6034ec6b445cbe590f51bf4e419f. Resources: {'key_pairs'} {{(pid=117649) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 15:12:59.494611 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-79b25b6f-5101-4eb3-a8cc-3379600a5694 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.443144 Jun 17 15:12:59.500317 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 110/222] 10.222.0.48 () {60 vars in 1158 bytes} [Fri Jun 17 15:12:59 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:12:59.509069 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-3c89d95c-5890-4434-af8b-f20fd58c115d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:12:59.509696 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-3c89d95c-5890-4434-af8b-f20fd58c115d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:12:59.524036 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3c89d95c-5890-4434-af8b-f20fd58c115d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:59.524575 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3c89d95c-5890-4434-af8b-f20fd58c115d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:59.525594 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3c89d95c-5890-4434-af8b-f20fd58c115d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:59.526257 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3c89d95c-5890-4434-af8b-f20fd58c115d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:59.526380 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-1fe61e3c-0a5e-4de0-957b-5720ce2f5b90 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:12:59.549323 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-1fe61e3c-0a5e-4de0-957b-5720ce2f5b90 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/8f90be07-f969-4dc7-b8ab-a5a41f850645" status: 200 len: 1519 microversion: 2.1 time: 0.320739 Jun 17 15:12:59.550054 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 113/223] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:12:59 2022] GET /compute/v2.1/servers/8f90be07-f969-4dc7-b8ab-a5a41f850645 => generated 1519 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:12:59.659482 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-0ee6663e-978b-40a4-84a1-7b1c3d6c85cb tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:12:59.660098 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-0ee6663e-978b-40a4-84a1-7b1c3d6c85cb tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] [instance: cbcfcb21-8a77-48d2-b889-85680b966a8e] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:12:59.674226 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0ee6663e-978b-40a4-84a1-7b1c3d6c85cb tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:59.678942 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0ee6663e-978b-40a4-84a1-7b1c3d6c85cb tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:59.680009 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0ee6663e-978b-40a4-84a1-7b1c3d6c85cb tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:12:59.687340 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0ee6663e-978b-40a4-84a1-7b1c3d6c85cb tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:12:59.720656 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-3c89d95c-5890-4434-af8b-f20fd58c115d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:12:59.731022 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-3c89d95c-5890-4434-af8b-f20fd58c115d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1316 microversion: 2.1 time: 0.229504 Jun 17 15:12:59.736075 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 111/224] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:12:59 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1316 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:13:00.049995 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-0ee6663e-978b-40a4-84a1-7b1c3d6c85cb tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd12373903ae4f059464f026f2c18581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de3212eec024eb7b1319357c96f0c01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:00.064217 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-0ee6663e-978b-40a4-84a1-7b1c3d6c85cb tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] 10.222.0.48 "GET /compute/v2.1/servers/cbcfcb21-8a77-48d2-b889-85680b966a8e" status: 200 len: 1314 microversion: 2.1 time: 0.408659 Jun 17 15:13:00.067284 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 114/225] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:12:59 2022] GET /compute/v2.1/servers/cbcfcb21-8a77-48d2-b889-85680b966a8e => generated 1314 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:13:00.235269 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-787710d9-b419-41cd-ba19-6f3559246e17 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:00.236450 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-787710d9-b419-41cd-ba19-6f3559246e17 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:00.247420 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-787710d9-b419-41cd-ba19-6f3559246e17 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:00.249997 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-787710d9-b419-41cd-ba19-6f3559246e17 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:00.251074 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-787710d9-b419-41cd-ba19-6f3559246e17 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:00.251748 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-787710d9-b419-41cd-ba19-6f3559246e17 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:00.570118 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-01caa0cd-80fd-4f57-8360-f622b17b3da3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:00.570908 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-01caa0cd-80fd-4f57-8360-f622b17b3da3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: 8f90be07-f969-4dc7-b8ab-a5a41f850645] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:00.583847 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-01caa0cd-80fd-4f57-8360-f622b17b3da3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:00.587517 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-01caa0cd-80fd-4f57-8360-f622b17b3da3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:00.590506 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-01caa0cd-80fd-4f57-8360-f622b17b3da3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:00.591493 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-01caa0cd-80fd-4f57-8360-f622b17b3da3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:00.831655 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-787710d9-b419-41cd-ba19-6f3559246e17 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:00.844836 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-787710d9-b419-41cd-ba19-6f3559246e17 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:00.846810 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-787710d9-b419-41cd-ba19-6f3559246e17 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:00.848194 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-787710d9-b419-41cd-ba19-6f3559246e17 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1721 microversion: 2.20 time: 0.618077 Jun 17 15:13:00.875353 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 112/226] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:13:00 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1721 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:13:00.887446 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-25187d85-9b23-427d-9771-eb4aebf1b671 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:00.890281 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-25187d85-9b23-427d-9771-eb4aebf1b671 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:00.906723 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-25187d85-9b23-427d-9771-eb4aebf1b671 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:00.910093 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-25187d85-9b23-427d-9771-eb4aebf1b671 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:00.914246 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-25187d85-9b23-427d-9771-eb4aebf1b671 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:00.915626 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-25187d85-9b23-427d-9771-eb4aebf1b671 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:01.143834 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-01caa0cd-80fd-4f57-8360-f622b17b3da3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:01.164668 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-01caa0cd-80fd-4f57-8360-f622b17b3da3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/8f90be07-f969-4dc7-b8ab-a5a41f850645" status: 200 len: 1519 microversion: 2.1 time: 0.600640 Jun 17 15:13:01.191400 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 115/227] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:13:00 2022] GET /compute/v2.1/servers/8f90be07-f969-4dc7-b8ab-a5a41f850645 => generated 1519 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:13:01.210104 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-c0bb2da8-544c-48e1-a703-f9b2ec224bbe tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:01.211837 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-c0bb2da8-544c-48e1-a703-f9b2ec224bbe tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] [instance: cbcfcb21-8a77-48d2-b889-85680b966a8e] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:01.240568 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c0bb2da8-544c-48e1-a703-f9b2ec224bbe tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:01.245480 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c0bb2da8-544c-48e1-a703-f9b2ec224bbe tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:01.248020 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c0bb2da8-544c-48e1-a703-f9b2ec224bbe tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:01.253237 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c0bb2da8-544c-48e1-a703-f9b2ec224bbe tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:01.598547 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-25187d85-9b23-427d-9771-eb4aebf1b671 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:01.617039 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-25187d85-9b23-427d-9771-eb4aebf1b671 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1358 microversion: 2.1 time: 0.738702 Jun 17 15:13:01.617659 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 113/228] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:13:00 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1358 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:13:01.785255 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-c0bb2da8-544c-48e1-a703-f9b2ec224bbe tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd12373903ae4f059464f026f2c18581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de3212eec024eb7b1319357c96f0c01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:01.805739 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-c0bb2da8-544c-48e1-a703-f9b2ec224bbe tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] 10.222.0.48 "GET /compute/v2.1/servers/cbcfcb21-8a77-48d2-b889-85680b966a8e" status: 200 len: 1314 microversion: 2.1 time: 0.612732 Jun 17 15:13:01.806338 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 116/229] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:13:01 2022] GET /compute/v2.1/servers/cbcfcb21-8a77-48d2-b889-85680b966a8e => generated 1314 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:13:01.869167 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-fb04d82d-fc75-4d75-b113-3271443b508e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:01.870686 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-fb04d82d-fc75-4d75-b113-3271443b508e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:01.884775 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fb04d82d-fc75-4d75-b113-3271443b508e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:01.885603 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fb04d82d-fc75-4d75-b113-3271443b508e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:01.886670 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fb04d82d-fc75-4d75-b113-3271443b508e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:01.887337 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fb04d82d-fc75-4d75-b113-3271443b508e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:02.212558 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-f63ead4a-094a-4ab8-bf7c-3e7d15fa0508 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:02.212558 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-f63ead4a-094a-4ab8-bf7c-3e7d15fa0508 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: 8f90be07-f969-4dc7-b8ab-a5a41f850645] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:02.236211 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f63ead4a-094a-4ab8-bf7c-3e7d15fa0508 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:02.239196 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f63ead4a-094a-4ab8-bf7c-3e7d15fa0508 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:02.244533 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f63ead4a-094a-4ab8-bf7c-3e7d15fa0508 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:02.245323 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f63ead4a-094a-4ab8-bf7c-3e7d15fa0508 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:02.283843 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-fb04d82d-fc75-4d75-b113-3271443b508e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:02.296701 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-fb04d82d-fc75-4d75-b113-3271443b508e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:02.301197 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-fb04d82d-fc75-4d75-b113-3271443b508e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:02.304878 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-fb04d82d-fc75-4d75-b113-3271443b508e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1742 microversion: 2.20 time: 0.438898 Jun 17 15:13:02.317062 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 114/230] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:13:01 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1742 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:13:02.576287 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [req-ea2b98fc-079e-4229-9855-972c1490c3c0 req-7a335119-c95a-4479-949f-5aecfc652e34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbcfcb21-8a77-48d2-b889-85680b966a8e", "name": "network-vif-plugged", "status": "completed", "tag": "bbd07444-a505-419c-9b36-e04c1807b663"}]} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:13:02.590212 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-ea2b98fc-079e-4229-9855-972c1490c3c0 req-7a335119-c95a-4479-949f-5aecfc652e34 service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:02.590676 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-ea2b98fc-079e-4229-9855-972c1490c3c0 req-7a335119-c95a-4479-949f-5aecfc652e34 service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:02.665722 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.compute.server_external_events [req-ea2b98fc-079e-4229-9855-972c1490c3c0 req-7a335119-c95a-4479-949f-5aecfc652e34 service nova] Creating event network-vif-plugged:bbd07444-a505-419c-9b36-e04c1807b663 for instance cbcfcb21-8a77-48d2-b889-85680b966a8e on hv-cinder-82549 Jun 17 15:13:02.706818 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [req-ea2b98fc-079e-4229-9855-972c1490c3c0 req-7a335119-c95a-4479-949f-5aecfc652e34 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128143 Jun 17 15:13:02.708438 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 115/231] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 15:13:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:13:02.729915 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-4257ae79-2274-4fb8-ac80-898fc892f34b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:02.733714 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-4257ae79-2274-4fb8-ac80-898fc892f34b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:02.760458 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4257ae79-2274-4fb8-ac80-898fc892f34b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:02.764447 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4257ae79-2274-4fb8-ac80-898fc892f34b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:02.768747 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4257ae79-2274-4fb8-ac80-898fc892f34b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:02.769572 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4257ae79-2274-4fb8-ac80-898fc892f34b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:02.773242 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-f63ead4a-094a-4ab8-bf7c-3e7d15fa0508 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:02.793816 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-f63ead4a-094a-4ab8-bf7c-3e7d15fa0508 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/8f90be07-f969-4dc7-b8ab-a5a41f850645" status: 200 len: 1519 microversion: 2.1 time: 0.592259 Jun 17 15:13:02.807233 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 117/232] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:13:02 2022] GET /compute/v2.1/servers/8f90be07-f969-4dc7-b8ab-a5a41f850645 => generated 1519 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:13:02.842880 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-7406b21f-7e7f-4386-9b77-efbff69ecef1 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:02.848186 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-7406b21f-7e7f-4386-9b77-efbff69ecef1 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] [instance: cbcfcb21-8a77-48d2-b889-85680b966a8e] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:02.860253 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7406b21f-7e7f-4386-9b77-efbff69ecef1 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:02.865253 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7406b21f-7e7f-4386-9b77-efbff69ecef1 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:02.866742 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7406b21f-7e7f-4386-9b77-efbff69ecef1 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:02.879068 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7406b21f-7e7f-4386-9b77-efbff69ecef1 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:03.668181 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-7406b21f-7e7f-4386-9b77-efbff69ecef1 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd12373903ae4f059464f026f2c18581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de3212eec024eb7b1319357c96f0c01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:03.686776 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-7406b21f-7e7f-4386-9b77-efbff69ecef1 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] 10.222.0.48 "GET /compute/v2.1/servers/cbcfcb21-8a77-48d2-b889-85680b966a8e" status: 200 len: 1314 microversion: 2.1 time: 0.862515 Jun 17 15:13:03.694378 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 118/233] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:13:02 2022] GET /compute/v2.1/servers/cbcfcb21-8a77-48d2-b889-85680b966a8e => generated 1314 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:13:03.702568 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-8c0c9a4a-89cc-4565-bdf0-7fa3b408ab23 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:03.703733 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-8c0c9a4a-89cc-4565-bdf0-7fa3b408ab23 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:03.741381 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8c0c9a4a-89cc-4565-bdf0-7fa3b408ab23 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:03.743576 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8c0c9a4a-89cc-4565-bdf0-7fa3b408ab23 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:03.748518 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8c0c9a4a-89cc-4565-bdf0-7fa3b408ab23 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:03.749375 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8c0c9a4a-89cc-4565-bdf0-7fa3b408ab23 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:03.846181 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-4257ae79-2274-4fb8-ac80-898fc892f34b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:03.855569 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-4257ae79-2274-4fb8-ac80-898fc892f34b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1358 microversion: 2.1 time: 1.145417 Jun 17 15:13:03.856220 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 116/234] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:13:02 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1358 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:13:03.900171 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-68ae12fb-a6cc-4bf2-a991-9dc14b757577 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:03.903070 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-68ae12fb-a6cc-4bf2-a991-9dc14b757577 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: 8f90be07-f969-4dc7-b8ab-a5a41f850645] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:03.921117 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-68ae12fb-a6cc-4bf2-a991-9dc14b757577 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:03.921591 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-68ae12fb-a6cc-4bf2-a991-9dc14b757577 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:03.922470 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-68ae12fb-a6cc-4bf2-a991-9dc14b757577 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:03.922946 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-68ae12fb-a6cc-4bf2-a991-9dc14b757577 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:04.175184 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-8c0c9a4a-89cc-4565-bdf0-7fa3b408ab23 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:04.187980 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-8c0c9a4a-89cc-4565-bdf0-7fa3b408ab23 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:04.190772 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-8c0c9a4a-89cc-4565-bdf0-7fa3b408ab23 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:04.192216 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-8c0c9a4a-89cc-4565-bdf0-7fa3b408ab23 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1742 microversion: 2.20 time: 0.494032 Jun 17 15:13:04.193069 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 119/235] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:13:03 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1742 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:13:04.727236 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-952306db-ab81-4ffb-b030-54f0d5cb8162 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:04.729303 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-952306db-ab81-4ffb-b030-54f0d5cb8162 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] [instance: cbcfcb21-8a77-48d2-b889-85680b966a8e] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:04.751210 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-952306db-ab81-4ffb-b030-54f0d5cb8162 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:04.751987 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-952306db-ab81-4ffb-b030-54f0d5cb8162 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:04.759670 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-952306db-ab81-4ffb-b030-54f0d5cb8162 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:04.759670 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-952306db-ab81-4ffb-b030-54f0d5cb8162 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:04.800695 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-68ae12fb-a6cc-4bf2-a991-9dc14b757577 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:04.812470 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-68ae12fb-a6cc-4bf2-a991-9dc14b757577 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/8f90be07-f969-4dc7-b8ab-a5a41f850645" status: 200 len: 1519 microversion: 2.1 time: 0.928683 Jun 17 15:13:04.819886 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 117/236] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:13:03 2022] GET /compute/v2.1/servers/8f90be07-f969-4dc7-b8ab-a5a41f850645 => generated 1519 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:13:04.873690 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-dc430f32-aacd-45e9-9683-3b5fc6802b91 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:04.874462 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-dc430f32-aacd-45e9-9683-3b5fc6802b91 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:04.915707 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-dc430f32-aacd-45e9-9683-3b5fc6802b91 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:04.918079 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-dc430f32-aacd-45e9-9683-3b5fc6802b91 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:04.922442 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-dc430f32-aacd-45e9-9683-3b5fc6802b91 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:04.927429 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-dc430f32-aacd-45e9-9683-3b5fc6802b91 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:05.293646 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell0:SELECT=12 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:13:05.489886 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-952306db-ab81-4ffb-b030-54f0d5cb8162 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd12373903ae4f059464f026f2c18581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de3212eec024eb7b1319357c96f0c01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:05.502017 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-952306db-ab81-4ffb-b030-54f0d5cb8162 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] 10.222.0.48 "GET /compute/v2.1/servers/cbcfcb21-8a77-48d2-b889-85680b966a8e" status: 200 len: 1314 microversion: 2.1 time: 0.783529 Jun 17 15:13:05.504227 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 120/237] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:13:04 2022] GET /compute/v2.1/servers/cbcfcb21-8a77-48d2-b889-85680b966a8e => generated 1314 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:13:05.511258 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [req-8dd75ec4-c196-4599-9da7-b806681b77ae req-a00ea5c2-3098-46a3-bba2-82d6238273b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91408900-da01-4985-b392-111577935284", "tag": "06c1246f-1c4b-48df-98b1-2028fa5b27e5"}]} {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:13:05.525357 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [req-8dd75ec4-c196-4599-9da7-b806681b77ae req-a00ea5c2-3098-46a3-bba2-82d6238273b0 service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:05.526292 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [req-8dd75ec4-c196-4599-9da7-b806681b77ae req-a00ea5c2-3098-46a3-bba2-82d6238273b0 service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:05.542616 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.compute.server_external_events [req-8dd75ec4-c196-4599-9da7-b806681b77ae req-a00ea5c2-3098-46a3-bba2-82d6238273b0 service nova] Creating event network-changed:06c1246f-1c4b-48df-98b1-2028fa5b27e5 for instance 91408900-da01-4985-b392-111577935284 on hv-cinder-82549 Jun 17 15:13:05.550811 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [req-8dd75ec4-c196-4599-9da7-b806681b77ae req-a00ea5c2-3098-46a3-bba2-82d6238273b0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044506 Jun 17 15:13:05.552086 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 121/238] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 15:13:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:13:05.560256 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-7c34062b-4fab-4d2e-a09c-206fd54f5b05 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:05.561083 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-7c34062b-4fab-4d2e-a09c-206fd54f5b05 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:05.569908 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7c34062b-4fab-4d2e-a09c-206fd54f5b05 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:05.570695 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7c34062b-4fab-4d2e-a09c-206fd54f5b05 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:05.571722 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7c34062b-4fab-4d2e-a09c-206fd54f5b05 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:05.572574 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7c34062b-4fab-4d2e-a09c-206fd54f5b05 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:05.637576 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-dc430f32-aacd-45e9-9683-3b5fc6802b91 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:05.686729 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-dc430f32-aacd-45e9-9683-3b5fc6802b91 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1358 microversion: 2.1 time: 0.816594 Jun 17 15:13:05.691715 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 118/239] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:13:04 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1358 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:13:05.839536 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-68344e56-4d05-448d-a404-237bee72bc8f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:05.841479 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-68344e56-4d05-448d-a404-237bee72bc8f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: 8f90be07-f969-4dc7-b8ab-a5a41f850645] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:05.879268 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-68344e56-4d05-448d-a404-237bee72bc8f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:05.886024 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-68344e56-4d05-448d-a404-237bee72bc8f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:05.890717 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-68344e56-4d05-448d-a404-237bee72bc8f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:05.891916 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-68344e56-4d05-448d-a404-237bee72bc8f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:06.119222 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-7c34062b-4fab-4d2e-a09c-206fd54f5b05 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:06.145699 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-7c34062b-4fab-4d2e-a09c-206fd54f5b05 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:06.154738 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-7c34062b-4fab-4d2e-a09c-206fd54f5b05 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:06.158615 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-7c34062b-4fab-4d2e-a09c-206fd54f5b05 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1742 microversion: 2.20 time: 0.604906 Jun 17 15:13:06.166717 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 122/240] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:13:05 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1742 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:13:06.302333 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-68344e56-4d05-448d-a404-237bee72bc8f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:06.320065 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-68344e56-4d05-448d-a404-237bee72bc8f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/8f90be07-f969-4dc7-b8ab-a5a41f850645" status: 200 len: 1519 microversion: 2.1 time: 0.487539 Jun 17 15:13:06.330426 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 119/241] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:13:05 2022] GET /compute/v2.1/servers/8f90be07-f969-4dc7-b8ab-a5a41f850645 => generated 1519 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:13:06.519416 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-7232bd6a-496b-4f35-82da-726c86958cd9 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:06.520470 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-7232bd6a-496b-4f35-82da-726c86958cd9 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] [instance: cbcfcb21-8a77-48d2-b889-85680b966a8e] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:06.558493 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7232bd6a-496b-4f35-82da-726c86958cd9 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:06.573028 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7232bd6a-496b-4f35-82da-726c86958cd9 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:06.573915 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7232bd6a-496b-4f35-82da-726c86958cd9 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:06.585840 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7232bd6a-496b-4f35-82da-726c86958cd9 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:06.714577 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-c0f72eba-03bc-4612-ad44-ec0c00a19f34 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:06.717394 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-c0f72eba-03bc-4612-ad44-ec0c00a19f34 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:06.749965 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell0:SELECT=2 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:13:06.782251 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c0f72eba-03bc-4612-ad44-ec0c00a19f34 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:06.784918 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c0f72eba-03bc-4612-ad44-ec0c00a19f34 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:06.787909 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c0f72eba-03bc-4612-ad44-ec0c00a19f34 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:06.788846 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c0f72eba-03bc-4612-ad44-ec0c00a19f34 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:07.138884 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-7232bd6a-496b-4f35-82da-726c86958cd9 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd12373903ae4f059464f026f2c18581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de3212eec024eb7b1319357c96f0c01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:07.167633 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-7232bd6a-496b-4f35-82da-726c86958cd9 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] 10.222.0.48 "GET /compute/v2.1/servers/cbcfcb21-8a77-48d2-b889-85680b966a8e" status: 200 len: 1497 microversion: 2.1 time: 0.651751 Jun 17 15:13:07.173752 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 123/242] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:13:06 2022] GET /compute/v2.1/servers/cbcfcb21-8a77-48d2-b889-85680b966a8e => generated 1497 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:13:07.192868 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-dd1d43b8-2e37-4f9d-87fb-59de67adda6b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:07.207932 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-dd1d43b8-2e37-4f9d-87fb-59de67adda6b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:07.251404 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-dd1d43b8-2e37-4f9d-87fb-59de67adda6b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:07.254838 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-dd1d43b8-2e37-4f9d-87fb-59de67adda6b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:07.261075 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-dd1d43b8-2e37-4f9d-87fb-59de67adda6b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:07.267402 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-dd1d43b8-2e37-4f9d-87fb-59de67adda6b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:07.282086 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-c0f72eba-03bc-4612-ad44-ec0c00a19f34 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:07.314770 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-c0f72eba-03bc-4612-ad44-ec0c00a19f34 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1358 microversion: 2.1 time: 0.612992 Jun 17 15:13:07.320769 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 120/243] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:13:06 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1358 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:13:07.348467 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-54e9c967-451b-4021-9b07-6321abf1035e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:07.348985 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-54e9c967-451b-4021-9b07-6321abf1035e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: 8f90be07-f969-4dc7-b8ab-a5a41f850645] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:07.371341 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-54e9c967-451b-4021-9b07-6321abf1035e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:07.371797 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-54e9c967-451b-4021-9b07-6321abf1035e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:07.382177 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-54e9c967-451b-4021-9b07-6321abf1035e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:07.383000 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-54e9c967-451b-4021-9b07-6321abf1035e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:07.700054 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-54e9c967-451b-4021-9b07-6321abf1035e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:07.720517 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-54e9c967-451b-4021-9b07-6321abf1035e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/8f90be07-f969-4dc7-b8ab-a5a41f850645" status: 200 len: 1519 microversion: 2.1 time: 0.376884 Jun 17 15:13:07.723602 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 121/244] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:13:07 2022] GET /compute/v2.1/servers/8f90be07-f969-4dc7-b8ab-a5a41f850645 => generated 1519 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:13:08.071627 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-dd1d43b8-2e37-4f9d-87fb-59de67adda6b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:08.085083 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-dd1d43b8-2e37-4f9d-87fb-59de67adda6b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:08.088116 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-dd1d43b8-2e37-4f9d-87fb-59de67adda6b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:08.089513 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-dd1d43b8-2e37-4f9d-87fb-59de67adda6b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1737 microversion: 2.20 time: 0.908818 Jun 17 15:13:08.091036 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 124/245] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:13:07 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1737 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 15:13:08.334277 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [req-d7f736b9-41ec-44f1-bab4-25a5d7c196e9 req-fa95b70e-e5a2-4559-a44c-a7e5540bb1fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e97df352-5cee-41f7-ae51-f55cd9e85869", "name": "network-vif-plugged", "status": "completed", "tag": "ff5c90be-6727-43d1-841f-760f94168fc6"}]} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:13:08.337691 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-8622c879-af67-48c2-9c36-b389e2d6b2b4 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:08.338502 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-8622c879-af67-48c2-9c36-b389e2d6b2b4 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:08.345592 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-d7f736b9-41ec-44f1-bab4-25a5d7c196e9 req-fa95b70e-e5a2-4559-a44c-a7e5540bb1fb service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:08.346038 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-d7f736b9-41ec-44f1-bab4-25a5d7c196e9 req-fa95b70e-e5a2-4559-a44c-a7e5540bb1fb service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:08.347937 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8622c879-af67-48c2-9c36-b389e2d6b2b4 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:08.354109 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8622c879-af67-48c2-9c36-b389e2d6b2b4 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:08.357026 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8622c879-af67-48c2-9c36-b389e2d6b2b4 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:08.359059 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8622c879-af67-48c2-9c36-b389e2d6b2b4 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:08.360849 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.compute.server_external_events [req-d7f736b9-41ec-44f1-bab4-25a5d7c196e9 req-fa95b70e-e5a2-4559-a44c-a7e5540bb1fb service nova] Creating event network-vif-plugged:ff5c90be-6727-43d1-841f-760f94168fc6 for instance e97df352-5cee-41f7-ae51-f55cd9e85869 on hv-cinder-82549 Jun 17 15:13:08.370898 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [req-d7f736b9-41ec-44f1-bab4-25a5d7c196e9 req-fa95b70e-e5a2-4559-a44c-a7e5540bb1fb service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043234 Jun 17 15:13:08.371673 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=100 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:13:08.372146 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 122/246] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 15:13:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:13:08.647870 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-c5a99b68-27c3-45d1-ba0c-26e60564def7 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:08.648948 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-c5a99b68-27c3-45d1-ba0c-26e60564def7 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] [instance: cbcfcb21-8a77-48d2-b889-85680b966a8e] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:08.651536 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:13:08.656970 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-8622c879-af67-48c2-9c36-b389e2d6b2b4 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:08.670425 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c5a99b68-27c3-45d1-ba0c-26e60564def7 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:08.670901 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c5a99b68-27c3-45d1-ba0c-26e60564def7 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:08.671749 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c5a99b68-27c3-45d1-ba0c-26e60564def7 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:08.672233 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c5a99b68-27c3-45d1-ba0c-26e60564def7 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:08.677419 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-8622c879-af67-48c2-9c36-b389e2d6b2b4 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1358 microversion: 2.1 time: 0.345588 Jun 17 15:13:08.678878 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 125/247] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:13:08 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1358 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:13:08.704066 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-c5a99b68-27c3-45d1-ba0c-26e60564def7 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] [instance: cbcfcb21-8a77-48d2-b889-85680b966a8e] Going to try to terminate instance {{(pid=117649) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 15:13:08.745032 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-2dc02ff3-07fd-4c83-a5fb-a8bbd7743ca9 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:08.745893 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-2dc02ff3-07fd-4c83-a5fb-a8bbd7743ca9 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: 8f90be07-f969-4dc7-b8ab-a5a41f850645] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:08.758399 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2dc02ff3-07fd-4c83-a5fb-a8bbd7743ca9 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:08.759135 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2dc02ff3-07fd-4c83-a5fb-a8bbd7743ca9 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:08.760543 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2dc02ff3-07fd-4c83-a5fb-a8bbd7743ca9 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:08.761286 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2dc02ff3-07fd-4c83-a5fb-a8bbd7743ca9 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:08.838805 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-c5a99b68-27c3-45d1-ba0c-26e60564def7 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] 10.222.0.48 "DELETE /compute/v2.1/servers/cbcfcb21-8a77-48d2-b889-85680b966a8e" status: 204 len: 0 microversion: 2.1 time: 0.196869 Jun 17 15:13:08.844438 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 123/248] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jun 17 15:13:08 2022] DELETE /compute/v2.1/servers/cbcfcb21-8a77-48d2-b889-85680b966a8e => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 15:13:08.860381 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-2cf05b67-5971-455d-bccd-0c97f353d894 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:08.861396 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-2cf05b67-5971-455d-bccd-0c97f353d894 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] [instance: cbcfcb21-8a77-48d2-b889-85680b966a8e] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:08.869623 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2cf05b67-5971-455d-bccd-0c97f353d894 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:08.870244 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2cf05b67-5971-455d-bccd-0c97f353d894 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:08.871380 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2cf05b67-5971-455d-bccd-0c97f353d894 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:08.872184 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2cf05b67-5971-455d-bccd-0c97f353d894 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:08.960206 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-2dc02ff3-07fd-4c83-a5fb-a8bbd7743ca9 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:08.970775 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-2dc02ff3-07fd-4c83-a5fb-a8bbd7743ca9 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/8f90be07-f969-4dc7-b8ab-a5a41f850645" status: 200 len: 1519 microversion: 2.1 time: 0.232641 Jun 17 15:13:08.971863 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 126/249] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:13:08 2022] GET /compute/v2.1/servers/8f90be07-f969-4dc7-b8ab-a5a41f850645 => generated 1519 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:13:09.130885 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-2e36535d-bb90-4ec5-9a16-d7b8a5a96c5a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:09.132053 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-2e36535d-bb90-4ec5-9a16-d7b8a5a96c5a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:09.134087 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:13:09.147894 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2e36535d-bb90-4ec5-9a16-d7b8a5a96c5a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:09.148423 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2e36535d-bb90-4ec5-9a16-d7b8a5a96c5a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:09.149585 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2e36535d-bb90-4ec5-9a16-d7b8a5a96c5a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:09.166105 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2e36535d-bb90-4ec5-9a16-d7b8a5a96c5a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:09.256712 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-2cf05b67-5971-455d-bccd-0c97f353d894 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd12373903ae4f059464f026f2c18581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de3212eec024eb7b1319357c96f0c01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:09.274448 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-2cf05b67-5971-455d-bccd-0c97f353d894 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] 10.222.0.48 "GET /compute/v2.1/servers/cbcfcb21-8a77-48d2-b889-85680b966a8e" status: 200 len: 1503 microversion: 2.1 time: 0.420314 Jun 17 15:13:09.276173 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 124/250] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:13:08 2022] GET /compute/v2.1/servers/cbcfcb21-8a77-48d2-b889-85680b966a8e => generated 1503 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:13:09.535470 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-2e36535d-bb90-4ec5-9a16-d7b8a5a96c5a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:09.546156 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-2e36535d-bb90-4ec5-9a16-d7b8a5a96c5a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:09.548436 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-2e36535d-bb90-4ec5-9a16-d7b8a5a96c5a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:09.550492 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-2e36535d-bb90-4ec5-9a16-d7b8a5a96c5a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1737 microversion: 2.20 time: 0.426071 Jun 17 15:13:09.551724 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 127/251] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:13:09 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1737 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 15:13:09.701788 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-f1855061-5315-4b79-98c3-2e04ac946c7b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:09.702644 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-f1855061-5315-4b79-98c3-2e04ac946c7b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:09.705344 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell0:SELECT=12 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:13:09.726619 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f1855061-5315-4b79-98c3-2e04ac946c7b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:09.730560 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f1855061-5315-4b79-98c3-2e04ac946c7b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:09.731935 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f1855061-5315-4b79-98c3-2e04ac946c7b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:09.732763 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f1855061-5315-4b79-98c3-2e04ac946c7b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:09.994334 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-22fbd424-8620-4d22-904e-c0e9339e9397 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:09.995524 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-22fbd424-8620-4d22-904e-c0e9339e9397 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: 8f90be07-f969-4dc7-b8ab-a5a41f850645] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:10.015749 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-22fbd424-8620-4d22-904e-c0e9339e9397 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:10.016923 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-22fbd424-8620-4d22-904e-c0e9339e9397 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:10.018269 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-22fbd424-8620-4d22-904e-c0e9339e9397 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:10.019013 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-22fbd424-8620-4d22-904e-c0e9339e9397 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:10.061241 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-f1855061-5315-4b79-98c3-2e04ac946c7b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:10.078869 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-f1855061-5315-4b79-98c3-2e04ac946c7b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1358 microversion: 2.1 time: 0.385718 Jun 17 15:13:10.104669 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 125/252] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:13:09 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1358 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:13:10.313589 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-4395fc9f-e285-459f-87a4-1d7611a41d00 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:10.315606 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-4395fc9f-e285-459f-87a4-1d7611a41d00 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] [instance: cbcfcb21-8a77-48d2-b889-85680b966a8e] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:10.341804 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4395fc9f-e285-459f-87a4-1d7611a41d00 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:10.342568 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4395fc9f-e285-459f-87a4-1d7611a41d00 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:10.344510 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4395fc9f-e285-459f-87a4-1d7611a41d00 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:10.345293 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4395fc9f-e285-459f-87a4-1d7611a41d00 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:10.351457 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-22fbd424-8620-4d22-904e-c0e9339e9397 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:10.431871 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-22fbd424-8620-4d22-904e-c0e9339e9397 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/8f90be07-f969-4dc7-b8ab-a5a41f850645" status: 200 len: 1519 microversion: 2.1 time: 0.445026 Jun 17 15:13:10.456066 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 128/253] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:13:09 2022] GET /compute/v2.1/servers/8f90be07-f969-4dc7-b8ab-a5a41f850645 => generated 1519 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:13:10.575149 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-cb27061c-849a-4eff-b344-cf95239b5082 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:10.584898 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-cb27061c-849a-4eff-b344-cf95239b5082 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:10.617946 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cb27061c-849a-4eff-b344-cf95239b5082 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:10.618754 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cb27061c-849a-4eff-b344-cf95239b5082 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:10.620143 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cb27061c-849a-4eff-b344-cf95239b5082 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:10.620955 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cb27061c-849a-4eff-b344-cf95239b5082 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:10.947119 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-4395fc9f-e285-459f-87a4-1d7611a41d00 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd12373903ae4f059464f026f2c18581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de3212eec024eb7b1319357c96f0c01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:10.989367 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:13:11.014728 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-4395fc9f-e285-459f-87a4-1d7611a41d00 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] 10.222.0.48 "GET /compute/v2.1/servers/cbcfcb21-8a77-48d2-b889-85680b966a8e" status: 200 len: 1503 microversion: 2.1 time: 0.711286 Jun 17 15:13:11.019400 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 126/254] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:13:10 2022] GET /compute/v2.1/servers/cbcfcb21-8a77-48d2-b889-85680b966a8e => generated 1503 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:13:11.056102 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-cb27061c-849a-4eff-b344-cf95239b5082 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:11.080747 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-cb27061c-849a-4eff-b344-cf95239b5082 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:11.083139 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-cb27061c-849a-4eff-b344-cf95239b5082 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:11.085011 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-cb27061c-849a-4eff-b344-cf95239b5082 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1737 microversion: 2.20 time: 0.518572 Jun 17 15:13:11.086145 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 129/255] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:13:10 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1737 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:13:11.124268 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-ad2c7498-3e8c-476f-8a22-0e18d568cda3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:11.125532 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-ad2c7498-3e8c-476f-8a22-0e18d568cda3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:11.144304 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ad2c7498-3e8c-476f-8a22-0e18d568cda3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:11.152991 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ad2c7498-3e8c-476f-8a22-0e18d568cda3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:11.155006 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ad2c7498-3e8c-476f-8a22-0e18d568cda3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:11.155917 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ad2c7498-3e8c-476f-8a22-0e18d568cda3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:11.466054 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-0889a79b-8d5f-47dc-a8fe-6017e26b9aa4 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:11.467096 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-0889a79b-8d5f-47dc-a8fe-6017e26b9aa4 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: 8f90be07-f969-4dc7-b8ab-a5a41f850645] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:11.478526 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0889a79b-8d5f-47dc-a8fe-6017e26b9aa4 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:11.485156 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0889a79b-8d5f-47dc-a8fe-6017e26b9aa4 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:11.499621 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0889a79b-8d5f-47dc-a8fe-6017e26b9aa4 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:11.503738 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0889a79b-8d5f-47dc-a8fe-6017e26b9aa4 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:11.586163 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-ad2c7498-3e8c-476f-8a22-0e18d568cda3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:11.605799 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-ad2c7498-3e8c-476f-8a22-0e18d568cda3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1358 microversion: 2.1 time: 0.496726 Jun 17 15:13:11.607861 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 127/256] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:13:11 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1358 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:13:11.839115 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-0889a79b-8d5f-47dc-a8fe-6017e26b9aa4 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:11.855338 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-0889a79b-8d5f-47dc-a8fe-6017e26b9aa4 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/8f90be07-f969-4dc7-b8ab-a5a41f850645" status: 200 len: 1519 microversion: 2.1 time: 0.395306 Jun 17 15:13:11.866752 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 130/257] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:13:11 2022] GET /compute/v2.1/servers/8f90be07-f969-4dc7-b8ab-a5a41f850645 => generated 1519 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:13:12.049499 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-7395c79c-c290-43ab-8ec1-d682663aa035 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:12.050548 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-7395c79c-c290-43ab-8ec1-d682663aa035 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] [instance: cbcfcb21-8a77-48d2-b889-85680b966a8e] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:12.069997 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7395c79c-c290-43ab-8ec1-d682663aa035 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:12.071116 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7395c79c-c290-43ab-8ec1-d682663aa035 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:12.073299 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7395c79c-c290-43ab-8ec1-d682663aa035 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:12.074646 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7395c79c-c290-43ab-8ec1-d682663aa035 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:12.122649 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-7435bd63-9e46-41d0-a1df-b202f0828cf9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:12.136405 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-7435bd63-9e46-41d0-a1df-b202f0828cf9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:12.164430 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7435bd63-9e46-41d0-a1df-b202f0828cf9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:12.168202 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7435bd63-9e46-41d0-a1df-b202f0828cf9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:12.169830 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7435bd63-9e46-41d0-a1df-b202f0828cf9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:12.172954 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7435bd63-9e46-41d0-a1df-b202f0828cf9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:12.374102 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-7395c79c-c290-43ab-8ec1-d682663aa035 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd12373903ae4f059464f026f2c18581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de3212eec024eb7b1319357c96f0c01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:12.399769 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-7395c79c-c290-43ab-8ec1-d682663aa035 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] 10.222.0.48 "GET /compute/v2.1/servers/cbcfcb21-8a77-48d2-b889-85680b966a8e" status: 200 len: 1503 microversion: 2.1 time: 0.358141 Jun 17 15:13:12.401179 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 128/258] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:13:12 2022] GET /compute/v2.1/servers/cbcfcb21-8a77-48d2-b889-85680b966a8e => generated 1503 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:13:12.407099 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-7435bd63-9e46-41d0-a1df-b202f0828cf9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:12.417304 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-7435bd63-9e46-41d0-a1df-b202f0828cf9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:12.420357 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-7435bd63-9e46-41d0-a1df-b202f0828cf9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:12.421557 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-7435bd63-9e46-41d0-a1df-b202f0828cf9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1737 microversion: 2.20 time: 0.306613 Jun 17 15:13:12.422154 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 131/259] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:13:12 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1737 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:13:12.638895 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-9402a8b4-ff51-403f-b1ff-6598f6e3ee22 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:12.639690 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-9402a8b4-ff51-403f-b1ff-6598f6e3ee22 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:12.648443 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9402a8b4-ff51-403f-b1ff-6598f6e3ee22 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:12.649083 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9402a8b4-ff51-403f-b1ff-6598f6e3ee22 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:12.650190 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9402a8b4-ff51-403f-b1ff-6598f6e3ee22 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:12.650765 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9402a8b4-ff51-403f-b1ff-6598f6e3ee22 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:12.890657 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-7e27c115-2044-4770-bf4f-a879f4e857fb tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:12.891691 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-7e27c115-2044-4770-bf4f-a879f4e857fb tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: 8f90be07-f969-4dc7-b8ab-a5a41f850645] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:12.893277 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-9402a8b4-ff51-403f-b1ff-6598f6e3ee22 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:12.900811 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7e27c115-2044-4770-bf4f-a879f4e857fb tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:12.901438 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7e27c115-2044-4770-bf4f-a879f4e857fb tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:12.902555 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7e27c115-2044-4770-bf4f-a879f4e857fb tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:12.903304 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7e27c115-2044-4770-bf4f-a879f4e857fb tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:12.907087 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-9402a8b4-ff51-403f-b1ff-6598f6e3ee22 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1358 microversion: 2.1 time: 0.275337 Jun 17 15:13:12.908073 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 129/260] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:13:12 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1358 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:13:13.063649 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-7e27c115-2044-4770-bf4f-a879f4e857fb tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:13.073198 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-7e27c115-2044-4770-bf4f-a879f4e857fb tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/8f90be07-f969-4dc7-b8ab-a5a41f850645" status: 200 len: 1519 microversion: 2.1 time: 0.189220 Jun 17 15:13:13.073782 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 132/261] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:13:12 2022] GET /compute/v2.1/servers/8f90be07-f969-4dc7-b8ab-a5a41f850645 => generated 1519 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:13:13.425307 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-1d1b67cd-3520-4875-862f-dc8dc5565b55 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:13.426629 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-1d1b67cd-3520-4875-862f-dc8dc5565b55 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] [instance: cbcfcb21-8a77-48d2-b889-85680b966a8e] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:13.437775 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1d1b67cd-3520-4875-862f-dc8dc5565b55 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:13.438224 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1d1b67cd-3520-4875-862f-dc8dc5565b55 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:13.438990 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1d1b67cd-3520-4875-862f-dc8dc5565b55 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:13.439574 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1d1b67cd-3520-4875-862f-dc8dc5565b55 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:13.439899 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-43252bf7-f2f4-4934-a083-369df05f5b10 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:13.440619 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-43252bf7-f2f4-4934-a083-369df05f5b10 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:13.452798 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-43252bf7-f2f4-4934-a083-369df05f5b10 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:13.453497 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-43252bf7-f2f4-4934-a083-369df05f5b10 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:13.454504 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-43252bf7-f2f4-4934-a083-369df05f5b10 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:13.455175 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-43252bf7-f2f4-4934-a083-369df05f5b10 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:13.648228 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-1d1b67cd-3520-4875-862f-dc8dc5565b55 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd12373903ae4f059464f026f2c18581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de3212eec024eb7b1319357c96f0c01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:13.655442 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-43252bf7-f2f4-4934-a083-369df05f5b10 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:13.657125 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-1d1b67cd-3520-4875-862f-dc8dc5565b55 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] 10.222.0.48 "GET /compute/v2.1/servers/cbcfcb21-8a77-48d2-b889-85680b966a8e" status: 200 len: 1503 microversion: 2.1 time: 0.240105 Jun 17 15:13:13.657878 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 130/262] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:13:13 2022] GET /compute/v2.1/servers/cbcfcb21-8a77-48d2-b889-85680b966a8e => generated 1503 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:13:13.665509 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-43252bf7-f2f4-4934-a083-369df05f5b10 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:13.667486 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-43252bf7-f2f4-4934-a083-369df05f5b10 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:13.668985 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-43252bf7-f2f4-4934-a083-369df05f5b10 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1737 microversion: 2.20 time: 0.233661 Jun 17 15:13:13.669681 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 133/263] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:13:13 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1737 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:13:13.936932 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-10b761c9-28b2-42ab-ad9d-da9682c9210e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:13.938150 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-10b761c9-28b2-42ab-ad9d-da9682c9210e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:13.948354 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-10b761c9-28b2-42ab-ad9d-da9682c9210e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:13.949084 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-10b761c9-28b2-42ab-ad9d-da9682c9210e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:13.950076 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-10b761c9-28b2-42ab-ad9d-da9682c9210e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:13.950580 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-10b761c9-28b2-42ab-ad9d-da9682c9210e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:14.094375 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-eeda1d8b-6c24-43af-954e-a01e3dfeaaeb tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:14.096265 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-eeda1d8b-6c24-43af-954e-a01e3dfeaaeb tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: 8f90be07-f969-4dc7-b8ab-a5a41f850645] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:14.107478 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-eeda1d8b-6c24-43af-954e-a01e3dfeaaeb tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:14.108440 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-eeda1d8b-6c24-43af-954e-a01e3dfeaaeb tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:14.110188 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-eeda1d8b-6c24-43af-954e-a01e3dfeaaeb tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:14.111327 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-eeda1d8b-6c24-43af-954e-a01e3dfeaaeb tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:14.181893 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-10b761c9-28b2-42ab-ad9d-da9682c9210e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:14.198116 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-10b761c9-28b2-42ab-ad9d-da9682c9210e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1358 microversion: 2.1 time: 0.267352 Jun 17 15:13:14.212693 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 131/264] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:13:13 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1358 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:13:14.320680 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-eeda1d8b-6c24-43af-954e-a01e3dfeaaeb tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:14.336186 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-eeda1d8b-6c24-43af-954e-a01e3dfeaaeb tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/8f90be07-f969-4dc7-b8ab-a5a41f850645" status: 200 len: 1519 microversion: 2.1 time: 0.249239 Jun 17 15:13:14.337908 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 134/265] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:13:14 2022] GET /compute/v2.1/servers/8f90be07-f969-4dc7-b8ab-a5a41f850645 => generated 1519 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:13:14.676949 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-d92806de-36a5-43ba-933b-2831c65d3099 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:14.678244 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-d92806de-36a5-43ba-933b-2831c65d3099 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] [instance: cbcfcb21-8a77-48d2-b889-85680b966a8e] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:14.716393 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d92806de-36a5-43ba-933b-2831c65d3099 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:14.720027 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-b62d64c4-2ce9-4a03-a9fb-1455321bfe77 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:14.721637 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-b62d64c4-2ce9-4a03-a9fb-1455321bfe77 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:14.722022 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d92806de-36a5-43ba-933b-2831c65d3099 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:14.723586 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d92806de-36a5-43ba-933b-2831c65d3099 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:14.724681 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d92806de-36a5-43ba-933b-2831c65d3099 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:14.734487 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b62d64c4-2ce9-4a03-a9fb-1455321bfe77 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:14.735556 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b62d64c4-2ce9-4a03-a9fb-1455321bfe77 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:14.736941 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b62d64c4-2ce9-4a03-a9fb-1455321bfe77 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:14.737920 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b62d64c4-2ce9-4a03-a9fb-1455321bfe77 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:15.002141 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-d92806de-36a5-43ba-933b-2831c65d3099 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd12373903ae4f059464f026f2c18581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de3212eec024eb7b1319357c96f0c01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:15.015495 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-d92806de-36a5-43ba-933b-2831c65d3099 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] 10.222.0.48 "GET /compute/v2.1/servers/cbcfcb21-8a77-48d2-b889-85680b966a8e" status: 200 len: 1503 microversion: 2.1 time: 0.344718 Jun 17 15:13:15.016715 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 132/266] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:13:14 2022] GET /compute/v2.1/servers/cbcfcb21-8a77-48d2-b889-85680b966a8e => generated 1503 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:13:15.049410 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-b62d64c4-2ce9-4a03-a9fb-1455321bfe77 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:15.059185 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-b62d64c4-2ce9-4a03-a9fb-1455321bfe77 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:15.060784 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-b62d64c4-2ce9-4a03-a9fb-1455321bfe77 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:15.062259 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-b62d64c4-2ce9-4a03-a9fb-1455321bfe77 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1737 microversion: 2.20 time: 0.378468 Jun 17 15:13:15.062833 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 135/267] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:13:14 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1737 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 15:13:15.227316 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-2de2783d-4ee6-474f-bd61-4bedf98438db tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:15.227936 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-2de2783d-4ee6-474f-bd61-4bedf98438db tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:15.234630 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2de2783d-4ee6-474f-bd61-4bedf98438db tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:15.235092 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2de2783d-4ee6-474f-bd61-4bedf98438db tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:15.235828 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2de2783d-4ee6-474f-bd61-4bedf98438db tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:15.236509 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2de2783d-4ee6-474f-bd61-4bedf98438db tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:15.366295 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-2ec9877b-9fc6-408b-b721-a775878be064 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:15.367637 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-2ec9877b-9fc6-408b-b721-a775878be064 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: 8f90be07-f969-4dc7-b8ab-a5a41f850645] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:15.379333 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2ec9877b-9fc6-408b-b721-a775878be064 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:15.380134 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2ec9877b-9fc6-408b-b721-a775878be064 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:15.381681 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2ec9877b-9fc6-408b-b721-a775878be064 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:15.382472 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2ec9877b-9fc6-408b-b721-a775878be064 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:15.404285 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-2de2783d-4ee6-474f-bd61-4bedf98438db tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:15.416176 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-2de2783d-4ee6-474f-bd61-4bedf98438db tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1358 microversion: 2.1 time: 0.192590 Jun 17 15:13:15.424427 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 133/268] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:13:15 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1358 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:13:15.556956 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-2ec9877b-9fc6-408b-b721-a775878be064 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:15.568084 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-2ec9877b-9fc6-408b-b721-a775878be064 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/8f90be07-f969-4dc7-b8ab-a5a41f850645" status: 200 len: 1519 microversion: 2.1 time: 0.209524 Jun 17 15:13:15.568746 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 136/269] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:13:15 2022] GET /compute/v2.1/servers/8f90be07-f969-4dc7-b8ab-a5a41f850645 => generated 1519 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:13:16.047939 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-a6ec5e01-c9f8-4f46-af1b-b08106e8c489 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:16.049177 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-a6ec5e01-c9f8-4f46-af1b-b08106e8c489 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] [instance: cbcfcb21-8a77-48d2-b889-85680b966a8e] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:16.060776 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a6ec5e01-c9f8-4f46-af1b-b08106e8c489 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:16.061612 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a6ec5e01-c9f8-4f46-af1b-b08106e8c489 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:16.062983 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a6ec5e01-c9f8-4f46-af1b-b08106e8c489 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:16.063742 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a6ec5e01-c9f8-4f46-af1b-b08106e8c489 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:16.085521 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-6b19594b-05c7-4af7-8c15-36327fbf4ef0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:16.086560 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-6b19594b-05c7-4af7-8c15-36327fbf4ef0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:16.109319 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6b19594b-05c7-4af7-8c15-36327fbf4ef0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:16.109868 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6b19594b-05c7-4af7-8c15-36327fbf4ef0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:16.110842 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6b19594b-05c7-4af7-8c15-36327fbf4ef0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:16.111359 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6b19594b-05c7-4af7-8c15-36327fbf4ef0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:16.260242 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-a6ec5e01-c9f8-4f46-af1b-b08106e8c489 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd12373903ae4f059464f026f2c18581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de3212eec024eb7b1319357c96f0c01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:16.274679 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-a6ec5e01-c9f8-4f46-af1b-b08106e8c489 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] 10.222.0.48 "GET /compute/v2.1/servers/cbcfcb21-8a77-48d2-b889-85680b966a8e" status: 200 len: 1503 microversion: 2.1 time: 0.235318 Jun 17 15:13:16.275737 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 134/270] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:13:16 2022] GET /compute/v2.1/servers/cbcfcb21-8a77-48d2-b889-85680b966a8e => generated 1503 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:13:16.295975 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-6b19594b-05c7-4af7-8c15-36327fbf4ef0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:16.306161 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-6b19594b-05c7-4af7-8c15-36327fbf4ef0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:16.307773 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-6b19594b-05c7-4af7-8c15-36327fbf4ef0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:16.309083 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-6b19594b-05c7-4af7-8c15-36327fbf4ef0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1737 microversion: 2.20 time: 0.231369 Jun 17 15:13:16.309720 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 137/271] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:13:16 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1737 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 15:13:16.442442 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-b749e1ca-6a5e-469a-9497-090ee71bb526 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:16.443062 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-b749e1ca-6a5e-469a-9497-090ee71bb526 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:16.449705 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b749e1ca-6a5e-469a-9497-090ee71bb526 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:16.450136 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b749e1ca-6a5e-469a-9497-090ee71bb526 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:16.450926 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b749e1ca-6a5e-469a-9497-090ee71bb526 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:16.451370 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b749e1ca-6a5e-469a-9497-090ee71bb526 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:16.588895 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-b662de3b-c4c1-47a9-bc20-e94b52b400e6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:16.590163 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-b662de3b-c4c1-47a9-bc20-e94b52b400e6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: 8f90be07-f969-4dc7-b8ab-a5a41f850645] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:16.600180 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b662de3b-c4c1-47a9-bc20-e94b52b400e6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:16.600973 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b662de3b-c4c1-47a9-bc20-e94b52b400e6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:16.602334 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b662de3b-c4c1-47a9-bc20-e94b52b400e6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:16.603055 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b662de3b-c4c1-47a9-bc20-e94b52b400e6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:16.636175 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-b749e1ca-6a5e-469a-9497-090ee71bb526 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:16.644416 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-b749e1ca-6a5e-469a-9497-090ee71bb526 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1358 microversion: 2.1 time: 0.205827 Jun 17 15:13:16.645048 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 135/272] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:13:16 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1358 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:13:16.788486 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-b662de3b-c4c1-47a9-bc20-e94b52b400e6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:16.796978 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-b662de3b-c4c1-47a9-bc20-e94b52b400e6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/8f90be07-f969-4dc7-b8ab-a5a41f850645" status: 200 len: 1519 microversion: 2.1 time: 0.215501 Jun 17 15:13:16.797628 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 138/273] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:13:16 2022] GET /compute/v2.1/servers/8f90be07-f969-4dc7-b8ab-a5a41f850645 => generated 1519 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:13:17.299333 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-5587902a-8f57-4f3a-a343-7e6589f2b03f tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:17.299911 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-5587902a-8f57-4f3a-a343-7e6589f2b03f tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] [instance: cbcfcb21-8a77-48d2-b889-85680b966a8e] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:17.306966 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5587902a-8f57-4f3a-a343-7e6589f2b03f tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:17.307462 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5587902a-8f57-4f3a-a343-7e6589f2b03f tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:17.308267 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5587902a-8f57-4f3a-a343-7e6589f2b03f tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:17.308774 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5587902a-8f57-4f3a-a343-7e6589f2b03f tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:17.330425 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-266d42fd-ba2e-4638-a391-571f712fb13f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:17.331454 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-266d42fd-ba2e-4638-a391-571f712fb13f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:17.342062 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-266d42fd-ba2e-4638-a391-571f712fb13f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:17.342746 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-266d42fd-ba2e-4638-a391-571f712fb13f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:17.343994 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-266d42fd-ba2e-4638-a391-571f712fb13f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:17.344747 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-266d42fd-ba2e-4638-a391-571f712fb13f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:17.466169 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-5587902a-8f57-4f3a-a343-7e6589f2b03f tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd12373903ae4f059464f026f2c18581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de3212eec024eb7b1319357c96f0c01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:17.473738 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-5587902a-8f57-4f3a-a343-7e6589f2b03f tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] 10.222.0.48 "GET /compute/v2.1/servers/cbcfcb21-8a77-48d2-b889-85680b966a8e" status: 200 len: 1503 microversion: 2.1 time: 0.178422 Jun 17 15:13:17.474316 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 136/274] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:13:17 2022] GET /compute/v2.1/servers/cbcfcb21-8a77-48d2-b889-85680b966a8e => generated 1503 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:13:17.544672 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-266d42fd-ba2e-4638-a391-571f712fb13f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:17.553881 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-266d42fd-ba2e-4638-a391-571f712fb13f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:17.555377 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-266d42fd-ba2e-4638-a391-571f712fb13f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:17.556640 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-266d42fd-ba2e-4638-a391-571f712fb13f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1737 microversion: 2.20 time: 0.233084 Jun 17 15:13:17.557262 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 139/275] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:13:17 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1737 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:13:17.661970 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-d0f5c13b-7ae0-4ea1-89a5-443cc4876ae0 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:17.662715 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-d0f5c13b-7ae0-4ea1-89a5-443cc4876ae0 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:17.671856 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d0f5c13b-7ae0-4ea1-89a5-443cc4876ae0 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:17.672296 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d0f5c13b-7ae0-4ea1-89a5-443cc4876ae0 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:17.673096 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d0f5c13b-7ae0-4ea1-89a5-443cc4876ae0 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:17.673524 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d0f5c13b-7ae0-4ea1-89a5-443cc4876ae0 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:17.811311 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-d0f5c13b-7ae0-4ea1-89a5-443cc4876ae0 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:17.819044 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-d0f5c13b-7ae0-4ea1-89a5-443cc4876ae0 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1358 microversion: 2.1 time: 0.161237 Jun 17 15:13:17.819620 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 137/276] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:13:17 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:13:17.826104 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-3df4b064-83f1-4a58-81e8-1b7ddbf5865d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:17.827109 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-3df4b064-83f1-4a58-81e8-1b7ddbf5865d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: 8f90be07-f969-4dc7-b8ab-a5a41f850645] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:17.837614 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3df4b064-83f1-4a58-81e8-1b7ddbf5865d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:17.838347 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3df4b064-83f1-4a58-81e8-1b7ddbf5865d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:17.839671 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3df4b064-83f1-4a58-81e8-1b7ddbf5865d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:17.840725 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3df4b064-83f1-4a58-81e8-1b7ddbf5865d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:17.994879 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-3df4b064-83f1-4a58-81e8-1b7ddbf5865d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:18.008961 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-3df4b064-83f1-4a58-81e8-1b7ddbf5865d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/8f90be07-f969-4dc7-b8ab-a5a41f850645" status: 200 len: 1519 microversion: 2.1 time: 0.189131 Jun 17 15:13:18.009838 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 140/277] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:13:17 2022] GET /compute/v2.1/servers/8f90be07-f969-4dc7-b8ab-a5a41f850645 => generated 1519 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:13:18.501985 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-cc646f06-c133-4157-93aa-b2516e49cbef tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:18.502974 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-cc646f06-c133-4157-93aa-b2516e49cbef tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] [instance: cbcfcb21-8a77-48d2-b889-85680b966a8e] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:18.509894 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cc646f06-c133-4157-93aa-b2516e49cbef tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:18.510344 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cc646f06-c133-4157-93aa-b2516e49cbef tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:18.511108 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cc646f06-c133-4157-93aa-b2516e49cbef tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:18.511536 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cc646f06-c133-4157-93aa-b2516e49cbef tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:18.577707 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-81e1da54-b1cd-41cd-b990-9a13d8f68424 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:18.578714 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-81e1da54-b1cd-41cd-b990-9a13d8f68424 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:18.590720 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-81e1da54-b1cd-41cd-b990-9a13d8f68424 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:18.591922 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-81e1da54-b1cd-41cd-b990-9a13d8f68424 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:18.594429 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-81e1da54-b1cd-41cd-b990-9a13d8f68424 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:18.595442 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-81e1da54-b1cd-41cd-b990-9a13d8f68424 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:18.977229 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-81e1da54-b1cd-41cd-b990-9a13d8f68424 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:18.987902 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=100 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:13:18.995870 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-81e1da54-b1cd-41cd-b990-9a13d8f68424 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:18.997988 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-81e1da54-b1cd-41cd-b990-9a13d8f68424 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:18.999456 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-81e1da54-b1cd-41cd-b990-9a13d8f68424 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1737 microversion: 2.20 time: 0.427104 Jun 17 15:13:19.000623 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 141/278] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:13:18 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1737 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 15:13:19.006050 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-5f9faf3b-4712-4ffa-8383-182c4a20a0d9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:19.006914 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-5f9faf3b-4712-4ffa-8383-182c4a20a0d9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:19.014673 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5f9faf3b-4712-4ffa-8383-182c4a20a0d9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:19.015544 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5f9faf3b-4712-4ffa-8383-182c4a20a0d9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:19.016670 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5f9faf3b-4712-4ffa-8383-182c4a20a0d9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:19.017383 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5f9faf3b-4712-4ffa-8383-182c4a20a0d9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:19.180270 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-cc646f06-c133-4157-93aa-b2516e49cbef tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd12373903ae4f059464f026f2c18581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de3212eec024eb7b1319357c96f0c01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:19.190326 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-cc646f06-c133-4157-93aa-b2516e49cbef tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] 10.222.0.48 "GET /compute/v2.1/servers/cbcfcb21-8a77-48d2-b889-85680b966a8e" status: 200 len: 1503 microversion: 2.1 time: 0.697325 Jun 17 15:13:19.191510 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 138/279] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:13:18 2022] GET /compute/v2.1/servers/cbcfcb21-8a77-48d2-b889-85680b966a8e => generated 1503 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:13:19.195899 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-5f9faf3b-4712-4ffa-8383-182c4a20a0d9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:19.197412 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-2f225413-89be-4d17-9e03-6c3a614d2b6d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:19.198262 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-2f225413-89be-4d17-9e03-6c3a614d2b6d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: 8f90be07-f969-4dc7-b8ab-a5a41f850645] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:19.203897 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-5f9faf3b-4712-4ffa-8383-182c4a20a0d9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1358 microversion: 2.1 time: 0.201879 Jun 17 15:13:19.204509 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 142/280] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:13:19 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1358 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:13:19.212718 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2f225413-89be-4d17-9e03-6c3a614d2b6d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:19.213767 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2f225413-89be-4d17-9e03-6c3a614d2b6d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:19.215807 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2f225413-89be-4d17-9e03-6c3a614d2b6d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:19.217580 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2f225413-89be-4d17-9e03-6c3a614d2b6d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:19.421232 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-2f225413-89be-4d17-9e03-6c3a614d2b6d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:19.466632 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-2f225413-89be-4d17-9e03-6c3a614d2b6d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/8f90be07-f969-4dc7-b8ab-a5a41f850645" status: 200 len: 1519 microversion: 2.1 time: 0.271457 Jun 17 15:13:19.482815 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 139/281] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:13:19 2022] GET /compute/v2.1/servers/8f90be07-f969-4dc7-b8ab-a5a41f850645 => generated 1519 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:13:20.035063 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-af47aff3-53db-435e-94ec-6cc15dea8029 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:20.035857 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-af47aff3-53db-435e-94ec-6cc15dea8029 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:20.049015 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-af47aff3-53db-435e-94ec-6cc15dea8029 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:20.050184 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-af47aff3-53db-435e-94ec-6cc15dea8029 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:20.051672 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-af47aff3-53db-435e-94ec-6cc15dea8029 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:20.053152 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-af47aff3-53db-435e-94ec-6cc15dea8029 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:20.228159 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-b518caf6-d741-4951-baa8-bc6336c5dcc6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:20.229412 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-b518caf6-d741-4951-baa8-bc6336c5dcc6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:20.244469 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b518caf6-d741-4951-baa8-bc6336c5dcc6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:20.244918 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b518caf6-d741-4951-baa8-bc6336c5dcc6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:20.245692 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b518caf6-d741-4951-baa8-bc6336c5dcc6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:20.246117 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b518caf6-d741-4951-baa8-bc6336c5dcc6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:20.345960 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-af47aff3-53db-435e-94ec-6cc15dea8029 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:20.364070 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-af47aff3-53db-435e-94ec-6cc15dea8029 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:20.366940 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-af47aff3-53db-435e-94ec-6cc15dea8029 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:20.368387 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-af47aff3-53db-435e-94ec-6cc15dea8029 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1737 microversion: 2.20 time: 0.340702 Jun 17 15:13:20.369422 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 143/282] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:13:20 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1737 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:13:20.389916 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-767b094c-56ee-47d1-afdb-59fd31cde62c tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:20.396824 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-767b094c-56ee-47d1-afdb-59fd31cde62c tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] [instance: cbcfcb21-8a77-48d2-b889-85680b966a8e] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:20.405226 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-767b094c-56ee-47d1-afdb-59fd31cde62c tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:20.408872 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-767b094c-56ee-47d1-afdb-59fd31cde62c tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:20.410251 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-767b094c-56ee-47d1-afdb-59fd31cde62c tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:20.414873 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-767b094c-56ee-47d1-afdb-59fd31cde62c tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:20.496772 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-b518caf6-d741-4951-baa8-bc6336c5dcc6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:20.506319 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-b518caf6-d741-4951-baa8-bc6336c5dcc6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1358 microversion: 2.1 time: 0.282720 Jun 17 15:13:20.507731 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 140/283] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:13:20 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1358 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:13:20.513386 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-b5956874-c8a0-4a89-a782-3d8855a35c65 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:20.514621 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-b5956874-c8a0-4a89-a782-3d8855a35c65 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: 8f90be07-f969-4dc7-b8ab-a5a41f850645] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:20.524242 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b5956874-c8a0-4a89-a782-3d8855a35c65 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:20.525137 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b5956874-c8a0-4a89-a782-3d8855a35c65 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:20.526156 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b5956874-c8a0-4a89-a782-3d8855a35c65 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:20.526813 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b5956874-c8a0-4a89-a782-3d8855a35c65 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:20.652956 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-767b094c-56ee-47d1-afdb-59fd31cde62c tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd12373903ae4f059464f026f2c18581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de3212eec024eb7b1319357c96f0c01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:20.666672 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-767b094c-56ee-47d1-afdb-59fd31cde62c tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] 10.222.0.48 "GET /compute/v2.1/servers/cbcfcb21-8a77-48d2-b889-85680b966a8e" status: 200 len: 1503 microversion: 2.1 time: 0.296005 Jun 17 15:13:20.668071 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 144/284] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:13:20 2022] GET /compute/v2.1/servers/cbcfcb21-8a77-48d2-b889-85680b966a8e => generated 1503 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:13:20.743977 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-b5956874-c8a0-4a89-a782-3d8855a35c65 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:20.758327 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-b5956874-c8a0-4a89-a782-3d8855a35c65 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/8f90be07-f969-4dc7-b8ab-a5a41f850645" status: 200 len: 1519 microversion: 2.1 time: 0.248161 Jun 17 15:13:20.759273 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 141/285] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:13:20 2022] GET /compute/v2.1/servers/8f90be07-f969-4dc7-b8ab-a5a41f850645 => generated 1519 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:13:21.402612 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-da28e415-0f03-4d06-8994-c954ad0ae7cc tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:21.403686 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-da28e415-0f03-4d06-8994-c954ad0ae7cc tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:21.413733 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-da28e415-0f03-4d06-8994-c954ad0ae7cc tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:21.414803 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-da28e415-0f03-4d06-8994-c954ad0ae7cc tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:21.415912 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-da28e415-0f03-4d06-8994-c954ad0ae7cc tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:21.416681 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-da28e415-0f03-4d06-8994-c954ad0ae7cc tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:21.533161 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-a756c3e1-f1c2-4bc0-ba94-95aa17a7248b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:21.534019 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-a756c3e1-f1c2-4bc0-ba94-95aa17a7248b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:21.540597 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a756c3e1-f1c2-4bc0-ba94-95aa17a7248b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:21.541046 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a756c3e1-f1c2-4bc0-ba94-95aa17a7248b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:21.541819 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a756c3e1-f1c2-4bc0-ba94-95aa17a7248b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:21.542250 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a756c3e1-f1c2-4bc0-ba94-95aa17a7248b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:21.742214 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-da28e415-0f03-4d06-8994-c954ad0ae7cc tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:21.756677 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-da28e415-0f03-4d06-8994-c954ad0ae7cc tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:21.760442 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-da28e415-0f03-4d06-8994-c954ad0ae7cc tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:21.763451 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-da28e415-0f03-4d06-8994-c954ad0ae7cc tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1737 microversion: 2.20 time: 0.367373 Jun 17 15:13:21.765425 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 145/286] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:13:21 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1737 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 15:13:21.776012 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-4f25443c-02c3-46e6-a406-602607551e40 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:21.777408 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-4f25443c-02c3-46e6-a406-602607551e40 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] [instance: cbcfcb21-8a77-48d2-b889-85680b966a8e] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:21.791092 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4f25443c-02c3-46e6-a406-602607551e40 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:21.792576 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4f25443c-02c3-46e6-a406-602607551e40 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:21.794601 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4f25443c-02c3-46e6-a406-602607551e40 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:21.795767 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4f25443c-02c3-46e6-a406-602607551e40 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:21.829633 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-a756c3e1-f1c2-4bc0-ba94-95aa17a7248b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:21.837897 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-a756c3e1-f1c2-4bc0-ba94-95aa17a7248b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1358 microversion: 2.1 time: 0.308550 Jun 17 15:13:21.838587 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 142/287] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:13:21 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1358 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:13:21.843824 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-ff2b78c2-d696-4be7-ada3-bb7446d0f1f6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:21.844775 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-ff2b78c2-d696-4be7-ada3-bb7446d0f1f6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: 8f90be07-f969-4dc7-b8ab-a5a41f850645] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:21.851876 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ff2b78c2-d696-4be7-ada3-bb7446d0f1f6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:21.852453 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ff2b78c2-d696-4be7-ada3-bb7446d0f1f6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:21.853300 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ff2b78c2-d696-4be7-ada3-bb7446d0f1f6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:21.853814 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ff2b78c2-d696-4be7-ada3-bb7446d0f1f6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:21.884005 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell1:SELECT=100 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:13:22.118627 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-4f25443c-02c3-46e6-a406-602607551e40 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd12373903ae4f059464f026f2c18581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de3212eec024eb7b1319357c96f0c01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:22.137297 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-ff2b78c2-d696-4be7-ada3-bb7446d0f1f6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:22.143608 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-4f25443c-02c3-46e6-a406-602607551e40 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] 10.222.0.48 "GET /compute/v2.1/servers/cbcfcb21-8a77-48d2-b889-85680b966a8e" status: 200 len: 1503 microversion: 2.1 time: 0.375044 Jun 17 15:13:22.148341 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-ff2b78c2-d696-4be7-ada3-bb7446d0f1f6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/8f90be07-f969-4dc7-b8ab-a5a41f850645" status: 200 len: 1519 microversion: 2.1 time: 0.308437 Jun 17 15:13:22.150905 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 146/288] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:13:21 2022] GET /compute/v2.1/servers/cbcfcb21-8a77-48d2-b889-85680b966a8e => generated 1503 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:13:22.162976 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 143/289] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:13:21 2022] GET /compute/v2.1/servers/8f90be07-f969-4dc7-b8ab-a5a41f850645 => generated 1519 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:13:22.303196 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [req-1a6d5edf-2756-43f5-af27-ad551ef09408 req-a289ca21-15b7-4138-aff8-5adfef4cd7b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbcfcb21-8a77-48d2-b889-85680b966a8e", "name": "network-vif-unplugged", "status": "completed", "tag": "bbd07444-a505-419c-9b36-e04c1807b663"}]} {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:13:22.317130 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [req-1a6d5edf-2756-43f5-af27-ad551ef09408 req-a289ca21-15b7-4138-aff8-5adfef4cd7b0 service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:22.317787 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [req-1a6d5edf-2756-43f5-af27-ad551ef09408 req-a289ca21-15b7-4138-aff8-5adfef4cd7b0 service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:22.347286 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.compute.server_external_events [req-1a6d5edf-2756-43f5-af27-ad551ef09408 req-a289ca21-15b7-4138-aff8-5adfef4cd7b0 service nova] Creating event network-vif-unplugged:bbd07444-a505-419c-9b36-e04c1807b663 for instance cbcfcb21-8a77-48d2-b889-85680b966a8e on hv-cinder-82549 Jun 17 15:13:22.357128 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [req-1a6d5edf-2756-43f5-af27-ad551ef09408 req-a289ca21-15b7-4138-aff8-5adfef4cd7b0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.058039 Jun 17 15:13:22.358036 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 147/290] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 15:13:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:13:22.786482 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-d843eb8a-0fba-49b1-82be-361bf9a1b6e6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:22.788594 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-d843eb8a-0fba-49b1-82be-361bf9a1b6e6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:22.809564 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d843eb8a-0fba-49b1-82be-361bf9a1b6e6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:22.810278 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d843eb8a-0fba-49b1-82be-361bf9a1b6e6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:22.811649 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d843eb8a-0fba-49b1-82be-361bf9a1b6e6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:22.813351 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d843eb8a-0fba-49b1-82be-361bf9a1b6e6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:22.863452 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-723b9078-6e08-43d2-ba5f-530e5b0d0875 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:22.864902 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-723b9078-6e08-43d2-ba5f-530e5b0d0875 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:22.875708 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-723b9078-6e08-43d2-ba5f-530e5b0d0875 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:22.876510 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-723b9078-6e08-43d2-ba5f-530e5b0d0875 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:22.877467 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-723b9078-6e08-43d2-ba5f-530e5b0d0875 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:22.878062 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-723b9078-6e08-43d2-ba5f-530e5b0d0875 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:23.254631 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-723b9078-6e08-43d2-ba5f-530e5b0d0875 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:23.263204 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-723b9078-6e08-43d2-ba5f-530e5b0d0875 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1358 microversion: 2.1 time: 0.404571 Jun 17 15:13:23.273048 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 148/291] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:13:22 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1358 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:13:23.278186 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-7444889b-5e2f-4582-91e1-75c6b7b46c40 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:23.279036 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-7444889b-5e2f-4582-91e1-75c6b7b46c40 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: 8f90be07-f969-4dc7-b8ab-a5a41f850645] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:23.286052 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7444889b-5e2f-4582-91e1-75c6b7b46c40 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:23.286502 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7444889b-5e2f-4582-91e1-75c6b7b46c40 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:23.287798 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7444889b-5e2f-4582-91e1-75c6b7b46c40 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:23.288488 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7444889b-5e2f-4582-91e1-75c6b7b46c40 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:23.345678 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-d843eb8a-0fba-49b1-82be-361bf9a1b6e6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:23.370273 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-d843eb8a-0fba-49b1-82be-361bf9a1b6e6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:23.373360 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-d843eb8a-0fba-49b1-82be-361bf9a1b6e6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:23.375489 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-d843eb8a-0fba-49b1-82be-361bf9a1b6e6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1737 microversion: 2.20 time: 0.592829 Jun 17 15:13:23.390131 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 144/292] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:13:22 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1737 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:13:23.406993 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-4855f150-53e3-4023-8c6f-8ec45839f9cb tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:23.409604 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-4855f150-53e3-4023-8c6f-8ec45839f9cb tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] [instance: cbcfcb21-8a77-48d2-b889-85680b966a8e] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:23.422949 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4855f150-53e3-4023-8c6f-8ec45839f9cb tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:23.424063 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4855f150-53e3-4023-8c6f-8ec45839f9cb tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:23.425658 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4855f150-53e3-4023-8c6f-8ec45839f9cb tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:23.427267 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4855f150-53e3-4023-8c6f-8ec45839f9cb tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:23.547661 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-7444889b-5e2f-4582-91e1-75c6b7b46c40 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:23.566179 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-4855f150-53e3-4023-8c6f-8ec45839f9cb tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd12373903ae4f059464f026f2c18581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de3212eec024eb7b1319357c96f0c01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:23.574835 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-4855f150-53e3-4023-8c6f-8ec45839f9cb tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] 10.222.0.48 "GET /compute/v2.1/servers/cbcfcb21-8a77-48d2-b889-85680b966a8e" status: 200 len: 1461 microversion: 2.1 time: 0.182790 Jun 17 15:13:23.576172 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 145/293] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:13:23 2022] GET /compute/v2.1/servers/cbcfcb21-8a77-48d2-b889-85680b966a8e => generated 1461 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:13:23.577939 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-7444889b-5e2f-4582-91e1-75c6b7b46c40 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/8f90be07-f969-4dc7-b8ab-a5a41f850645" status: 200 len: 1499 microversion: 2.1 time: 0.302020 Jun 17 15:13:23.578542 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 149/294] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:13:23 2022] GET /compute/v2.1/servers/8f90be07-f969-4dc7-b8ab-a5a41f850645 => generated 1499 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:13:23.581565 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [req-63a34f13-879c-436c-bc22-fd6c30ae1e80 req-1374ee27-e5df-415e-9835-f34d55a57ca5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbcfcb21-8a77-48d2-b889-85680b966a8e", "name": "network-vif-deleted", "tag": "bbd07444-a505-419c-9b36-e04c1807b663"}]} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:13:23.589794 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-63a34f13-879c-436c-bc22-fd6c30ae1e80 req-1374ee27-e5df-415e-9835-f34d55a57ca5 service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:23.590484 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-63a34f13-879c-436c-bc22-fd6c30ae1e80 req-1374ee27-e5df-415e-9835-f34d55a57ca5 service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:23.604526 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.compute.server_external_events [req-63a34f13-879c-436c-bc22-fd6c30ae1e80 req-1374ee27-e5df-415e-9835-f34d55a57ca5 service nova] Creating event network-vif-deleted:bbd07444-a505-419c-9b36-e04c1807b663 for instance cbcfcb21-8a77-48d2-b889-85680b966a8e on hv-cinder-82549 Jun 17 15:13:23.611536 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [req-63a34f13-879c-436c-bc22-fd6c30ae1e80 req-1374ee27-e5df-415e-9835-f34d55a57ca5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033934 Jun 17 15:13:23.613989 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-3c37313a-1199-44da-85cc-653d98658650 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0879cba9-05ea-436c-ab19-4f21c801cc3e"}} {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:13:23.616734 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 146/295] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 15:13:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:13:23.617483 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-3c37313a-1199-44da-85cc-653d98658650 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: 8f90be07-f969-4dc7-b8ab-a5a41f850645] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:23.625705 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3c37313a-1199-44da-85cc-653d98658650 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:23.626735 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3c37313a-1199-44da-85cc-653d98658650 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:23.627515 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3c37313a-1199-44da-85cc-653d98658650 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:23.627952 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3c37313a-1199-44da-85cc-653d98658650 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:23.661805 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.wsgi [None req-3c37313a-1199-44da-85cc-653d98658650 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] HTTP exception thrown: Cannot 'attach_volume' instance 8f90be07-f969-4dc7-b8ab-a5a41f850645 while it is in vm_state rescued Jun 17 15:13:23.664528 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-3c37313a-1199-44da-85cc-653d98658650 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Request method failure captured: Jun 17 15:13:23.664528 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: request: POST /compute/v2.1/servers/8f90be07-f969-4dc7-b8ab-a5a41f850645/os-volume_attachments HTTP/1.1 Jun 17 15:13:23.664528 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Accept: application/json Jun 17 15:13:23.664528 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Accept-Encoding: identity Jun 17 15:13:23.664528 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Connection: close Jun 17 15:13:23.664528 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Content-Length: 74 Jun 17 15:13:23.664528 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Content-Type: application/json Jun 17 15:13:23.664528 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Host: 10.222.0.48 Jun 17 15:13:23.664528 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Openstack-System-Scope: None Jun 17 15:13:23.664528 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: User-Agent: python-urllib3/1.26.9 Jun 17 15:13:23.664528 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Auth-Token: gAAAAABirJmQC7m757v9yyJD0BsI2MhqMNm1yc2WpkBWgAGOwCYW524pgy_6_7F6gBQez89A-LSNviRE5zDFwqgj2BZoXTsMX0NmzFHDYuHo31ibepKT71785ic3IrIvGY4IglQk81nqgsevYUUWYR-s69vMdAmv9JQXTwFMOwaCzN_3w4dwj6k Jun 17 15:13:23.664528 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Domain-Id: None Jun 17 15:13:23.664528 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Domain-Name: None Jun 17 15:13:23.664528 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Identity-Status: Confirmed Jun 17 15:13:23.664528 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Is-Admin-Project: True Jun 17 15:13:23.664528 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Domain-Id: default Jun 17 15:13:23.664528 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Domain-Name: Default Jun 17 15:13:23.664528 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Id: 50408ec18fa04036a0abb6236343e258 Jun 17 15:13:23.664528 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1478734135 Jun 17 15:13:23.664528 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Role: reader,member Jun 17 15:13:23.664528 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Roles: reader,member Jun 17 15:13:23.666086 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_50408ec18fa04036a0abb6236343e258", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/50408ec18fa04036a0abb6236343e258"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/50408ec18fa04036a0abb6236343e258"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/50408ec18fa04036a0abb6236343e258"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Jun 17 15:13:23.666086 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1478734135 Jun 17 15:13:23.666086 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant-Id: 50408ec18fa04036a0abb6236343e258 Jun 17 15:13:23.666086 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1478734135 Jun 17 15:13:23.666086 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User: tempest-ServerRescueNegativeTestJSON-1478734135-project Jun 17 15:13:23.666086 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Domain-Id: default Jun 17 15:13:23.666086 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Domain-Name: Default Jun 17 15:13:23.666086 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Id: 562485deaf214fa29eac132464ef93e3 Jun 17 15:13:23.666086 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1478734135-project Jun 17 15:13:23.666086 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Jun 17 15:13:23.666086 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: {"volumeAttachment": {"volumeId": "0879cba9-05ea-436c-ab19-4f21c801cc3e"}} Jun 17 15:13:23.666086 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: method: > Jun 17 15:13:23.666995 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: exception: Cannot 'attach_volume' instance 8f90be07-f969-4dc7-b8ab-a5a41f850645 while it is in vm_state rescued Jun 17 15:13:23.666995 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: action_args: {'server_id': '8f90be07-f969-4dc7-b8ab-a5a41f850645', 'body': {'volumeAttachment': {'volumeId': '0879cba9-05ea-436c-ab19-4f21c801cc3e'}}} Jun 17 15:13:23.666995 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 15:13:23.666995 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:13:23.666995 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 17 15:13:23.666995 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 17 15:13:23.666995 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 17 15:13:23.666995 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 15:13:23.666995 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 17 15:13:23.666995 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 17 15:13:23.666995 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8f90be07-f969-4dc7-b8ab-a5a41f850645 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 17 15:13:23.666995 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:13:23.666995 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:13:23.666995 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:13:23.666995 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:13:23.666995 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:13:23.666995 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:13:23.666995 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 15:13:23.666995 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 15:13:23.668481 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 15:13:23.668481 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 15:13:23.668481 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 17 15:13:23.668481 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 17 15:13:23.668481 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 17 15:13:23.668481 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 17 15:13:23.668481 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 17 15:13:23.668481 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 17 15:13:23.668481 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 17 15:13:23.668481 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 17 15:13:23.668481 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 17 15:13:23.668481 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 17 15:13:23.668481 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 8f90be07-f969-4dc7-b8ab-a5a41f850645 while it is in vm_state rescued Jun 17 15:13:23.668481 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:13:23.668481 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:13:23.668481 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:13:23.668481 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:13:23.668481 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:13:23.668481 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:13:23.669866 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 15:13:23.669866 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 15:13:23.669866 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 8f90be07-f969-4dc7-b8ab-a5a41f850645 while it is in vm_state rescued Jun 17 15:13:23.669866 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:13:23.671806 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-3c37313a-1199-44da-85cc-653d98658650 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Returning 409 to user: Cannot 'attach_volume' instance 8f90be07-f969-4dc7-b8ab-a5a41f850645 while it is in vm_state rescued {{(pid=117650) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 15:13:23.672934 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-3c37313a-1199-44da-85cc-653d98658650 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "POST /compute/v2.1/servers/8f90be07-f969-4dc7-b8ab-a5a41f850645/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.071739 Jun 17 15:13:23.673971 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 150/296] 10.222.0.48 () {60 vars in 1322 bytes} [Fri Jun 17 15:13:23 2022] POST /compute/v2.1/servers/8f90be07-f969-4dc7-b8ab-a5a41f850645/os-volume_attachments => generated 152 bytes in 74 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 17 15:13:23.688878 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-2e847450-a541-4c1a-8dc1-ae1225e4b3dc tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:13:23.690786 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-2e847450-a541-4c1a-8dc1-ae1225e4b3dc tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: 8f90be07-f969-4dc7-b8ab-a5a41f850645] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:23.708186 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2e847450-a541-4c1a-8dc1-ae1225e4b3dc tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:23.709801 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2e847450-a541-4c1a-8dc1-ae1225e4b3dc tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:23.712825 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2e847450-a541-4c1a-8dc1-ae1225e4b3dc tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:23.713527 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2e847450-a541-4c1a-8dc1-ae1225e4b3dc tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:23.885267 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-2e847450-a541-4c1a-8dc1-ae1225e4b3dc tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "POST /compute/v2.1/servers/8f90be07-f969-4dc7-b8ab-a5a41f850645/action" status: 202 len: 0 microversion: 2.1 time: 0.200490 Jun 17 15:13:23.887798 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 147/297] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jun 17 15:13:23 2022] POST /compute/v2.1/servers/8f90be07-f969-4dc7-b8ab-a5a41f850645/action => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 17 15:13:23.911582 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-3135a3c2-06d8-41e0-9f2f-4f525f388147 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:23.914001 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-3135a3c2-06d8-41e0-9f2f-4f525f388147 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: 8f90be07-f969-4dc7-b8ab-a5a41f850645] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:23.926972 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3135a3c2-06d8-41e0-9f2f-4f525f388147 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:23.928865 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3135a3c2-06d8-41e0-9f2f-4f525f388147 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:23.930951 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3135a3c2-06d8-41e0-9f2f-4f525f388147 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:23.931946 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3135a3c2-06d8-41e0-9f2f-4f525f388147 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:24.207564 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-3135a3c2-06d8-41e0-9f2f-4f525f388147 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:24.223739 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-3135a3c2-06d8-41e0-9f2f-4f525f388147 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/8f90be07-f969-4dc7-b8ab-a5a41f850645" status: 200 len: 1507 microversion: 2.1 time: 0.328822 Jun 17 15:13:24.225769 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 151/298] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:13:23 2022] GET /compute/v2.1/servers/8f90be07-f969-4dc7-b8ab-a5a41f850645 => generated 1507 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:13:24.281912 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-b3988782-9a43-46e6-8aa9-224e2b248cae tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:24.283091 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-b3988782-9a43-46e6-8aa9-224e2b248cae tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:24.290859 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b3988782-9a43-46e6-8aa9-224e2b248cae tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:24.291692 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b3988782-9a43-46e6-8aa9-224e2b248cae tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:24.292678 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b3988782-9a43-46e6-8aa9-224e2b248cae tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:24.293267 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b3988782-9a43-46e6-8aa9-224e2b248cae tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:24.403817 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-889868d1-dcd1-4c1b-8a43-85dea03bfe70 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:24.404859 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-889868d1-dcd1-4c1b-8a43-85dea03bfe70 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:24.421099 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-889868d1-dcd1-4c1b-8a43-85dea03bfe70 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:24.422860 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-889868d1-dcd1-4c1b-8a43-85dea03bfe70 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:24.425741 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-889868d1-dcd1-4c1b-8a43-85dea03bfe70 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:24.429586 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-889868d1-dcd1-4c1b-8a43-85dea03bfe70 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:24.554156 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-b3988782-9a43-46e6-8aa9-224e2b248cae tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:24.563236 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-b3988782-9a43-46e6-8aa9-224e2b248cae tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1358 microversion: 2.1 time: 0.286090 Jun 17 15:13:24.564143 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 148/299] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:13:24 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1358 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:13:24.602510 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-4f715c35-508a-4a70-8913-eb05d911f5fa tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:24.603608 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-4f715c35-508a-4a70-8913-eb05d911f5fa tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] [instance: cbcfcb21-8a77-48d2-b889-85680b966a8e] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:24.611437 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4f715c35-508a-4a70-8913-eb05d911f5fa tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:24.611946 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4f715c35-508a-4a70-8913-eb05d911f5fa tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:24.613066 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4f715c35-508a-4a70-8913-eb05d911f5fa tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:24.613353 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4f715c35-508a-4a70-8913-eb05d911f5fa tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:24.644130 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-889868d1-dcd1-4c1b-8a43-85dea03bfe70 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:24.653771 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-889868d1-dcd1-4c1b-8a43-85dea03bfe70 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:24.656081 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4f715c35-508a-4a70-8913-eb05d911f5fa tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:24.656570 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4f715c35-508a-4a70-8913-eb05d911f5fa tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:24.657043 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.objects.instance [None req-4f715c35-508a-4a70-8913-eb05d911f5fa tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lazy-loading 'fault' on Instance uuid cbcfcb21-8a77-48d2-b889-85680b966a8e {{(pid=117649) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 15:13:24.659046 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-889868d1-dcd1-4c1b-8a43-85dea03bfe70 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:24.661865 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-889868d1-dcd1-4c1b-8a43-85dea03bfe70 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1737 microversion: 2.20 time: 0.261697 Jun 17 15:13:24.663257 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 152/300] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:13:24 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1737 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:13:24.718055 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-4f715c35-508a-4a70-8913-eb05d911f5fa tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd12373903ae4f059464f026f2c18581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de3212eec024eb7b1319357c96f0c01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:24.726557 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-4f715c35-508a-4a70-8913-eb05d911f5fa tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] 10.222.0.48 "GET /compute/v2.1/servers/cbcfcb21-8a77-48d2-b889-85680b966a8e" status: 200 len: 1304 microversion: 2.1 time: 0.129197 Jun 17 15:13:24.727460 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 149/301] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:13:24 2022] GET /compute/v2.1/servers/cbcfcb21-8a77-48d2-b889-85680b966a8e => generated 1304 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:13:25.248789 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-b53bb6d8-5cb1-44cc-90e3-b8668b727290 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:25.250282 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-b53bb6d8-5cb1-44cc-90e3-b8668b727290 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: 8f90be07-f969-4dc7-b8ab-a5a41f850645] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:25.310802 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b53bb6d8-5cb1-44cc-90e3-b8668b727290 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:25.311856 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b53bb6d8-5cb1-44cc-90e3-b8668b727290 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:25.317951 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b53bb6d8-5cb1-44cc-90e3-b8668b727290 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:25.323255 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b53bb6d8-5cb1-44cc-90e3-b8668b727290 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:25.582103 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-1a7fc71d-f381-488b-a220-548912257c66 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:25.582820 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-1a7fc71d-f381-488b-a220-548912257c66 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:25.591468 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1a7fc71d-f381-488b-a220-548912257c66 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:25.595275 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1a7fc71d-f381-488b-a220-548912257c66 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:25.597095 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1a7fc71d-f381-488b-a220-548912257c66 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:25.600927 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1a7fc71d-f381-488b-a220-548912257c66 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:25.636721 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-b53bb6d8-5cb1-44cc-90e3-b8668b727290 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:25.645333 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-b53bb6d8-5cb1-44cc-90e3-b8668b727290 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/8f90be07-f969-4dc7-b8ab-a5a41f850645" status: 200 len: 1507 microversion: 2.1 time: 0.400331 Jun 17 15:13:25.657085 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 153/302] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:13:25 2022] GET /compute/v2.1/servers/8f90be07-f969-4dc7-b8ab-a5a41f850645 => generated 1507 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:13:25.684953 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-ba5d3c3b-387f-4f56-89d1-249a988e5742 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:25.685861 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-ba5d3c3b-387f-4f56-89d1-249a988e5742 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:25.695330 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ba5d3c3b-387f-4f56-89d1-249a988e5742 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:25.696071 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ba5d3c3b-387f-4f56-89d1-249a988e5742 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:25.697452 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ba5d3c3b-387f-4f56-89d1-249a988e5742 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:25.698170 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ba5d3c3b-387f-4f56-89d1-249a988e5742 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:25.788544 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-1a7fc71d-f381-488b-a220-548912257c66 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:25.797132 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-1a7fc71d-f381-488b-a220-548912257c66 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1358 microversion: 2.1 time: 0.219556 Jun 17 15:13:25.798649 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 150/303] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:13:25 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1358 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:13:25.810348 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-9652e510-c11b-41fa-b402-110ef1f8c26f tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:25.816562 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-9652e510-c11b-41fa-b402-110ef1f8c26f tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] [instance: cbcfcb21-8a77-48d2-b889-85680b966a8e] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:25.831377 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9652e510-c11b-41fa-b402-110ef1f8c26f tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:25.831831 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9652e510-c11b-41fa-b402-110ef1f8c26f tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:25.832639 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9652e510-c11b-41fa-b402-110ef1f8c26f tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:25.833071 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9652e510-c11b-41fa-b402-110ef1f8c26f tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:25.918080 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-ba5d3c3b-387f-4f56-89d1-249a988e5742 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:25.918896 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9652e510-c11b-41fa-b402-110ef1f8c26f tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:25.921167 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9652e510-c11b-41fa-b402-110ef1f8c26f tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:25.921886 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.objects.instance [None req-9652e510-c11b-41fa-b402-110ef1f8c26f tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lazy-loading 'fault' on Instance uuid cbcfcb21-8a77-48d2-b889-85680b966a8e {{(pid=117649) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 15:13:25.931834 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-ba5d3c3b-387f-4f56-89d1-249a988e5742 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:25.934180 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-ba5d3c3b-387f-4f56-89d1-249a988e5742 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:25.935363 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-ba5d3c3b-387f-4f56-89d1-249a988e5742 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1737 microversion: 2.20 time: 0.258553 Jun 17 15:13:25.946060 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 154/304] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:13:25 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1737 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:13:25.989120 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-9652e510-c11b-41fa-b402-110ef1f8c26f tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd12373903ae4f059464f026f2c18581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de3212eec024eb7b1319357c96f0c01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:25.998260 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-9652e510-c11b-41fa-b402-110ef1f8c26f tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] 10.222.0.48 "GET /compute/v2.1/servers/cbcfcb21-8a77-48d2-b889-85680b966a8e" status: 200 len: 1304 microversion: 2.1 time: 0.194631 Jun 17 15:13:25.999446 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 151/305] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:13:25 2022] GET /compute/v2.1/servers/cbcfcb21-8a77-48d2-b889-85680b966a8e => generated 1304 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:13:26.666763 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-5e47e35a-88d3-4289-a1c4-4b802b3d512c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:26.667851 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-5e47e35a-88d3-4289-a1c4-4b802b3d512c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: 8f90be07-f969-4dc7-b8ab-a5a41f850645] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:26.681728 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5e47e35a-88d3-4289-a1c4-4b802b3d512c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:26.682836 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5e47e35a-88d3-4289-a1c4-4b802b3d512c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:26.684485 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5e47e35a-88d3-4289-a1c4-4b802b3d512c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:26.685251 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5e47e35a-88d3-4289-a1c4-4b802b3d512c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:26.816707 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-dd153d51-77f6-4651-8a84-5dc3ac48037e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:26.818094 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-dd153d51-77f6-4651-8a84-5dc3ac48037e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:26.825144 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-dd153d51-77f6-4651-8a84-5dc3ac48037e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:26.833639 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-dd153d51-77f6-4651-8a84-5dc3ac48037e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:26.834561 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-dd153d51-77f6-4651-8a84-5dc3ac48037e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:26.834935 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-dd153d51-77f6-4651-8a84-5dc3ac48037e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:26.909591 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-5e47e35a-88d3-4289-a1c4-4b802b3d512c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:26.919855 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-5e47e35a-88d3-4289-a1c4-4b802b3d512c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/8f90be07-f969-4dc7-b8ab-a5a41f850645" status: 200 len: 1507 microversion: 2.1 time: 0.260037 Jun 17 15:13:26.921700 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 155/306] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:13:26 2022] GET /compute/v2.1/servers/8f90be07-f969-4dc7-b8ab-a5a41f850645 => generated 1507 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:13:26.965194 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-10910b9e-dcd4-40e2-98f9-35969049447a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:26.966038 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-10910b9e-dcd4-40e2-98f9-35969049447a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:26.975896 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-10910b9e-dcd4-40e2-98f9-35969049447a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:26.976790 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-10910b9e-dcd4-40e2-98f9-35969049447a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:26.977916 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-10910b9e-dcd4-40e2-98f9-35969049447a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:26.978498 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-10910b9e-dcd4-40e2-98f9-35969049447a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:27.091532 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-dd153d51-77f6-4651-8a84-5dc3ac48037e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:27.101723 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-dd153d51-77f6-4651-8a84-5dc3ac48037e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1358 microversion: 2.1 time: 0.291032 Jun 17 15:13:27.121658 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 152/307] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:13:26 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1358 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:13:27.142463 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-a57e8e08-fe15-48ea-b2b3-073ad3618f51 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:27.143482 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-a57e8e08-fe15-48ea-b2b3-073ad3618f51 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] [instance: cbcfcb21-8a77-48d2-b889-85680b966a8e] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:27.152171 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a57e8e08-fe15-48ea-b2b3-073ad3618f51 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:27.153430 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a57e8e08-fe15-48ea-b2b3-073ad3618f51 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:27.154889 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a57e8e08-fe15-48ea-b2b3-073ad3618f51 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:27.156218 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a57e8e08-fe15-48ea-b2b3-073ad3618f51 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:27.203427 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a57e8e08-fe15-48ea-b2b3-073ad3618f51 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:27.203987 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a57e8e08-fe15-48ea-b2b3-073ad3618f51 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:27.204503 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.objects.instance [None req-a57e8e08-fe15-48ea-b2b3-073ad3618f51 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lazy-loading 'fault' on Instance uuid cbcfcb21-8a77-48d2-b889-85680b966a8e {{(pid=117649) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 15:13:27.205630 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-10910b9e-dcd4-40e2-98f9-35969049447a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:27.214286 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-10910b9e-dcd4-40e2-98f9-35969049447a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:27.226376 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-10910b9e-dcd4-40e2-98f9-35969049447a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:27.231764 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-10910b9e-dcd4-40e2-98f9-35969049447a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1737 microversion: 2.20 time: 0.270947 Jun 17 15:13:27.251603 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 156/308] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:13:26 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1737 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 15:13:27.269427 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-a57e8e08-fe15-48ea-b2b3-073ad3618f51 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd12373903ae4f059464f026f2c18581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5de3212eec024eb7b1319357c96f0c01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:27.278204 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-a57e8e08-fe15-48ea-b2b3-073ad3618f51 tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] 10.222.0.48 "GET /compute/v2.1/servers/cbcfcb21-8a77-48d2-b889-85680b966a8e" status: 200 len: 1304 microversion: 2.1 time: 0.154881 Jun 17 15:13:27.279066 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 153/309] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:13:27 2022] GET /compute/v2.1/servers/cbcfcb21-8a77-48d2-b889-85680b966a8e => generated 1304 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:13:27.946280 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-ca993ccb-6b95-4e20-aad5-afcb924ef28a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:27.949284 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-ca993ccb-6b95-4e20-aad5-afcb924ef28a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: 8f90be07-f969-4dc7-b8ab-a5a41f850645] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:28.010011 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ca993ccb-6b95-4e20-aad5-afcb924ef28a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:28.010842 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ca993ccb-6b95-4e20-aad5-afcb924ef28a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:28.012616 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ca993ccb-6b95-4e20-aad5-afcb924ef28a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:28.013757 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ca993ccb-6b95-4e20-aad5-afcb924ef28a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:28.142527 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-5d38575b-76e8-4fd1-be2c-709ac58c0d1f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:28.153702 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-5d38575b-76e8-4fd1-be2c-709ac58c0d1f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:28.239137 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5d38575b-76e8-4fd1-be2c-709ac58c0d1f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:28.239907 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5d38575b-76e8-4fd1-be2c-709ac58c0d1f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:28.241275 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5d38575b-76e8-4fd1-be2c-709ac58c0d1f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:28.242006 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5d38575b-76e8-4fd1-be2c-709ac58c0d1f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:28.445038 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-ca993ccb-6b95-4e20-aad5-afcb924ef28a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:28.456939 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-ca993ccb-6b95-4e20-aad5-afcb924ef28a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/8f90be07-f969-4dc7-b8ab-a5a41f850645" status: 200 len: 1507 microversion: 2.1 time: 0.520890 Jun 17 15:13:28.469447 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 157/310] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:13:27 2022] GET /compute/v2.1/servers/8f90be07-f969-4dc7-b8ab-a5a41f850645 => generated 1507 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:13:28.477997 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-4dcb0c15-d635-44ee-a98b-058c6d0f66ee tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:28.479767 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-4dcb0c15-d635-44ee-a98b-058c6d0f66ee tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:28.487654 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4dcb0c15-d635-44ee-a98b-058c6d0f66ee tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:28.488503 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4dcb0c15-d635-44ee-a98b-058c6d0f66ee tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:28.490197 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4dcb0c15-d635-44ee-a98b-058c6d0f66ee tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:28.490875 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4dcb0c15-d635-44ee-a98b-058c6d0f66ee tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:28.532530 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-5d38575b-76e8-4fd1-be2c-709ac58c0d1f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:28.541165 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-5d38575b-76e8-4fd1-be2c-709ac58c0d1f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1358 microversion: 2.1 time: 0.407334 Jun 17 15:13:28.541750 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 154/311] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:13:28 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1358 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:13:28.549481 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-eac116bd-63eb-4073-be46-7fbd328d94bd tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:28.550093 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-eac116bd-63eb-4073-be46-7fbd328d94bd tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] [instance: cbcfcb21-8a77-48d2-b889-85680b966a8e] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:28.557639 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-eac116bd-63eb-4073-be46-7fbd328d94bd tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:28.558088 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-eac116bd-63eb-4073-be46-7fbd328d94bd tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:28.558868 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-eac116bd-63eb-4073-be46-7fbd328d94bd tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:28.559298 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-eac116bd-63eb-4073-be46-7fbd328d94bd tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:28.578113 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.wsgi [None req-eac116bd-63eb-4073-be46-7fbd328d94bd tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] HTTP exception thrown: Instance cbcfcb21-8a77-48d2-b889-85680b966a8e could not be found. Jun 17 15:13:28.580917 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-eac116bd-63eb-4073-be46-7fbd328d94bd tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Request method failure captured: Jun 17 15:13:28.580917 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: request: GET /compute/v2.1/servers/cbcfcb21-8a77-48d2-b889-85680b966a8e HTTP/1.1 Jun 17 15:13:28.580917 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Accept: application/json Jun 17 15:13:28.580917 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Accept-Encoding: identity Jun 17 15:13:28.580917 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Connection: close Jun 17 15:13:28.580917 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Content-Length: 0 Jun 17 15:13:28.580917 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Content-Type: application/json Jun 17 15:13:28.580917 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Host: 10.222.0.48 Jun 17 15:13:28.580917 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Openstack-System-Scope: None Jun 17 15:13:28.580917 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: User-Agent: python-urllib3/1.26.9 Jun 17 15:13:28.580917 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Auth-Token: gAAAAABirJnV-H_bjNw4OzE2GGzJYccJh1Lqx8LKMqUAH_x-U80LBH6_2ZEoOYsCGg8KVjs37A3UTfUbd5Z1rXEkWm9JKCcovQE3jpwdviDGFjn-la78i52cNdtqcP9m1CwbUOtcpeuHX2SyolE0s5lohNU1_eKha1nI76oe8km0u72o0sq6qu4 Jun 17 15:13:28.580917 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Domain-Id: None Jun 17 15:13:28.580917 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Domain-Name: None Jun 17 15:13:28.580917 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Identity-Status: Confirmed Jun 17 15:13:28.580917 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Is-Admin-Project: True Jun 17 15:13:28.580917 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Domain-Id: default Jun 17 15:13:28.580917 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Domain-Name: Default Jun 17 15:13:28.580917 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Id: 5de3212eec024eb7b1319357c96f0c01 Jun 17 15:13:28.580917 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Name: tempest-VolumesActionsTest-2011511006 Jun 17 15:13:28.580917 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Role: reader,member Jun 17 15:13:28.580917 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Roles: reader,member Jun 17 15:13:28.582239 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_5de3212eec024eb7b1319357c96f0c01", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/5de3212eec024eb7b1319357c96f0c01"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5de3212eec024eb7b1319357c96f0c01"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5de3212eec024eb7b1319357c96f0c01"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Jun 17 15:13:28.582239 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant: tempest-VolumesActionsTest-2011511006 Jun 17 15:13:28.582239 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant-Id: 5de3212eec024eb7b1319357c96f0c01 Jun 17 15:13:28.582239 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant-Name: tempest-VolumesActionsTest-2011511006 Jun 17 15:13:28.582239 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User: tempest-VolumesActionsTest-2011511006-project Jun 17 15:13:28.582239 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Domain-Id: default Jun 17 15:13:28.582239 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Domain-Name: Default Jun 17 15:13:28.582239 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Id: fd12373903ae4f059464f026f2c18581 Jun 17 15:13:28.582239 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Name: tempest-VolumesActionsTest-2011511006-project Jun 17 15:13:28.582239 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: method: > Jun 17 15:13:28.582239 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: exception: Instance cbcfcb21-8a77-48d2-b889-85680b966a8e could not be found. Jun 17 15:13:28.582239 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: action_args: {'id': 'cbcfcb21-8a77-48d2-b889-85680b966a8e'} Jun 17 15:13:28.583026 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 15:13:28.583026 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:13:28.583026 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 15:13:28.583026 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 15:13:28.583026 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 15:13:28.583026 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 15:13:28.583026 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 15:13:28.583026 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 15:13:28.583026 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 15:13:28.583026 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 15:13:28.583026 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cbcfcb21-8a77-48d2-b889-85680b966a8e could not be found. Jun 17 15:13:28.583026 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:13:28.583026 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:13:28.583026 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:13:28.583026 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:13:28.583026 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:13:28.583026 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:13:28.583026 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 15:13:28.583026 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 15:13:28.583026 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 15:13:28.584245 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 15:13:28.584245 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 15:13:28.584245 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 15:13:28.584245 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 15:13:28.584245 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 15:13:28.584245 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 15:13:28.584245 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 15:13:28.584245 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbcfcb21-8a77-48d2-b889-85680b966a8e could not be found. Jun 17 15:13:28.584245 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:13:28.584245 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:13:28.584245 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:13:28.584245 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:13:28.584245 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:13:28.584245 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:13:28.584245 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 15:13:28.584245 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 15:13:28.584245 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbcfcb21-8a77-48d2-b889-85680b966a8e could not be found. Jun 17 15:13:28.584245 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:13:28.587072 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-eac116bd-63eb-4073-be46-7fbd328d94bd tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] Returning 404 to user: Instance cbcfcb21-8a77-48d2-b889-85680b966a8e could not be found. {{(pid=117649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 15:13:28.588375 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-eac116bd-63eb-4073-be46-7fbd328d94bd tempest-VolumesActionsTest-2011511006 tempest-VolumesActionsTest-2011511006-project] 10.222.0.48 "GET /compute/v2.1/servers/cbcfcb21-8a77-48d2-b889-85680b966a8e" status: 404 len: 111 microversion: 2.1 time: 0.045639 Jun 17 15:13:28.597250 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 155/312] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:13:28 2022] GET /compute/v2.1/servers/cbcfcb21-8a77-48d2-b889-85680b966a8e => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 15:13:28.765775 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-4dcb0c15-d635-44ee-a98b-058c6d0f66ee tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:28.776927 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-4dcb0c15-d635-44ee-a98b-058c6d0f66ee tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:28.778973 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-4dcb0c15-d635-44ee-a98b-058c6d0f66ee tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:28.780535 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-4dcb0c15-d635-44ee-a98b-058c6d0f66ee tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1737 microversion: 2.20 time: 0.309541 Jun 17 15:13:28.781371 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 158/313] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:13:28 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1737 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:13:29.478577 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-74176a13-1089-4556-b490-bd0b6f074c3a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:29.479185 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-74176a13-1089-4556-b490-bd0b6f074c3a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: 8f90be07-f969-4dc7-b8ab-a5a41f850645] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:29.487807 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-74176a13-1089-4556-b490-bd0b6f074c3a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:29.510500 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-74176a13-1089-4556-b490-bd0b6f074c3a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:29.510500 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-74176a13-1089-4556-b490-bd0b6f074c3a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:29.510500 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-74176a13-1089-4556-b490-bd0b6f074c3a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:29.558130 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-2e8cf4d1-5cf0-4936-8008-1237d54687ab tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:29.558946 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-2e8cf4d1-5cf0-4936-8008-1237d54687ab tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:29.576667 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2e8cf4d1-5cf0-4936-8008-1237d54687ab tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:29.577096 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2e8cf4d1-5cf0-4936-8008-1237d54687ab tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:29.578244 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2e8cf4d1-5cf0-4936-8008-1237d54687ab tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:29.579183 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2e8cf4d1-5cf0-4936-8008-1237d54687ab tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:29.672296 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=100 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:13:29.998580 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-74176a13-1089-4556-b490-bd0b6f074c3a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:30.014120 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-74176a13-1089-4556-b490-bd0b6f074c3a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/8f90be07-f969-4dc7-b8ab-a5a41f850645" status: 200 len: 1507 microversion: 2.1 time: 0.538811 Jun 17 15:13:30.015286 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 156/314] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:13:29 2022] GET /compute/v2.1/servers/8f90be07-f969-4dc7-b8ab-a5a41f850645 => generated 1507 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:13:30.029152 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-e4fdb4d6-b006-4f2a-a70a-e7d18c0b07ea tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:30.038603 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-e4fdb4d6-b006-4f2a-a70a-e7d18c0b07ea tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:30.060872 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e4fdb4d6-b006-4f2a-a70a-e7d18c0b07ea tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:30.061784 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e4fdb4d6-b006-4f2a-a70a-e7d18c0b07ea tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:30.062855 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e4fdb4d6-b006-4f2a-a70a-e7d18c0b07ea tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:30.063553 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e4fdb4d6-b006-4f2a-a70a-e7d18c0b07ea tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:30.165217 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-2e8cf4d1-5cf0-4936-8008-1237d54687ab tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:30.178291 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-2e8cf4d1-5cf0-4936-8008-1237d54687ab tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1358 microversion: 2.1 time: 0.623908 Jun 17 15:13:30.180665 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 159/315] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:13:29 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1358 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:13:30.562006 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-e4fdb4d6-b006-4f2a-a70a-e7d18c0b07ea tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:30.573990 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-e4fdb4d6-b006-4f2a-a70a-e7d18c0b07ea tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:30.575992 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-e4fdb4d6-b006-4f2a-a70a-e7d18c0b07ea tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:30.577666 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-e4fdb4d6-b006-4f2a-a70a-e7d18c0b07ea tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1737 microversion: 2.20 time: 0.553924 Jun 17 15:13:30.578646 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 157/316] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:13:30 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1737 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:13:31.045112 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-c1f114b6-0c31-4566-b5d9-20aa6ba187a2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:31.045731 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-c1f114b6-0c31-4566-b5d9-20aa6ba187a2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: 8f90be07-f969-4dc7-b8ab-a5a41f850645] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:31.056598 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c1f114b6-0c31-4566-b5d9-20aa6ba187a2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:31.057049 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c1f114b6-0c31-4566-b5d9-20aa6ba187a2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:31.057821 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c1f114b6-0c31-4566-b5d9-20aa6ba187a2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:31.063361 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c1f114b6-0c31-4566-b5d9-20aa6ba187a2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:31.195704 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-521c9bb4-4d74-4ab9-8e83-a6c0c402f55d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:31.196348 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-521c9bb4-4d74-4ab9-8e83-a6c0c402f55d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:31.203462 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-521c9bb4-4d74-4ab9-8e83-a6c0c402f55d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:31.203924 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-521c9bb4-4d74-4ab9-8e83-a6c0c402f55d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:31.204779 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-521c9bb4-4d74-4ab9-8e83-a6c0c402f55d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:31.205220 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-521c9bb4-4d74-4ab9-8e83-a6c0c402f55d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:31.346543 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-c1f114b6-0c31-4566-b5d9-20aa6ba187a2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:31.354710 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-521c9bb4-4d74-4ab9-8e83-a6c0c402f55d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:31.358840 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-c1f114b6-0c31-4566-b5d9-20aa6ba187a2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/8f90be07-f969-4dc7-b8ab-a5a41f850645" status: 200 len: 1507 microversion: 2.1 time: 0.327104 Jun 17 15:13:31.359593 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 160/317] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:13:31 2022] GET /compute/v2.1/servers/8f90be07-f969-4dc7-b8ab-a5a41f850645 => generated 1507 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:13:31.367790 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-521c9bb4-4d74-4ab9-8e83-a6c0c402f55d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1358 microversion: 2.1 time: 0.176173 Jun 17 15:13:31.373300 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 158/318] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:13:31 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1358 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:13:31.600499 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-6e05db04-2eeb-470e-9f40-ee223acde6d2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:31.601127 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-6e05db04-2eeb-470e-9f40-ee223acde6d2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:31.607633 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6e05db04-2eeb-470e-9f40-ee223acde6d2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:31.608089 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6e05db04-2eeb-470e-9f40-ee223acde6d2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:31.608898 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6e05db04-2eeb-470e-9f40-ee223acde6d2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:31.609663 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6e05db04-2eeb-470e-9f40-ee223acde6d2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:31.818762 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-6e05db04-2eeb-470e-9f40-ee223acde6d2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:31.828256 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-6e05db04-2eeb-470e-9f40-ee223acde6d2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:31.830457 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-6e05db04-2eeb-470e-9f40-ee223acde6d2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:31.832562 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-6e05db04-2eeb-470e-9f40-ee223acde6d2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1737 microversion: 2.20 time: 0.239557 Jun 17 15:13:31.833644 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 161/319] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:13:31 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1737 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:13:32.375066 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-9d043015-fdbf-49ac-a614-e5d2b7f3f4bc tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:32.376444 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-9d043015-fdbf-49ac-a614-e5d2b7f3f4bc tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: 8f90be07-f969-4dc7-b8ab-a5a41f850645] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:32.389209 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-3b9a79ae-e274-4834-9593-83995117fdc8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:32.390081 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-3b9a79ae-e274-4834-9593-83995117fdc8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:32.395951 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9d043015-fdbf-49ac-a614-e5d2b7f3f4bc tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:32.398494 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3b9a79ae-e274-4834-9593-83995117fdc8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:32.398978 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9d043015-fdbf-49ac-a614-e5d2b7f3f4bc tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:32.400057 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9d043015-fdbf-49ac-a614-e5d2b7f3f4bc tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:32.400613 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9d043015-fdbf-49ac-a614-e5d2b7f3f4bc tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:32.401114 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3b9a79ae-e274-4834-9593-83995117fdc8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:32.406080 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3b9a79ae-e274-4834-9593-83995117fdc8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:32.406812 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3b9a79ae-e274-4834-9593-83995117fdc8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:32.424667 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:13:32.577780 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-3b9a79ae-e274-4834-9593-83995117fdc8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:32.587618 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-3b9a79ae-e274-4834-9593-83995117fdc8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1358 microversion: 2.1 time: 0.201994 Jun 17 15:13:32.597410 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 162/320] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:13:32 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1358 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:13:32.643124 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-9d043015-fdbf-49ac-a614-e5d2b7f3f4bc tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:32.654247 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-9d043015-fdbf-49ac-a614-e5d2b7f3f4bc tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/8f90be07-f969-4dc7-b8ab-a5a41f850645" status: 200 len: 1507 microversion: 2.1 time: 0.282879 Jun 17 15:13:32.654837 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 159/321] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:13:32 2022] GET /compute/v2.1/servers/8f90be07-f969-4dc7-b8ab-a5a41f850645 => generated 1507 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:13:32.856657 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-5409d427-99e9-449e-b861-e5f871023d39 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:32.857651 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-5409d427-99e9-449e-b861-e5f871023d39 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:32.868620 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5409d427-99e9-449e-b861-e5f871023d39 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:32.869446 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5409d427-99e9-449e-b861-e5f871023d39 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:32.870478 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5409d427-99e9-449e-b861-e5f871023d39 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:32.871131 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5409d427-99e9-449e-b861-e5f871023d39 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:33.049481 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-5409d427-99e9-449e-b861-e5f871023d39 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:33.058097 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-5409d427-99e9-449e-b861-e5f871023d39 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:33.059765 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-5409d427-99e9-449e-b861-e5f871023d39 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:33.061089 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-5409d427-99e9-449e-b861-e5f871023d39 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1737 microversion: 2.20 time: 0.213541 Jun 17 15:13:33.061886 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 163/322] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:13:32 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1737 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:13:33.613303 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-12b1f36b-6f8e-4893-9a24-b1ee2973219d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:33.613303 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-12b1f36b-6f8e-4893-9a24-b1ee2973219d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:33.615411 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-12b1f36b-6f8e-4893-9a24-b1ee2973219d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:33.615961 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-12b1f36b-6f8e-4893-9a24-b1ee2973219d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:33.616939 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-12b1f36b-6f8e-4893-9a24-b1ee2973219d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:33.617607 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-12b1f36b-6f8e-4893-9a24-b1ee2973219d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:33.672264 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-6cd8786c-3f34-402f-a2e3-04f6d32b52b6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:33.672940 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-6cd8786c-3f34-402f-a2e3-04f6d32b52b6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: 8f90be07-f969-4dc7-b8ab-a5a41f850645] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:33.685192 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6cd8786c-3f34-402f-a2e3-04f6d32b52b6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:33.685637 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6cd8786c-3f34-402f-a2e3-04f6d32b52b6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:33.686417 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6cd8786c-3f34-402f-a2e3-04f6d32b52b6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:33.686846 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6cd8786c-3f34-402f-a2e3-04f6d32b52b6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:33.897614 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-6cd8786c-3f34-402f-a2e3-04f6d32b52b6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:33.902677 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-12b1f36b-6f8e-4893-9a24-b1ee2973219d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:33.908863 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-6cd8786c-3f34-402f-a2e3-04f6d32b52b6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/8f90be07-f969-4dc7-b8ab-a5a41f850645" status: 200 len: 1507 microversion: 2.1 time: 0.241576 Jun 17 15:13:33.909810 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 164/323] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:13:33 2022] GET /compute/v2.1/servers/8f90be07-f969-4dc7-b8ab-a5a41f850645 => generated 1507 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:13:33.918540 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-12b1f36b-6f8e-4893-9a24-b1ee2973219d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1358 microversion: 2.1 time: 0.317287 Jun 17 15:13:33.919351 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 160/324] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:13:33 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1358 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:13:34.080141 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-ff526362-2cea-4ee0-af7f-6d365389cb93 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:34.080946 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-ff526362-2cea-4ee0-af7f-6d365389cb93 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:34.087988 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ff526362-2cea-4ee0-af7f-6d365389cb93 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:34.088568 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ff526362-2cea-4ee0-af7f-6d365389cb93 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:34.089809 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ff526362-2cea-4ee0-af7f-6d365389cb93 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:34.090724 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ff526362-2cea-4ee0-af7f-6d365389cb93 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:34.312468 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-ff526362-2cea-4ee0-af7f-6d365389cb93 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:34.323164 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-ff526362-2cea-4ee0-af7f-6d365389cb93 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:34.324723 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-ff526362-2cea-4ee0-af7f-6d365389cb93 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:34.326495 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-ff526362-2cea-4ee0-af7f-6d365389cb93 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1737 microversion: 2.20 time: 0.250401 Jun 17 15:13:34.329464 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 165/325] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:13:34 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1737 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:13:34.926601 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-19cccf13-8bf5-4f12-9ae4-3d5f64645838 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:34.927325 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-19cccf13-8bf5-4f12-9ae4-3d5f64645838 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: 8f90be07-f969-4dc7-b8ab-a5a41f850645] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:34.935818 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-4896eace-dd20-40fd-8e5c-fd014f3e70a9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:34.939138 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-4896eace-dd20-40fd-8e5c-fd014f3e70a9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:34.943646 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-19cccf13-8bf5-4f12-9ae4-3d5f64645838 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:34.944098 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-19cccf13-8bf5-4f12-9ae4-3d5f64645838 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:34.945810 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-19cccf13-8bf5-4f12-9ae4-3d5f64645838 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:34.946252 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-19cccf13-8bf5-4f12-9ae4-3d5f64645838 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:34.949254 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4896eace-dd20-40fd-8e5c-fd014f3e70a9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:34.949890 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4896eace-dd20-40fd-8e5c-fd014f3e70a9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:34.950808 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4896eace-dd20-40fd-8e5c-fd014f3e70a9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:34.951348 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4896eace-dd20-40fd-8e5c-fd014f3e70a9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:35.110019 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-4896eace-dd20-40fd-8e5c-fd014f3e70a9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:35.121857 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-4896eace-dd20-40fd-8e5c-fd014f3e70a9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1358 microversion: 2.1 time: 0.189948 Jun 17 15:13:35.122765 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 166/326] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:13:34 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1358 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:13:35.199855 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-19cccf13-8bf5-4f12-9ae4-3d5f64645838 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:35.209360 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-19cccf13-8bf5-4f12-9ae4-3d5f64645838 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/8f90be07-f969-4dc7-b8ab-a5a41f850645" status: 200 len: 1507 microversion: 2.1 time: 0.285892 Jun 17 15:13:35.210352 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 161/327] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:13:34 2022] GET /compute/v2.1/servers/8f90be07-f969-4dc7-b8ab-a5a41f850645 => generated 1507 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:13:35.347428 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-89c284f8-e3ba-4e15-bb42-7d6e5f83e326 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:35.348079 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-89c284f8-e3ba-4e15-bb42-7d6e5f83e326 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:35.355957 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-89c284f8-e3ba-4e15-bb42-7d6e5f83e326 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:35.356567 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-89c284f8-e3ba-4e15-bb42-7d6e5f83e326 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:35.357341 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-89c284f8-e3ba-4e15-bb42-7d6e5f83e326 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:35.357769 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-89c284f8-e3ba-4e15-bb42-7d6e5f83e326 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:35.533633 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-89c284f8-e3ba-4e15-bb42-7d6e5f83e326 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:35.547219 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-89c284f8-e3ba-4e15-bb42-7d6e5f83e326 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:35.550347 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-89c284f8-e3ba-4e15-bb42-7d6e5f83e326 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:35.552438 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-89c284f8-e3ba-4e15-bb42-7d6e5f83e326 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1719 microversion: 2.20 time: 0.208502 Jun 17 15:13:35.563360 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 167/328] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:13:35 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1719 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:13:36.146429 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-5bb0f3ed-6b0e-435c-b3cf-7627be4585b0 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:36.148736 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-5bb0f3ed-6b0e-435c-b3cf-7627be4585b0 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:36.162621 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5bb0f3ed-6b0e-435c-b3cf-7627be4585b0 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:36.169277 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5bb0f3ed-6b0e-435c-b3cf-7627be4585b0 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:36.172211 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5bb0f3ed-6b0e-435c-b3cf-7627be4585b0 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:36.173460 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5bb0f3ed-6b0e-435c-b3cf-7627be4585b0 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:36.231472 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-50adf4bd-05da-4d32-85c8-130ac1bae3ca tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:36.232678 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-50adf4bd-05da-4d32-85c8-130ac1bae3ca tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: 8f90be07-f969-4dc7-b8ab-a5a41f850645] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:36.259154 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-50adf4bd-05da-4d32-85c8-130ac1bae3ca tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:36.259619 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-50adf4bd-05da-4d32-85c8-130ac1bae3ca tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:36.260539 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-50adf4bd-05da-4d32-85c8-130ac1bae3ca tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:36.260976 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-50adf4bd-05da-4d32-85c8-130ac1bae3ca tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:36.506894 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-50adf4bd-05da-4d32-85c8-130ac1bae3ca tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:36.519514 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-50adf4bd-05da-4d32-85c8-130ac1bae3ca tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/8f90be07-f969-4dc7-b8ab-a5a41f850645" status: 200 len: 1507 microversion: 2.1 time: 0.295993 Jun 17 15:13:36.520800 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 168/329] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:13:36 2022] GET /compute/v2.1/servers/8f90be07-f969-4dc7-b8ab-a5a41f850645 => generated 1507 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:13:36.551822 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-5bb0f3ed-6b0e-435c-b3cf-7627be4585b0 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:36.560111 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-5bb0f3ed-6b0e-435c-b3cf-7627be4585b0 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1358 microversion: 2.1 time: 0.424391 Jun 17 15:13:36.571952 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 162/330] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:13:36 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1358 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:13:36.593464 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-dfebc9ed-8700-46a4-b856-98d54f950deb tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:36.594302 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-dfebc9ed-8700-46a4-b856-98d54f950deb tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:36.610457 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-dfebc9ed-8700-46a4-b856-98d54f950deb tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:36.616060 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-dfebc9ed-8700-46a4-b856-98d54f950deb tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:36.617646 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-dfebc9ed-8700-46a4-b856-98d54f950deb tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:36.618345 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-dfebc9ed-8700-46a4-b856-98d54f950deb tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:36.866090 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-dfebc9ed-8700-46a4-b856-98d54f950deb tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:36.875204 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-dfebc9ed-8700-46a4-b856-98d54f950deb tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:36.878381 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-dfebc9ed-8700-46a4-b856-98d54f950deb tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:36.880071 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-dfebc9ed-8700-46a4-b856-98d54f950deb tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1719 microversion: 2.20 time: 0.308579 Jun 17 15:13:36.892593 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 169/331] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:13:36 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1719 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 15:13:37.539594 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-cb4cb057-5842-4a97-a908-fd3305f72b44 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:37.541435 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-cb4cb057-5842-4a97-a908-fd3305f72b44 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: 8f90be07-f969-4dc7-b8ab-a5a41f850645] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:37.560563 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cb4cb057-5842-4a97-a908-fd3305f72b44 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:37.561641 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cb4cb057-5842-4a97-a908-fd3305f72b44 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:37.564672 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cb4cb057-5842-4a97-a908-fd3305f72b44 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:37.565333 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cb4cb057-5842-4a97-a908-fd3305f72b44 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:37.582364 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-7d01e5b2-608d-4f48-b0d3-a8d53cd8aca5 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:37.583739 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-7d01e5b2-608d-4f48-b0d3-a8d53cd8aca5 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:37.592793 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7d01e5b2-608d-4f48-b0d3-a8d53cd8aca5 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:37.593245 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7d01e5b2-608d-4f48-b0d3-a8d53cd8aca5 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:37.594681 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7d01e5b2-608d-4f48-b0d3-a8d53cd8aca5 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:37.595156 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7d01e5b2-608d-4f48-b0d3-a8d53cd8aca5 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:37.785070 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-7d01e5b2-608d-4f48-b0d3-a8d53cd8aca5 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:37.797466 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-7d01e5b2-608d-4f48-b0d3-a8d53cd8aca5 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1358 microversion: 2.1 time: 0.222177 Jun 17 15:13:37.798711 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 170/332] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:13:37 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1358 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:13:37.901049 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-10fe41c9-fbd7-42a6-9676-6987e5f79fce tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:37.902037 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-10fe41c9-fbd7-42a6-9676-6987e5f79fce tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:37.913101 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-10fe41c9-fbd7-42a6-9676-6987e5f79fce tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:37.916429 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-10fe41c9-fbd7-42a6-9676-6987e5f79fce tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:37.917676 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-10fe41c9-fbd7-42a6-9676-6987e5f79fce tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:37.918328 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-10fe41c9-fbd7-42a6-9676-6987e5f79fce tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:37.920680 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-cb4cb057-5842-4a97-a908-fd3305f72b44 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:37.940670 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-cb4cb057-5842-4a97-a908-fd3305f72b44 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/8f90be07-f969-4dc7-b8ab-a5a41f850645" status: 200 len: 1507 microversion: 2.1 time: 0.405121 Jun 17 15:13:37.943980 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 163/333] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:13:37 2022] GET /compute/v2.1/servers/8f90be07-f969-4dc7-b8ab-a5a41f850645 => generated 1507 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:13:38.132911 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-9e75054d-bcc3-474a-a4e0-e8f6b79e0870 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-263837681", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1574553842", "security_groups": [{"name": "tempest-secgroup-smoke-1442508771"}], "networks": [{"uuid": "748e4452-725f-4863-8be8-0a086386d061"}], "block_device_mapping_v2": [{"uuid": "77a2c07f-a473-4089-88d3-4a3289042ef4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:13:38.460130 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.network.neutron [None req-9e75054d-bcc3-474a-a4e0-e8f6b79e0870 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] validate_networks() for [('748e4452-725f-4863-8be8-0a086386d061', None, None, None, None, None)] {{(pid=117649) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 15:13:38.501610 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-10fe41c9-fbd7-42a6-9676-6987e5f79fce tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:38.524157 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-10fe41c9-fbd7-42a6-9676-6987e5f79fce tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:38.530675 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-10fe41c9-fbd7-42a6-9676-6987e5f79fce tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:38.539180 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-10fe41c9-fbd7-42a6-9676-6987e5f79fce tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1719 microversion: 2.20 time: 0.644080 Jun 17 15:13:38.544252 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 171/334] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:13:37 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1719 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:13:38.816037 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-69b2f889-e44b-4037-8736-4e2038dd257c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:38.817394 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-69b2f889-e44b-4037-8736-4e2038dd257c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:38.838261 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-69b2f889-e44b-4037-8736-4e2038dd257c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:38.838991 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-69b2f889-e44b-4037-8736-4e2038dd257c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:38.840565 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-69b2f889-e44b-4037-8736-4e2038dd257c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:38.841010 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-69b2f889-e44b-4037-8736-4e2038dd257c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:39.168140 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:13:39.227757 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-69b2f889-e44b-4037-8736-4e2038dd257c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:39.236357 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-69b2f889-e44b-4037-8736-4e2038dd257c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1358 microversion: 2.1 time: 0.424536 Jun 17 15:13:39.237214 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 172/335] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:13:38 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1358 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:13:39.243267 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-ed6b69f0-2215-4652-b8b7-8258cc753310 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:39.243908 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-ed6b69f0-2215-4652-b8b7-8258cc753310 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: 8f90be07-f969-4dc7-b8ab-a5a41f850645] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:39.250919 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_api:SELECT=92 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:13:39.253540 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ed6b69f0-2215-4652-b8b7-8258cc753310 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:39.254449 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ed6b69f0-2215-4652-b8b7-8258cc753310 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:39.256297 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ed6b69f0-2215-4652-b8b7-8258cc753310 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:39.256981 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ed6b69f0-2215-4652-b8b7-8258cc753310 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:39.605751 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-ed6b69f0-2215-4652-b8b7-8258cc753310 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:39.618131 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-ed6b69f0-2215-4652-b8b7-8258cc753310 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/8f90be07-f969-4dc7-b8ab-a5a41f850645" status: 200 len: 1513 microversion: 2.1 time: 0.379401 Jun 17 15:13:39.620409 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 173/336] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:13:39 2022] GET /compute/v2.1/servers/8f90be07-f969-4dc7-b8ab-a5a41f850645 => generated 1513 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:13:39.641934 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-cd6e7f2b-16ab-413d-a4f7-4f63a1501afa tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:39.642553 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-cd6e7f2b-16ab-413d-a4f7-4f63a1501afa tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:39.655461 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cd6e7f2b-16ab-413d-a4f7-4f63a1501afa tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:39.655934 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cd6e7f2b-16ab-413d-a4f7-4f63a1501afa tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:39.656775 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cd6e7f2b-16ab-413d-a4f7-4f63a1501afa tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:39.657213 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cd6e7f2b-16ab-413d-a4f7-4f63a1501afa tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:39.673020 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-9e75054d-bcc3-474a-a4e0-e8f6b79e0870 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Flavor limits 0:0:0 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 15:13:39.674211 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-9e75054d-bcc3-474a-a4e0-e8f6b79e0870 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Image limits 0:0:0 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 15:13:39.674993 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-9e75054d-bcc3-474a-a4e0-e8f6b79e0870 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Flavor pref 0:0:0 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 15:13:39.675740 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-9e75054d-bcc3-474a-a4e0-e8f6b79e0870 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Image pref 0:0:0 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 15:13:39.676401 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-9e75054d-bcc3-474a-a4e0-e8f6b79e0870 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 15:13:39.689247 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9e75054d-bcc3-474a-a4e0-e8f6b79e0870 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:39.690044 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9e75054d-bcc3-474a-a4e0-e8f6b79e0870 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:39.691166 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9e75054d-bcc3-474a-a4e0-e8f6b79e0870 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:39.691836 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9e75054d-bcc3-474a-a4e0-e8f6b79e0870 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:39.715457 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.quota [None req-9e75054d-bcc3-474a-a4e0-e8f6b79e0870 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Getting quotas for project 8e2a6034ec6b445cbe590f51bf4e419f. Resources: {'cores', 'ram', 'instances'} {{(pid=117649) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 15:13:39.721444 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.quota [None req-9e75054d-bcc3-474a-a4e0-e8f6b79e0870 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Getting quotas for user 717db70ce2734d169aee71912f18ba8a and project 8e2a6034ec6b445cbe590f51bf4e419f. Resources: {'cores', 'ram', 'instances'} {{(pid=117649) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 15:13:39.803643 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-9e75054d-bcc3-474a-a4e0-e8f6b79e0870 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Going to run 1 instances... {{(pid=117649) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 15:13:39.806197 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-9e75054d-bcc3-474a-a4e0-e8f6b79e0870 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='77a2c07f-a473-4089-88d3-4a3289042ef4',volume_size=None,volume_type=None)] {{(pid=117649) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 15:13:40.103644 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-9e75054d-bcc3-474a-a4e0-e8f6b79e0870 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.978153 Jun 17 15:13:40.109452 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 164/337] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Jun 17 15:13:38 2022] POST /compute/v2.1/servers => generated 406 bytes in 1985 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 15:13:40.123726 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-fc6dfcb4-317d-4067-8644-1b5bef4f3aa7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:40.126419 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-fc6dfcb4-317d-4067-8644-1b5bef4f3aa7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:40.201494 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-cd6e7f2b-16ab-413d-a4f7-4f63a1501afa tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:40.214071 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-cd6e7f2b-16ab-413d-a4f7-4f63a1501afa tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:40.215907 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-cd6e7f2b-16ab-413d-a4f7-4f63a1501afa tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:40.240243 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-cd6e7f2b-16ab-413d-a4f7-4f63a1501afa tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1719 microversion: 2.20 time: 0.618413 Jun 17 15:13:40.252732 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 174/338] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:13:39 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1719 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:13:40.265921 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-fc6dfcb4-317d-4067-8644-1b5bef4f3aa7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:40.279003 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-fc6dfcb4-317d-4067-8644-1b5bef4f3aa7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1088 microversion: 2.1 time: 0.166168 Jun 17 15:13:40.279271 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [req-1b83dd08-99e0-4614-81f9-d5cf436d6a82 req-71ace115-1b2a-480f-8983-285e51a4feb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91408900-da01-4985-b392-111577935284", "name": "network-vif-plugged", "status": "completed", "tag": "06c1246f-1c4b-48df-98b1-2028fa5b27e5"}]} {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:13:40.281994 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 165/339] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:13:40 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1088 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:13:40.287250 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-931fd3f5-fbd6-4df8-ac2f-5452113c4c69 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:40.288266 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-931fd3f5-fbd6-4df8-ac2f-5452113c4c69 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:40.299107 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-931fd3f5-fbd6-4df8-ac2f-5452113c4c69 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:40.299943 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-931fd3f5-fbd6-4df8-ac2f-5452113c4c69 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:40.302921 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-931fd3f5-fbd6-4df8-ac2f-5452113c4c69 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:40.305966 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-931fd3f5-fbd6-4df8-ac2f-5452113c4c69 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:40.308764 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [req-1b83dd08-99e0-4614-81f9-d5cf436d6a82 req-71ace115-1b2a-480f-8983-285e51a4feb4 service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:40.309223 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [req-1b83dd08-99e0-4614-81f9-d5cf436d6a82 req-71ace115-1b2a-480f-8983-285e51a4feb4 service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:40.348786 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.compute.server_external_events [req-1b83dd08-99e0-4614-81f9-d5cf436d6a82 req-71ace115-1b2a-480f-8983-285e51a4feb4 service nova] Creating event network-vif-plugged:06c1246f-1c4b-48df-98b1-2028fa5b27e5 for instance 91408900-da01-4985-b392-111577935284 on hv-cinder-82549 Jun 17 15:13:40.374095 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [req-1b83dd08-99e0-4614-81f9-d5cf436d6a82 req-71ace115-1b2a-480f-8983-285e51a4feb4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119505 Jun 17 15:13:40.387807 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 175/340] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 15:13:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:13:40.597677 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-931fd3f5-fbd6-4df8-ac2f-5452113c4c69 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:40.625588 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-931fd3f5-fbd6-4df8-ac2f-5452113c4c69 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1358 microversion: 2.1 time: 0.339942 Jun 17 15:13:40.626142 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 166/341] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:13:40 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1358 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:13:41.267492 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-7b526273-cf40-456a-a727-476cc0db2e37 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:41.268821 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-7b526273-cf40-456a-a727-476cc0db2e37 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:41.275778 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7b526273-cf40-456a-a727-476cc0db2e37 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:41.284756 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7b526273-cf40-456a-a727-476cc0db2e37 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:41.288665 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7b526273-cf40-456a-a727-476cc0db2e37 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:41.288665 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7b526273-cf40-456a-a727-476cc0db2e37 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:41.299233 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-4cad9f61-7872-4114-a895-d82ae6282b0b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:41.299748 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-4cad9f61-7872-4114-a895-d82ae6282b0b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:41.309795 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4cad9f61-7872-4114-a895-d82ae6282b0b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:41.310239 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4cad9f61-7872-4114-a895-d82ae6282b0b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:41.311009 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4cad9f61-7872-4114-a895-d82ae6282b0b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:41.311436 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4cad9f61-7872-4114-a895-d82ae6282b0b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:41.413986 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-4cad9f61-7872-4114-a895-d82ae6282b0b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:41.429504 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-4cad9f61-7872-4114-a895-d82ae6282b0b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1138 microversion: 2.1 time: 0.134481 Jun 17 15:13:41.430716 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 167/342] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:13:41 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1138 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:13:41.597637 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-7b526273-cf40-456a-a727-476cc0db2e37 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:41.601923 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=100 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:13:41.612072 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-7b526273-cf40-456a-a727-476cc0db2e37 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:41.614588 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-7b526273-cf40-456a-a727-476cc0db2e37 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:41.616204 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-7b526273-cf40-456a-a727-476cc0db2e37 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1719 microversion: 2.20 time: 0.353287 Jun 17 15:13:41.617182 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 176/343] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:13:41 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1719 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:13:41.646541 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-9ab49403-6e0e-4bfc-8f77-c0ae0ef0e864 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:41.647682 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-9ab49403-6e0e-4bfc-8f77-c0ae0ef0e864 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:41.655330 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9ab49403-6e0e-4bfc-8f77-c0ae0ef0e864 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:41.655771 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9ab49403-6e0e-4bfc-8f77-c0ae0ef0e864 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:41.656971 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9ab49403-6e0e-4bfc-8f77-c0ae0ef0e864 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:41.658141 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9ab49403-6e0e-4bfc-8f77-c0ae0ef0e864 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:41.845150 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-9ab49403-6e0e-4bfc-8f77-c0ae0ef0e864 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:41.855601 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-9ab49403-6e0e-4bfc-8f77-c0ae0ef0e864 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1358 microversion: 2.1 time: 0.216123 Jun 17 15:13:41.856270 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 168/344] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:13:41 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1358 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:13:42.028010 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-b80ad06d-7428-416f-9bdf-0fdf0e229597 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Action: 'create', calling method: .version_select at 0x7faf50d7be50>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-417419175", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHN3ouL6jotPtKuX80iQ0tZvdUi7Rvj/hizLFNp3yqV/+CYlO+2XzLfT5KWdNGWuQCmbpiX4V1pmaliqQVvzW+H6Iit5+fL5J7e0LqRJ9wA/7yP6NmmP46AgVCPyEd5lKQ=="}} {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:13:42.042474 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.quota [None req-b80ad06d-7428-416f-9bdf-0fdf0e229597 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Getting quotas for project 6298c1910e1a488983d5399d7952a5cf. Resources: {'key_pairs'} {{(pid=117650) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 15:13:42.047024 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.quota [None req-b80ad06d-7428-416f-9bdf-0fdf0e229597 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Getting quotas for user 4e3e797edb9a453d9142c3196a4f21bb and project 6298c1910e1a488983d5399d7952a5cf. Resources: {'key_pairs'} {{(pid=117650) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 15:13:42.073799 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-b80ad06d-7428-416f-9bdf-0fdf0e229597 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.247757 Jun 17 15:13:42.074521 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 177/345] 10.222.0.48 () {60 vars in 1158 bytes} [Fri Jun 17 15:13:41 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:13:42.446916 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-c3988937-549d-4ad5-a421-f74f95c05e20 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:42.447528 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-c3988937-549d-4ad5-a421-f74f95c05e20 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:42.464856 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c3988937-549d-4ad5-a421-f74f95c05e20 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:42.465565 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c3988937-549d-4ad5-a421-f74f95c05e20 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:42.466359 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c3988937-549d-4ad5-a421-f74f95c05e20 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:42.466827 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c3988937-549d-4ad5-a421-f74f95c05e20 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:42.554774 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [req-2a0a03f1-2b4b-47d3-befb-98df03f0426c req-c7416c8b-ca7d-4a14-8e15-a8574d88f734 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e97df352-5cee-41f7-ae51-f55cd9e85869", "name": "network-vif-unplugged", "status": "completed", "tag": "ff5c90be-6727-43d1-841f-760f94168fc6"}]} {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:13:42.593788 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [req-2a0a03f1-2b4b-47d3-befb-98df03f0426c req-c7416c8b-ca7d-4a14-8e15-a8574d88f734 service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:42.594549 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [req-2a0a03f1-2b4b-47d3-befb-98df03f0426c req-c7416c8b-ca7d-4a14-8e15-a8574d88f734 service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:42.617743 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.compute.server_external_events [req-2a0a03f1-2b4b-47d3-befb-98df03f0426c req-c7416c8b-ca7d-4a14-8e15-a8574d88f734 service nova] Creating event network-vif-unplugged:ff5c90be-6727-43d1-841f-760f94168fc6 for instance e97df352-5cee-41f7-ae51-f55cd9e85869 on hv-cinder-82549 Jun 17 15:13:42.623938 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [req-2a0a03f1-2b4b-47d3-befb-98df03f0426c req-c7416c8b-ca7d-4a14-8e15-a8574d88f734 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.079627 Jun 17 15:13:42.625306 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 178/346] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 15:13:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:13:42.635550 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-94367d8d-c5bf-4fc4-982e-27c274bc3b3e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:42.636671 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-94367d8d-c5bf-4fc4-982e-27c274bc3b3e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:42.662620 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-94367d8d-c5bf-4fc4-982e-27c274bc3b3e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:42.665777 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-94367d8d-c5bf-4fc4-982e-27c274bc3b3e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:42.672282 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-94367d8d-c5bf-4fc4-982e-27c274bc3b3e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:42.673311 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-94367d8d-c5bf-4fc4-982e-27c274bc3b3e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:42.751814 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-c3988937-549d-4ad5-a421-f74f95c05e20 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:42.773625 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-c3988937-549d-4ad5-a421-f74f95c05e20 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1130 microversion: 2.1 time: 0.330450 Jun 17 15:13:42.775296 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 169/347] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:13:42 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1130 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:13:42.873063 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-010ca5c2-ba63-4d7b-b6bf-642d6662322e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:42.874028 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-010ca5c2-ba63-4d7b-b6bf-642d6662322e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:42.883813 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-010ca5c2-ba63-4d7b-b6bf-642d6662322e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:42.888043 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-010ca5c2-ba63-4d7b-b6bf-642d6662322e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:42.889115 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-010ca5c2-ba63-4d7b-b6bf-642d6662322e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:42.891937 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-010ca5c2-ba63-4d7b-b6bf-642d6662322e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:43.072189 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-94367d8d-c5bf-4fc4-982e-27c274bc3b3e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:43.087272 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-94367d8d-c5bf-4fc4-982e-27c274bc3b3e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:43.091316 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-94367d8d-c5bf-4fc4-982e-27c274bc3b3e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:43.094738 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-94367d8d-c5bf-4fc4-982e-27c274bc3b3e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1719 microversion: 2.20 time: 0.463997 Jun 17 15:13:43.111261 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 179/348] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:13:42 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1719 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 15:13:43.131829 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-010ca5c2-ba63-4d7b-b6bf-642d6662322e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:43.140164 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-010ca5c2-ba63-4d7b-b6bf-642d6662322e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1358 microversion: 2.1 time: 0.270729 Jun 17 15:13:43.140782 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 170/349] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:13:42 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1358 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:13:43.569918 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-97620638-62e7-49ea-88f3-650368bc6382 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Action: 'create', calling method: .version_select at 0x7faf50d7b670>, body: {"keypair": {"name": "tempest-keypair-840291724", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ3ItCLxQJ6KOw8A+56pAYKZd48MJV5jnQ9+SQXwpI4qeOSgiMKA3S55bT1WDmfbd6t5TsBoJEGOdJU8hKZzclGn22pD1ps78cCoDQswi0x09IBX48mMMYPfoNgLesD7Ug=="}} {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:13:43.603531 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.quota [None req-97620638-62e7-49ea-88f3-650368bc6382 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Getting quotas for project 50408ec18fa04036a0abb6236343e258. Resources: {'key_pairs'} {{(pid=117650) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 15:13:43.610079 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.quota [None req-97620638-62e7-49ea-88f3-650368bc6382 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Getting quotas for user 562485deaf214fa29eac132464ef93e3 and project 50408ec18fa04036a0abb6236343e258. Resources: {'key_pairs'} {{(pid=117650) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 15:13:43.645418 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-97620638-62e7-49ea-88f3-650368bc6382 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.084913 Jun 17 15:13:43.647066 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 180/350] 10.222.0.48 () {60 vars in 1158 bytes} [Fri Jun 17 15:13:43 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:13:43.792270 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-e78ef0f5-f46a-4375-8ac3-5541a093b8e5 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:43.794785 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-e78ef0f5-f46a-4375-8ac3-5541a093b8e5 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:43.812275 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e78ef0f5-f46a-4375-8ac3-5541a093b8e5 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:43.814346 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e78ef0f5-f46a-4375-8ac3-5541a093b8e5 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:43.815322 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e78ef0f5-f46a-4375-8ac3-5541a093b8e5 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:43.815844 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e78ef0f5-f46a-4375-8ac3-5541a093b8e5 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:43.929538 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-e78ef0f5-f46a-4375-8ac3-5541a093b8e5 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:43.947325 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-e78ef0f5-f46a-4375-8ac3-5541a093b8e5 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1194 microversion: 2.1 time: 0.159298 Jun 17 15:13:43.958035 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 171/351] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:13:43 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1194 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:13:44.117087 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-dac42e74-d663-4bbf-b4a9-31260b229641 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:44.118210 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-dac42e74-d663-4bbf-b4a9-31260b229641 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:44.136608 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-dac42e74-d663-4bbf-b4a9-31260b229641 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:44.137279 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-dac42e74-d663-4bbf-b4a9-31260b229641 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:44.138284 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-dac42e74-d663-4bbf-b4a9-31260b229641 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:44.138940 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-dac42e74-d663-4bbf-b4a9-31260b229641 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:44.225020 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-73146ebe-5ef1-4435-895b-f66985624845 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:44.225855 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-73146ebe-5ef1-4435-895b-f66985624845 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:44.250946 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-73146ebe-5ef1-4435-895b-f66985624845 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:44.258485 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-73146ebe-5ef1-4435-895b-f66985624845 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:44.265414 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-73146ebe-5ef1-4435-895b-f66985624845 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:44.272735 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-73146ebe-5ef1-4435-895b-f66985624845 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:44.473012 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-73146ebe-5ef1-4435-895b-f66985624845 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:44.484554 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-73146ebe-5ef1-4435-895b-f66985624845 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1358 microversion: 2.1 time: 0.310480 Jun 17 15:13:44.485142 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 172/352] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:13:44 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1358 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:13:44.814626 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-dac42e74-d663-4bbf-b4a9-31260b229641 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:44.827201 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-dac42e74-d663-4bbf-b4a9-31260b229641 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:44.833073 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-dac42e74-d663-4bbf-b4a9-31260b229641 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:44.837878 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-dac42e74-d663-4bbf-b4a9-31260b229641 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1719 microversion: 2.20 time: 0.725481 Jun 17 15:13:44.870352 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 181/353] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:13:44 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1719 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 15:13:44.966365 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-7c3aeaed-0194-4462-9d70-7be173916e81 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:44.967745 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-7c3aeaed-0194-4462-9d70-7be173916e81 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:44.976169 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7c3aeaed-0194-4462-9d70-7be173916e81 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:44.977088 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7c3aeaed-0194-4462-9d70-7be173916e81 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:44.978056 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7c3aeaed-0194-4462-9d70-7be173916e81 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:44.978800 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7c3aeaed-0194-4462-9d70-7be173916e81 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:45.073036 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-7c3aeaed-0194-4462-9d70-7be173916e81 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:45.085729 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-7c3aeaed-0194-4462-9d70-7be173916e81 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1194 microversion: 2.1 time: 0.121732 Jun 17 15:13:45.087398 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 173/354] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:13:44 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1194 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:13:45.502634 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-f537efa3-420c-4f44-bdda-1d6d2ec4bcb9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:45.503255 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-f537efa3-420c-4f44-bdda-1d6d2ec4bcb9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:45.525525 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f537efa3-420c-4f44-bdda-1d6d2ec4bcb9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:45.526369 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f537efa3-420c-4f44-bdda-1d6d2ec4bcb9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:45.530477 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f537efa3-420c-4f44-bdda-1d6d2ec4bcb9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:45.531614 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f537efa3-420c-4f44-bdda-1d6d2ec4bcb9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:45.895002 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-5445d182-73d0-4649-922b-693533a1308f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:45.896616 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-5445d182-73d0-4649-922b-693533a1308f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:45.924887 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5445d182-73d0-4649-922b-693533a1308f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:45.925452 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5445d182-73d0-4649-922b-693533a1308f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:45.932602 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5445d182-73d0-4649-922b-693533a1308f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:45.933192 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5445d182-73d0-4649-922b-693533a1308f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:45.945792 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-f537efa3-420c-4f44-bdda-1d6d2ec4bcb9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:45.974708 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-f537efa3-420c-4f44-bdda-1d6d2ec4bcb9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1358 microversion: 2.1 time: 0.470512 Jun 17 15:13:45.979722 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 182/355] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:13:45 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1358 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:13:46.108892 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-c464731a-2b8d-41b5-87a3-c15ff4ca2e3c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:46.109914 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-c464731a-2b8d-41b5-87a3-c15ff4ca2e3c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:46.136985 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c464731a-2b8d-41b5-87a3-c15ff4ca2e3c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:46.137855 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c464731a-2b8d-41b5-87a3-c15ff4ca2e3c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:46.141354 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c464731a-2b8d-41b5-87a3-c15ff4ca2e3c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:46.142138 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c464731a-2b8d-41b5-87a3-c15ff4ca2e3c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:46.287436 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-c464731a-2b8d-41b5-87a3-c15ff4ca2e3c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:46.297652 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-c464731a-2b8d-41b5-87a3-c15ff4ca2e3c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1204 microversion: 2.1 time: 0.197208 Jun 17 15:13:46.301108 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 183/356] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:13:46 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1204 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:13:46.340534 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-5445d182-73d0-4649-922b-693533a1308f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:46.350039 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-5445d182-73d0-4649-922b-693533a1308f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:46.355298 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-5445d182-73d0-4649-922b-693533a1308f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:46.359477 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-5445d182-73d0-4649-922b-693533a1308f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1719 microversion: 2.20 time: 0.469423 Jun 17 15:13:46.363190 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 174/357] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:13:45 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1719 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:13:46.998927 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-a7627c22-e4f3-4364-8f4b-f46a1c7206d9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:47.000021 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-a7627c22-e4f3-4364-8f4b-f46a1c7206d9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:47.026009 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a7627c22-e4f3-4364-8f4b-f46a1c7206d9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:47.026774 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a7627c22-e4f3-4364-8f4b-f46a1c7206d9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:47.032144 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a7627c22-e4f3-4364-8f4b-f46a1c7206d9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:47.033390 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a7627c22-e4f3-4364-8f4b-f46a1c7206d9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:47.334416 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-4af5788d-4bce-45c1-ab75-7b216e19941d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:47.341769 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-4af5788d-4bce-45c1-ab75-7b216e19941d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:47.396192 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4af5788d-4bce-45c1-ab75-7b216e19941d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:47.401089 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4af5788d-4bce-45c1-ab75-7b216e19941d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:47.403254 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4af5788d-4bce-45c1-ab75-7b216e19941d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:47.404239 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4af5788d-4bce-45c1-ab75-7b216e19941d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:47.494488 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-a7627c22-e4f3-4364-8f4b-f46a1c7206d9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:47.508240 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-a7627c22-e4f3-4364-8f4b-f46a1c7206d9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1549 microversion: 2.1 time: 0.518390 Jun 17 15:13:47.508877 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 184/358] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:13:46 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1549 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:13:47.513900 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-4ee31f7e-0c9f-4b0a-9786-12961738dbd6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:47.518985 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-4ee31f7e-0c9f-4b0a-9786-12961738dbd6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:47.530841 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4ee31f7e-0c9f-4b0a-9786-12961738dbd6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:47.531886 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4ee31f7e-0c9f-4b0a-9786-12961738dbd6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:47.533300 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4ee31f7e-0c9f-4b0a-9786-12961738dbd6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:47.534005 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4ee31f7e-0c9f-4b0a-9786-12961738dbd6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:47.800787 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-4ee31f7e-0c9f-4b0a-9786-12961738dbd6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:47.815130 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-4ee31f7e-0c9f-4b0a-9786-12961738dbd6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:47.818439 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-4ee31f7e-0c9f-4b0a-9786-12961738dbd6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:47.820967 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-4ee31f7e-0c9f-4b0a-9786-12961738dbd6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1662 microversion: 2.20 time: 0.310445 Jun 17 15:13:47.822614 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 185/359] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:13:47 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1662 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:13:47.831341 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-e5c1753e-34ee-4bb9-9128-4799eb4edf60 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:47.833000 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-e5c1753e-34ee-4bb9-9128-4799eb4edf60 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:47.845945 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e5c1753e-34ee-4bb9-9128-4799eb4edf60 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:47.848171 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-4af5788d-4bce-45c1-ab75-7b216e19941d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:47.848519 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e5c1753e-34ee-4bb9-9128-4799eb4edf60 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:47.850727 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e5c1753e-34ee-4bb9-9128-4799eb4edf60 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:47.851695 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e5c1753e-34ee-4bb9-9128-4799eb4edf60 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:47.860912 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-4af5788d-4bce-45c1-ab75-7b216e19941d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1204 microversion: 2.1 time: 0.544421 Jun 17 15:13:47.864404 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 175/360] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:13:47 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1204 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:13:47.884372 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-7c7c5475-8246-49cc-92f3-c09cce400eb5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "08b9c4b5-f0db-4bcb-a513-aa77c245a60a"}} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:13:47.886338 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-7c7c5475-8246-49cc-92f3-c09cce400eb5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:47.905020 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7c7c5475-8246-49cc-92f3-c09cce400eb5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:47.906078 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7c7c5475-8246-49cc-92f3-c09cce400eb5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:47.912200 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7c7c5475-8246-49cc-92f3-c09cce400eb5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:47.912750 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7c7c5475-8246-49cc-92f3-c09cce400eb5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:48.343037 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-e5c1753e-34ee-4bb9-9128-4799eb4edf60 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:48.405416 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-e5c1753e-34ee-4bb9-9128-4799eb4edf60 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1549 microversion: 2.1 time: 0.555025 Jun 17 15:13:48.407972 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 186/361] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:13:47 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1549 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:13:48.426574 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-e612d3bf-ed82-4c20-8e63-1b2926dab68d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:48.431810 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-e612d3bf-ed82-4c20-8e63-1b2926dab68d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:48.433681 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-e612d3bf-ed82-4c20-8e63-1b2926dab68d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Searching by: {'deleted': False, 'project_id': '77979ae6c7c440fab7bbce5fbe452210'} {{(pid=117650) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 17 15:13:48.443226 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e612d3bf-ed82-4c20-8e63-1b2926dab68d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:48.443930 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e612d3bf-ed82-4c20-8e63-1b2926dab68d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:48.445287 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e612d3bf-ed82-4c20-8e63-1b2926dab68d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:48.445929 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e612d3bf-ed82-4c20-8e63-1b2926dab68d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:48.700262 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:13:48.850680 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.multi_cell_list [None req-e612d3bf-ed82-4c20-8e63-1b2926dab68d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117650) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 17 15:13:49.239794 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-7c7c5475-8246-49cc-92f3-c09cce400eb5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "POST /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.370668 Jun 17 15:13:49.263920 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 176/362] 10.222.0.48 () {62 vars in 1363 bytes} [Fri Jun 17 15:13:47 2022] POST /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 188 bytes in 1398 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:13:49.298026 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-04e3730a-78e3-48a7-89b7-19c600893fc6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-115786275", "imageRef": "8c105ca4-6fe3-4e70-af71-b03c64fe1efe", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3a4e37db-e344-461b-88a0-74065462698f"}], "security_groups": [{"name": "tempest-securitygroup--1381731003"}], "key_name": "tempest-keypair-840291724", "user_data": "}} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:13:49.461081 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-e612d3bf-ed82-4c20-8e63-1b2926dab68d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 1.018773 Jun 17 15:13:49.471938 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 187/363] 10.222.0.48 () {58 vars in 1124 bytes} [Fri Jun 17 15:13:48 2022] GET /compute/v2.1/servers => generated 342 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:13:49.483442 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-d2524bb5-a05e-412c-83f7-6b20c7952ab7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:49.483991 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-d2524bb5-a05e-412c-83f7-6b20c7952ab7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:49.503020 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d2524bb5-a05e-412c-83f7-6b20c7952ab7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:49.503472 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d2524bb5-a05e-412c-83f7-6b20c7952ab7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:49.504260 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d2524bb5-a05e-412c-83f7-6b20c7952ab7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:49.511809 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d2524bb5-a05e-412c-83f7-6b20c7952ab7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:49.706405 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell0:SELECT=2 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:13:49.972009 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-d2524bb5-a05e-412c-83f7-6b20c7952ab7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:49.980770 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-d2524bb5-a05e-412c-83f7-6b20c7952ab7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1260 microversion: 2.1 time: 0.507596 Jun 17 15:13:49.984944 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 188/364] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:13:49 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1260 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:13:49.994232 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-69b6eea3-efa6-4636-ac60-5bb686d7ab4d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:49.995417 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-69b6eea3-efa6-4636-ac60-5bb686d7ab4d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:50.024365 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-69b6eea3-efa6-4636-ac60-5bb686d7ab4d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:50.024515 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-69b6eea3-efa6-4636-ac60-5bb686d7ab4d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:50.029121 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-69b6eea3-efa6-4636-ac60-5bb686d7ab4d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:50.029957 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-69b6eea3-efa6-4636-ac60-5bb686d7ab4d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:50.279110 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell0:SELECT=8 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:13:50.407335 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-69b6eea3-efa6-4636-ac60-5bb686d7ab4d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:50.419770 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-69b6eea3-efa6-4636-ac60-5bb686d7ab4d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1549 microversion: 2.1 time: 0.433178 Jun 17 15:13:50.422103 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 189/365] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:13:49 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1549 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:13:50.429466 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-40688887-7509-48f8-9bf4-9a0e1b4eb123 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:13:50.431036 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-40688887-7509-48f8-9bf4-9a0e1b4eb123 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:50.438524 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-40688887-7509-48f8-9bf4-9a0e1b4eb123 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:50.439310 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-40688887-7509-48f8-9bf4-9a0e1b4eb123 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:50.440401 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-40688887-7509-48f8-9bf4-9a0e1b4eb123 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:50.441049 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-40688887-7509-48f8-9bf4-9a0e1b4eb123 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:50.703582 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-40688887-7509-48f8-9bf4-9a0e1b4eb123 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "POST /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/action" status: 202 len: 0 microversion: 2.20 time: 0.279649 Jun 17 15:13:50.708123 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 190/366] 10.222.0.48 () {62 vars in 1318 bytes} [Fri Jun 17 15:13:50 2022] POST /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/action => generated 0 bytes in 285 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 17 15:13:50.714007 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [req-f09c93be-a1fc-4478-9320-14117f1a84a0 req-38e07dc9-4140-41c7-bfe0-6ba64275b1b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b30f80f-8b8c-4c07-8653-4f9fd128ce77", "tag": "8bfd0e33-2b14-4398-b80c-8da478f93229"}]} {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:13:50.725648 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [req-f09c93be-a1fc-4478-9320-14117f1a84a0 req-38e07dc9-4140-41c7-bfe0-6ba64275b1b7 service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:50.726278 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [req-f09c93be-a1fc-4478-9320-14117f1a84a0 req-38e07dc9-4140-41c7-bfe0-6ba64275b1b7 service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:50.742344 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.compute.server_external_events [req-f09c93be-a1fc-4478-9320-14117f1a84a0 req-38e07dc9-4140-41c7-bfe0-6ba64275b1b7 service nova] Creating event network-changed:8bfd0e33-2b14-4398-b80c-8da478f93229 for instance 5b30f80f-8b8c-4c07-8653-4f9fd128ce77 on hv-cinder-82549 Jun 17 15:13:50.752120 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [req-f09c93be-a1fc-4478-9320-14117f1a84a0 req-38e07dc9-4140-41c7-bfe0-6ba64275b1b7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038986 Jun 17 15:13:50.753118 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 191/367] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 15:13:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:13:50.759523 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-340c5589-5565-4f42-bd6a-52793d0ebfbc tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:50.760682 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-340c5589-5565-4f42-bd6a-52793d0ebfbc tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:50.767821 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-340c5589-5565-4f42-bd6a-52793d0ebfbc tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:50.768551 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-340c5589-5565-4f42-bd6a-52793d0ebfbc tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:50.769841 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-340c5589-5565-4f42-bd6a-52793d0ebfbc tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:50.770963 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-340c5589-5565-4f42-bd6a-52793d0ebfbc tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:51.084147 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-340c5589-5565-4f42-bd6a-52793d0ebfbc tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:51.132182 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-340c5589-5565-4f42-bd6a-52793d0ebfbc tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:51.173364 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-340c5589-5565-4f42-bd6a-52793d0ebfbc tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:51.187920 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-340c5589-5565-4f42-bd6a-52793d0ebfbc tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1748 microversion: 2.20 time: 0.428418 Jun 17 15:13:51.211428 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 192/368] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:13:50 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1748 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:13:51.259232 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-f66b9b7c-0225-405a-9542-91c3f964468f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:51.263222 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-f66b9b7c-0225-405a-9542-91c3f964468f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:51.293649 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f66b9b7c-0225-405a-9542-91c3f964468f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:51.294909 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f66b9b7c-0225-405a-9542-91c3f964468f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:51.297137 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f66b9b7c-0225-405a-9542-91c3f964468f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:51.298302 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f66b9b7c-0225-405a-9542-91c3f964468f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:51.717055 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-f66b9b7c-0225-405a-9542-91c3f964468f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:51.733377 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-f66b9b7c-0225-405a-9542-91c3f964468f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1260 microversion: 2.1 time: 0.508721 Jun 17 15:13:51.743027 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 193/369] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:13:51 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1260 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:13:52.263587 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-26b446b7-fbc2-4089-b654-7e12f25b8489 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:52.265118 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-26b446b7-fbc2-4089-b654-7e12f25b8489 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:52.287279 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-26b446b7-fbc2-4089-b654-7e12f25b8489 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:52.288647 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-26b446b7-fbc2-4089-b654-7e12f25b8489 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:52.289559 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-26b446b7-fbc2-4089-b654-7e12f25b8489 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:52.289986 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-26b446b7-fbc2-4089-b654-7e12f25b8489 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:52.586501 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-26b446b7-fbc2-4089-b654-7e12f25b8489 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:52.600845 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-26b446b7-fbc2-4089-b654-7e12f25b8489 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:52.603240 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-26b446b7-fbc2-4089-b654-7e12f25b8489 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:52.604733 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-26b446b7-fbc2-4089-b654-7e12f25b8489 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1748 microversion: 2.20 time: 0.346240 Jun 17 15:13:52.606356 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 194/370] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:13:52 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1748 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:13:52.760226 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-52393354-3794-4b9e-b4b1-0504b261c509 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:52.765955 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-52393354-3794-4b9e-b4b1-0504b261c509 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:52.795081 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-52393354-3794-4b9e-b4b1-0504b261c509 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:52.795958 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-52393354-3794-4b9e-b4b1-0504b261c509 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:52.800684 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-52393354-3794-4b9e-b4b1-0504b261c509 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:52.801851 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-52393354-3794-4b9e-b4b1-0504b261c509 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:52.853990 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:13:53.048944 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-52393354-3794-4b9e-b4b1-0504b261c509 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:53.059525 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-52393354-3794-4b9e-b4b1-0504b261c509 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1260 microversion: 2.1 time: 0.311532 Jun 17 15:13:53.065067 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 195/371] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:13:52 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1260 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:13:53.077188 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-19705f84-81a3-4971-baad-71ca33f42fa7 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cde658e2-871f-4bf2-8afb-0912666bb314"}} {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:13:53.078619 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-19705f84-81a3-4971-baad-71ca33f42fa7 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:53.092654 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-19705f84-81a3-4971-baad-71ca33f42fa7 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:53.093556 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-19705f84-81a3-4971-baad-71ca33f42fa7 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:53.099020 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-19705f84-81a3-4971-baad-71ca33f42fa7 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:53.100086 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-19705f84-81a3-4971-baad-71ca33f42fa7 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:53.553439 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-19705f84-81a3-4971-baad-71ca33f42fa7 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "POST /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.486978 Jun 17 15:13:53.561211 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 196/372] 10.222.0.48 () {60 vars in 1322 bytes} [Fri Jun 17 15:13:53 2022] POST /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 194 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:13:53.623465 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell0:SELECT=8 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:13:53.630734 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-437542d3-e9b0-4ce5-bbbb-041e16ee4f87 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:53.632258 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-437542d3-e9b0-4ce5-bbbb-041e16ee4f87 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:53.662522 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-437542d3-e9b0-4ce5-bbbb-041e16ee4f87 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:53.662999 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-437542d3-e9b0-4ce5-bbbb-041e16ee4f87 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:53.664041 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-437542d3-e9b0-4ce5-bbbb-041e16ee4f87 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:53.665119 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-437542d3-e9b0-4ce5-bbbb-041e16ee4f87 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:53.935005 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-437542d3-e9b0-4ce5-bbbb-041e16ee4f87 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:53.946310 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-437542d3-e9b0-4ce5-bbbb-041e16ee4f87 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:53.948778 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-437542d3-e9b0-4ce5-bbbb-041e16ee4f87 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:53.950382 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-437542d3-e9b0-4ce5-bbbb-041e16ee4f87 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1748 microversion: 2.20 time: 0.328736 Jun 17 15:13:53.951046 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 197/373] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:13:53 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1748 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:13:54.081505 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-ece500a0-1166-4c57-84bb-8c199e20c02f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:54.082313 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-ece500a0-1166-4c57-84bb-8c199e20c02f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:54.090858 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ece500a0-1166-4c57-84bb-8c199e20c02f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:54.091568 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ece500a0-1166-4c57-84bb-8c199e20c02f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:54.092570 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ece500a0-1166-4c57-84bb-8c199e20c02f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:54.093175 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ece500a0-1166-4c57-84bb-8c199e20c02f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:54.248978 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-ece500a0-1166-4c57-84bb-8c199e20c02f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:54.257515 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-ece500a0-1166-4c57-84bb-8c199e20c02f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1260 microversion: 2.1 time: 0.180003 Jun 17 15:13:54.258108 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 198/374] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:13:54 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1260 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:13:54.970869 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-46562a50-c1ed-4e93-a45c-0fde0b68ecb3 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:54.971665 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-46562a50-c1ed-4e93-a45c-0fde0b68ecb3 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:54.979650 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-46562a50-c1ed-4e93-a45c-0fde0b68ecb3 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:54.980192 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-46562a50-c1ed-4e93-a45c-0fde0b68ecb3 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:54.981027 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-46562a50-c1ed-4e93-a45c-0fde0b68ecb3 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:54.981529 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-46562a50-c1ed-4e93-a45c-0fde0b68ecb3 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:55.146834 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-46562a50-c1ed-4e93-a45c-0fde0b68ecb3 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:55.156539 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-46562a50-c1ed-4e93-a45c-0fde0b68ecb3 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:55.158379 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-46562a50-c1ed-4e93-a45c-0fde0b68ecb3 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:55.159590 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-46562a50-c1ed-4e93-a45c-0fde0b68ecb3 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1748 microversion: 2.20 time: 0.193334 Jun 17 15:13:55.160290 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 199/375] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:13:54 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1748 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:13:55.274991 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-9bea2ad4-af28-4c34-b9f0-a9965a70bf80 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:55.275656 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-9bea2ad4-af28-4c34-b9f0-a9965a70bf80 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:55.282929 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9bea2ad4-af28-4c34-b9f0-a9965a70bf80 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:55.283848 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9bea2ad4-af28-4c34-b9f0-a9965a70bf80 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:55.284836 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9bea2ad4-af28-4c34-b9f0-a9965a70bf80 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:55.285690 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9bea2ad4-af28-4c34-b9f0-a9965a70bf80 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:55.450276 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-9bea2ad4-af28-4c34-b9f0-a9965a70bf80 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:55.458110 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-9bea2ad4-af28-4c34-b9f0-a9965a70bf80 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1260 microversion: 2.1 time: 0.187644 Jun 17 15:13:55.458714 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 200/376] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:13:55 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1260 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:13:56.179725 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-6a4a29a4-4aca-419a-aa17-cfc9f2cb1868 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:56.180646 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-6a4a29a4-4aca-419a-aa17-cfc9f2cb1868 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:56.188102 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6a4a29a4-4aca-419a-aa17-cfc9f2cb1868 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:56.188571 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6a4a29a4-4aca-419a-aa17-cfc9f2cb1868 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:56.189375 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6a4a29a4-4aca-419a-aa17-cfc9f2cb1868 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:56.189856 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6a4a29a4-4aca-419a-aa17-cfc9f2cb1868 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:56.329030 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-6a4a29a4-4aca-419a-aa17-cfc9f2cb1868 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:56.338120 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-6a4a29a4-4aca-419a-aa17-cfc9f2cb1868 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:56.339623 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-6a4a29a4-4aca-419a-aa17-cfc9f2cb1868 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:56.341282 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-6a4a29a4-4aca-419a-aa17-cfc9f2cb1868 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1748 microversion: 2.20 time: 0.166150 Jun 17 15:13:56.342127 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 201/377] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:13:56 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1748 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:13:56.476274 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-0c815565-3300-4ea2-a7e6-86b4da6b2991 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:56.477148 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-0c815565-3300-4ea2-a7e6-86b4da6b2991 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:56.486216 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0c815565-3300-4ea2-a7e6-86b4da6b2991 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:56.486675 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0c815565-3300-4ea2-a7e6-86b4da6b2991 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:56.487972 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0c815565-3300-4ea2-a7e6-86b4da6b2991 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:56.488887 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0c815565-3300-4ea2-a7e6-86b4da6b2991 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:56.671079 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-0c815565-3300-4ea2-a7e6-86b4da6b2991 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:56.680066 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-0c815565-3300-4ea2-a7e6-86b4da6b2991 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1260 microversion: 2.1 time: 0.208639 Jun 17 15:13:56.680661 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 202/378] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:13:56 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1260 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:13:57.362047 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-4ccfda89-0f93-4b91-a3aa-3b9ac66c0654 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:57.363120 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-4ccfda89-0f93-4b91-a3aa-3b9ac66c0654 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:57.371100 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4ccfda89-0f93-4b91-a3aa-3b9ac66c0654 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:57.371630 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4ccfda89-0f93-4b91-a3aa-3b9ac66c0654 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:57.375564 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4ccfda89-0f93-4b91-a3aa-3b9ac66c0654 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:57.376416 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4ccfda89-0f93-4b91-a3aa-3b9ac66c0654 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:57.549271 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-4ccfda89-0f93-4b91-a3aa-3b9ac66c0654 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:57.564620 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-4ccfda89-0f93-4b91-a3aa-3b9ac66c0654 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:57.567465 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-4ccfda89-0f93-4b91-a3aa-3b9ac66c0654 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:57.569547 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-4ccfda89-0f93-4b91-a3aa-3b9ac66c0654 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1748 microversion: 2.20 time: 0.212411 Jun 17 15:13:57.572752 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 203/379] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:13:57 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1748 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:13:57.699559 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-1b09326b-019b-4860-936f-186a375e09d7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:57.700278 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-1b09326b-019b-4860-936f-186a375e09d7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:57.719480 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1b09326b-019b-4860-936f-186a375e09d7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:57.719938 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1b09326b-019b-4860-936f-186a375e09d7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:57.720772 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1b09326b-019b-4860-936f-186a375e09d7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:57.721216 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1b09326b-019b-4860-936f-186a375e09d7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:57.943567 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-1b09326b-019b-4860-936f-186a375e09d7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:57.953692 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-1b09326b-019b-4860-936f-186a375e09d7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1260 microversion: 2.1 time: 0.258307 Jun 17 15:13:57.955023 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 204/380] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:13:57 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1260 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:13:58.591772 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-fe617009-9839-4bc3-96b4-757e379b9bb6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:58.592513 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-fe617009-9839-4bc3-96b4-757e379b9bb6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:58.600092 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fe617009-9839-4bc3-96b4-757e379b9bb6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:58.600586 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fe617009-9839-4bc3-96b4-757e379b9bb6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:58.601536 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fe617009-9839-4bc3-96b4-757e379b9bb6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:58.601996 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fe617009-9839-4bc3-96b4-757e379b9bb6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:58.649459 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell0:SELECT=2 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:13:58.771721 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-fe617009-9839-4bc3-96b4-757e379b9bb6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:58.779450 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-fe617009-9839-4bc3-96b4-757e379b9bb6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:58.781146 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-fe617009-9839-4bc3-96b4-757e379b9bb6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:58.782651 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-fe617009-9839-4bc3-96b4-757e379b9bb6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1748 microversion: 2.20 time: 0.195485 Jun 17 15:13:58.784202 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 205/381] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:13:58 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1748 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 15:13:58.971868 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-7c416675-b274-4bb9-a9ee-ad62b318a93b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:58.972735 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-7c416675-b274-4bb9-a9ee-ad62b318a93b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:58.980234 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7c416675-b274-4bb9-a9ee-ad62b318a93b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:58.980734 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7c416675-b274-4bb9-a9ee-ad62b318a93b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:58.981551 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7c416675-b274-4bb9-a9ee-ad62b318a93b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:58.981989 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7c416675-b274-4bb9-a9ee-ad62b318a93b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:59.179933 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-7c416675-b274-4bb9-a9ee-ad62b318a93b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:13:59.201733 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-7c416675-b274-4bb9-a9ee-ad62b318a93b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1260 microversion: 2.1 time: 0.233691 Jun 17 15:13:59.202392 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 206/382] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:13:58 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1260 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:13:59.227567 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=5,nova_cell1:UPDATE=3 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:13:59.370328 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:13:59.804637 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-9183e264-35b2-480f-97e5-468a874d5a48 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:13:59.805959 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-9183e264-35b2-480f-97e5-468a874d5a48 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:13:59.813628 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9183e264-35b2-480f-97e5-468a874d5a48 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:59.814093 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9183e264-35b2-480f-97e5-468a874d5a48 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:59.815099 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9183e264-35b2-480f-97e5-468a874d5a48 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:13:59.816317 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9183e264-35b2-480f-97e5-468a874d5a48 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:13:59.998648 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-9183e264-35b2-480f-97e5-468a874d5a48 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:00.011092 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-9183e264-35b2-480f-97e5-468a874d5a48 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:00.012726 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-9183e264-35b2-480f-97e5-468a874d5a48 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:00.014079 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-9183e264-35b2-480f-97e5-468a874d5a48 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1748 microversion: 2.20 time: 0.214420 Jun 17 15:14:00.026239 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 207/383] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:13:59 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1748 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 15:14:00.225076 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-4b4cb414-3c09-4b91-9e62-2402af54e46c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:00.225721 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-4b4cb414-3c09-4b91-9e62-2402af54e46c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:00.249505 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4b4cb414-3c09-4b91-9e62-2402af54e46c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:00.252678 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4b4cb414-3c09-4b91-9e62-2402af54e46c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:00.253683 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4b4cb414-3c09-4b91-9e62-2402af54e46c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:00.254594 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4b4cb414-3c09-4b91-9e62-2402af54e46c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:00.449316 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-4b4cb414-3c09-4b91-9e62-2402af54e46c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:00.457268 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-4b4cb414-3c09-4b91-9e62-2402af54e46c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1260 microversion: 2.1 time: 0.241431 Jun 17 15:14:00.458461 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 208/384] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:14:00 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1260 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:14:01.034275 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-de475abe-a18d-400c-a07b-27dbd4aabd02 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:01.035704 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-de475abe-a18d-400c-a07b-27dbd4aabd02 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:01.068073 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-de475abe-a18d-400c-a07b-27dbd4aabd02 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:01.068929 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-de475abe-a18d-400c-a07b-27dbd4aabd02 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:01.069944 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-de475abe-a18d-400c-a07b-27dbd4aabd02 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:01.070597 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-de475abe-a18d-400c-a07b-27dbd4aabd02 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:01.313624 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-de475abe-a18d-400c-a07b-27dbd4aabd02 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:01.328496 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-de475abe-a18d-400c-a07b-27dbd4aabd02 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:01.332473 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-de475abe-a18d-400c-a07b-27dbd4aabd02 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:01.342610 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-de475abe-a18d-400c-a07b-27dbd4aabd02 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1748 microversion: 2.20 time: 0.312432 Jun 17 15:14:01.343800 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 209/385] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:14:01 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1748 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 15:14:01.413291 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-9add4df2-6f50-42f9-94a2-d8a7646c3af4 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:01.414719 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-9add4df2-6f50-42f9-94a2-d8a7646c3af4 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:01.424057 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9add4df2-6f50-42f9-94a2-d8a7646c3af4 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:01.424846 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9add4df2-6f50-42f9-94a2-d8a7646c3af4 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:01.425974 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9add4df2-6f50-42f9-94a2-d8a7646c3af4 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:01.426702 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9add4df2-6f50-42f9-94a2-d8a7646c3af4 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:01.602923 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-9add4df2-6f50-42f9-94a2-d8a7646c3af4 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:01.606870 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:14:01.612884 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-9add4df2-6f50-42f9-94a2-d8a7646c3af4 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1595 microversion: 2.1 time: 0.205593 Jun 17 15:14:01.613633 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 210/386] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:14:01 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1595 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:14:01.618729 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [req-a3fc14ac-2168-46a5-8f1c-f43d68f664a7 req-44166178-461f-4b1f-b91c-0856a323ac5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b30f80f-8b8c-4c07-8653-4f9fd128ce77", "name": "network-vif-plugged", "status": "completed", "tag": "8bfd0e33-2b14-4398-b80c-8da478f93229"}]} {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:14:01.630935 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [req-a3fc14ac-2168-46a5-8f1c-f43d68f664a7 req-44166178-461f-4b1f-b91c-0856a323ac5f service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:01.631384 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [req-a3fc14ac-2168-46a5-8f1c-f43d68f664a7 req-44166178-461f-4b1f-b91c-0856a323ac5f service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:01.645030 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.compute.server_external_events [req-a3fc14ac-2168-46a5-8f1c-f43d68f664a7 req-44166178-461f-4b1f-b91c-0856a323ac5f service nova] Creating event network-vif-plugged:8bfd0e33-2b14-4398-b80c-8da478f93229 for instance 5b30f80f-8b8c-4c07-8653-4f9fd128ce77 on hv-cinder-82549 Jun 17 15:14:01.652205 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [req-a3fc14ac-2168-46a5-8f1c-f43d68f664a7 req-44166178-461f-4b1f-b91c-0856a323ac5f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037055 Jun 17 15:14:01.652889 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 211/387] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 15:14:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:14:01.659184 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-ed79a89b-1701-4afa-bdeb-5c26a0890c29 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:01.659925 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-ed79a89b-1701-4afa-bdeb-5c26a0890c29 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:01.662295 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:14:01.670230 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ed79a89b-1701-4afa-bdeb-5c26a0890c29 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:01.670973 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ed79a89b-1701-4afa-bdeb-5c26a0890c29 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:01.671996 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ed79a89b-1701-4afa-bdeb-5c26a0890c29 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:01.672628 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ed79a89b-1701-4afa-bdeb-5c26a0890c29 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:01.850450 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-ed79a89b-1701-4afa-bdeb-5c26a0890c29 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:01.863106 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-ed79a89b-1701-4afa-bdeb-5c26a0890c29 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1260 microversion: 2.1 time: 0.208322 Jun 17 15:14:01.872440 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 212/388] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:14:01 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1260 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:14:02.365995 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-8d367889-6ab6-4285-b593-27b76d36098f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:02.366743 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-8d367889-6ab6-4285-b593-27b76d36098f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:02.382456 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8d367889-6ab6-4285-b593-27b76d36098f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:02.382910 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8d367889-6ab6-4285-b593-27b76d36098f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:02.383891 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8d367889-6ab6-4285-b593-27b76d36098f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:02.384527 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8d367889-6ab6-4285-b593-27b76d36098f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:02.562966 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-8d367889-6ab6-4285-b593-27b76d36098f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:02.572666 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-8d367889-6ab6-4285-b593-27b76d36098f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:02.574520 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-8d367889-6ab6-4285-b593-27b76d36098f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:02.576105 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-8d367889-6ab6-4285-b593-27b76d36098f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1748 microversion: 2.20 time: 0.214144 Jun 17 15:14:02.576882 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 213/389] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:14:02 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1748 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 15:14:02.880469 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-d584b112-ebda-4592-a524-15d80ed7efc3 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:02.881124 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-d584b112-ebda-4592-a524-15d80ed7efc3 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:02.888529 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d584b112-ebda-4592-a524-15d80ed7efc3 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:02.889027 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d584b112-ebda-4592-a524-15d80ed7efc3 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:02.889981 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d584b112-ebda-4592-a524-15d80ed7efc3 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:02.890560 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d584b112-ebda-4592-a524-15d80ed7efc3 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:03.043083 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-d584b112-ebda-4592-a524-15d80ed7efc3 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:03.052658 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-d584b112-ebda-4592-a524-15d80ed7efc3 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1260 microversion: 2.1 time: 0.175860 Jun 17 15:14:03.053927 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 214/390] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:14:02 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1260 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:14:03.597003 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-48621df1-4528-4c02-a4dd-a31f32f2f534 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:03.599488 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-48621df1-4528-4c02-a4dd-a31f32f2f534 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:03.617156 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-48621df1-4528-4c02-a4dd-a31f32f2f534 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:03.618881 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-48621df1-4528-4c02-a4dd-a31f32f2f534 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:03.620513 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-48621df1-4528-4c02-a4dd-a31f32f2f534 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:03.625800 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-48621df1-4528-4c02-a4dd-a31f32f2f534 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:03.680019 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.network.neutron [None req-04e3730a-78e3-48a7-89b7-19c600893fc6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] validate_networks() for [('3a4e37db-e344-461b-88a0-74065462698f', None, None, None, None, None)] {{(pid=117649) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 15:14:03.980134 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-48621df1-4528-4c02-a4dd-a31f32f2f534 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:03.992073 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-48621df1-4528-4c02-a4dd-a31f32f2f534 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:03.994991 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-48621df1-4528-4c02-a4dd-a31f32f2f534 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:03.997252 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-48621df1-4528-4c02-a4dd-a31f32f2f534 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1748 microversion: 2.20 time: 0.405220 Jun 17 15:14:04.010599 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 215/391] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:14:03 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1748 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:14:04.071436 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-27c038c2-0ece-4b51-a108-73a7dae007b0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:04.073674 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-27c038c2-0ece-4b51-a108-73a7dae007b0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:04.089333 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-27c038c2-0ece-4b51-a108-73a7dae007b0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:04.090062 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-27c038c2-0ece-4b51-a108-73a7dae007b0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:04.091121 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-27c038c2-0ece-4b51-a108-73a7dae007b0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:04.091562 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-27c038c2-0ece-4b51-a108-73a7dae007b0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:04.515475 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-27c038c2-0ece-4b51-a108-73a7dae007b0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:04.527057 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-27c038c2-0ece-4b51-a108-73a7dae007b0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1444 microversion: 2.1 time: 0.461138 Jun 17 15:14:04.528961 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 216/392] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:14:04 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1444 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:14:04.549319 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-2f524730-0086-4765-aaec-cf172ac92466 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:04.550276 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-2f524730-0086-4765-aaec-cf172ac92466 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:04.559065 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2f524730-0086-4765-aaec-cf172ac92466 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:04.559521 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2f524730-0086-4765-aaec-cf172ac92466 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:04.560305 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2f524730-0086-4765-aaec-cf172ac92466 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:04.561358 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2f524730-0086-4765-aaec-cf172ac92466 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:04.732158 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-2f524730-0086-4765-aaec-cf172ac92466 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:04.742314 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-2f524730-0086-4765-aaec-cf172ac92466 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1444 microversion: 2.1 time: 0.198045 Jun 17 15:14:04.742889 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 217/393] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:14:04 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1444 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:14:05.018532 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-eae01fa3-c1c6-46ad-b4d3-9289c2884a7d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:05.019623 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-eae01fa3-c1c6-46ad-b4d3-9289c2884a7d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:05.030936 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-eae01fa3-c1c6-46ad-b4d3-9289c2884a7d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:05.031399 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-eae01fa3-c1c6-46ad-b4d3-9289c2884a7d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:05.032321 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-eae01fa3-c1c6-46ad-b4d3-9289c2884a7d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:05.032794 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-eae01fa3-c1c6-46ad-b4d3-9289c2884a7d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:05.071423 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-04e3730a-78e3-48a7-89b7-19c600893fc6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Flavor limits 0:0:0 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 15:14:05.071940 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-04e3730a-78e3-48a7-89b7-19c600893fc6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Image limits 0:0:0 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 15:14:05.072880 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-04e3730a-78e3-48a7-89b7-19c600893fc6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Flavor pref 0:0:0 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 15:14:05.073402 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-04e3730a-78e3-48a7-89b7-19c600893fc6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Image pref 0:0:0 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 15:14:05.073903 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-04e3730a-78e3-48a7-89b7-19c600893fc6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 15:14:05.091538 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-04e3730a-78e3-48a7-89b7-19c600893fc6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:05.093256 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-04e3730a-78e3-48a7-89b7-19c600893fc6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:05.094295 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-04e3730a-78e3-48a7-89b7-19c600893fc6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:05.095020 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-04e3730a-78e3-48a7-89b7-19c600893fc6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:05.151971 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.quota [None req-04e3730a-78e3-48a7-89b7-19c600893fc6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Getting quotas for project 50408ec18fa04036a0abb6236343e258. Resources: {'cores', 'ram', 'instances'} {{(pid=117649) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 15:14:05.160936 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.quota [None req-04e3730a-78e3-48a7-89b7-19c600893fc6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Getting quotas for user 562485deaf214fa29eac132464ef93e3 and project 50408ec18fa04036a0abb6236343e258. Resources: {'cores', 'ram', 'instances'} {{(pid=117649) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 15:14:05.221349 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-04e3730a-78e3-48a7-89b7-19c600893fc6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Going to run 1 instances... {{(pid=117649) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 15:14:05.240686 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-04e3730a-78e3-48a7-89b7-19c600893fc6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c105ca4-6fe3-4e70-af71-b03c64fe1efe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117649) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 15:14:05.304965 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-eae01fa3-c1c6-46ad-b4d3-9289c2884a7d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:05.318490 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-eae01fa3-c1c6-46ad-b4d3-9289c2884a7d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:05.323851 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-eae01fa3-c1c6-46ad-b4d3-9289c2884a7d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:05.325104 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-eae01fa3-c1c6-46ad-b4d3-9289c2884a7d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1748 microversion: 2.20 time: 0.311524 Jun 17 15:14:05.329174 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 218/394] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:14:05 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1748 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:14:05.379215 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-04e3730a-78e3-48a7-89b7-19c600893fc6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 16.113683 Jun 17 15:14:05.381754 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 177/395] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Jun 17 15:13:49 2022] POST /compute/v2.1/servers => generated 409 bytes in 16117 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 15:14:05.393730 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-b7f17caa-03f0-4f01-9892-51a151e0f456 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:05.394566 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-b7f17caa-03f0-4f01-9892-51a151e0f456 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:05.485692 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-b7f17caa-03f0-4f01-9892-51a151e0f456 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:05.506530 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-b7f17caa-03f0-4f01-9892-51a151e0f456 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1244 microversion: 2.1 time: 0.118084 Jun 17 15:14:05.516166 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 219/396] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:14:05 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1244 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:14:05.842897 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [req-3f6885a2-ea9e-4417-b83e-6906beb33d40 req-6791c75d-e7e7-4308-ac3c-7a436035d192 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91408900-da01-4985-b392-111577935284", "tag": "06c1246f-1c4b-48df-98b1-2028fa5b27e5"}]} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:14:05.860646 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-3f6885a2-ea9e-4417-b83e-6906beb33d40 req-6791c75d-e7e7-4308-ac3c-7a436035d192 service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:05.862193 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-3f6885a2-ea9e-4417-b83e-6906beb33d40 req-6791c75d-e7e7-4308-ac3c-7a436035d192 service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:05.897902 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.compute.server_external_events [req-3f6885a2-ea9e-4417-b83e-6906beb33d40 req-6791c75d-e7e7-4308-ac3c-7a436035d192 service nova] Creating event network-changed:06c1246f-1c4b-48df-98b1-2028fa5b27e5 for instance 91408900-da01-4985-b392-111577935284 on hv-cinder-82549 Jun 17 15:14:05.910327 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [req-3f6885a2-ea9e-4417-b83e-6906beb33d40 req-6791c75d-e7e7-4308-ac3c-7a436035d192 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074347 Jun 17 15:14:05.910975 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 178/397] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 15:14:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:14:06.349993 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-48807b96-f242-4e7d-ba7a-fad3cfcf78ad tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:06.350612 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-48807b96-f242-4e7d-ba7a-fad3cfcf78ad tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:06.365461 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-48807b96-f242-4e7d-ba7a-fad3cfcf78ad tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:06.367640 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-48807b96-f242-4e7d-ba7a-fad3cfcf78ad tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:06.370337 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-48807b96-f242-4e7d-ba7a-fad3cfcf78ad tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:06.371139 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-48807b96-f242-4e7d-ba7a-fad3cfcf78ad tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:06.529476 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-d14b2f75-215f-484f-9bf8-72a76362e746 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:06.533678 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-d14b2f75-215f-484f-9bf8-72a76362e746 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:06.553646 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d14b2f75-215f-484f-9bf8-72a76362e746 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:06.558447 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d14b2f75-215f-484f-9bf8-72a76362e746 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:06.575058 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d14b2f75-215f-484f-9bf8-72a76362e746 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:06.589539 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d14b2f75-215f-484f-9bf8-72a76362e746 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:06.895420 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-d14b2f75-215f-484f-9bf8-72a76362e746 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:06.905921 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-d14b2f75-215f-484f-9bf8-72a76362e746 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1248 microversion: 2.1 time: 0.381954 Jun 17 15:14:06.922656 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 179/398] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:14:06 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1248 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:14:07.429803 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-48807b96-f242-4e7d-ba7a-fad3cfcf78ad tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:07.442548 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-48807b96-f242-4e7d-ba7a-fad3cfcf78ad tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:07.451738 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-48807b96-f242-4e7d-ba7a-fad3cfcf78ad tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:07.459901 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-48807b96-f242-4e7d-ba7a-fad3cfcf78ad tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1750 microversion: 2.20 time: 1.109733 Jun 17 15:14:07.461600 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 220/399] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:14:06 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1750 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:14:07.926266 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-e8975178-cfaa-4850-82a6-a3d377608331 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:07.928011 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-e8975178-cfaa-4850-82a6-a3d377608331 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:07.949318 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e8975178-cfaa-4850-82a6-a3d377608331 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:07.950076 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e8975178-cfaa-4850-82a6-a3d377608331 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:07.951077 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e8975178-cfaa-4850-82a6-a3d377608331 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:07.951668 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e8975178-cfaa-4850-82a6-a3d377608331 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:08.042880 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-e8975178-cfaa-4850-82a6-a3d377608331 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:08.057352 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-e8975178-cfaa-4850-82a6-a3d377608331 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1240 microversion: 2.1 time: 0.135220 Jun 17 15:14:08.059404 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 180/400] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:14:07 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1240 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:14:08.484144 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-b32ff02e-dfe9-4709-ba03-9cd871cf08d2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:08.485620 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-b32ff02e-dfe9-4709-ba03-9cd871cf08d2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:08.496919 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b32ff02e-dfe9-4709-ba03-9cd871cf08d2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:08.498026 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b32ff02e-dfe9-4709-ba03-9cd871cf08d2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:08.500054 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b32ff02e-dfe9-4709-ba03-9cd871cf08d2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:08.501191 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b32ff02e-dfe9-4709-ba03-9cd871cf08d2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:08.994330 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-b32ff02e-dfe9-4709-ba03-9cd871cf08d2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:09.021619 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-b32ff02e-dfe9-4709-ba03-9cd871cf08d2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:09.037383 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-b32ff02e-dfe9-4709-ba03-9cd871cf08d2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:09.041367 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-b32ff02e-dfe9-4709-ba03-9cd871cf08d2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1806 microversion: 2.20 time: 0.562306 Jun 17 15:14:09.044417 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 221/401] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:14:08 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1806 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:14:09.083213 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-deb1b489-8890-49a7-8b45-355c6ecd3b11 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:09.084752 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-deb1b489-8890-49a7-8b45-355c6ecd3b11 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:09.094301 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-deb1b489-8890-49a7-8b45-355c6ecd3b11 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:09.095469 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-deb1b489-8890-49a7-8b45-355c6ecd3b11 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:09.097481 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-deb1b489-8890-49a7-8b45-355c6ecd3b11 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:09.098336 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-deb1b489-8890-49a7-8b45-355c6ecd3b11 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:09.240485 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-f78f31cb-4c6e-4584-8386-190ecfe44a7f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-374272086"}} {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:14:09.241409 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-f78f31cb-4c6e-4584-8386-190ecfe44a7f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:09.253610 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f78f31cb-4c6e-4584-8386-190ecfe44a7f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:09.254679 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f78f31cb-4c6e-4584-8386-190ecfe44a7f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:09.257454 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f78f31cb-4c6e-4584-8386-190ecfe44a7f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:09.261992 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f78f31cb-4c6e-4584-8386-190ecfe44a7f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:09.299055 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-deb1b489-8890-49a7-8b45-355c6ecd3b11 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:09.307950 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-deb1b489-8890-49a7-8b45-355c6ecd3b11 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1314 microversion: 2.1 time: 0.230434 Jun 17 15:14:09.309016 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 181/402] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:14:09 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:14:09.656869 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.network.security_group_api [None req-f78f31cb-4c6e-4584-8386-190ecfe44a7f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Adding security group bb1a391c-01df-48f6-a6bf-ad02cf73985c to port 06c1246f-1c4b-48df-98b1-2028fa5b27e5 Jun 17 15:14:09.785140 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [req-dc83fe2f-f069-41ff-b9cc-0e332fc474e1 req-ab2b7e90-ff70-4738-b484-bf4bdc25e5ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b30f80f-8b8c-4c07-8653-4f9fd128ce77", "tag": "8bfd0e33-2b14-4398-b80c-8da478f93229"}]} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:14:09.800202 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-dc83fe2f-f069-41ff-b9cc-0e332fc474e1 req-ab2b7e90-ff70-4738-b484-bf4bdc25e5ce service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:09.801386 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-dc83fe2f-f069-41ff-b9cc-0e332fc474e1 req-ab2b7e90-ff70-4738-b484-bf4bdc25e5ce service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:09.821954 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.compute.server_external_events [req-dc83fe2f-f069-41ff-b9cc-0e332fc474e1 req-ab2b7e90-ff70-4738-b484-bf4bdc25e5ce service nova] Creating event network-changed:8bfd0e33-2b14-4398-b80c-8da478f93229 for instance 5b30f80f-8b8c-4c07-8653-4f9fd128ce77 on hv-cinder-82549 Jun 17 15:14:09.831641 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [req-dc83fe2f-f069-41ff-b9cc-0e332fc474e1 req-ab2b7e90-ff70-4738-b484-bf4bdc25e5ce service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056814 Jun 17 15:14:09.833519 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 182/403] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 15:14:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:14:10.078373 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-8682fb68-b84d-4346-9a09-ece404bfc851 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:10.079091 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-8682fb68-b84d-4346-9a09-ece404bfc851 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:10.093262 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8682fb68-b84d-4346-9a09-ece404bfc851 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:10.100953 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8682fb68-b84d-4346-9a09-ece404bfc851 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:10.119125 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8682fb68-b84d-4346-9a09-ece404bfc851 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:10.120725 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8682fb68-b84d-4346-9a09-ece404bfc851 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:10.758504 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-8682fb68-b84d-4346-9a09-ece404bfc851 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:10.771988 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-8682fb68-b84d-4346-9a09-ece404bfc851 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:10.781536 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-8682fb68-b84d-4346-9a09-ece404bfc851 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:10.782778 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-8682fb68-b84d-4346-9a09-ece404bfc851 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1806 microversion: 2.20 time: 0.713567 Jun 17 15:14:10.784086 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 183/404] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:14:10 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1806 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:14:10.796086 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-d9f1a358-0532-41f3-9dda-9cd4b07f18e1 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-358401523", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-417419175", "security_groups": [{"name": "tempest-secgroup-smoke-43842466"}], "block_device_mapping_v2": [{"uuid": "d219a8a3-6869-4be6-905b-7575088d2909", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "30077c53-15dd-418f-9772-b61a459cd5ce"}]}} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:14:11.047207 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-f78f31cb-4c6e-4584-8386-190ecfe44a7f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "POST /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/action" status: 202 len: 0 microversion: 2.1 time: 1.812519 Jun 17 15:14:11.048500 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 222/405] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jun 17 15:14:09 2022] POST /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/action => generated 0 bytes in 1814 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 15:14:11.053952 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-4f694225-36e9-4a81-b0ca-3f31897b696f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:11.054577 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-4f694225-36e9-4a81-b0ca-3f31897b696f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:11.071777 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4f694225-36e9-4a81-b0ca-3f31897b696f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:11.072237 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4f694225-36e9-4a81-b0ca-3f31897b696f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:11.073045 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4f694225-36e9-4a81-b0ca-3f31897b696f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:11.092580 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4f694225-36e9-4a81-b0ca-3f31897b696f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:11.497288 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.network.neutron [None req-d9f1a358-0532-41f3-9dda-9cd4b07f18e1 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] validate_networks() for [('30077c53-15dd-418f-9772-b61a459cd5ce', None, None, None, None, None)] {{(pid=117649) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 15:14:11.596463 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-4f694225-36e9-4a81-b0ca-3f31897b696f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:11.607413 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-4f694225-36e9-4a81-b0ca-3f31897b696f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1370 microversion: 2.1 time: 0.557406 Jun 17 15:14:11.623405 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 223/406] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:14:11 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1370 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:14:11.630569 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-57ebb5d5-4632-4967-a4fc-0f4bbf1bfc3d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:11.631513 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-57ebb5d5-4632-4967-a4fc-0f4bbf1bfc3d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:11.639487 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-57ebb5d5-4632-4967-a4fc-0f4bbf1bfc3d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:11.641043 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-57ebb5d5-4632-4967-a4fc-0f4bbf1bfc3d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:11.642077 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-57ebb5d5-4632-4967-a4fc-0f4bbf1bfc3d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:11.642723 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-57ebb5d5-4632-4967-a4fc-0f4bbf1bfc3d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:12.012449 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-57ebb5d5-4632-4967-a4fc-0f4bbf1bfc3d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:12.022250 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-57ebb5d5-4632-4967-a4fc-0f4bbf1bfc3d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1759 microversion: 2.1 time: 0.397068 Jun 17 15:14:12.028285 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 224/407] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:14:11 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1759 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:14:12.035076 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-27ec3517-ce3a-41c9-a52c-0865c9d5a874 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:12.042353 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-27ec3517-ce3a-41c9-a52c-0865c9d5a874 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:12.061825 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-27ec3517-ce3a-41c9-a52c-0865c9d5a874 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:12.062548 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-27ec3517-ce3a-41c9-a52c-0865c9d5a874 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:12.063284 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-27ec3517-ce3a-41c9-a52c-0865c9d5a874 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:12.063958 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-27ec3517-ce3a-41c9-a52c-0865c9d5a874 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:12.320484 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-27ec3517-ce3a-41c9-a52c-0865c9d5a874 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:12.336123 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-27ec3517-ce3a-41c9-a52c-0865c9d5a874 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:12.341720 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-27ec3517-ce3a-41c9-a52c-0865c9d5a874 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:12.344098 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-27ec3517-ce3a-41c9-a52c-0865c9d5a874 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1806 microversion: 2.20 time: 0.312920 Jun 17 15:14:12.345184 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 225/408] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:14:12 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1806 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:14:12.351476 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [req-6ec073ed-a972-4187-8212-c9d6803967d9 req-cfb24c10-04a8-483d-84ba-33b9413d1dc6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91408900-da01-4985-b392-111577935284", "tag": "06c1246f-1c4b-48df-98b1-2028fa5b27e5"}]} {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:14:12.365843 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [req-6ec073ed-a972-4187-8212-c9d6803967d9 req-cfb24c10-04a8-483d-84ba-33b9413d1dc6 service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:12.366783 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [req-6ec073ed-a972-4187-8212-c9d6803967d9 req-cfb24c10-04a8-483d-84ba-33b9413d1dc6 service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:12.385058 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.compute.server_external_events [req-6ec073ed-a972-4187-8212-c9d6803967d9 req-cfb24c10-04a8-483d-84ba-33b9413d1dc6 service nova] Creating event network-changed:06c1246f-1c4b-48df-98b1-2028fa5b27e5 for instance 91408900-da01-4985-b392-111577935284 on hv-cinder-82549 Jun 17 15:14:12.391964 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [req-6ec073ed-a972-4187-8212-c9d6803967d9 req-cfb24c10-04a8-483d-84ba-33b9413d1dc6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044631 Jun 17 15:14:12.398136 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 226/409] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 15:14:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:14:12.627956 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-278aab84-5746-4b19-8fb9-ea87f0a27390 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:12.628700 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-278aab84-5746-4b19-8fb9-ea87f0a27390 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:12.642722 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-278aab84-5746-4b19-8fb9-ea87f0a27390 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:12.643088 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-278aab84-5746-4b19-8fb9-ea87f0a27390 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:12.643886 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-278aab84-5746-4b19-8fb9-ea87f0a27390 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:12.644378 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-278aab84-5746-4b19-8fb9-ea87f0a27390 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:12.886148 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-278aab84-5746-4b19-8fb9-ea87f0a27390 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:12.896800 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-278aab84-5746-4b19-8fb9-ea87f0a27390 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1370 microversion: 2.1 time: 0.273225 Jun 17 15:14:12.907754 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 227/410] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:14:12 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1370 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:14:12.936542 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-d9f1a358-0532-41f3-9dda-9cd4b07f18e1 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Flavor limits 0:0:0 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 15:14:12.937616 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-d9f1a358-0532-41f3-9dda-9cd4b07f18e1 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Image limits 0:0:0 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 15:14:12.938284 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-d9f1a358-0532-41f3-9dda-9cd4b07f18e1 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Flavor pref 0:0:0 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 15:14:12.939283 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-d9f1a358-0532-41f3-9dda-9cd4b07f18e1 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Image pref 0:0:0 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 15:14:12.939864 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-d9f1a358-0532-41f3-9dda-9cd4b07f18e1 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 15:14:12.957379 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d9f1a358-0532-41f3-9dda-9cd4b07f18e1 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:12.958150 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d9f1a358-0532-41f3-9dda-9cd4b07f18e1 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:12.959138 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d9f1a358-0532-41f3-9dda-9cd4b07f18e1 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:12.959739 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d9f1a358-0532-41f3-9dda-9cd4b07f18e1 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:12.981596 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.quota [None req-d9f1a358-0532-41f3-9dda-9cd4b07f18e1 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Getting quotas for project 6298c1910e1a488983d5399d7952a5cf. Resources: {'cores', 'ram', 'instances'} {{(pid=117649) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 15:14:12.986991 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.quota [None req-d9f1a358-0532-41f3-9dda-9cd4b07f18e1 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Getting quotas for user 4e3e797edb9a453d9142c3196a4f21bb and project 6298c1910e1a488983d5399d7952a5cf. Resources: {'cores', 'ram', 'instances'} {{(pid=117649) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 15:14:13.080114 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-d9f1a358-0532-41f3-9dda-9cd4b07f18e1 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Going to run 1 instances... {{(pid=117649) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 15:14:13.082756 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-d9f1a358-0532-41f3-9dda-9cd4b07f18e1 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d219a8a3-6869-4be6-905b-7575088d2909',volume_size=None,volume_type=None)] {{(pid=117649) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 15:14:13.316604 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-d9f1a358-0532-41f3-9dda-9cd4b07f18e1 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 2.530687 Jun 17 15:14:13.318166 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 184/411] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Jun 17 15:14:10 2022] POST /compute/v2.1/servers => generated 404 bytes in 2533 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 15:14:13.330914 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [req-3a688c2c-147b-4cf2-90da-ffb18a873a7b req-971d97b0-0e6f-40d1-8e5c-a711c8cd2fd8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba5d3180-d42a-4678-af13-c99282e054bf", "tag": "06e8bb11-060d-47aa-9950-9bdbeda221ff"}]} {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:14:13.333974 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-2a78ee90-da9e-467c-a5e6-c104536b6180 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:13.334917 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-2a78ee90-da9e-467c-a5e6-c104536b6180 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:13.348320 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [req-3a688c2c-147b-4cf2-90da-ffb18a873a7b req-971d97b0-0e6f-40d1-8e5c-a711c8cd2fd8 service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:13.349058 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [req-3a688c2c-147b-4cf2-90da-ffb18a873a7b req-971d97b0-0e6f-40d1-8e5c-a711c8cd2fd8 service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:13.387352 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.compute.server_external_events [req-3a688c2c-147b-4cf2-90da-ffb18a873a7b req-971d97b0-0e6f-40d1-8e5c-a711c8cd2fd8 service nova] Creating event network-changed:06e8bb11-060d-47aa-9950-9bdbeda221ff for instance ba5d3180-d42a-4678-af13-c99282e054bf on hv-cinder-82549 Jun 17 15:14:13.394484 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [req-3a688c2c-147b-4cf2-90da-ffb18a873a7b req-971d97b0-0e6f-40d1-8e5c-a711c8cd2fd8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069054 Jun 17 15:14:13.397249 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 228/412] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 15:14:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:14:13.416909 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-cc9398d3-f7eb-4e84-97d0-03b82886cfbb tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:13.417614 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-cc9398d3-f7eb-4e84-97d0-03b82886cfbb tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:13.434834 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cc9398d3-f7eb-4e84-97d0-03b82886cfbb tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:13.435567 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cc9398d3-f7eb-4e84-97d0-03b82886cfbb tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:13.437825 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cc9398d3-f7eb-4e84-97d0-03b82886cfbb tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:13.438437 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cc9398d3-f7eb-4e84-97d0-03b82886cfbb tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:13.717146 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-cc9398d3-f7eb-4e84-97d0-03b82886cfbb tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:13.728844 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-cc9398d3-f7eb-4e84-97d0-03b82886cfbb tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:13.730654 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-cc9398d3-f7eb-4e84-97d0-03b82886cfbb tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:13.732405 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-cc9398d3-f7eb-4e84-97d0-03b82886cfbb tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1806 microversion: 2.20 time: 0.330287 Jun 17 15:14:13.733421 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 229/413] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:14:13 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1806 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:14:13.871315 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-2a78ee90-da9e-467c-a5e6-c104536b6180 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:13.891476 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-2a78ee90-da9e-467c-a5e6-c104536b6180 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1093 microversion: 2.1 time: 0.566578 Jun 17 15:14:13.892082 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 185/414] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:14:13 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1093 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:14:13.915442 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-8cc2ffb9-5e49-4235-9707-391badeee9af tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:13.916052 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-8cc2ffb9-5e49-4235-9707-391badeee9af tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:13.922089 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8cc2ffb9-5e49-4235-9707-391badeee9af tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:13.922599 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8cc2ffb9-5e49-4235-9707-391badeee9af tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:13.923364 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8cc2ffb9-5e49-4235-9707-391badeee9af tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:13.923813 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8cc2ffb9-5e49-4235-9707-391badeee9af tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:14.118831 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-8cc2ffb9-5e49-4235-9707-391badeee9af tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:14.125070 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=100 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:14:14.136441 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-8cc2ffb9-5e49-4235-9707-391badeee9af tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1370 microversion: 2.1 time: 0.225297 Jun 17 15:14:14.150333 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 230/415] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:14:13 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1370 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:14:14.751060 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-6181beee-43e6-4227-81e2-f3bf7a9d5a6e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:14.751659 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-6181beee-43e6-4227-81e2-f3bf7a9d5a6e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:14.758158 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6181beee-43e6-4227-81e2-f3bf7a9d5a6e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:14.758613 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6181beee-43e6-4227-81e2-f3bf7a9d5a6e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:14.759375 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6181beee-43e6-4227-81e2-f3bf7a9d5a6e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:14.759814 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6181beee-43e6-4227-81e2-f3bf7a9d5a6e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:14.903285 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-6181beee-43e6-4227-81e2-f3bf7a9d5a6e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:14.909115 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-4568b458-695f-48c3-8bca-f53551ea2d3d tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:14.909681 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-4568b458-695f-48c3-8bca-f53551ea2d3d tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:14.912741 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-6181beee-43e6-4227-81e2-f3bf7a9d5a6e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:14.914258 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-6181beee-43e6-4227-81e2-f3bf7a9d5a6e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:14.915423 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-6181beee-43e6-4227-81e2-f3bf7a9d5a6e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1806 microversion: 2.20 time: 0.168302 Jun 17 15:14:14.915990 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 186/416] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:14:14 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1806 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:14:14.916805 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4568b458-695f-48c3-8bca-f53551ea2d3d tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:14.917254 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4568b458-695f-48c3-8bca-f53551ea2d3d tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:14.918026 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4568b458-695f-48c3-8bca-f53551ea2d3d tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:14.918458 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4568b458-695f-48c3-8bca-f53551ea2d3d tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:14.990351 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-4568b458-695f-48c3-8bca-f53551ea2d3d tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:14.998169 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-4568b458-695f-48c3-8bca-f53551ea2d3d tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1191 microversion: 2.1 time: 0.092831 Jun 17 15:14:14.998752 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 231/417] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:14:14 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1191 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:14:15.157528 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-01efc1d2-dbd6-4ae8-9a87-b30af422220d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:15.158174 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-01efc1d2-dbd6-4ae8-9a87-b30af422220d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:15.164226 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-01efc1d2-dbd6-4ae8-9a87-b30af422220d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:15.164713 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-01efc1d2-dbd6-4ae8-9a87-b30af422220d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:15.165501 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-01efc1d2-dbd6-4ae8-9a87-b30af422220d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:15.166002 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-01efc1d2-dbd6-4ae8-9a87-b30af422220d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:15.298047 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-01efc1d2-dbd6-4ae8-9a87-b30af422220d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:15.305762 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-01efc1d2-dbd6-4ae8-9a87-b30af422220d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1370 microversion: 2.1 time: 0.152077 Jun 17 15:14:15.306360 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 187/418] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:14:15 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1370 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:14:15.935113 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-04dde145-0425-4ab5-a26a-d47e391fbe33 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:15.935653 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-04dde145-0425-4ab5-a26a-d47e391fbe33 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:15.939063 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell0:SELECT=2 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:14:15.943478 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-04dde145-0425-4ab5-a26a-d47e391fbe33 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:15.943920 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-04dde145-0425-4ab5-a26a-d47e391fbe33 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:15.944709 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-04dde145-0425-4ab5-a26a-d47e391fbe33 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:15.945137 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-04dde145-0425-4ab5-a26a-d47e391fbe33 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:16.015152 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-1e8588fc-a466-4332-a544-5232e6631628 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:16.015798 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-1e8588fc-a466-4332-a544-5232e6631628 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:16.022218 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1e8588fc-a466-4332-a544-5232e6631628 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:16.022669 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1e8588fc-a466-4332-a544-5232e6631628 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:16.023484 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1e8588fc-a466-4332-a544-5232e6631628 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:16.023924 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1e8588fc-a466-4332-a544-5232e6631628 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:16.130227 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-04dde145-0425-4ab5-a26a-d47e391fbe33 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:16.133826 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-1e8588fc-a466-4332-a544-5232e6631628 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:16.160466 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-04dde145-0425-4ab5-a26a-d47e391fbe33 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:16.163390 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-1e8588fc-a466-4332-a544-5232e6631628 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1191 microversion: 2.1 time: 0.149643 Jun 17 15:14:16.164444 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 188/419] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:14:16 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1191 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:14:16.164694 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-04dde145-0425-4ab5-a26a-d47e391fbe33 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:16.179173 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-04dde145-0425-4ab5-a26a-d47e391fbe33 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1806 microversion: 2.20 time: 0.247124 Jun 17 15:14:16.181335 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 232/420] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:14:15 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1806 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:14:16.322899 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-7efa380b-d187-4951-b6d3-e14a3608eddc tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:16.323492 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-7efa380b-d187-4951-b6d3-e14a3608eddc tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:16.329456 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7efa380b-d187-4951-b6d3-e14a3608eddc tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:16.329899 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7efa380b-d187-4951-b6d3-e14a3608eddc tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:16.330647 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7efa380b-d187-4951-b6d3-e14a3608eddc tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:16.331072 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7efa380b-d187-4951-b6d3-e14a3608eddc tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:16.479704 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-7efa380b-d187-4951-b6d3-e14a3608eddc tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:16.487712 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-7efa380b-d187-4951-b6d3-e14a3608eddc tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1370 microversion: 2.1 time: 0.168756 Jun 17 15:14:16.488271 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 189/421] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:14:16 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1370 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:14:17.184474 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-0e92bfdc-e8f6-4d1f-8c07-70070006e498 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:17.185481 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-0e92bfdc-e8f6-4d1f-8c07-70070006e498 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:17.204247 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-2ba20503-910a-495c-9f54-016a9f40a227 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:17.205707 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-2ba20503-910a-495c-9f54-016a9f40a227 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:17.216190 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0e92bfdc-e8f6-4d1f-8c07-70070006e498 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:17.217066 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0e92bfdc-e8f6-4d1f-8c07-70070006e498 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:17.217523 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0e92bfdc-e8f6-4d1f-8c07-70070006e498 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:17.217970 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0e92bfdc-e8f6-4d1f-8c07-70070006e498 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:17.224951 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2ba20503-910a-495c-9f54-016a9f40a227 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:17.226152 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2ba20503-910a-495c-9f54-016a9f40a227 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:17.227808 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2ba20503-910a-495c-9f54-016a9f40a227 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:17.228933 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2ba20503-910a-495c-9f54-016a9f40a227 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:17.293574 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-0e92bfdc-e8f6-4d1f-8c07-70070006e498 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:17.303249 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-0e92bfdc-e8f6-4d1f-8c07-70070006e498 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1191 microversion: 2.1 time: 0.123437 Jun 17 15:14:17.305110 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 233/422] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:14:17 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1191 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:14:17.506079 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-108b75f6-476a-4e55-b2ef-3a5b87f45167 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:17.507789 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-108b75f6-476a-4e55-b2ef-3a5b87f45167 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:17.520003 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-108b75f6-476a-4e55-b2ef-3a5b87f45167 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:17.520691 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-108b75f6-476a-4e55-b2ef-3a5b87f45167 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:17.521678 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-108b75f6-476a-4e55-b2ef-3a5b87f45167 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:17.522164 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-108b75f6-476a-4e55-b2ef-3a5b87f45167 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:17.524484 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-2ba20503-910a-495c-9f54-016a9f40a227 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:17.533430 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-2ba20503-910a-495c-9f54-016a9f40a227 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:17.535010 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-2ba20503-910a-495c-9f54-016a9f40a227 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:17.537514 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-2ba20503-910a-495c-9f54-016a9f40a227 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1806 microversion: 2.20 time: 0.341006 Jun 17 15:14:17.538751 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 190/423] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:14:17 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1806 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 15:14:17.718993 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-108b75f6-476a-4e55-b2ef-3a5b87f45167 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:17.726814 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-108b75f6-476a-4e55-b2ef-3a5b87f45167 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1370 microversion: 2.1 time: 0.225867 Jun 17 15:14:17.727396 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 234/424] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:14:17 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1370 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:14:18.326208 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-68940528-6a90-4858-a8ca-2681b75857ae tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:18.326760 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-68940528-6a90-4858-a8ca-2681b75857ae tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:18.333916 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-68940528-6a90-4858-a8ca-2681b75857ae tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:18.334376 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-68940528-6a90-4858-a8ca-2681b75857ae tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:18.335212 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-68940528-6a90-4858-a8ca-2681b75857ae tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:18.335656 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-68940528-6a90-4858-a8ca-2681b75857ae tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:18.423889 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-68940528-6a90-4858-a8ca-2681b75857ae tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:18.432377 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-68940528-6a90-4858-a8ca-2681b75857ae tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1191 microversion: 2.1 time: 0.110147 Jun 17 15:14:18.433188 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 191/425] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:14:18 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1191 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:14:18.557302 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-08ef14e1-1851-4f02-b0df-0667df0f88b0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:18.558061 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-08ef14e1-1851-4f02-b0df-0667df0f88b0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:18.564610 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-08ef14e1-1851-4f02-b0df-0667df0f88b0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:18.565054 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-08ef14e1-1851-4f02-b0df-0667df0f88b0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:18.565804 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-08ef14e1-1851-4f02-b0df-0667df0f88b0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:18.566232 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-08ef14e1-1851-4f02-b0df-0667df0f88b0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:18.721096 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-08ef14e1-1851-4f02-b0df-0667df0f88b0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:18.731391 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-08ef14e1-1851-4f02-b0df-0667df0f88b0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:18.732830 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-08ef14e1-1851-4f02-b0df-0667df0f88b0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:18.734042 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-08ef14e1-1851-4f02-b0df-0667df0f88b0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1806 microversion: 2.20 time: 0.180750 Jun 17 15:14:18.734608 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 235/426] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:14:18 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1806 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 15:14:18.746403 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-6151609c-0112-46ed-be24-7b324f9e5d5c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:18.747472 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-6151609c-0112-46ed-be24-7b324f9e5d5c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:18.753953 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6151609c-0112-46ed-be24-7b324f9e5d5c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:18.754463 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6151609c-0112-46ed-be24-7b324f9e5d5c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:18.755220 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6151609c-0112-46ed-be24-7b324f9e5d5c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:18.755658 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6151609c-0112-46ed-be24-7b324f9e5d5c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:18.948906 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-6151609c-0112-46ed-be24-7b324f9e5d5c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:18.958211 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-6151609c-0112-46ed-be24-7b324f9e5d5c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1370 microversion: 2.1 time: 0.218044 Jun 17 15:14:18.966270 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 192/427] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:14:18 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1370 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:14:19.453230 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-f6c80677-8692-4423-bfee-8149a31f5c5e tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:19.454271 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-f6c80677-8692-4423-bfee-8149a31f5c5e tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:19.467588 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f6c80677-8692-4423-bfee-8149a31f5c5e tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:19.468846 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f6c80677-8692-4423-bfee-8149a31f5c5e tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:19.470999 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f6c80677-8692-4423-bfee-8149a31f5c5e tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:19.472191 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f6c80677-8692-4423-bfee-8149a31f5c5e tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:19.475981 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [req-63eb09bd-4d75-4858-b98e-94b85d0823f6 req-52b9bf5a-1b27-43eb-9200-333db16071bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba5d3180-d42a-4678-af13-c99282e054bf", "name": "network-vif-plugged", "status": "completed", "tag": "06e8bb11-060d-47aa-9950-9bdbeda221ff"}]} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:14:19.523556 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-63eb09bd-4d75-4858-b98e-94b85d0823f6 req-52b9bf5a-1b27-43eb-9200-333db16071bd service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:19.525218 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-63eb09bd-4d75-4858-b98e-94b85d0823f6 req-52b9bf5a-1b27-43eb-9200-333db16071bd service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:19.575178 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.compute.server_external_events [req-63eb09bd-4d75-4858-b98e-94b85d0823f6 req-52b9bf5a-1b27-43eb-9200-333db16071bd service nova] Creating event network-vif-plugged:06e8bb11-060d-47aa-9950-9bdbeda221ff for instance ba5d3180-d42a-4678-af13-c99282e054bf on hv-cinder-82549 Jun 17 15:14:19.585439 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [req-63eb09bd-4d75-4858-b98e-94b85d0823f6 req-52b9bf5a-1b27-43eb-9200-333db16071bd service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115817 Jun 17 15:14:19.587328 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 193/428] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 15:14:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:14:19.653476 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-f6c80677-8692-4423-bfee-8149a31f5c5e tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:19.670188 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-f6c80677-8692-4423-bfee-8149a31f5c5e tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1191 microversion: 2.1 time: 0.223722 Jun 17 15:14:19.676394 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 236/429] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:14:19 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1191 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:14:19.755452 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-51c094f8-cab3-473b-bec9-97bd8f3f614d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:19.756132 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-51c094f8-cab3-473b-bec9-97bd8f3f614d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:19.763682 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-51c094f8-cab3-473b-bec9-97bd8f3f614d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:19.764138 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-51c094f8-cab3-473b-bec9-97bd8f3f614d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:19.764993 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-51c094f8-cab3-473b-bec9-97bd8f3f614d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:19.765436 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-51c094f8-cab3-473b-bec9-97bd8f3f614d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:19.933917 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-51c094f8-cab3-473b-bec9-97bd8f3f614d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:19.959608 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-51c094f8-cab3-473b-bec9-97bd8f3f614d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:19.962143 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-51c094f8-cab3-473b-bec9-97bd8f3f614d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:19.963714 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-51c094f8-cab3-473b-bec9-97bd8f3f614d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1806 microversion: 2.20 time: 0.214036 Jun 17 15:14:19.965699 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 194/430] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:14:19 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1806 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:14:19.992053 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-11b0800f-9053-476f-acd8-15f14c8d7297 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:19.993366 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-11b0800f-9053-476f-acd8-15f14c8d7297 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:20.010826 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-11b0800f-9053-476f-acd8-15f14c8d7297 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:20.012458 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-11b0800f-9053-476f-acd8-15f14c8d7297 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:20.013983 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-11b0800f-9053-476f-acd8-15f14c8d7297 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:20.015013 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-11b0800f-9053-476f-acd8-15f14c8d7297 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:20.211886 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-11b0800f-9053-476f-acd8-15f14c8d7297 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:20.221935 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-11b0800f-9053-476f-acd8-15f14c8d7297 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1370 microversion: 2.1 time: 0.244778 Jun 17 15:14:20.222510 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 237/431] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:14:19 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1370 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:14:20.696972 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-b87b3444-3ab9-495b-91b0-7dd22a81240c tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:20.697802 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-b87b3444-3ab9-495b-91b0-7dd22a81240c tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:20.711395 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b87b3444-3ab9-495b-91b0-7dd22a81240c tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:20.713126 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b87b3444-3ab9-495b-91b0-7dd22a81240c tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:20.716881 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b87b3444-3ab9-495b-91b0-7dd22a81240c tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:20.718458 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b87b3444-3ab9-495b-91b0-7dd22a81240c tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:20.797796 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-b87b3444-3ab9-495b-91b0-7dd22a81240c tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:20.805391 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-b87b3444-3ab9-495b-91b0-7dd22a81240c tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1191 microversion: 2.1 time: 0.112375 Jun 17 15:14:20.806173 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 195/432] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:14:20 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1191 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:14:20.996224 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-466ec920-e000-4513-b274-3a925afc487f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:20.996961 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-466ec920-e000-4513-b274-3a925afc487f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:21.007519 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-466ec920-e000-4513-b274-3a925afc487f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:21.007973 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-466ec920-e000-4513-b274-3a925afc487f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:21.009221 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-466ec920-e000-4513-b274-3a925afc487f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:21.009828 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-466ec920-e000-4513-b274-3a925afc487f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:21.241936 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-32c0699e-9630-4f4b-b065-cc5cabff636b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:21.242839 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-32c0699e-9630-4f4b-b065-cc5cabff636b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:21.251983 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-32c0699e-9630-4f4b-b065-cc5cabff636b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:21.252764 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-32c0699e-9630-4f4b-b065-cc5cabff636b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:21.253546 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-32c0699e-9630-4f4b-b065-cc5cabff636b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:21.253982 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-32c0699e-9630-4f4b-b065-cc5cabff636b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:21.309922 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-466ec920-e000-4513-b274-3a925afc487f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:21.338627 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-466ec920-e000-4513-b274-3a925afc487f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:21.340106 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-466ec920-e000-4513-b274-3a925afc487f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:21.342264 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-466ec920-e000-4513-b274-3a925afc487f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1806 microversion: 2.20 time: 0.350884 Jun 17 15:14:21.343017 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 238/433] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:14:20 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1806 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:14:21.408476 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-32c0699e-9630-4f4b-b065-cc5cabff636b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:21.417479 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-32c0699e-9630-4f4b-b065-cc5cabff636b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1370 microversion: 2.1 time: 0.179846 Jun 17 15:14:21.420530 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 196/434] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:14:21 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1370 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:14:21.822550 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-9d58d013-cc33-410d-bc3d-408937661dd9 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:21.823314 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-9d58d013-cc33-410d-bc3d-408937661dd9 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:21.829300 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9d58d013-cc33-410d-bc3d-408937661dd9 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:21.829738 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9d58d013-cc33-410d-bc3d-408937661dd9 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:21.830494 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9d58d013-cc33-410d-bc3d-408937661dd9 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:21.830917 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9d58d013-cc33-410d-bc3d-408937661dd9 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:21.904962 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-9d58d013-cc33-410d-bc3d-408937661dd9 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:21.913661 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-9d58d013-cc33-410d-bc3d-408937661dd9 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1191 microversion: 2.1 time: 0.095495 Jun 17 15:14:21.914197 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 239/435] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:14:21 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1191 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:14:22.359819 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-5393aa09-4eff-4f3d-bf66-21a980613ff7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:22.360596 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-5393aa09-4eff-4f3d-bf66-21a980613ff7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:22.371913 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5393aa09-4eff-4f3d-bf66-21a980613ff7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:22.377717 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5393aa09-4eff-4f3d-bf66-21a980613ff7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:22.377717 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5393aa09-4eff-4f3d-bf66-21a980613ff7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:22.377717 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5393aa09-4eff-4f3d-bf66-21a980613ff7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:22.436826 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-e0bce6c2-6821-43f4-878c-e4a11f39e06d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:22.438333 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-e0bce6c2-6821-43f4-878c-e4a11f39e06d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:22.445908 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e0bce6c2-6821-43f4-878c-e4a11f39e06d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:22.446764 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e0bce6c2-6821-43f4-878c-e4a11f39e06d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:22.447759 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e0bce6c2-6821-43f4-878c-e4a11f39e06d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:22.448429 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e0bce6c2-6821-43f4-878c-e4a11f39e06d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:22.554947 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-5393aa09-4eff-4f3d-bf66-21a980613ff7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:22.559089 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell1:SELECT=100 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:14:22.567778 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-5393aa09-4eff-4f3d-bf66-21a980613ff7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:22.569693 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-5393aa09-4eff-4f3d-bf66-21a980613ff7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:22.571045 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-5393aa09-4eff-4f3d-bf66-21a980613ff7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1806 microversion: 2.20 time: 0.215082 Jun 17 15:14:22.571768 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 197/436] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:14:22 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1806 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:14:22.678408 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-e0bce6c2-6821-43f4-878c-e4a11f39e06d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:22.686035 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-e0bce6c2-6821-43f4-878c-e4a11f39e06d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1370 microversion: 2.1 time: 0.252941 Jun 17 15:14:22.686897 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 240/437] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:14:22 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1370 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:14:22.930428 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-c6bea703-40e8-490a-b094-c13387959099 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:22.930976 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-c6bea703-40e8-490a-b094-c13387959099 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:22.936977 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c6bea703-40e8-490a-b094-c13387959099 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:22.937426 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c6bea703-40e8-490a-b094-c13387959099 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:22.938187 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c6bea703-40e8-490a-b094-c13387959099 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:22.938619 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c6bea703-40e8-490a-b094-c13387959099 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:22.970779 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell0:SELECT=4 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:14:23.009628 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-c6bea703-40e8-490a-b094-c13387959099 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:23.031184 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-c6bea703-40e8-490a-b094-c13387959099 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1191 microversion: 2.1 time: 0.102283 Jun 17 15:14:23.041068 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 198/438] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:14:22 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1191 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:14:23.590794 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-3ab54eae-3f88-4029-96c9-40ea6ea3768a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:23.592038 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-3ab54eae-3f88-4029-96c9-40ea6ea3768a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:23.606011 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3ab54eae-3f88-4029-96c9-40ea6ea3768a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:23.609739 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3ab54eae-3f88-4029-96c9-40ea6ea3768a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:23.610760 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3ab54eae-3f88-4029-96c9-40ea6ea3768a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:23.611352 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3ab54eae-3f88-4029-96c9-40ea6ea3768a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:23.706479 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-0e213c47-e9cb-49e1-bbed-dee2c4b95ce1 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:23.707117 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-0e213c47-e9cb-49e1-bbed-dee2c4b95ce1 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:23.719129 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0e213c47-e9cb-49e1-bbed-dee2c4b95ce1 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:23.725236 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0e213c47-e9cb-49e1-bbed-dee2c4b95ce1 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:23.726866 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0e213c47-e9cb-49e1-bbed-dee2c4b95ce1 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:23.727455 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0e213c47-e9cb-49e1-bbed-dee2c4b95ce1 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:23.877419 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell0:SELECT=14 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:14:23.899477 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-0e213c47-e9cb-49e1-bbed-dee2c4b95ce1 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:23.908359 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-0e213c47-e9cb-49e1-bbed-dee2c4b95ce1 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1370 microversion: 2.1 time: 0.207166 Jun 17 15:14:23.911001 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 199/439] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:14:23 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1370 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:14:23.922502 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-3ab54eae-3f88-4029-96c9-40ea6ea3768a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:23.933214 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-3ab54eae-3f88-4029-96c9-40ea6ea3768a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:23.934738 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-3ab54eae-3f88-4029-96c9-40ea6ea3768a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:23.935921 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-3ab54eae-3f88-4029-96c9-40ea6ea3768a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1806 microversion: 2.20 time: 0.349933 Jun 17 15:14:23.941552 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 241/440] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:14:23 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1806 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:14:24.049636 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-7bd7a2a7-594c-4b74-9b8f-332ecb50940e tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:24.050283 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-7bd7a2a7-594c-4b74-9b8f-332ecb50940e tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:24.061959 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7bd7a2a7-594c-4b74-9b8f-332ecb50940e tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:24.065151 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7bd7a2a7-594c-4b74-9b8f-332ecb50940e tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:24.066452 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7bd7a2a7-594c-4b74-9b8f-332ecb50940e tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:24.067694 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7bd7a2a7-594c-4b74-9b8f-332ecb50940e tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:24.137134 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-7bd7a2a7-594c-4b74-9b8f-332ecb50940e tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:24.145387 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-7bd7a2a7-594c-4b74-9b8f-332ecb50940e tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1191 microversion: 2.1 time: 0.099172 Jun 17 15:14:24.145979 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 200/441] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:14:24 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1191 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:14:24.926744 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-f5dc1055-9b70-42e2-84f2-0b41fa1e7d15 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:24.927367 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-f5dc1055-9b70-42e2-84f2-0b41fa1e7d15 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:24.934208 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f5dc1055-9b70-42e2-84f2-0b41fa1e7d15 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:24.934673 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f5dc1055-9b70-42e2-84f2-0b41fa1e7d15 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:24.935505 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f5dc1055-9b70-42e2-84f2-0b41fa1e7d15 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:24.935986 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f5dc1055-9b70-42e2-84f2-0b41fa1e7d15 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:24.958819 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-908b3d3c-e7ab-41ef-9b12-8fadb2490074 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:24.960395 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-908b3d3c-e7ab-41ef-9b12-8fadb2490074 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:24.967050 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-908b3d3c-e7ab-41ef-9b12-8fadb2490074 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:24.967792 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-908b3d3c-e7ab-41ef-9b12-8fadb2490074 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:24.968567 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-908b3d3c-e7ab-41ef-9b12-8fadb2490074 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:24.969059 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-908b3d3c-e7ab-41ef-9b12-8fadb2490074 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:25.127741 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-f5dc1055-9b70-42e2-84f2-0b41fa1e7d15 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:25.137806 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-f5dc1055-9b70-42e2-84f2-0b41fa1e7d15 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1370 microversion: 2.1 time: 0.214580 Jun 17 15:14:25.138401 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 242/442] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:14:24 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1370 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:14:25.154750 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-908b3d3c-e7ab-41ef-9b12-8fadb2490074 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:25.163213 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-da7be963-7042-49b4-b1ff-2905e36f7c36 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:25.163934 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-da7be963-7042-49b4-b1ff-2905e36f7c36 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:25.164209 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-908b3d3c-e7ab-41ef-9b12-8fadb2490074 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:25.166303 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-908b3d3c-e7ab-41ef-9b12-8fadb2490074 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:25.167685 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-908b3d3c-e7ab-41ef-9b12-8fadb2490074 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1806 microversion: 2.20 time: 0.212831 Jun 17 15:14:25.168744 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 201/443] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:14:24 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1806 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 15:14:25.170579 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-da7be963-7042-49b4-b1ff-2905e36f7c36 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:25.171032 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-da7be963-7042-49b4-b1ff-2905e36f7c36 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:25.171821 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-da7be963-7042-49b4-b1ff-2905e36f7c36 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:25.172248 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-da7be963-7042-49b4-b1ff-2905e36f7c36 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:25.233255 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-da7be963-7042-49b4-b1ff-2905e36f7c36 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:25.240589 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-da7be963-7042-49b4-b1ff-2905e36f7c36 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1191 microversion: 2.1 time: 0.082098 Jun 17 15:14:25.241208 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 243/444] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:14:25 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1191 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:14:25.470737 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-3aeff8b2-886f-41b2-b042-0d452c78129f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1711494902", "imageRef": "8c105ca4-6fe3-4e70-af71-b03c64fe1efe", "flavorRef": "452", "networks": [{"uuid": "d35faa71-7887-4fdd-af5e-ab1ead5747a1"}]}} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:14:25.530876 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.network.neutron [None req-3aeff8b2-886f-41b2-b042-0d452c78129f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] validate_networks() for [('d35faa71-7887-4fdd-af5e-ab1ead5747a1', None, None, None, None, None)] {{(pid=117649) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 15:14:25.963450 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-3aeff8b2-886f-41b2-b042-0d452c78129f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Flavor limits 0:0:0 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 15:14:25.964160 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-3aeff8b2-886f-41b2-b042-0d452c78129f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Image limits 0:0:0 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 15:14:25.964532 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-3aeff8b2-886f-41b2-b042-0d452c78129f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Flavor pref 0:0:0 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 15:14:25.965011 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-3aeff8b2-886f-41b2-b042-0d452c78129f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Image pref 0:0:0 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 15:14:25.965769 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-3aeff8b2-886f-41b2-b042-0d452c78129f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 15:14:25.975646 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3aeff8b2-886f-41b2-b042-0d452c78129f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:25.976085 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3aeff8b2-886f-41b2-b042-0d452c78129f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:25.976903 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3aeff8b2-886f-41b2-b042-0d452c78129f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:25.977327 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3aeff8b2-886f-41b2-b042-0d452c78129f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:25.995341 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.quota [None req-3aeff8b2-886f-41b2-b042-0d452c78129f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Getting quotas for project 42b42320bc424a19b4ac5e35dae7afb3. Resources: {'cores', 'ram', 'instances'} {{(pid=117649) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 15:14:25.999424 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.quota [None req-3aeff8b2-886f-41b2-b042-0d452c78129f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Getting quotas for user b6ac8cbc7c6d4cce9d2b0a1289846a3d and project 42b42320bc424a19b4ac5e35dae7afb3. Resources: {'cores', 'ram', 'instances'} {{(pid=117649) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 15:14:26.013463 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-3aeff8b2-886f-41b2-b042-0d452c78129f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Going to run 1 instances... {{(pid=117649) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 15:14:26.017202 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-3aeff8b2-886f-41b2-b042-0d452c78129f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c105ca4-6fe3-4e70-af71-b03c64fe1efe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117649) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 15:14:26.087781 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-3aeff8b2-886f-41b2-b042-0d452c78129f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.623550 Jun 17 15:14:26.088984 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 202/445] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Jun 17 15:14:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 626 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 15:14:26.109820 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-45fab0b2-b7c7-4fdf-bbf6-697affa3f82d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:26.111085 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-45fab0b2-b7c7-4fdf-bbf6-697affa3f82d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:26.155699 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-8f369731-0423-4676-8ce9-bb059772438e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:26.156425 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-8f369731-0423-4676-8ce9-bb059772438e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:26.171857 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:14:26.182671 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-45fab0b2-b7c7-4fdf-bbf6-697affa3f82d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:26.183744 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8f369731-0423-4676-8ce9-bb059772438e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:26.184205 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8f369731-0423-4676-8ce9-bb059772438e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:26.190415 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8f369731-0423-4676-8ce9-bb059772438e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:26.190712 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-45fab0b2-b7c7-4fdf-bbf6-697affa3f82d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1219 microversion: 2.1 time: 0.094588 Jun 17 15:14:26.190848 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8f369731-0423-4676-8ce9-bb059772438e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:26.191551 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 244/446] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:14:26 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1219 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:14:26.204041 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-795bcf03-bb83-4543-8b7a-f1eca3f72701 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:26.204707 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-795bcf03-bb83-4543-8b7a-f1eca3f72701 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:26.211585 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-795bcf03-bb83-4543-8b7a-f1eca3f72701 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:26.212231 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-795bcf03-bb83-4543-8b7a-f1eca3f72701 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:26.213015 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-795bcf03-bb83-4543-8b7a-f1eca3f72701 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:26.213445 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-795bcf03-bb83-4543-8b7a-f1eca3f72701 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:26.415332 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-795bcf03-bb83-4543-8b7a-f1eca3f72701 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:26.428289 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-795bcf03-bb83-4543-8b7a-f1eca3f72701 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:26.430695 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-795bcf03-bb83-4543-8b7a-f1eca3f72701 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:26.432835 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-795bcf03-bb83-4543-8b7a-f1eca3f72701 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1806 microversion: 2.20 time: 0.240170 Jun 17 15:14:26.433851 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 245/447] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:14:26 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1806 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:14:26.444950 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-d7c3f084-2a73-4ea1-8108-93373e261e53 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:26.445818 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-d7c3f084-2a73-4ea1-8108-93373e261e53 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:26.446226 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-8f369731-0423-4676-8ce9-bb059772438e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:26.452754 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d7c3f084-2a73-4ea1-8108-93373e261e53 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:26.453369 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d7c3f084-2a73-4ea1-8108-93373e261e53 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:26.454308 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d7c3f084-2a73-4ea1-8108-93373e261e53 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:26.454736 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d7c3f084-2a73-4ea1-8108-93373e261e53 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:26.455072 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-8f369731-0423-4676-8ce9-bb059772438e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1370 microversion: 2.1 time: 0.303700 Jun 17 15:14:26.460905 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 203/448] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:14:26 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1370 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:14:26.530864 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-d7c3f084-2a73-4ea1-8108-93373e261e53 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:26.543102 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-d7c3f084-2a73-4ea1-8108-93373e261e53 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1191 microversion: 2.1 time: 0.107620 Jun 17 15:14:26.543947 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 246/449] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:14:26 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1191 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:14:27.206708 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-493828c1-c9c8-473a-87ca-f6c2da8acef8 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:27.207494 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-493828c1-c9c8-473a-87ca-f6c2da8acef8 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:27.214090 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-493828c1-c9c8-473a-87ca-f6c2da8acef8 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:27.214607 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-493828c1-c9c8-473a-87ca-f6c2da8acef8 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:27.215692 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-493828c1-c9c8-473a-87ca-f6c2da8acef8 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:27.216188 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-493828c1-c9c8-473a-87ca-f6c2da8acef8 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:27.279485 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-493828c1-c9c8-473a-87ca-f6c2da8acef8 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:27.288159 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-493828c1-c9c8-473a-87ca-f6c2da8acef8 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1223 microversion: 2.1 time: 0.085120 Jun 17 15:14:27.289057 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 204/450] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:14:27 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:14:27.452507 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-aeac818e-1650-43f6-aec3-327407870a35 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:27.453111 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-aeac818e-1650-43f6-aec3-327407870a35 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:27.460175 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-aeac818e-1650-43f6-aec3-327407870a35 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:27.460640 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-aeac818e-1650-43f6-aec3-327407870a35 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:27.461411 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-aeac818e-1650-43f6-aec3-327407870a35 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:27.461818 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-aeac818e-1650-43f6-aec3-327407870a35 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:27.473641 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-c8175b00-4cac-4dcf-b69a-ca5b0cd4260c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:27.474578 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-c8175b00-4cac-4dcf-b69a-ca5b0cd4260c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:27.481538 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c8175b00-4cac-4dcf-b69a-ca5b0cd4260c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:27.482312 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c8175b00-4cac-4dcf-b69a-ca5b0cd4260c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:27.483248 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c8175b00-4cac-4dcf-b69a-ca5b0cd4260c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:27.483863 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c8175b00-4cac-4dcf-b69a-ca5b0cd4260c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:27.607583 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-aeac818e-1650-43f6-aec3-327407870a35 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:27.617506 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-aeac818e-1650-43f6-aec3-327407870a35 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:27.619552 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-aeac818e-1650-43f6-aec3-327407870a35 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:27.621005 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-aeac818e-1650-43f6-aec3-327407870a35 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1806 microversion: 2.20 time: 0.172370 Jun 17 15:14:27.622241 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 247/451] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:14:27 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1806 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:14:27.627957 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-c1066dfb-9e52-4f1a-8af8-9fde70435e67 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:27.630042 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-c1066dfb-9e52-4f1a-8af8-9fde70435e67 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:27.637362 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c1066dfb-9e52-4f1a-8af8-9fde70435e67 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:27.638092 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c1066dfb-9e52-4f1a-8af8-9fde70435e67 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:27.639176 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c1066dfb-9e52-4f1a-8af8-9fde70435e67 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:27.639771 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c1066dfb-9e52-4f1a-8af8-9fde70435e67 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:27.654894 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-c8175b00-4cac-4dcf-b69a-ca5b0cd4260c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:27.662739 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-c8175b00-4cac-4dcf-b69a-ca5b0cd4260c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1370 microversion: 2.1 time: 0.193463 Jun 17 15:14:27.663944 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 205/452] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:14:27 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1370 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:14:27.666853 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=100 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:14:27.719382 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-c1066dfb-9e52-4f1a-8af8-9fde70435e67 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:27.735719 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-c1066dfb-9e52-4f1a-8af8-9fde70435e67 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1191 microversion: 2.1 time: 0.112196 Jun 17 15:14:27.737060 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 248/453] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:14:27 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1191 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:14:28.305178 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-76a78ef6-0a1a-4a60-8ff8-33144ca3cac6 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:28.305785 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-76a78ef6-0a1a-4a60-8ff8-33144ca3cac6 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:28.311571 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-76a78ef6-0a1a-4a60-8ff8-33144ca3cac6 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:28.312010 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-76a78ef6-0a1a-4a60-8ff8-33144ca3cac6 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:28.312794 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-76a78ef6-0a1a-4a60-8ff8-33144ca3cac6 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:28.313224 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-76a78ef6-0a1a-4a60-8ff8-33144ca3cac6 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:28.374456 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-76a78ef6-0a1a-4a60-8ff8-33144ca3cac6 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:28.383765 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-76a78ef6-0a1a-4a60-8ff8-33144ca3cac6 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1215 microversion: 2.1 time: 0.082738 Jun 17 15:14:28.384359 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 206/454] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:14:28 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1215 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:14:28.639976 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-9cf7718d-eef8-4653-b20c-d781a3145595 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:28.640619 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-9cf7718d-eef8-4653-b20c-d781a3145595 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:28.647123 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9cf7718d-eef8-4653-b20c-d781a3145595 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:28.647627 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9cf7718d-eef8-4653-b20c-d781a3145595 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:28.648373 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9cf7718d-eef8-4653-b20c-d781a3145595 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:28.648809 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9cf7718d-eef8-4653-b20c-d781a3145595 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:28.679915 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-ebde6285-7c1d-49ab-bdc3-40cb15cd1a48 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:28.680576 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-ebde6285-7c1d-49ab-bdc3-40cb15cd1a48 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:28.686652 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ebde6285-7c1d-49ab-bdc3-40cb15cd1a48 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:28.687095 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ebde6285-7c1d-49ab-bdc3-40cb15cd1a48 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:28.687853 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ebde6285-7c1d-49ab-bdc3-40cb15cd1a48 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:28.688318 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ebde6285-7c1d-49ab-bdc3-40cb15cd1a48 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:28.802516 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-9cf7718d-eef8-4653-b20c-d781a3145595 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:28.821758 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-9cf7718d-eef8-4653-b20c-d781a3145595 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:28.825532 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-9cf7718d-eef8-4653-b20c-d781a3145595 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:28.827160 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-9cf7718d-eef8-4653-b20c-d781a3145595 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1806 microversion: 2.20 time: 0.191079 Jun 17 15:14:28.827985 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 249/455] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:14:28 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1806 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:14:28.836192 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-fc74c1d5-52c0-4d90-a16d-ade0031606d5 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:28.837312 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-fc74c1d5-52c0-4d90-a16d-ade0031606d5 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:28.846259 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fc74c1d5-52c0-4d90-a16d-ade0031606d5 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:28.848702 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fc74c1d5-52c0-4d90-a16d-ade0031606d5 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:28.849752 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fc74c1d5-52c0-4d90-a16d-ade0031606d5 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:28.850479 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fc74c1d5-52c0-4d90-a16d-ade0031606d5 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:28.905184 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-ebde6285-7c1d-49ab-bdc3-40cb15cd1a48 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:28.913718 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-ebde6285-7c1d-49ab-bdc3-40cb15cd1a48 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1370 microversion: 2.1 time: 0.238031 Jun 17 15:14:28.914858 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 207/456] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:14:28 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1370 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:14:28.921998 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-fc74c1d5-52c0-4d90-a16d-ade0031606d5 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:28.931251 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-fc74c1d5-52c0-4d90-a16d-ade0031606d5 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1199 microversion: 2.1 time: 0.100780 Jun 17 15:14:28.932475 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 250/457] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:14:28 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1199 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:14:29.402936 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-d08aff77-1f3d-4137-839c-6008d893918a tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:29.403546 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-d08aff77-1f3d-4137-839c-6008d893918a tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:29.409528 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d08aff77-1f3d-4137-839c-6008d893918a tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:29.409969 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d08aff77-1f3d-4137-839c-6008d893918a tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:29.411219 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d08aff77-1f3d-4137-839c-6008d893918a tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:29.411648 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d08aff77-1f3d-4137-839c-6008d893918a tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:29.471963 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-d08aff77-1f3d-4137-839c-6008d893918a tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:29.479934 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-d08aff77-1f3d-4137-839c-6008d893918a tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1271 microversion: 2.1 time: 0.080859 Jun 17 15:14:29.480530 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 208/458] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:14:29 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1271 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:14:29.846707 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-79fa2472-81b2-4867-ba2e-e30be0e168d9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:29.847387 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-79fa2472-81b2-4867-ba2e-e30be0e168d9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:29.854761 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-79fa2472-81b2-4867-ba2e-e30be0e168d9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:29.855174 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-79fa2472-81b2-4867-ba2e-e30be0e168d9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:29.856006 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-79fa2472-81b2-4867-ba2e-e30be0e168d9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:29.856508 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-79fa2472-81b2-4867-ba2e-e30be0e168d9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:29.930786 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-8e7acd90-6d8e-4101-a34f-156d15770797 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:29.931311 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-8e7acd90-6d8e-4101-a34f-156d15770797 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:29.937422 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8e7acd90-6d8e-4101-a34f-156d15770797 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:29.937873 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8e7acd90-6d8e-4101-a34f-156d15770797 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:29.938638 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8e7acd90-6d8e-4101-a34f-156d15770797 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:29.939067 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8e7acd90-6d8e-4101-a34f-156d15770797 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:29.999008 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-79fa2472-81b2-4867-ba2e-e30be0e168d9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:30.008204 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-79fa2472-81b2-4867-ba2e-e30be0e168d9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:30.009750 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-79fa2472-81b2-4867-ba2e-e30be0e168d9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:30.010902 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-79fa2472-81b2-4867-ba2e-e30be0e168d9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1806 microversion: 2.20 time: 0.168355 Jun 17 15:14:30.011458 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 251/459] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:14:29 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1806 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:14:30.016004 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-59cee8fb-53f1-4ec9-a488-749a8b2bb0fa tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:30.016877 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-59cee8fb-53f1-4ec9-a488-749a8b2bb0fa tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:30.023986 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-59cee8fb-53f1-4ec9-a488-749a8b2bb0fa tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:30.030513 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-59cee8fb-53f1-4ec9-a488-749a8b2bb0fa tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:30.031341 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-59cee8fb-53f1-4ec9-a488-749a8b2bb0fa tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:30.031778 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-59cee8fb-53f1-4ec9-a488-749a8b2bb0fa tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:30.098225 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-59cee8fb-53f1-4ec9-a488-749a8b2bb0fa tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:30.109345 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-59cee8fb-53f1-4ec9-a488-749a8b2bb0fa tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1209 microversion: 2.1 time: 0.096622 Jun 17 15:14:30.110206 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 252/460] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:14:30 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1209 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:14:30.138842 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-8e7acd90-6d8e-4101-a34f-156d15770797 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:30.151019 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-8e7acd90-6d8e-4101-a34f-156d15770797 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1370 microversion: 2.1 time: 0.224125 Jun 17 15:14:30.152411 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 209/461] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:14:29 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1370 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:14:30.497273 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-4e616a23-19c5-4057-80fe-bb4cb137fb35 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:30.497856 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-4e616a23-19c5-4057-80fe-bb4cb137fb35 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:30.505021 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4e616a23-19c5-4057-80fe-bb4cb137fb35 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:30.505596 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4e616a23-19c5-4057-80fe-bb4cb137fb35 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:30.506500 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4e616a23-19c5-4057-80fe-bb4cb137fb35 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:30.506984 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4e616a23-19c5-4057-80fe-bb4cb137fb35 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:30.578784 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-4e616a23-19c5-4057-80fe-bb4cb137fb35 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:30.586482 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-4e616a23-19c5-4057-80fe-bb4cb137fb35 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1279 microversion: 2.1 time: 0.093079 Jun 17 15:14:30.587060 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 253/462] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:14:30 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1279 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:14:31.030321 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-a7404bb7-6c06-44c1-95e9-1e1ca9d808da tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:31.030862 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-a7404bb7-6c06-44c1-95e9-1e1ca9d808da tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:31.037447 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a7404bb7-6c06-44c1-95e9-1e1ca9d808da tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:31.037896 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a7404bb7-6c06-44c1-95e9-1e1ca9d808da tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:31.038684 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a7404bb7-6c06-44c1-95e9-1e1ca9d808da tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:31.039121 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a7404bb7-6c06-44c1-95e9-1e1ca9d808da tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:31.127183 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-a8c55ab1-8dec-45e4-a2c2-bb9b7063696a tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:31.127828 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-a8c55ab1-8dec-45e4-a2c2-bb9b7063696a tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:31.135393 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a8c55ab1-8dec-45e4-a2c2-bb9b7063696a tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:31.135845 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a8c55ab1-8dec-45e4-a2c2-bb9b7063696a tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:31.136644 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a8c55ab1-8dec-45e4-a2c2-bb9b7063696a tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:31.137101 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a8c55ab1-8dec-45e4-a2c2-bb9b7063696a tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:31.177342 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-a7404bb7-6c06-44c1-95e9-1e1ca9d808da tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:31.185849 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-a7404bb7-6c06-44c1-95e9-1e1ca9d808da tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:31.187349 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-a7404bb7-6c06-44c1-95e9-1e1ca9d808da tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:31.188538 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-a7404bb7-6c06-44c1-95e9-1e1ca9d808da tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1806 microversion: 2.20 time: 0.162245 Jun 17 15:14:31.189096 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 210/463] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:14:31 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1806 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:14:31.194397 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-5a6be18e-7855-4d1b-9ad5-e5c80bc7902c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:31.195082 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-5a6be18e-7855-4d1b-9ad5-e5c80bc7902c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:31.202070 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5a6be18e-7855-4d1b-9ad5-e5c80bc7902c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:31.202596 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5a6be18e-7855-4d1b-9ad5-e5c80bc7902c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:31.203365 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5a6be18e-7855-4d1b-9ad5-e5c80bc7902c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:31.203812 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5a6be18e-7855-4d1b-9ad5-e5c80bc7902c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:31.278432 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-a8c55ab1-8dec-45e4-a2c2-bb9b7063696a tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:31.286645 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-a8c55ab1-8dec-45e4-a2c2-bb9b7063696a tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1275 microversion: 2.1 time: 0.163602 Jun 17 15:14:31.287216 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 254/464] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:14:31 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1275 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:14:31.336468 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-5a6be18e-7855-4d1b-9ad5-e5c80bc7902c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:31.344205 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-5a6be18e-7855-4d1b-9ad5-e5c80bc7902c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1370 microversion: 2.1 time: 0.153362 Jun 17 15:14:31.344803 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 211/465] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:14:31 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1370 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:14:31.603050 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-8f5ed621-23a8-43ff-98d6-e5de6b776781 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:31.603697 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-8f5ed621-23a8-43ff-98d6-e5de6b776781 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:31.609750 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8f5ed621-23a8-43ff-98d6-e5de6b776781 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:31.610200 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8f5ed621-23a8-43ff-98d6-e5de6b776781 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:31.610970 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8f5ed621-23a8-43ff-98d6-e5de6b776781 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:31.611403 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8f5ed621-23a8-43ff-98d6-e5de6b776781 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:31.671987 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-8f5ed621-23a8-43ff-98d6-e5de6b776781 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:31.679439 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-8f5ed621-23a8-43ff-98d6-e5de6b776781 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1279 microversion: 2.1 time: 0.080261 Jun 17 15:14:31.680197 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 255/466] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:14:31 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1279 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:14:32.206002 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-0c88aecd-a171-4348-94f8-adbc3f04a72f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:32.206549 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-0c88aecd-a171-4348-94f8-adbc3f04a72f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:32.212490 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0c88aecd-a171-4348-94f8-adbc3f04a72f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:32.212929 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0c88aecd-a171-4348-94f8-adbc3f04a72f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:32.213671 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0c88aecd-a171-4348-94f8-adbc3f04a72f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:32.214095 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0c88aecd-a171-4348-94f8-adbc3f04a72f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:32.303085 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-3c8240b9-f900-41c9-bcf7-691b4cb3d041 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:32.303697 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-3c8240b9-f900-41c9-bcf7-691b4cb3d041 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:32.306027 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_api:SELECT=92 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:14:32.311343 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3c8240b9-f900-41c9-bcf7-691b4cb3d041 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:32.311793 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3c8240b9-f900-41c9-bcf7-691b4cb3d041 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:32.312695 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3c8240b9-f900-41c9-bcf7-691b4cb3d041 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:32.313129 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3c8240b9-f900-41c9-bcf7-691b4cb3d041 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:32.345357 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-0c88aecd-a171-4348-94f8-adbc3f04a72f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:32.354861 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-0c88aecd-a171-4348-94f8-adbc3f04a72f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:32.356418 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-0c88aecd-a171-4348-94f8-adbc3f04a72f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:32.357630 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-0c88aecd-a171-4348-94f8-adbc3f04a72f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1806 microversion: 2.20 time: 0.155579 Jun 17 15:14:32.358352 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 212/467] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:14:32 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1806 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:14:32.369880 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-39c69286-3a55-49fd-ae43-ba45c3ce6d20 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:32.370521 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-39c69286-3a55-49fd-ae43-ba45c3ce6d20 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:32.380408 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-39c69286-3a55-49fd-ae43-ba45c3ce6d20 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:32.380861 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-39c69286-3a55-49fd-ae43-ba45c3ce6d20 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:32.381635 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-39c69286-3a55-49fd-ae43-ba45c3ce6d20 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:32.382072 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-39c69286-3a55-49fd-ae43-ba45c3ce6d20 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:32.447962 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-3c8240b9-f900-41c9-bcf7-691b4cb3d041 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:32.455895 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-3c8240b9-f900-41c9-bcf7-691b4cb3d041 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1275 microversion: 2.1 time: 0.157174 Jun 17 15:14:32.456578 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 256/468] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:14:32 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1275 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:14:32.519745 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-39c69286-3a55-49fd-ae43-ba45c3ce6d20 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:32.527721 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-39c69286-3a55-49fd-ae43-ba45c3ce6d20 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1370 microversion: 2.1 time: 0.161634 Jun 17 15:14:32.528309 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 213/469] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:14:32 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1370 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:14:32.695659 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-de5b9fba-c443-4238-ba14-4624a83175c9 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:32.696310 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-de5b9fba-c443-4238-ba14-4624a83175c9 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:32.702689 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-de5b9fba-c443-4238-ba14-4624a83175c9 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:32.703138 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-de5b9fba-c443-4238-ba14-4624a83175c9 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:32.703923 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-de5b9fba-c443-4238-ba14-4624a83175c9 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:32.704386 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-de5b9fba-c443-4238-ba14-4624a83175c9 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:32.766915 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-de5b9fba-c443-4238-ba14-4624a83175c9 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:32.775106 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-de5b9fba-c443-4238-ba14-4624a83175c9 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1279 microversion: 2.1 time: 0.083400 Jun 17 15:14:32.775679 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 257/470] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:14:32 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1279 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:14:33.376077 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-4a64d471-b7bd-4d9e-b98b-c7d22ce15406 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:33.377457 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-4a64d471-b7bd-4d9e-b98b-c7d22ce15406 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:33.384648 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4a64d471-b7bd-4d9e-b98b-c7d22ce15406 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:33.385184 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4a64d471-b7bd-4d9e-b98b-c7d22ce15406 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:33.386355 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4a64d471-b7bd-4d9e-b98b-c7d22ce15406 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:33.386786 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4a64d471-b7bd-4d9e-b98b-c7d22ce15406 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:33.472750 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-b4eeb006-b04b-459d-8038-0af6072969dc tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:33.474006 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-b4eeb006-b04b-459d-8038-0af6072969dc tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:33.495554 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b4eeb006-b04b-459d-8038-0af6072969dc tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:33.496050 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b4eeb006-b04b-459d-8038-0af6072969dc tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:33.497309 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b4eeb006-b04b-459d-8038-0af6072969dc tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:33.497309 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b4eeb006-b04b-459d-8038-0af6072969dc tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:33.535097 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-4a64d471-b7bd-4d9e-b98b-c7d22ce15406 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:33.545486 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-4a64d471-b7bd-4d9e-b98b-c7d22ce15406 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:33.547043 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-4a64d471-b7bd-4d9e-b98b-c7d22ce15406 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:33.548223 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-4a64d471-b7bd-4d9e-b98b-c7d22ce15406 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1806 microversion: 2.20 time: 0.176283 Jun 17 15:14:33.549053 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 214/471] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:14:33 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1806 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:14:33.554177 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-be286f62-36cf-41f6-8ff7-3ee98357a095 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:33.554826 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-be286f62-36cf-41f6-8ff7-3ee98357a095 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:33.565289 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-be286f62-36cf-41f6-8ff7-3ee98357a095 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:33.566243 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-be286f62-36cf-41f6-8ff7-3ee98357a095 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:33.568263 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-be286f62-36cf-41f6-8ff7-3ee98357a095 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:33.569456 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-be286f62-36cf-41f6-8ff7-3ee98357a095 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:33.574619 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell1:SELECT=100 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:14:33.713888 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-b4eeb006-b04b-459d-8038-0af6072969dc tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:33.723221 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-b4eeb006-b04b-459d-8038-0af6072969dc tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1275 microversion: 2.1 time: 0.253805 Jun 17 15:14:33.724166 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 258/472] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:14:33 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1275 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:14:33.730008 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [req-c8591ea6-211d-4284-8f1e-f14c342e167f req-eb40b375-a140-4b08-b933-85085f558149 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8fee7bc0-cd0e-4c25-8475-b43e79cb933a", "tag": "4e15dfc0-dc8a-4b19-9fc3-632ff970220b"}]} {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:14:33.734069 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-be286f62-36cf-41f6-8ff7-3ee98357a095 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:33.739870 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [req-c8591ea6-211d-4284-8f1e-f14c342e167f req-eb40b375-a140-4b08-b933-85085f558149 service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:33.740442 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [req-c8591ea6-211d-4284-8f1e-f14c342e167f req-eb40b375-a140-4b08-b933-85085f558149 service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:33.743238 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-be286f62-36cf-41f6-8ff7-3ee98357a095 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1561 microversion: 2.1 time: 0.193202 Jun 17 15:14:33.753395 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.compute.server_external_events [req-c8591ea6-211d-4284-8f1e-f14c342e167f req-eb40b375-a140-4b08-b933-85085f558149 service nova] Creating event network-changed:4e15dfc0-dc8a-4b19-9fc3-632ff970220b for instance 8fee7bc0-cd0e-4c25-8475-b43e79cb933a on hv-cinder-82549 Jun 17 15:14:33.755650 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 215/473] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:14:33 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1561 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:14:33.760781 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-d5eb095c-0f49-4c12-9325-8655f1102974 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:33.761025 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [req-c8591ea6-211d-4284-8f1e-f14c342e167f req-eb40b375-a140-4b08-b933-85085f558149 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034786 Jun 17 15:14:33.761285 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-d5eb095c-0f49-4c12-9325-8655f1102974 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:33.761822 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 259/474] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 15:14:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:14:33.767805 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d5eb095c-0f49-4c12-9325-8655f1102974 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:33.768262 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d5eb095c-0f49-4c12-9325-8655f1102974 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:33.769072 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d5eb095c-0f49-4c12-9325-8655f1102974 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:33.770250 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d5eb095c-0f49-4c12-9325-8655f1102974 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:33.792712 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-76c1d2f0-3659-4ed5-b367-3f58e40f734c tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:33.793743 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-76c1d2f0-3659-4ed5-b367-3f58e40f734c tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:33.800170 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-76c1d2f0-3659-4ed5-b367-3f58e40f734c tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:33.800717 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-76c1d2f0-3659-4ed5-b367-3f58e40f734c tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:33.801589 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-76c1d2f0-3659-4ed5-b367-3f58e40f734c tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:33.802020 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-76c1d2f0-3659-4ed5-b367-3f58e40f734c tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:33.859827 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-d5eb095c-0f49-4c12-9325-8655f1102974 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.102967 Jun 17 15:14:33.860501 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 216/475] 10.222.0.48 () {58 vars in 1274 bytes} [Fri Jun 17 15:14:33 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:14:33.869093 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-76c1d2f0-3659-4ed5-b367-3f58e40f734c tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:33.876763 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-76c1d2f0-3659-4ed5-b367-3f58e40f734c tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1277 microversion: 2.1 time: 0.088597 Jun 17 15:14:33.877879 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 260/476] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:14:33 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1277 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:14:34.567914 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-b29d5583-9354-46b2-9403-51ac1ee612d9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:34.568552 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-b29d5583-9354-46b2-9403-51ac1ee612d9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:34.574683 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b29d5583-9354-46b2-9403-51ac1ee612d9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:34.575134 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b29d5583-9354-46b2-9403-51ac1ee612d9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:34.575923 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b29d5583-9354-46b2-9403-51ac1ee612d9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:34.576455 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b29d5583-9354-46b2-9403-51ac1ee612d9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:34.740007 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-b2c6a789-425a-4fce-a28c-2edee3d46d82 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:34.740676 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-b2c6a789-425a-4fce-a28c-2edee3d46d82 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:34.747738 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b2c6a789-425a-4fce-a28c-2edee3d46d82 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:34.748212 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b2c6a789-425a-4fce-a28c-2edee3d46d82 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:34.748984 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b2c6a789-425a-4fce-a28c-2edee3d46d82 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:34.749426 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b2c6a789-425a-4fce-a28c-2edee3d46d82 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:34.900298 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-b2c6a789-425a-4fce-a28c-2edee3d46d82 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:34.908022 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-b2c6a789-425a-4fce-a28c-2edee3d46d82 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1275 microversion: 2.1 time: 0.172002 Jun 17 15:14:34.908965 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 261/477] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:14:34 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1275 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:14:34.913605 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-01327804-8ca6-4752-8e13-d3197e99134f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:34.914872 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-01327804-8ca6-4752-8e13-d3197e99134f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:34.921743 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-01327804-8ca6-4752-8e13-d3197e99134f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:34.922468 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-01327804-8ca6-4752-8e13-d3197e99134f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:34.923241 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-01327804-8ca6-4752-8e13-d3197e99134f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:34.923673 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-01327804-8ca6-4752-8e13-d3197e99134f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:35.009394 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-01327804-8ca6-4752-8e13-d3197e99134f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:35.021009 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-01327804-8ca6-4752-8e13-d3197e99134f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1277 microversion: 2.1 time: 0.110965 Jun 17 15:14:35.021682 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 262/478] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:14:34 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1277 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:14:35.114647 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-b29d5583-9354-46b2-9403-51ac1ee612d9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:35.128316 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-b29d5583-9354-46b2-9403-51ac1ee612d9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:35.131933 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-b29d5583-9354-46b2-9403-51ac1ee612d9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:35.134141 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-b29d5583-9354-46b2-9403-51ac1ee612d9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1806 microversion: 2.20 time: 0.570524 Jun 17 15:14:35.135144 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 217/479] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:14:34 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1806 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:14:35.685165 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [req-877e5061-d0b7-4b55-ba14-35050f132df6 req-391aacc9-f1ac-42e3-b9f4-4970af9df415 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba5d3180-d42a-4678-af13-c99282e054bf", "tag": "06e8bb11-060d-47aa-9950-9bdbeda221ff"}]} {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:14:35.695004 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [req-877e5061-d0b7-4b55-ba14-35050f132df6 req-391aacc9-f1ac-42e3-b9f4-4970af9df415 service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:35.695349 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [req-877e5061-d0b7-4b55-ba14-35050f132df6 req-391aacc9-f1ac-42e3-b9f4-4970af9df415 service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:35.708166 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.compute.server_external_events [req-877e5061-d0b7-4b55-ba14-35050f132df6 req-391aacc9-f1ac-42e3-b9f4-4970af9df415 service nova] Creating event network-changed:06e8bb11-060d-47aa-9950-9bdbeda221ff for instance ba5d3180-d42a-4678-af13-c99282e054bf on hv-cinder-82549 Jun 17 15:14:35.713497 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [req-877e5061-d0b7-4b55-ba14-35050f132df6 req-391aacc9-f1ac-42e3-b9f4-4970af9df415 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031949 Jun 17 15:14:35.714225 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 263/480] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 15:14:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:14:35.925484 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-b5b4f73a-2f0c-4d26-b348-270c94ea5811 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:35.926756 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-b5b4f73a-2f0c-4d26-b348-270c94ea5811 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:35.933574 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b5b4f73a-2f0c-4d26-b348-270c94ea5811 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:35.934013 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b5b4f73a-2f0c-4d26-b348-270c94ea5811 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:35.934810 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b5b4f73a-2f0c-4d26-b348-270c94ea5811 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:35.935243 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b5b4f73a-2f0c-4d26-b348-270c94ea5811 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:35.985742 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell0:SELECT=2 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:14:36.007727 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell0:SELECT=6 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:14:36.040664 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-0c7b2b09-05da-4067-beb5-c05cebfbada1 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:36.041936 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-0c7b2b09-05da-4067-beb5-c05cebfbada1 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:36.052760 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0c7b2b09-05da-4067-beb5-c05cebfbada1 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:36.053539 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0c7b2b09-05da-4067-beb5-c05cebfbada1 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:36.054917 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0c7b2b09-05da-4067-beb5-c05cebfbada1 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:36.055685 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0c7b2b09-05da-4067-beb5-c05cebfbada1 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:36.122695 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-b5b4f73a-2f0c-4d26-b348-270c94ea5811 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:36.136615 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-b5b4f73a-2f0c-4d26-b348-270c94ea5811 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1275 microversion: 2.1 time: 0.215089 Jun 17 15:14:36.137602 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 218/481] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:14:35 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1275 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:14:36.187910 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-70976b6e-dd9f-4562-b36c-6e2b8f8db3d1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:36.190640 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-70976b6e-dd9f-4562-b36c-6e2b8f8db3d1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:36.190881 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell0:SELECT=2 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:14:36.207605 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-70976b6e-dd9f-4562-b36c-6e2b8f8db3d1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:36.208885 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-70976b6e-dd9f-4562-b36c-6e2b8f8db3d1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:36.210867 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-70976b6e-dd9f-4562-b36c-6e2b8f8db3d1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:36.212168 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-70976b6e-dd9f-4562-b36c-6e2b8f8db3d1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:36.303250 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-0c7b2b09-05da-4067-beb5-c05cebfbada1 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:36.311744 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-0c7b2b09-05da-4067-beb5-c05cebfbada1 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1319 microversion: 2.1 time: 0.277230 Jun 17 15:14:36.312684 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 264/482] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:14:36 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1319 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:14:36.423846 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-70976b6e-dd9f-4562-b36c-6e2b8f8db3d1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:36.435725 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-70976b6e-dd9f-4562-b36c-6e2b8f8db3d1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:36.437485 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-70976b6e-dd9f-4562-b36c-6e2b8f8db3d1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:36.438961 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-70976b6e-dd9f-4562-b36c-6e2b8f8db3d1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1806 microversion: 2.20 time: 0.268474 Jun 17 15:14:36.439733 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 219/483] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:14:36 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1806 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:14:37.166275 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-76d0fd71-2176-47b5-b888-fd22ea1149c5 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:37.166995 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-76d0fd71-2176-47b5-b888-fd22ea1149c5 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:37.174208 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-76d0fd71-2176-47b5-b888-fd22ea1149c5 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:37.174657 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-76d0fd71-2176-47b5-b888-fd22ea1149c5 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:37.175453 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-76d0fd71-2176-47b5-b888-fd22ea1149c5 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:37.176472 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-76d0fd71-2176-47b5-b888-fd22ea1149c5 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:37.329087 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-d9ba74b7-95d5-4661-af0d-442d4e252246 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:37.329771 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-d9ba74b7-95d5-4661-af0d-442d4e252246 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:37.336481 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d9ba74b7-95d5-4661-af0d-442d4e252246 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:37.336653 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d9ba74b7-95d5-4661-af0d-442d4e252246 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:37.337325 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d9ba74b7-95d5-4661-af0d-442d4e252246 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:37.337969 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d9ba74b7-95d5-4661-af0d-442d4e252246 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:37.339255 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-76d0fd71-2176-47b5-b888-fd22ea1149c5 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:37.351270 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-76d0fd71-2176-47b5-b888-fd22ea1149c5 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1275 microversion: 2.1 time: 0.188437 Jun 17 15:14:37.358440 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 265/484] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:14:37 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1275 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:14:37.459529 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-1139aaf7-15c9-4572-bdf7-85cde42f7669 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:37.460753 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-1139aaf7-15c9-4572-bdf7-85cde42f7669 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:37.468024 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1139aaf7-15c9-4572-bdf7-85cde42f7669 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:37.468678 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1139aaf7-15c9-4572-bdf7-85cde42f7669 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:37.469611 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1139aaf7-15c9-4572-bdf7-85cde42f7669 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:37.470166 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1139aaf7-15c9-4572-bdf7-85cde42f7669 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:37.493859 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=100 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:14:37.498300 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-d9ba74b7-95d5-4661-af0d-442d4e252246 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:37.512310 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-d9ba74b7-95d5-4661-af0d-442d4e252246 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1319 microversion: 2.1 time: 0.186755 Jun 17 15:14:37.513328 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 220/485] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:14:37 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1319 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:14:37.627711 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-1139aaf7-15c9-4572-bdf7-85cde42f7669 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:37.637269 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-1139aaf7-15c9-4572-bdf7-85cde42f7669 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:37.638783 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-1139aaf7-15c9-4572-bdf7-85cde42f7669 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:37.639944 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-1139aaf7-15c9-4572-bdf7-85cde42f7669 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1806 microversion: 2.20 time: 0.184428 Jun 17 15:14:37.640541 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 266/486] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:14:37 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1806 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 15:14:38.378532 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-2595d9df-8648-4150-9b21-e66105ae26f0 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:38.381152 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-2595d9df-8648-4150-9b21-e66105ae26f0 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:38.397789 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2595d9df-8648-4150-9b21-e66105ae26f0 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:38.399302 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2595d9df-8648-4150-9b21-e66105ae26f0 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:38.401195 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2595d9df-8648-4150-9b21-e66105ae26f0 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:38.402338 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2595d9df-8648-4150-9b21-e66105ae26f0 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:38.530352 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-5789ac5f-4c9a-4e83-85a3-f3def124d4cd tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:38.532735 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-5789ac5f-4c9a-4e83-85a3-f3def124d4cd tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:38.547117 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5789ac5f-4c9a-4e83-85a3-f3def124d4cd tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:38.547620 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5789ac5f-4c9a-4e83-85a3-f3def124d4cd tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:38.548635 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5789ac5f-4c9a-4e83-85a3-f3def124d4cd tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:38.549064 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5789ac5f-4c9a-4e83-85a3-f3def124d4cd tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:38.829308 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-5789ac5f-4c9a-4e83-85a3-f3def124d4cd tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:38.839354 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-5789ac5f-4c9a-4e83-85a3-f3def124d4cd tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1319 microversion: 2.1 time: 0.312857 Jun 17 15:14:38.840108 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 267/487] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:14:38 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1319 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:14:38.869696 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-c2fb64de-173e-4ef6-9ea1-40be7c597b82 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:38.870699 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-c2fb64de-173e-4ef6-9ea1-40be7c597b82 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:38.884261 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c2fb64de-173e-4ef6-9ea1-40be7c597b82 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:38.885352 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c2fb64de-173e-4ef6-9ea1-40be7c597b82 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:38.886647 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c2fb64de-173e-4ef6-9ea1-40be7c597b82 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:38.887631 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c2fb64de-173e-4ef6-9ea1-40be7c597b82 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:38.934738 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-2595d9df-8648-4150-9b21-e66105ae26f0 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:38.951677 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-2595d9df-8648-4150-9b21-e66105ae26f0 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1263 microversion: 2.1 time: 0.584567 Jun 17 15:14:38.953374 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 221/488] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:14:38 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1263 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:14:39.082769 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-c2fb64de-173e-4ef6-9ea1-40be7c597b82 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:39.096160 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-c2fb64de-173e-4ef6-9ea1-40be7c597b82 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:39.099002 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-c2fb64de-173e-4ef6-9ea1-40be7c597b82 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:39.100630 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-c2fb64de-173e-4ef6-9ea1-40be7c597b82 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1806 microversion: 2.20 time: 0.238726 Jun 17 15:14:39.101348 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 268/489] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:14:38 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1806 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:14:39.399379 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [req-02443bb6-f188-4c97-9dca-9063cba994c9 req-b2ba56da-30a9-49f3-9e8d-6e81ee5492c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "808f28e6-03bc-4b67-ab1f-f1ef13838924", "tag": "6f21e069-6aab-4e06-9e07-c0ccc170bbac"}]} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:14:39.409146 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-02443bb6-f188-4c97-9dca-9063cba994c9 req-b2ba56da-30a9-49f3-9e8d-6e81ee5492c8 service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:39.410166 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-02443bb6-f188-4c97-9dca-9063cba994c9 req-b2ba56da-30a9-49f3-9e8d-6e81ee5492c8 service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:39.423956 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.compute.server_external_events [req-02443bb6-f188-4c97-9dca-9063cba994c9 req-b2ba56da-30a9-49f3-9e8d-6e81ee5492c8 service nova] Creating event network-changed:6f21e069-6aab-4e06-9e07-c0ccc170bbac for instance 808f28e6-03bc-4b67-ab1f-f1ef13838924 on hv-cinder-82549 Jun 17 15:14:39.432605 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [req-02443bb6-f188-4c97-9dca-9063cba994c9 req-b2ba56da-30a9-49f3-9e8d-6e81ee5492c8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036746 Jun 17 15:14:39.433582 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 222/490] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 15:14:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:14:39.867901 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-4ac174eb-4db5-4e76-823a-371d07777c53 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:39.869045 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-4ac174eb-4db5-4e76-823a-371d07777c53 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:39.883230 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4ac174eb-4db5-4e76-823a-371d07777c53 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:39.884695 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4ac174eb-4db5-4e76-823a-371d07777c53 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:39.886470 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4ac174eb-4db5-4e76-823a-371d07777c53 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:39.887065 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4ac174eb-4db5-4e76-823a-371d07777c53 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:39.983197 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-77cb46a1-0210-4dce-b833-4ad54923428b tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:39.992525 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-77cb46a1-0210-4dce-b833-4ad54923428b tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:40.004713 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-77cb46a1-0210-4dce-b833-4ad54923428b tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:40.005786 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-77cb46a1-0210-4dce-b833-4ad54923428b tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:40.007347 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-77cb46a1-0210-4dce-b833-4ad54923428b tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:40.008292 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-77cb46a1-0210-4dce-b833-4ad54923428b tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:40.427050 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-77cb46a1-0210-4dce-b833-4ad54923428b tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:40.439455 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-77cb46a1-0210-4dce-b833-4ad54923428b tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1263 microversion: 2.1 time: 0.470737 Jun 17 15:14:40.440771 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 223/491] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:14:39 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1263 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:14:40.450434 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-78e6423d-9dac-4b33-bd50-74d09eec0865 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:40.451642 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-78e6423d-9dac-4b33-bd50-74d09eec0865 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:40.462794 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-78e6423d-9dac-4b33-bd50-74d09eec0865 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:40.463476 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-78e6423d-9dac-4b33-bd50-74d09eec0865 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:40.464775 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-78e6423d-9dac-4b33-bd50-74d09eec0865 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:40.465950 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-78e6423d-9dac-4b33-bd50-74d09eec0865 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:40.531143 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-4ac174eb-4db5-4e76-823a-371d07777c53 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:40.539844 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-4ac174eb-4db5-4e76-823a-371d07777c53 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1319 microversion: 2.1 time: 0.680687 Jun 17 15:14:40.540502 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 269/492] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:14:39 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1319 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:14:40.974799 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-78e6423d-9dac-4b33-bd50-74d09eec0865 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:40.984545 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-78e6423d-9dac-4b33-bd50-74d09eec0865 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:40.986051 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-78e6423d-9dac-4b33-bd50-74d09eec0865 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:40.987242 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-78e6423d-9dac-4b33-bd50-74d09eec0865 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1806 microversion: 2.20 time: 0.544497 Jun 17 15:14:40.988588 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 224/493] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:14:40 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1806 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:14:41.459228 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-c8807f38-b5b3-402a-8727-95edc3962127 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:41.459842 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-c8807f38-b5b3-402a-8727-95edc3962127 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:41.473690 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c8807f38-b5b3-402a-8727-95edc3962127 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:41.479458 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c8807f38-b5b3-402a-8727-95edc3962127 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:41.480348 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c8807f38-b5b3-402a-8727-95edc3962127 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:41.481101 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c8807f38-b5b3-402a-8727-95edc3962127 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:41.559153 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-f01f2d33-6e13-4715-869b-8fbebdf1b9c5 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:41.560027 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-f01f2d33-6e13-4715-869b-8fbebdf1b9c5 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:41.568638 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f01f2d33-6e13-4715-869b-8fbebdf1b9c5 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:41.569206 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f01f2d33-6e13-4715-869b-8fbebdf1b9c5 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:41.570321 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f01f2d33-6e13-4715-869b-8fbebdf1b9c5 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:41.570863 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f01f2d33-6e13-4715-869b-8fbebdf1b9c5 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:41.620745 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-c8807f38-b5b3-402a-8727-95edc3962127 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:41.628680 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-c8807f38-b5b3-402a-8727-95edc3962127 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1263 microversion: 2.1 time: 0.173206 Jun 17 15:14:41.629361 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 270/494] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:14:41 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1263 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:14:41.701640 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-f01f2d33-6e13-4715-869b-8fbebdf1b9c5 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:41.710095 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-f01f2d33-6e13-4715-869b-8fbebdf1b9c5 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1319 microversion: 2.1 time: 0.156616 Jun 17 15:14:41.710708 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 225/495] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:14:41 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:14:42.006017 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-7b186942-6772-4945-b409-ee2a180c2a02 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:42.006623 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-7b186942-6772-4945-b409-ee2a180c2a02 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:42.012932 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7b186942-6772-4945-b409-ee2a180c2a02 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:42.013371 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7b186942-6772-4945-b409-ee2a180c2a02 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:42.014119 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7b186942-6772-4945-b409-ee2a180c2a02 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:42.014550 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7b186942-6772-4945-b409-ee2a180c2a02 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:42.141015 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-7b186942-6772-4945-b409-ee2a180c2a02 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:42.150107 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-7b186942-6772-4945-b409-ee2a180c2a02 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:42.151640 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-7b186942-6772-4945-b409-ee2a180c2a02 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:42.152841 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-7b186942-6772-4945-b409-ee2a180c2a02 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1806 microversion: 2.20 time: 0.151326 Jun 17 15:14:42.153613 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 271/496] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:14:42 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1806 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:14:42.645642 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-3ff0bcf9-9f88-4d5d-abb7-c96c646a0f5c tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:42.646164 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-3ff0bcf9-9f88-4d5d-abb7-c96c646a0f5c tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:42.652452 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3ff0bcf9-9f88-4d5d-abb7-c96c646a0f5c tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:42.652894 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3ff0bcf9-9f88-4d5d-abb7-c96c646a0f5c tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:42.653638 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3ff0bcf9-9f88-4d5d-abb7-c96c646a0f5c tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:42.654065 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3ff0bcf9-9f88-4d5d-abb7-c96c646a0f5c tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:42.728228 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-9c76a196-8465-4af3-bcf6-93791119b93d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:42.729008 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-9c76a196-8465-4af3-bcf6-93791119b93d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:42.736165 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9c76a196-8465-4af3-bcf6-93791119b93d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:42.736747 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9c76a196-8465-4af3-bcf6-93791119b93d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:42.737610 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9c76a196-8465-4af3-bcf6-93791119b93d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:42.738746 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9c76a196-8465-4af3-bcf6-93791119b93d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:42.793966 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-3ff0bcf9-9f88-4d5d-abb7-c96c646a0f5c tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:42.802479 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-3ff0bcf9-9f88-4d5d-abb7-c96c646a0f5c tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1263 microversion: 2.1 time: 0.160704 Jun 17 15:14:42.803687 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 226/497] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:14:42 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1263 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:14:42.873387 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-9c76a196-8465-4af3-bcf6-93791119b93d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:42.881083 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-9c76a196-8465-4af3-bcf6-93791119b93d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1319 microversion: 2.1 time: 0.156831 Jun 17 15:14:42.881678 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 272/498] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:14:42 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:14:43.171605 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-1a22c2f7-dfac-470e-bc5a-31941bc66ab8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:43.172219 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-1a22c2f7-dfac-470e-bc5a-31941bc66ab8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:43.178803 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1a22c2f7-dfac-470e-bc5a-31941bc66ab8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:43.179248 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1a22c2f7-dfac-470e-bc5a-31941bc66ab8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:43.180031 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1a22c2f7-dfac-470e-bc5a-31941bc66ab8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:43.180505 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1a22c2f7-dfac-470e-bc5a-31941bc66ab8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:43.315589 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-1a22c2f7-dfac-470e-bc5a-31941bc66ab8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:43.325225 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-1a22c2f7-dfac-470e-bc5a-31941bc66ab8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:43.326710 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-1a22c2f7-dfac-470e-bc5a-31941bc66ab8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:43.327856 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-1a22c2f7-dfac-470e-bc5a-31941bc66ab8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1806 microversion: 2.20 time: 0.160385 Jun 17 15:14:43.328436 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 227/499] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:14:43 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1806 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:14:43.819849 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-e6cd962a-d482-4ace-b306-2f018016e3b5 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:43.820509 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-e6cd962a-d482-4ace-b306-2f018016e3b5 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:43.827653 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e6cd962a-d482-4ace-b306-2f018016e3b5 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:43.828081 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e6cd962a-d482-4ace-b306-2f018016e3b5 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:43.828898 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e6cd962a-d482-4ace-b306-2f018016e3b5 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:43.829337 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e6cd962a-d482-4ace-b306-2f018016e3b5 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:43.898276 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-844703a9-eafa-43e8-971c-22f2fee6a958 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:43.899272 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-844703a9-eafa-43e8-971c-22f2fee6a958 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:43.905610 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-844703a9-eafa-43e8-971c-22f2fee6a958 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:43.906051 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-844703a9-eafa-43e8-971c-22f2fee6a958 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:43.906818 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-844703a9-eafa-43e8-971c-22f2fee6a958 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:43.907248 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-844703a9-eafa-43e8-971c-22f2fee6a958 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:43.979169 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-e6cd962a-d482-4ace-b306-2f018016e3b5 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:43.987082 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-e6cd962a-d482-4ace-b306-2f018016e3b5 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1263 microversion: 2.1 time: 0.171711 Jun 17 15:14:43.987662 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 273/500] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:14:43 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1263 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:14:44.044306 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-844703a9-eafa-43e8-971c-22f2fee6a958 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:44.052497 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-844703a9-eafa-43e8-971c-22f2fee6a958 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1319 microversion: 2.1 time: 0.158140 Jun 17 15:14:44.053068 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 228/501] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:14:43 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:14:44.346616 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-3011f979-f844-4025-ab6f-77362f461987 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:44.347249 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-3011f979-f844-4025-ab6f-77362f461987 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:44.353299 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3011f979-f844-4025-ab6f-77362f461987 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:44.353746 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3011f979-f844-4025-ab6f-77362f461987 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:44.354499 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3011f979-f844-4025-ab6f-77362f461987 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:44.354924 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3011f979-f844-4025-ab6f-77362f461987 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:44.484034 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-3011f979-f844-4025-ab6f-77362f461987 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:44.493323 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-3011f979-f844-4025-ab6f-77362f461987 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:44.494948 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-3011f979-f844-4025-ab6f-77362f461987 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:44.496140 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-3011f979-f844-4025-ab6f-77362f461987 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1806 microversion: 2.20 time: 0.153447 Jun 17 15:14:44.496777 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 274/502] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:14:44 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1806 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:14:45.004625 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-5c4b54d3-769a-46a6-abef-7357d9e70f5e tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:45.005194 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-5c4b54d3-769a-46a6-abef-7357d9e70f5e tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:45.011079 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5c4b54d3-769a-46a6-abef-7357d9e70f5e tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:45.011533 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5c4b54d3-769a-46a6-abef-7357d9e70f5e tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:45.012253 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5c4b54d3-769a-46a6-abef-7357d9e70f5e tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:45.012715 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5c4b54d3-769a-46a6-abef-7357d9e70f5e tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:45.069177 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-9168361a-53e1-4ee8-ad3d-b6243e95fe27 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:45.069792 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-9168361a-53e1-4ee8-ad3d-b6243e95fe27 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:45.076235 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9168361a-53e1-4ee8-ad3d-b6243e95fe27 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:45.076724 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9168361a-53e1-4ee8-ad3d-b6243e95fe27 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:45.077478 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9168361a-53e1-4ee8-ad3d-b6243e95fe27 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:45.077903 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9168361a-53e1-4ee8-ad3d-b6243e95fe27 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:45.143033 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-5c4b54d3-769a-46a6-abef-7357d9e70f5e tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:45.150306 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-5c4b54d3-769a-46a6-abef-7357d9e70f5e tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1263 microversion: 2.1 time: 0.149731 Jun 17 15:14:45.150886 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 229/503] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:14:44 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1263 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:14:45.210010 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-9168361a-53e1-4ee8-ad3d-b6243e95fe27 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:45.217703 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-9168361a-53e1-4ee8-ad3d-b6243e95fe27 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1319 microversion: 2.1 time: 0.152418 Jun 17 15:14:45.218257 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 275/504] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:14:45 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:14:45.514710 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-780244d5-3d94-4cbf-8656-78d43cc05dc8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:45.515308 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-780244d5-3d94-4cbf-8656-78d43cc05dc8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:45.522020 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-780244d5-3d94-4cbf-8656-78d43cc05dc8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:45.522464 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-780244d5-3d94-4cbf-8656-78d43cc05dc8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:45.523225 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-780244d5-3d94-4cbf-8656-78d43cc05dc8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:45.523688 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-780244d5-3d94-4cbf-8656-78d43cc05dc8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:45.656704 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-780244d5-3d94-4cbf-8656-78d43cc05dc8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:45.665661 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-780244d5-3d94-4cbf-8656-78d43cc05dc8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:45.667138 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-780244d5-3d94-4cbf-8656-78d43cc05dc8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:45.668403 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-780244d5-3d94-4cbf-8656-78d43cc05dc8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1806 microversion: 2.20 time: 0.157497 Jun 17 15:14:45.668914 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 230/505] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:14:45 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1806 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:14:46.167152 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-a5db923f-4ee9-4ec1-91d0-e91d5d9afb25 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:46.167895 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-a5db923f-4ee9-4ec1-91d0-e91d5d9afb25 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:46.174864 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a5db923f-4ee9-4ec1-91d0-e91d5d9afb25 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:46.175838 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a5db923f-4ee9-4ec1-91d0-e91d5d9afb25 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:46.176677 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a5db923f-4ee9-4ec1-91d0-e91d5d9afb25 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:46.177113 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a5db923f-4ee9-4ec1-91d0-e91d5d9afb25 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:46.234829 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-cef3ce8c-51fe-400f-af3f-d34b7a75ef20 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:46.235430 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-cef3ce8c-51fe-400f-af3f-d34b7a75ef20 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:46.242171 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cef3ce8c-51fe-400f-af3f-d34b7a75ef20 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:46.242617 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cef3ce8c-51fe-400f-af3f-d34b7a75ef20 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:46.243374 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cef3ce8c-51fe-400f-af3f-d34b7a75ef20 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:46.243807 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cef3ce8c-51fe-400f-af3f-d34b7a75ef20 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:46.310643 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-a5db923f-4ee9-4ec1-91d0-e91d5d9afb25 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:46.319043 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-a5db923f-4ee9-4ec1-91d0-e91d5d9afb25 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1263 microversion: 2.1 time: 0.155973 Jun 17 15:14:46.319658 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 276/506] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:14:46 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1263 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:14:46.389956 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-cef3ce8c-51fe-400f-af3f-d34b7a75ef20 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:46.398316 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-cef3ce8c-51fe-400f-af3f-d34b7a75ef20 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1319 microversion: 2.1 time: 0.167221 Jun 17 15:14:46.398908 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 231/507] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:14:46 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:14:46.686771 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-f4f30390-7d77-4599-9e7d-bf76c70639e1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:46.687372 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-f4f30390-7d77-4599-9e7d-bf76c70639e1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:46.693586 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f4f30390-7d77-4599-9e7d-bf76c70639e1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:46.694025 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f4f30390-7d77-4599-9e7d-bf76c70639e1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:46.694786 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f4f30390-7d77-4599-9e7d-bf76c70639e1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:46.695212 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f4f30390-7d77-4599-9e7d-bf76c70639e1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:46.834095 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-f4f30390-7d77-4599-9e7d-bf76c70639e1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:46.843176 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-f4f30390-7d77-4599-9e7d-bf76c70639e1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:46.844723 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-f4f30390-7d77-4599-9e7d-bf76c70639e1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:46.845891 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-f4f30390-7d77-4599-9e7d-bf76c70639e1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1806 microversion: 2.20 time: 0.163092 Jun 17 15:14:46.846612 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 277/508] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:14:46 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1806 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:14:47.045418 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [req-f4645be2-3307-45e5-adf1-1f42e5a44440 req-b17ad2d9-fb86-4331-a550-c9b9f491ea09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e97df352-5cee-41f7-ae51-f55cd9e85869", "name": "network-vif-plugged", "status": "completed", "tag": "ff5c90be-6727-43d1-841f-760f94168fc6"}]} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:14:47.055491 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-f4645be2-3307-45e5-adf1-1f42e5a44440 req-b17ad2d9-fb86-4331-a550-c9b9f491ea09 service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:47.055717 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-f4645be2-3307-45e5-adf1-1f42e5a44440 req-b17ad2d9-fb86-4331-a550-c9b9f491ea09 service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:47.072883 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.compute.server_external_events [req-f4645be2-3307-45e5-adf1-1f42e5a44440 req-b17ad2d9-fb86-4331-a550-c9b9f491ea09 service nova] Creating event network-vif-plugged:ff5c90be-6727-43d1-841f-760f94168fc6 for instance e97df352-5cee-41f7-ae51-f55cd9e85869 on hv-cinder-82549 Jun 17 15:14:47.078706 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [req-f4645be2-3307-45e5-adf1-1f42e5a44440 req-b17ad2d9-fb86-4331-a550-c9b9f491ea09 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038198 Jun 17 15:14:47.079561 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 232/509] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 15:14:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:14:47.335780 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-c759aaf8-0938-4796-b20a-018c9915bbc8 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:47.336429 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-c759aaf8-0938-4796-b20a-018c9915bbc8 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:47.343372 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c759aaf8-0938-4796-b20a-018c9915bbc8 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:47.343813 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c759aaf8-0938-4796-b20a-018c9915bbc8 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:47.344599 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c759aaf8-0938-4796-b20a-018c9915bbc8 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:47.345023 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c759aaf8-0938-4796-b20a-018c9915bbc8 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:47.416076 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-1f2841c9-23c7-4e31-ab56-879666da0d45 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:47.417067 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-1f2841c9-23c7-4e31-ab56-879666da0d45 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:47.423939 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1f2841c9-23c7-4e31-ab56-879666da0d45 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:47.424616 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1f2841c9-23c7-4e31-ab56-879666da0d45 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:47.425627 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1f2841c9-23c7-4e31-ab56-879666da0d45 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:47.426214 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1f2841c9-23c7-4e31-ab56-879666da0d45 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:47.446374 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell1:SELECT=100 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:14:47.495797 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-c759aaf8-0938-4796-b20a-018c9915bbc8 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:47.509212 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-c759aaf8-0938-4796-b20a-018c9915bbc8 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1263 microversion: 2.1 time: 0.177554 Jun 17 15:14:47.510340 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 278/510] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:14:47 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1263 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:14:47.575905 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-1f2841c9-23c7-4e31-ab56-879666da0d45 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:47.586682 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-1f2841c9-23c7-4e31-ab56-879666da0d45 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1319 microversion: 2.1 time: 0.175003 Jun 17 15:14:47.587645 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 233/511] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:14:47 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1319 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:14:47.865593 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-1404cc3d-012d-4366-b68e-128bb55f44d8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:47.866163 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-1404cc3d-012d-4366-b68e-128bb55f44d8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:47.872362 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1404cc3d-012d-4366-b68e-128bb55f44d8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:47.872842 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1404cc3d-012d-4366-b68e-128bb55f44d8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:47.873643 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1404cc3d-012d-4366-b68e-128bb55f44d8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:47.874108 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1404cc3d-012d-4366-b68e-128bb55f44d8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:48.017182 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-1404cc3d-012d-4366-b68e-128bb55f44d8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:48.026121 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-1404cc3d-012d-4366-b68e-128bb55f44d8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:48.027609 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-1404cc3d-012d-4366-b68e-128bb55f44d8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:48.028806 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-1404cc3d-012d-4366-b68e-128bb55f44d8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1806 microversion: 2.20 time: 0.167979 Jun 17 15:14:48.029369 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 279/512] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:14:47 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1806 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:14:48.532746 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-0bc3356f-70c5-4b29-9fdf-86198083f175 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:48.533428 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-0bc3356f-70c5-4b29-9fdf-86198083f175 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:48.540604 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0bc3356f-70c5-4b29-9fdf-86198083f175 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:48.541050 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0bc3356f-70c5-4b29-9fdf-86198083f175 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:48.541810 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0bc3356f-70c5-4b29-9fdf-86198083f175 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:48.542239 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0bc3356f-70c5-4b29-9fdf-86198083f175 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:48.619093 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-79a1a77e-f7b6-4097-b115-9d28313e6266 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:48.621150 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-79a1a77e-f7b6-4097-b115-9d28313e6266 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:48.634664 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-79a1a77e-f7b6-4097-b115-9d28313e6266 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:48.635333 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-79a1a77e-f7b6-4097-b115-9d28313e6266 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:48.636188 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-79a1a77e-f7b6-4097-b115-9d28313e6266 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:48.636768 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-79a1a77e-f7b6-4097-b115-9d28313e6266 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:48.692512 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-0bc3356f-70c5-4b29-9fdf-86198083f175 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:48.703346 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-0bc3356f-70c5-4b29-9fdf-86198083f175 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1263 microversion: 2.1 time: 0.174202 Jun 17 15:14:48.704015 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 234/513] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:14:48 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1263 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:14:48.832374 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-79a1a77e-f7b6-4097-b115-9d28313e6266 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:48.845048 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-79a1a77e-f7b6-4097-b115-9d28313e6266 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1319 microversion: 2.1 time: 0.234146 Jun 17 15:14:48.846032 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 280/514] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:14:48 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1319 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:14:49.047991 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-3c1c6875-f185-4393-b557-09388467bb81 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:49.048755 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-3c1c6875-f185-4393-b557-09388467bb81 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:49.055662 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3c1c6875-f185-4393-b557-09388467bb81 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:49.056172 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3c1c6875-f185-4393-b557-09388467bb81 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:49.057157 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3c1c6875-f185-4393-b557-09388467bb81 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:49.057700 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3c1c6875-f185-4393-b557-09388467bb81 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:49.102712 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [req-5180a182-b8fa-47d0-be18-9679685d0739 req-d4105420-5581-449a-a69b-1a8a038578e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "808f28e6-03bc-4b67-ab1f-f1ef13838924", "name": "network-vif-plugged", "status": "completed", "tag": "6f21e069-6aab-4e06-9e07-c0ccc170bbac"}]} {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:14:49.123780 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [req-5180a182-b8fa-47d0-be18-9679685d0739 req-d4105420-5581-449a-a69b-1a8a038578e3 service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:49.125008 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [req-5180a182-b8fa-47d0-be18-9679685d0739 req-d4105420-5581-449a-a69b-1a8a038578e3 service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:49.147314 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.compute.server_external_events [req-5180a182-b8fa-47d0-be18-9679685d0739 req-d4105420-5581-449a-a69b-1a8a038578e3 service nova] Creating event network-vif-plugged:6f21e069-6aab-4e06-9e07-c0ccc170bbac for instance 808f28e6-03bc-4b67-ab1f-f1ef13838924 on hv-cinder-82549 Jun 17 15:14:49.155820 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [req-5180a182-b8fa-47d0-be18-9679685d0739 req-d4105420-5581-449a-a69b-1a8a038578e3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060469 Jun 17 15:14:49.156811 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 281/515] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 15:14:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:14:49.236551 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-3c1c6875-f185-4393-b557-09388467bb81 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:49.246706 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-3c1c6875-f185-4393-b557-09388467bb81 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:49.248195 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-3c1c6875-f185-4393-b557-09388467bb81 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:49.249417 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-3c1c6875-f185-4393-b557-09388467bb81 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1806 microversion: 2.20 time: 0.205881 Jun 17 15:14:49.249981 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 235/516] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:14:49 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1806 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:14:49.746156 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-2587aa44-1d6d-43ba-a9bb-3db0b020fe08 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:49.749736 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-2587aa44-1d6d-43ba-a9bb-3db0b020fe08 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:49.765663 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2587aa44-1d6d-43ba-a9bb-3db0b020fe08 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:49.768483 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2587aa44-1d6d-43ba-a9bb-3db0b020fe08 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:49.770412 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2587aa44-1d6d-43ba-a9bb-3db0b020fe08 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:49.771500 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2587aa44-1d6d-43ba-a9bb-3db0b020fe08 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:49.868013 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-0806a93c-e589-46ac-92f4-b4a1c13c2ccf tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:49.869110 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-0806a93c-e589-46ac-92f4-b4a1c13c2ccf tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:49.896932 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0806a93c-e589-46ac-92f4-b4a1c13c2ccf tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:49.898086 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0806a93c-e589-46ac-92f4-b4a1c13c2ccf tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:49.899840 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0806a93c-e589-46ac-92f4-b4a1c13c2ccf tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:49.901375 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0806a93c-e589-46ac-92f4-b4a1c13c2ccf tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:50.136805 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-2587aa44-1d6d-43ba-a9bb-3db0b020fe08 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:50.155726 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-2587aa44-1d6d-43ba-a9bb-3db0b020fe08 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1263 microversion: 2.1 time: 0.434435 Jun 17 15:14:50.175933 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 282/517] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:14:49 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1263 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:14:50.287031 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-646bee1c-9374-4a33-b2a4-b0b28cada7fa tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:50.288985 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-646bee1c-9374-4a33-b2a4-b0b28cada7fa tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:50.301988 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-646bee1c-9374-4a33-b2a4-b0b28cada7fa tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:50.303307 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-646bee1c-9374-4a33-b2a4-b0b28cada7fa tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:50.305090 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-646bee1c-9374-4a33-b2a4-b0b28cada7fa tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:50.306157 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-646bee1c-9374-4a33-b2a4-b0b28cada7fa tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:50.358432 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-0806a93c-e589-46ac-92f4-b4a1c13c2ccf tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:50.370582 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-0806a93c-e589-46ac-92f4-b4a1c13c2ccf tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1319 microversion: 2.1 time: 0.510031 Jun 17 15:14:50.371196 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 236/518] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:14:49 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1319 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:14:50.547260 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-646bee1c-9374-4a33-b2a4-b0b28cada7fa tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:50.551017 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=100 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:14:50.557230 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-646bee1c-9374-4a33-b2a4-b0b28cada7fa tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:50.558766 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-646bee1c-9374-4a33-b2a4-b0b28cada7fa tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:50.559956 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-646bee1c-9374-4a33-b2a4-b0b28cada7fa tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1806 microversion: 2.20 time: 0.293404 Jun 17 15:14:50.560583 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 283/519] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:14:50 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1806 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:14:51.182935 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-74f430f3-dea7-4c45-8fc8-8d9d0b97fced tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:51.184005 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-74f430f3-dea7-4c45-8fc8-8d9d0b97fced tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:51.195001 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-74f430f3-dea7-4c45-8fc8-8d9d0b97fced tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:51.195001 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-74f430f3-dea7-4c45-8fc8-8d9d0b97fced tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:51.195001 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-74f430f3-dea7-4c45-8fc8-8d9d0b97fced tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:51.195001 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-74f430f3-dea7-4c45-8fc8-8d9d0b97fced tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:51.353540 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-74f430f3-dea7-4c45-8fc8-8d9d0b97fced tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:51.362175 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-74f430f3-dea7-4c45-8fc8-8d9d0b97fced tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1263 microversion: 2.1 time: 0.183723 Jun 17 15:14:51.364167 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 237/520] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:14:51 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1263 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:14:51.393447 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-11ef4899-2af5-4031-a89d-6c2614fb8d07 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:51.394052 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-11ef4899-2af5-4031-a89d-6c2614fb8d07 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:51.401316 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-11ef4899-2af5-4031-a89d-6c2614fb8d07 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:51.402035 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-11ef4899-2af5-4031-a89d-6c2614fb8d07 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:51.403051 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-11ef4899-2af5-4031-a89d-6c2614fb8d07 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:51.403689 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-11ef4899-2af5-4031-a89d-6c2614fb8d07 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:51.531225 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [req-c0074c5b-72fe-4d8c-95f2-dc9452b25a1d req-d23c80d8-27cf-4f45-a955-dcccaaedeb6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fee7bc0-cd0e-4c25-8475-b43e79cb933a", "name": "network-vif-plugged", "status": "completed", "tag": "4e15dfc0-dc8a-4b19-9fc3-632ff970220b"}]} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:14:51.558145 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-c0074c5b-72fe-4d8c-95f2-dc9452b25a1d req-d23c80d8-27cf-4f45-a955-dcccaaedeb6c service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:51.559345 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-c0074c5b-72fe-4d8c-95f2-dc9452b25a1d req-d23c80d8-27cf-4f45-a955-dcccaaedeb6c service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:51.582317 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-11ef4899-2af5-4031-a89d-6c2614fb8d07 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:51.588283 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.compute.server_external_events [req-c0074c5b-72fe-4d8c-95f2-dc9452b25a1d req-d23c80d8-27cf-4f45-a955-dcccaaedeb6c service nova] Creating event network-vif-plugged:4e15dfc0-dc8a-4b19-9fc3-632ff970220b for instance 8fee7bc0-cd0e-4c25-8475-b43e79cb933a on hv-cinder-82549 Jun 17 15:14:51.595232 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-11ef4899-2af5-4031-a89d-6c2614fb8d07 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1319 microversion: 2.1 time: 0.208440 Jun 17 15:14:51.598905 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 284/521] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:14:51 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1319 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:14:51.605369 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [req-c0074c5b-72fe-4d8c-95f2-dc9452b25a1d req-d23c80d8-27cf-4f45-a955-dcccaaedeb6c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079451 Jun 17 15:14:51.608645 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 238/522] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 15:14:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:14:51.609307 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-844c1a85-b0f4-4d86-ae3d-40e8f7ba77ba tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:51.610131 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-844c1a85-b0f4-4d86-ae3d-40e8f7ba77ba tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:51.618437 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-844c1a85-b0f4-4d86-ae3d-40e8f7ba77ba tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:51.618885 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-844c1a85-b0f4-4d86-ae3d-40e8f7ba77ba tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:51.619677 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-844c1a85-b0f4-4d86-ae3d-40e8f7ba77ba tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:51.620108 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-844c1a85-b0f4-4d86-ae3d-40e8f7ba77ba tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:51.791806 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-844c1a85-b0f4-4d86-ae3d-40e8f7ba77ba tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:51.806848 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-844c1a85-b0f4-4d86-ae3d-40e8f7ba77ba tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:51.810162 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-844c1a85-b0f4-4d86-ae3d-40e8f7ba77ba tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:51.811978 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-844c1a85-b0f4-4d86-ae3d-40e8f7ba77ba tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1793 microversion: 2.20 time: 0.211107 Jun 17 15:14:51.812998 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 285/523] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:14:51 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1793 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:14:51.852413 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-a2176255-43be-4bf0-ac21-41b16d9e63cd tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:14:51.854455 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-a2176255-43be-4bf0-ac21-41b16d9e63cd tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:51.861526 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a2176255-43be-4bf0-ac21-41b16d9e63cd tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:51.862357 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a2176255-43be-4bf0-ac21-41b16d9e63cd tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:51.863858 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a2176255-43be-4bf0-ac21-41b16d9e63cd tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:51.885364 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a2176255-43be-4bf0-ac21-41b16d9e63cd tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:51.983174 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-a2176255-43be-4bf0-ac21-41b16d9e63cd tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "POST /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/action" status: 202 len: 0 microversion: 2.1 time: 0.138209 Jun 17 15:14:51.986944 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 239/524] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jun 17 15:14:51 2022] POST /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 15:14:51.994195 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-9bf6aac6-7064-4995-b7fe-f5b4e17414ed tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:51.994717 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-9bf6aac6-7064-4995-b7fe-f5b4e17414ed tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:52.002583 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9bf6aac6-7064-4995-b7fe-f5b4e17414ed tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:52.003194 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9bf6aac6-7064-4995-b7fe-f5b4e17414ed tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:52.004734 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9bf6aac6-7064-4995-b7fe-f5b4e17414ed tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:52.005418 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9bf6aac6-7064-4995-b7fe-f5b4e17414ed tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:52.224081 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-9bf6aac6-7064-4995-b7fe-f5b4e17414ed tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:52.233209 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-9bf6aac6-7064-4995-b7fe-f5b4e17414ed tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1751 microversion: 2.1 time: 0.244697 Jun 17 15:14:52.233795 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 286/525] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:14:51 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1751 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:14:52.390663 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-9eae47a4-5f34-4b48-ac9d-01e97fc2b443 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:52.391464 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-9eae47a4-5f34-4b48-ac9d-01e97fc2b443 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:52.400224 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9eae47a4-5f34-4b48-ac9d-01e97fc2b443 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:52.400908 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9eae47a4-5f34-4b48-ac9d-01e97fc2b443 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:52.401874 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9eae47a4-5f34-4b48-ac9d-01e97fc2b443 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:52.402377 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9eae47a4-5f34-4b48-ac9d-01e97fc2b443 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:52.621204 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-9eae47a4-5f34-4b48-ac9d-01e97fc2b443 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:52.631459 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-0e890719-daa8-4fcd-bc1c-8fb2639d86e1 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:52.636602 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-0e890719-daa8-4fcd-bc1c-8fb2639d86e1 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:52.639370 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-9eae47a4-5f34-4b48-ac9d-01e97fc2b443 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1263 microversion: 2.1 time: 0.252136 Jun 17 15:14:52.641027 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 240/526] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:14:52 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1263 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:14:52.664223 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0e890719-daa8-4fcd-bc1c-8fb2639d86e1 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:52.666167 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0e890719-daa8-4fcd-bc1c-8fb2639d86e1 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:52.670661 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0e890719-daa8-4fcd-bc1c-8fb2639d86e1 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:52.672744 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0e890719-daa8-4fcd-bc1c-8fb2639d86e1 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:52.992269 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-0e890719-daa8-4fcd-bc1c-8fb2639d86e1 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:53.001436 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-0e890719-daa8-4fcd-bc1c-8fb2639d86e1 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1508 microversion: 2.1 time: 0.381065 Jun 17 15:14:53.002228 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 287/527] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:14:52 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1508 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:14:53.254395 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-535e3b46-b23c-46a5-ae6f-fb343384e143 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:53.255275 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-535e3b46-b23c-46a5-ae6f-fb343384e143 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:53.266145 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-535e3b46-b23c-46a5-ae6f-fb343384e143 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:53.266879 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-535e3b46-b23c-46a5-ae6f-fb343384e143 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:53.268190 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-535e3b46-b23c-46a5-ae6f-fb343384e143 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:53.268992 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-535e3b46-b23c-46a5-ae6f-fb343384e143 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:53.510201 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-535e3b46-b23c-46a5-ae6f-fb343384e143 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:53.523667 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-535e3b46-b23c-46a5-ae6f-fb343384e143 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1751 microversion: 2.1 time: 0.275832 Jun 17 15:14:53.524556 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 241/528] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:14:53 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1751 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:14:53.664218 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-03d42311-336f-4b2b-97eb-ac0f68a18a33 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:53.664955 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-03d42311-336f-4b2b-97eb-ac0f68a18a33 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:53.671999 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-03d42311-336f-4b2b-97eb-ac0f68a18a33 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:53.672460 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-03d42311-336f-4b2b-97eb-ac0f68a18a33 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:53.673337 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-03d42311-336f-4b2b-97eb-ac0f68a18a33 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:53.673953 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-03d42311-336f-4b2b-97eb-ac0f68a18a33 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:53.836776 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-03d42311-336f-4b2b-97eb-ac0f68a18a33 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:53.850955 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-03d42311-336f-4b2b-97eb-ac0f68a18a33 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1263 microversion: 2.1 time: 0.191092 Jun 17 15:14:53.852006 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 288/529] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:14:53 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1263 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:14:54.543941 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-f6607cc2-a6a8-4b53-83cf-e60fe3dd74a8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:54.544552 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-f6607cc2-a6a8-4b53-83cf-e60fe3dd74a8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:54.551573 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f6607cc2-a6a8-4b53-83cf-e60fe3dd74a8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:54.552036 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f6607cc2-a6a8-4b53-83cf-e60fe3dd74a8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:54.552855 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f6607cc2-a6a8-4b53-83cf-e60fe3dd74a8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:54.553296 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f6607cc2-a6a8-4b53-83cf-e60fe3dd74a8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:54.781853 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-f6607cc2-a6a8-4b53-83cf-e60fe3dd74a8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:54.790783 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-f6607cc2-a6a8-4b53-83cf-e60fe3dd74a8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1751 microversion: 2.1 time: 0.250874 Jun 17 15:14:54.791370 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 242/530] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:14:54 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1751 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:14:54.873442 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-b168ec26-058f-4e9d-a14c-c29c4ec125c3 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:54.874047 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-b168ec26-058f-4e9d-a14c-c29c4ec125c3 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:54.881542 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b168ec26-058f-4e9d-a14c-c29c4ec125c3 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:54.881985 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b168ec26-058f-4e9d-a14c-c29c4ec125c3 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:54.882782 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b168ec26-058f-4e9d-a14c-c29c4ec125c3 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:54.883220 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b168ec26-058f-4e9d-a14c-c29c4ec125c3 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:55.063996 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-b168ec26-058f-4e9d-a14c-c29c4ec125c3 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:55.073812 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-b168ec26-058f-4e9d-a14c-c29c4ec125c3 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1263 microversion: 2.1 time: 0.204288 Jun 17 15:14:55.074394 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 289/531] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:14:54 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1263 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:14:55.808850 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-64cb5a09-9036-495f-8071-e7e8679784f9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:55.809574 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-64cb5a09-9036-495f-8071-e7e8679784f9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:55.817196 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-64cb5a09-9036-495f-8071-e7e8679784f9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:55.817640 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-64cb5a09-9036-495f-8071-e7e8679784f9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:55.818418 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-64cb5a09-9036-495f-8071-e7e8679784f9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:55.818850 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-64cb5a09-9036-495f-8071-e7e8679784f9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:55.982711 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-64cb5a09-9036-495f-8071-e7e8679784f9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:55.991683 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-64cb5a09-9036-495f-8071-e7e8679784f9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1756 microversion: 2.1 time: 0.187169 Jun 17 15:14:55.992257 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 243/532] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:14:55 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1756 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:14:56.095365 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-6c5955b0-48ca-4b05-b7dd-ceae69431bed tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:56.096103 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-6c5955b0-48ca-4b05-b7dd-ceae69431bed tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:56.105065 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6c5955b0-48ca-4b05-b7dd-ceae69431bed tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:56.105572 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6c5955b0-48ca-4b05-b7dd-ceae69431bed tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:56.106492 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6c5955b0-48ca-4b05-b7dd-ceae69431bed tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:56.106956 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6c5955b0-48ca-4b05-b7dd-ceae69431bed tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:56.304831 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-6c5955b0-48ca-4b05-b7dd-ceae69431bed tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:56.312892 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-6c5955b0-48ca-4b05-b7dd-ceae69431bed tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1449 microversion: 2.1 time: 0.221641 Jun 17 15:14:56.313672 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 290/533] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:14:56 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1449 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:14:56.334430 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-a4b8f719-e4a5-4d44-b4af-af393298d7c0 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:56.335573 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-a4b8f719-e4a5-4d44-b4af-af393298d7c0 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:56.339368 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_api:SELECT=81 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:14:56.346281 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a4b8f719-e4a5-4d44-b4af-af393298d7c0 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:56.347402 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a4b8f719-e4a5-4d44-b4af-af393298d7c0 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:56.348340 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a4b8f719-e4a5-4d44-b4af-af393298d7c0 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:56.348860 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a4b8f719-e4a5-4d44-b4af-af393298d7c0 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:56.505193 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-a4b8f719-e4a5-4d44-b4af-af393298d7c0 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:56.512960 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-a4b8f719-e4a5-4d44-b4af-af393298d7c0 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1449 microversion: 2.1 time: 0.185997 Jun 17 15:14:56.513544 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 244/534] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:14:56 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1449 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:14:57.015548 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-6531eb0f-c511-4986-baa9-0060f27cccc8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:57.016854 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-6531eb0f-c511-4986-baa9-0060f27cccc8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:57.027398 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6531eb0f-c511-4986-baa9-0060f27cccc8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:57.028212 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6531eb0f-c511-4986-baa9-0060f27cccc8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:57.029615 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6531eb0f-c511-4986-baa9-0060f27cccc8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:57.030374 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6531eb0f-c511-4986-baa9-0060f27cccc8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:57.330352 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-6531eb0f-c511-4986-baa9-0060f27cccc8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:57.348490 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-6531eb0f-c511-4986-baa9-0060f27cccc8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1756 microversion: 2.1 time: 0.340807 Jun 17 15:14:57.349755 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 291/535] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:14:57 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1756 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:14:58.377361 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-47de1046-97ab-422f-af90-8cc3b3ea0525 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:58.378719 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-47de1046-97ab-422f-af90-8cc3b3ea0525 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:58.387097 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-47de1046-97ab-422f-af90-8cc3b3ea0525 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:58.387760 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-47de1046-97ab-422f-af90-8cc3b3ea0525 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:58.388928 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-47de1046-97ab-422f-af90-8cc3b3ea0525 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:58.389529 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-47de1046-97ab-422f-af90-8cc3b3ea0525 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:58.613369 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-47de1046-97ab-422f-af90-8cc3b3ea0525 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:58.622672 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-47de1046-97ab-422f-af90-8cc3b3ea0525 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1756 microversion: 2.1 time: 0.251647 Jun 17 15:14:58.623272 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 245/536] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:14:58 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1756 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:14:58.990495 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [req-bd22bf4a-3d3e-4e6b-8055-d001855b9c46 req-7f3ae999-0838-4c40-a588-a6a1e605d051 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8fee7bc0-cd0e-4c25-8475-b43e79cb933a", "tag": "4e15dfc0-dc8a-4b19-9fc3-632ff970220b"}]} {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:14:59.012276 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [req-bd22bf4a-3d3e-4e6b-8055-d001855b9c46 req-7f3ae999-0838-4c40-a588-a6a1e605d051 service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:59.012276 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [req-bd22bf4a-3d3e-4e6b-8055-d001855b9c46 req-7f3ae999-0838-4c40-a588-a6a1e605d051 service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:59.029502 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.compute.server_external_events [req-bd22bf4a-3d3e-4e6b-8055-d001855b9c46 req-7f3ae999-0838-4c40-a588-a6a1e605d051 service nova] Creating event network-changed:4e15dfc0-dc8a-4b19-9fc3-632ff970220b for instance 8fee7bc0-cd0e-4c25-8475-b43e79cb933a on hv-cinder-82549 Jun 17 15:14:59.038088 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [req-bd22bf4a-3d3e-4e6b-8055-d001855b9c46 req-7f3ae999-0838-4c40-a588-a6a1e605d051 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052263 Jun 17 15:14:59.039089 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 292/537] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 15:14:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:14:59.643297 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-9adfe1b9-8f7f-419f-b99e-b9a6631b211c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:14:59.644153 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-9adfe1b9-8f7f-419f-b99e-b9a6631b211c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:14:59.651864 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9adfe1b9-8f7f-419f-b99e-b9a6631b211c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:59.652311 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9adfe1b9-8f7f-419f-b99e-b9a6631b211c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:59.653115 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9adfe1b9-8f7f-419f-b99e-b9a6631b211c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:14:59.653545 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9adfe1b9-8f7f-419f-b99e-b9a6631b211c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:14:59.917877 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-9adfe1b9-8f7f-419f-b99e-b9a6631b211c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:14:59.927850 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-9adfe1b9-8f7f-419f-b99e-b9a6631b211c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1756 microversion: 2.1 time: 0.289973 Jun 17 15:14:59.928998 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 246/538] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:14:59 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1756 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:15:00.949004 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-77948365-3457-418c-9fd4-6736d7b8439a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:15:00.950641 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-77948365-3457-418c-9fd4-6736d7b8439a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:15:00.962752 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-77948365-3457-418c-9fd4-6736d7b8439a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:15:00.963839 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-77948365-3457-418c-9fd4-6736d7b8439a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:15:00.965590 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-77948365-3457-418c-9fd4-6736d7b8439a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:15:00.966390 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-77948365-3457-418c-9fd4-6736d7b8439a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:15:01.149360 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-77948365-3457-418c-9fd4-6736d7b8439a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:15:01.162534 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-77948365-3457-418c-9fd4-6736d7b8439a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1756 microversion: 2.1 time: 0.219393 Jun 17 15:15:01.163199 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 293/539] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:15:00 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1756 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:15:02.187865 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-8b92d8a4-65f1-4453-8ba6-e092106d6a7c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:15:02.188595 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-8b92d8a4-65f1-4453-8ba6-e092106d6a7c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:15:02.196558 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8b92d8a4-65f1-4453-8ba6-e092106d6a7c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:15:02.197111 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8b92d8a4-65f1-4453-8ba6-e092106d6a7c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:15:02.197963 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8b92d8a4-65f1-4453-8ba6-e092106d6a7c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:15:02.198459 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8b92d8a4-65f1-4453-8ba6-e092106d6a7c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:15:02.368681 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-8b92d8a4-65f1-4453-8ba6-e092106d6a7c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:15:02.377667 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-8b92d8a4-65f1-4453-8ba6-e092106d6a7c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1756 microversion: 2.1 time: 0.193762 Jun 17 15:15:02.379144 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 247/540] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:15:02 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1756 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:15:03.398385 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-b0960bbd-b302-4aa7-a639-81ea49101fb7 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:15:03.399104 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-b0960bbd-b302-4aa7-a639-81ea49101fb7 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:15:03.403387 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_api:SELECT=76 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:15:03.413495 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b0960bbd-b302-4aa7-a639-81ea49101fb7 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:15:03.414221 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b0960bbd-b302-4aa7-a639-81ea49101fb7 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:15:03.415615 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b0960bbd-b302-4aa7-a639-81ea49101fb7 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:15:03.416419 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b0960bbd-b302-4aa7-a639-81ea49101fb7 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:15:03.707573 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-b0960bbd-b302-4aa7-a639-81ea49101fb7 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:15:03.723021 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-b0960bbd-b302-4aa7-a639-81ea49101fb7 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1756 microversion: 2.1 time: 0.329635 Jun 17 15:15:03.724134 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 294/541] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:15:03 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1756 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:15:04.746977 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-4b21ec89-5441-478e-b514-7e1fce32074b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:15:04.748028 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-4b21ec89-5441-478e-b514-7e1fce32074b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:15:04.758697 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4b21ec89-5441-478e-b514-7e1fce32074b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:15:04.759383 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4b21ec89-5441-478e-b514-7e1fce32074b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:15:04.760699 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4b21ec89-5441-478e-b514-7e1fce32074b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:15:04.761395 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4b21ec89-5441-478e-b514-7e1fce32074b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:15:04.922856 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-4b21ec89-5441-478e-b514-7e1fce32074b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:15:04.931315 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-4b21ec89-5441-478e-b514-7e1fce32074b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1756 microversion: 2.1 time: 0.190977 Jun 17 15:15:04.931873 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 248/542] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:15:04 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1756 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:15:05.948505 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-c889e568-35a4-446d-bd2b-34b2419205b1 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:15:05.949162 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-c889e568-35a4-446d-bd2b-34b2419205b1 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:15:05.956475 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c889e568-35a4-446d-bd2b-34b2419205b1 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:15:05.957025 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c889e568-35a4-446d-bd2b-34b2419205b1 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:15:05.958301 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c889e568-35a4-446d-bd2b-34b2419205b1 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:15:05.958301 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c889e568-35a4-446d-bd2b-34b2419205b1 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:15:06.123758 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-c889e568-35a4-446d-bd2b-34b2419205b1 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:15:06.133429 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-c889e568-35a4-446d-bd2b-34b2419205b1 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1756 microversion: 2.1 time: 0.188726 Jun 17 15:15:06.134024 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 295/543] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:15:05 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1756 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:15:07.158989 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-70003c42-54b6-40dc-bfad-c7305ba7a6dc tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:15:07.160207 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-70003c42-54b6-40dc-bfad-c7305ba7a6dc tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:15:07.166615 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-70003c42-54b6-40dc-bfad-c7305ba7a6dc tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:15:07.167056 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-70003c42-54b6-40dc-bfad-c7305ba7a6dc tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:15:07.167826 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-70003c42-54b6-40dc-bfad-c7305ba7a6dc tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:15:07.168347 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-70003c42-54b6-40dc-bfad-c7305ba7a6dc tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:15:07.334818 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-70003c42-54b6-40dc-bfad-c7305ba7a6dc tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:15:07.338413 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:15:07.344509 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-70003c42-54b6-40dc-bfad-c7305ba7a6dc tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1756 microversion: 2.1 time: 0.192927 Jun 17 15:15:07.345112 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 249/544] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:15:07 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1756 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:15:08.363194 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-1e44d3c4-e153-4d16-9020-5b6e2c4227ce tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:15:08.363826 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-1e44d3c4-e153-4d16-9020-5b6e2c4227ce tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:15:08.370549 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1e44d3c4-e153-4d16-9020-5b6e2c4227ce tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:15:08.371023 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1e44d3c4-e153-4d16-9020-5b6e2c4227ce tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:15:08.371766 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1e44d3c4-e153-4d16-9020-5b6e2c4227ce tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:15:08.372203 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1e44d3c4-e153-4d16-9020-5b6e2c4227ce tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:15:08.547712 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-1e44d3c4-e153-4d16-9020-5b6e2c4227ce tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:15:08.556925 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-1e44d3c4-e153-4d16-9020-5b6e2c4227ce tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1756 microversion: 2.1 time: 0.197776 Jun 17 15:15:08.557733 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 296/545] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:15:08 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1756 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:15:09.576881 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-8b6d1a3a-ed11-4caf-b6df-994925415087 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:15:09.577538 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-8b6d1a3a-ed11-4caf-b6df-994925415087 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:15:09.584436 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8b6d1a3a-ed11-4caf-b6df-994925415087 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:15:09.584883 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8b6d1a3a-ed11-4caf-b6df-994925415087 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:15:09.592418 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8b6d1a3a-ed11-4caf-b6df-994925415087 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:15:09.592418 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8b6d1a3a-ed11-4caf-b6df-994925415087 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:15:09.761770 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-8b6d1a3a-ed11-4caf-b6df-994925415087 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:15:09.770804 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-8b6d1a3a-ed11-4caf-b6df-994925415087 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1756 microversion: 2.1 time: 0.198905 Jun 17 15:15:09.771389 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 250/546] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:15:09 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1756 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:15:10.788040 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-af5bf9a7-a76a-4e01-b90a-30778bd4c9a5 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:15:10.788807 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-af5bf9a7-a76a-4e01-b90a-30778bd4c9a5 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:15:10.797077 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-af5bf9a7-a76a-4e01-b90a-30778bd4c9a5 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:15:10.797547 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-af5bf9a7-a76a-4e01-b90a-30778bd4c9a5 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:15:10.798404 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-af5bf9a7-a76a-4e01-b90a-30778bd4c9a5 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:15:10.798892 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-af5bf9a7-a76a-4e01-b90a-30778bd4c9a5 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:15:10.979381 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-af5bf9a7-a76a-4e01-b90a-30778bd4c9a5 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:15:10.988517 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-af5bf9a7-a76a-4e01-b90a-30778bd4c9a5 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1756 microversion: 2.1 time: 0.204625 Jun 17 15:15:10.989173 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 297/547] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:15:10 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1756 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:15:12.006802 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-86efe266-ae88-4a91-af74-ec06fad9bec8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:15:12.007427 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-86efe266-ae88-4a91-af74-ec06fad9bec8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:15:12.014088 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-86efe266-ae88-4a91-af74-ec06fad9bec8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:15:12.014451 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-86efe266-ae88-4a91-af74-ec06fad9bec8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:15:12.015224 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-86efe266-ae88-4a91-af74-ec06fad9bec8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:15:12.015652 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-86efe266-ae88-4a91-af74-ec06fad9bec8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:15:12.201206 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-86efe266-ae88-4a91-af74-ec06fad9bec8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:15:12.212480 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-86efe266-ae88-4a91-af74-ec06fad9bec8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1756 microversion: 2.1 time: 0.210083 Jun 17 15:15:12.213112 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 251/548] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:15:12 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1756 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:15:13.231456 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-fad7d4c9-3ed0-4dfc-8a56-78bff91eda2b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:15:13.232104 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-fad7d4c9-3ed0-4dfc-8a56-78bff91eda2b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:15:13.240686 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fad7d4c9-3ed0-4dfc-8a56-78bff91eda2b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:15:13.241215 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fad7d4c9-3ed0-4dfc-8a56-78bff91eda2b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:15:13.242115 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fad7d4c9-3ed0-4dfc-8a56-78bff91eda2b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:15:13.242659 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fad7d4c9-3ed0-4dfc-8a56-78bff91eda2b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:15:13.421438 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-fad7d4c9-3ed0-4dfc-8a56-78bff91eda2b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:15:13.435095 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-fad7d4c9-3ed0-4dfc-8a56-78bff91eda2b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1756 microversion: 2.1 time: 0.207528 Jun 17 15:15:13.436426 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 298/549] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:15:13 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1756 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:15:14.455344 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-d71957aa-4899-4bd3-8eda-3d7b95d435f1 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:15:14.456408 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-d71957aa-4899-4bd3-8eda-3d7b95d435f1 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:15:14.463064 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d71957aa-4899-4bd3-8eda-3d7b95d435f1 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:15:14.463502 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d71957aa-4899-4bd3-8eda-3d7b95d435f1 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:15:14.464287 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d71957aa-4899-4bd3-8eda-3d7b95d435f1 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:15:14.464758 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d71957aa-4899-4bd3-8eda-3d7b95d435f1 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:15:14.625824 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-d71957aa-4899-4bd3-8eda-3d7b95d435f1 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:15:14.635843 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-d71957aa-4899-4bd3-8eda-3d7b95d435f1 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1756 microversion: 2.1 time: 0.184885 Jun 17 15:15:14.636469 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 252/550] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:15:14 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1756 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:15:15.654764 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-98c4b467-032b-46d9-b03a-b15cb3603afb tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:15:15.655453 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-98c4b467-032b-46d9-b03a-b15cb3603afb tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:15:15.662588 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-98c4b467-032b-46d9-b03a-b15cb3603afb tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:15:15.663036 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-98c4b467-032b-46d9-b03a-b15cb3603afb tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:15:15.663828 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-98c4b467-032b-46d9-b03a-b15cb3603afb tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:15:15.664267 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-98c4b467-032b-46d9-b03a-b15cb3603afb tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:15:15.848586 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-98c4b467-032b-46d9-b03a-b15cb3603afb tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:15:15.857452 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-98c4b467-032b-46d9-b03a-b15cb3603afb tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1756 microversion: 2.1 time: 0.206499 Jun 17 15:15:15.858040 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 299/551] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:15:15 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1756 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:15:16.883226 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-a5a1c9d8-61db-4be7-abe3-a91731013176 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:15:16.883872 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-a5a1c9d8-61db-4be7-abe3-a91731013176 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:15:16.890158 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a5a1c9d8-61db-4be7-abe3-a91731013176 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:15:16.890603 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a5a1c9d8-61db-4be7-abe3-a91731013176 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:15:16.891377 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a5a1c9d8-61db-4be7-abe3-a91731013176 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:15:16.891808 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a5a1c9d8-61db-4be7-abe3-a91731013176 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:15:17.044897 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-a5a1c9d8-61db-4be7-abe3-a91731013176 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:15:17.053841 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-a5a1c9d8-61db-4be7-abe3-a91731013176 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1759 microversion: 2.1 time: 0.174459 Jun 17 15:15:17.054428 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 253/552] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:15:16 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1759 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:15:22.407434 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-f376e592-9bbd-4743-ad2d-afdc78c0525c tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4e6d668f-6234-4ba9-913a-11f57866e984", "device": "/dev/sdb"}} {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:15:22.409608 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-f376e592-9bbd-4743-ad2d-afdc78c0525c tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:15:22.416503 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f376e592-9bbd-4743-ad2d-afdc78c0525c tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:15:22.417018 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f376e592-9bbd-4743-ad2d-afdc78c0525c tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:15:22.417830 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f376e592-9bbd-4743-ad2d-afdc78c0525c tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:15:22.418302 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f376e592-9bbd-4743-ad2d-afdc78c0525c tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:15:22.421064 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=93 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:15:22.713978 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-f376e592-9bbd-4743-ad2d-afdc78c0525c tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "POST /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.310418 Jun 17 15:15:22.714625 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 300/553] 10.222.0.48 () {60 vars in 1322 bytes} [Fri Jun 17 15:15:22 2022] POST /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924/os-volume_attachments => generated 194 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:15:44.130483 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-36410ad9-ce8b-4f0d-9ad4-cfdf09bb9022 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "713822dc-11e8-4f5c-ae7c-bcf41e01b06d"}} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:15:44.131601 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-36410ad9-ce8b-4f0d-9ad4-cfdf09bb9022 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:15:44.133773 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_api:SELECT=19 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:15:44.134452 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell1:SELECT=24 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:15:44.140798 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-36410ad9-ce8b-4f0d-9ad4-cfdf09bb9022 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:15:44.141241 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-36410ad9-ce8b-4f0d-9ad4-cfdf09bb9022 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:15:44.142005 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-36410ad9-ce8b-4f0d-9ad4-cfdf09bb9022 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:15:44.142565 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-36410ad9-ce8b-4f0d-9ad4-cfdf09bb9022 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:15:44.785972 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-36410ad9-ce8b-4f0d-9ad4-cfdf09bb9022 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "POST /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.660277 Jun 17 15:15:44.786836 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 254/554] 10.222.0.48 () {60 vars in 1322 bytes} [Fri Jun 17 15:15:44 2022] POST /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 194 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:15:53.779353 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_api:SELECT=13 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:15:53.780131 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=10,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:15:53.784685 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-551a0fd5-57c0-4fdf-88c2-6ec86235b125 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:15:53.785286 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-551a0fd5-57c0-4fdf-88c2-6ec86235b125 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:15:53.792951 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-551a0fd5-57c0-4fdf-88c2-6ec86235b125 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:15:53.793401 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-551a0fd5-57c0-4fdf-88c2-6ec86235b125 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:15:53.794193 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-551a0fd5-57c0-4fdf-88c2-6ec86235b125 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:15:53.794627 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-551a0fd5-57c0-4fdf-88c2-6ec86235b125 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:15:53.829333 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-551a0fd5-57c0-4fdf-88c2-6ec86235b125 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments/08b9c4b5-f0db-4bcb-a513-aa77c245a60a" status: 200 len: 194 microversion: 2.20 time: 0.051411 Jun 17 15:15:53.829944 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 301/555] 10.222.0.48 () {60 vars in 1453 bytes} [Fri Jun 17 15:15:53 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments/08b9c4b5-f0db-4bcb-a513-aa77c245a60a => generated 194 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 15:15:53.897502 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-40b1a123-60f4-45d9-848b-0a8a30a8f2d7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:15:53.898189 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-40b1a123-60f4-45d9-848b-0a8a30a8f2d7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:15:53.904775 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-40b1a123-60f4-45d9-848b-0a8a30a8f2d7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:15:53.905228 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-40b1a123-60f4-45d9-848b-0a8a30a8f2d7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:15:53.906012 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-40b1a123-60f4-45d9-848b-0a8a30a8f2d7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:15:53.906450 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-40b1a123-60f4-45d9-848b-0a8a30a8f2d7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:15:54.046779 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.objects.instance [None req-40b1a123-60f4-45d9-848b-0a8a30a8f2d7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lazy-loading 'services' on Instance uuid e97df352-5cee-41f7-ae51-f55cd9e85869 {{(pid=117649) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 15:15:54.180092 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-40b1a123-60f4-45d9-848b-0a8a30a8f2d7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "DELETE /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments/08b9c4b5-f0db-4bcb-a513-aa77c245a60a" status: 202 len: 0 microversion: 2.20 time: 0.287263 Jun 17 15:15:54.180919 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 255/556] 10.222.0.48 () {60 vars in 1456 bytes} [Fri Jun 17 15:15:53 2022] DELETE /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments/08b9c4b5-f0db-4bcb-a513-aa77c245a60a => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 17 15:15:54.189865 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-566f8c3c-5822-47e7-9b4f-0024ac5d2592 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:15:54.190924 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-566f8c3c-5822-47e7-9b4f-0024ac5d2592 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:15:54.197994 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-566f8c3c-5822-47e7-9b4f-0024ac5d2592 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:15:54.198449 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-566f8c3c-5822-47e7-9b4f-0024ac5d2592 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:15:54.199261 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-566f8c3c-5822-47e7-9b4f-0024ac5d2592 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:15:54.199739 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-566f8c3c-5822-47e7-9b4f-0024ac5d2592 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:15:54.232520 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-566f8c3c-5822-47e7-9b4f-0024ac5d2592 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046828 Jun 17 15:15:54.233118 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 302/557] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:15:54 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 15:15:55.246605 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-6ad50f37-668e-4f83-8082-c21ed9f3f955 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:15:55.247706 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-6ad50f37-668e-4f83-8082-c21ed9f3f955 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:15:55.255125 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6ad50f37-668e-4f83-8082-c21ed9f3f955 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:15:55.255626 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6ad50f37-668e-4f83-8082-c21ed9f3f955 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:15:55.256509 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6ad50f37-668e-4f83-8082-c21ed9f3f955 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:15:55.256956 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6ad50f37-668e-4f83-8082-c21ed9f3f955 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:15:55.290717 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-6ad50f37-668e-4f83-8082-c21ed9f3f955 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049176 Jun 17 15:15:55.291318 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 256/558] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:15:55 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:15:56.304794 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-19344e87-22df-4b46-b0ef-3fc26c1fa927 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:15:56.305906 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-19344e87-22df-4b46-b0ef-3fc26c1fa927 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:15:56.313432 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-19344e87-22df-4b46-b0ef-3fc26c1fa927 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:15:56.313893 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-19344e87-22df-4b46-b0ef-3fc26c1fa927 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:15:56.315273 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-19344e87-22df-4b46-b0ef-3fc26c1fa927 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:15:56.315906 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-19344e87-22df-4b46-b0ef-3fc26c1fa927 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:15:56.350042 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-19344e87-22df-4b46-b0ef-3fc26c1fa927 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050379 Jun 17 15:15:56.350626 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 303/559] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:15:56 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:15:57.366083 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-dbffc3b9-fb16-4dfb-9874-621a3a27b3fe tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:15:57.367388 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-dbffc3b9-fb16-4dfb-9874-621a3a27b3fe tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:15:57.376044 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-dbffc3b9-fb16-4dfb-9874-621a3a27b3fe tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:15:57.376538 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-dbffc3b9-fb16-4dfb-9874-621a3a27b3fe tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:15:57.377591 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-dbffc3b9-fb16-4dfb-9874-621a3a27b3fe tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:15:57.378047 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-dbffc3b9-fb16-4dfb-9874-621a3a27b3fe tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:15:57.416247 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-dbffc3b9-fb16-4dfb-9874-621a3a27b3fe tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056385 Jun 17 15:15:57.417357 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 257/560] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:15:57 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:15:58.429890 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-ce4bba04-8042-441a-a19a-4462d5f7c3b2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:15:58.430811 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-ce4bba04-8042-441a-a19a-4462d5f7c3b2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:15:58.437806 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ce4bba04-8042-441a-a19a-4462d5f7c3b2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:15:58.438250 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ce4bba04-8042-441a-a19a-4462d5f7c3b2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:15:58.439066 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ce4bba04-8042-441a-a19a-4462d5f7c3b2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:15:58.439541 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ce4bba04-8042-441a-a19a-4462d5f7c3b2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:15:58.470924 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-ce4bba04-8042-441a-a19a-4462d5f7c3b2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044984 Jun 17 15:15:58.471492 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 304/561] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:15:58 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:15:59.487181 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-26ee85f2-9656-4254-8dee-f258db1230a2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:15:59.488203 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-26ee85f2-9656-4254-8dee-f258db1230a2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:15:59.496664 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-26ee85f2-9656-4254-8dee-f258db1230a2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:15:59.497117 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-26ee85f2-9656-4254-8dee-f258db1230a2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:15:59.497897 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-26ee85f2-9656-4254-8dee-f258db1230a2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:15:59.498334 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-26ee85f2-9656-4254-8dee-f258db1230a2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:15:59.534454 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-26ee85f2-9656-4254-8dee-f258db1230a2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054566 Jun 17 15:15:59.535339 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 258/562] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:15:59 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:16:00.547038 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-45899533-b47a-487d-85bb-b90541387377 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:00.547960 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-45899533-b47a-487d-85bb-b90541387377 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:00.554840 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-45899533-b47a-487d-85bb-b90541387377 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:00.555283 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-45899533-b47a-487d-85bb-b90541387377 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:00.556066 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-45899533-b47a-487d-85bb-b90541387377 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:00.556534 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-45899533-b47a-487d-85bb-b90541387377 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:00.588160 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-45899533-b47a-487d-85bb-b90541387377 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045113 Jun 17 15:16:00.588974 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 305/563] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:16:00 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 15:16:01.601067 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-4ef77a0f-7024-4014-aaf8-818c0eac952b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:01.602005 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-4ef77a0f-7024-4014-aaf8-818c0eac952b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:01.608974 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4ef77a0f-7024-4014-aaf8-818c0eac952b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:01.609413 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4ef77a0f-7024-4014-aaf8-818c0eac952b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:01.610264 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4ef77a0f-7024-4014-aaf8-818c0eac952b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:01.610767 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4ef77a0f-7024-4014-aaf8-818c0eac952b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:01.642023 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-4ef77a0f-7024-4014-aaf8-818c0eac952b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044894 Jun 17 15:16:01.642504 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 259/564] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:16:01 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 15:16:02.656188 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-4d3bb080-f9ec-4d73-9bc7-9aef49d3b605 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:02.657250 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-4d3bb080-f9ec-4d73-9bc7-9aef49d3b605 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:02.664737 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4d3bb080-f9ec-4d73-9bc7-9aef49d3b605 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:02.665259 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4d3bb080-f9ec-4d73-9bc7-9aef49d3b605 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:02.666078 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4d3bb080-f9ec-4d73-9bc7-9aef49d3b605 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:02.666552 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4d3bb080-f9ec-4d73-9bc7-9aef49d3b605 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:02.700756 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-4d3bb080-f9ec-4d73-9bc7-9aef49d3b605 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049705 Jun 17 15:16:02.701345 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 306/565] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:16:02 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:16:03.712926 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-86a8314e-822e-4577-ad06-2fd572d36d16 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:03.714226 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-86a8314e-822e-4577-ad06-2fd572d36d16 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:03.721891 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-86a8314e-822e-4577-ad06-2fd572d36d16 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:03.722340 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-86a8314e-822e-4577-ad06-2fd572d36d16 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:03.723120 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-86a8314e-822e-4577-ad06-2fd572d36d16 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:03.723558 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-86a8314e-822e-4577-ad06-2fd572d36d16 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:03.755177 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-86a8314e-822e-4577-ad06-2fd572d36d16 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046437 Jun 17 15:16:03.755756 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 260/566] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:16:03 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:16:04.767853 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-86742d34-a1c3-4688-ad03-8d1c80de3aef tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:04.768828 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-86742d34-a1c3-4688-ad03-8d1c80de3aef tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:04.775604 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-86742d34-a1c3-4688-ad03-8d1c80de3aef tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:04.776061 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-86742d34-a1c3-4688-ad03-8d1c80de3aef tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:04.776848 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-86742d34-a1c3-4688-ad03-8d1c80de3aef tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:04.777310 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-86742d34-a1c3-4688-ad03-8d1c80de3aef tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:04.807078 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-86742d34-a1c3-4688-ad03-8d1c80de3aef tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043746 Jun 17 15:16:04.807653 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 307/567] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:16:04 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:16:05.819682 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-2e0c3bad-1ca4-4c40-a7b2-b492f3cee191 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:05.820543 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-2e0c3bad-1ca4-4c40-a7b2-b492f3cee191 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:05.827501 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2e0c3bad-1ca4-4c40-a7b2-b492f3cee191 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:05.827966 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2e0c3bad-1ca4-4c40-a7b2-b492f3cee191 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:05.828768 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2e0c3bad-1ca4-4c40-a7b2-b492f3cee191 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:05.829198 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2e0c3bad-1ca4-4c40-a7b2-b492f3cee191 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:05.863723 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-2e0c3bad-1ca4-4c40-a7b2-b492f3cee191 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048227 Jun 17 15:16:05.864301 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 261/568] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:16:05 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:16:06.878894 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-cd255a03-a86a-4c8a-b1cf-ed899937a4f5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:06.879952 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-cd255a03-a86a-4c8a-b1cf-ed899937a4f5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:06.886812 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cd255a03-a86a-4c8a-b1cf-ed899937a4f5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:06.887261 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cd255a03-a86a-4c8a-b1cf-ed899937a4f5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:06.888032 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cd255a03-a86a-4c8a-b1cf-ed899937a4f5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:06.888482 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cd255a03-a86a-4c8a-b1cf-ed899937a4f5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:06.920317 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-cd255a03-a86a-4c8a-b1cf-ed899937a4f5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047798 Jun 17 15:16:06.920913 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 308/569] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:16:06 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:16:07.937352 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-8d8695b4-2bc9-4d61-baae-9a6574580aea tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:07.938284 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-8d8695b4-2bc9-4d61-baae-9a6574580aea tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:07.945680 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8d8695b4-2bc9-4d61-baae-9a6574580aea tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:07.946126 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8d8695b4-2bc9-4d61-baae-9a6574580aea tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:07.946901 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8d8695b4-2bc9-4d61-baae-9a6574580aea tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:07.947390 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8d8695b4-2bc9-4d61-baae-9a6574580aea tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:07.979243 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-8d8695b4-2bc9-4d61-baae-9a6574580aea tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045886 Jun 17 15:16:07.979831 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 262/570] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:16:07 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 15:16:08.991062 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-d5ca597a-bd1a-4141-bd81-5c3bb6b9b741 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:08.992011 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-d5ca597a-bd1a-4141-bd81-5c3bb6b9b741 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:08.998629 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d5ca597a-bd1a-4141-bd81-5c3bb6b9b741 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:08.999077 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d5ca597a-bd1a-4141-bd81-5c3bb6b9b741 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:08.999857 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d5ca597a-bd1a-4141-bd81-5c3bb6b9b741 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:09.000292 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d5ca597a-bd1a-4141-bd81-5c3bb6b9b741 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:09.031981 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-d5ca597a-bd1a-4141-bd81-5c3bb6b9b741 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044932 Jun 17 15:16:09.032607 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 309/571] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:16:08 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:16:10.386776 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-bd51bd7d-26ee-44e8-8772-d8c1ef57b0c8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:10.387752 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-bd51bd7d-26ee-44e8-8772-d8c1ef57b0c8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:10.394688 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bd51bd7d-26ee-44e8-8772-d8c1ef57b0c8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:10.395136 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bd51bd7d-26ee-44e8-8772-d8c1ef57b0c8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:10.395914 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bd51bd7d-26ee-44e8-8772-d8c1ef57b0c8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:10.396422 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bd51bd7d-26ee-44e8-8772-d8c1ef57b0c8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:10.434672 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-bd51bd7d-26ee-44e8-8772-d8c1ef57b0c8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.392733 Jun 17 15:16:10.434672 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 263/572] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:16:10 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:16:11.446161 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-10109d5b-98ae-4f57-bca0-ef2a397fd132 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:11.447091 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-10109d5b-98ae-4f57-bca0-ef2a397fd132 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:11.454162 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-10109d5b-98ae-4f57-bca0-ef2a397fd132 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:11.454616 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-10109d5b-98ae-4f57-bca0-ef2a397fd132 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:11.455443 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-10109d5b-98ae-4f57-bca0-ef2a397fd132 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:11.455983 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-10109d5b-98ae-4f57-bca0-ef2a397fd132 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:11.492618 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-10109d5b-98ae-4f57-bca0-ef2a397fd132 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050409 Jun 17 15:16:11.493227 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 310/573] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:16:11 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:16:11.526019 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 15:16:11.526679 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Fri Jun 17 15:16:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 15:16:12.508693 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-a89e4d82-bd77-4227-97b6-5b5258e91d16 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:12.509777 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-a89e4d82-bd77-4227-97b6-5b5258e91d16 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:12.520724 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a89e4d82-bd77-4227-97b6-5b5258e91d16 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:12.521330 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a89e4d82-bd77-4227-97b6-5b5258e91d16 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:12.522331 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a89e4d82-bd77-4227-97b6-5b5258e91d16 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:12.522840 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a89e4d82-bd77-4227-97b6-5b5258e91d16 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:12.575857 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-a89e4d82-bd77-4227-97b6-5b5258e91d16 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.074894 Jun 17 15:16:12.577392 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 264/574] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:16:12 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:16:13.591390 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-4416745b-f51b-4e04-9d5d-6ad5655ca1d5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:13.592436 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-4416745b-f51b-4e04-9d5d-6ad5655ca1d5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:13.599344 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4416745b-f51b-4e04-9d5d-6ad5655ca1d5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:13.599792 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4416745b-f51b-4e04-9d5d-6ad5655ca1d5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:13.600602 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4416745b-f51b-4e04-9d5d-6ad5655ca1d5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:13.601040 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4416745b-f51b-4e04-9d5d-6ad5655ca1d5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:13.631606 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-4416745b-f51b-4e04-9d5d-6ad5655ca1d5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044558 Jun 17 15:16:13.632058 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 311/575] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:16:13 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:16:14.646493 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-1e7a3d4f-3502-45cd-87f8-45df3d1d8639 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:14.647344 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-1e7a3d4f-3502-45cd-87f8-45df3d1d8639 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:14.649446 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_api:SELECT=23 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:16:14.655916 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1e7a3d4f-3502-45cd-87f8-45df3d1d8639 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:14.656465 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1e7a3d4f-3502-45cd-87f8-45df3d1d8639 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:14.657899 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1e7a3d4f-3502-45cd-87f8-45df3d1d8639 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:14.658377 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1e7a3d4f-3502-45cd-87f8-45df3d1d8639 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:14.661371 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:16:14.693220 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-1e7a3d4f-3502-45cd-87f8-45df3d1d8639 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051265 Jun 17 15:16:14.693878 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 265/576] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:16:14 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:16:15.349254 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 15:16:15.349893 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Fri Jun 17 15:16:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 15:16:15.705536 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-8bae3818-6dec-4cac-9d09-e52616ccf793 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:15.706463 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-8bae3818-6dec-4cac-9d09-e52616ccf793 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:15.714046 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8bae3818-6dec-4cac-9d09-e52616ccf793 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:15.714501 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8bae3818-6dec-4cac-9d09-e52616ccf793 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:15.715280 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8bae3818-6dec-4cac-9d09-e52616ccf793 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:15.715972 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8bae3818-6dec-4cac-9d09-e52616ccf793 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:15.746324 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-8bae3818-6dec-4cac-9d09-e52616ccf793 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044918 Jun 17 15:16:15.746893 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 312/577] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:16:15 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:16:16.718666 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 15:16:16.719385 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Fri Jun 17 15:16:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 15:16:16.760781 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-47c4caf6-ab8b-4a88-8585-76c05dff291f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:16.761788 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-47c4caf6-ab8b-4a88-8585-76c05dff291f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:16.769784 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-47c4caf6-ab8b-4a88-8585-76c05dff291f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:16.770410 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-47c4caf6-ab8b-4a88-8585-76c05dff291f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:16.771696 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-47c4caf6-ab8b-4a88-8585-76c05dff291f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:16.772216 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-47c4caf6-ab8b-4a88-8585-76c05dff291f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:16.806726 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-47c4caf6-ab8b-4a88-8585-76c05dff291f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050019 Jun 17 15:16:16.807322 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 266/578] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:16:16 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:16:17.819881 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-3cb00a7c-86f9-4d3e-8ddb-cd361f5df0d4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:17.820854 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-3cb00a7c-86f9-4d3e-8ddb-cd361f5df0d4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:17.828012 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3cb00a7c-86f9-4d3e-8ddb-cd361f5df0d4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:17.828501 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3cb00a7c-86f9-4d3e-8ddb-cd361f5df0d4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:17.829315 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3cb00a7c-86f9-4d3e-8ddb-cd361f5df0d4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:17.829761 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3cb00a7c-86f9-4d3e-8ddb-cd361f5df0d4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:17.864433 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-3cb00a7c-86f9-4d3e-8ddb-cd361f5df0d4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048610 Jun 17 15:16:17.865007 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 313/579] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:16:17 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:16:18.877812 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-41d4814c-5c66-4da5-b7a4-2c3627e0d1e1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:18.879096 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-41d4814c-5c66-4da5-b7a4-2c3627e0d1e1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:18.886957 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-41d4814c-5c66-4da5-b7a4-2c3627e0d1e1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:18.887423 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-41d4814c-5c66-4da5-b7a4-2c3627e0d1e1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:18.888195 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-41d4814c-5c66-4da5-b7a4-2c3627e0d1e1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:18.888652 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-41d4814c-5c66-4da5-b7a4-2c3627e0d1e1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:18.922216 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-41d4814c-5c66-4da5-b7a4-2c3627e0d1e1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049557 Jun 17 15:16:18.922976 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 267/580] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:16:18 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:16:19.934845 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-50085c96-b281-4cc3-aa23-52bad162f5ab tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:19.935682 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-50085c96-b281-4cc3-aa23-52bad162f5ab tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:19.943180 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-50085c96-b281-4cc3-aa23-52bad162f5ab tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:19.943664 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-50085c96-b281-4cc3-aa23-52bad162f5ab tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:19.944546 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-50085c96-b281-4cc3-aa23-52bad162f5ab tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:19.944987 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-50085c96-b281-4cc3-aa23-52bad162f5ab tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:19.978103 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-50085c96-b281-4cc3-aa23-52bad162f5ab tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047435 Jun 17 15:16:19.978684 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 314/581] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:16:19 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:16:20.362918 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-739b586f-eb55-41ee-a80d-f5d666802dcb tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-374272086"}} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:16:20.363526 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-739b586f-eb55-41ee-a80d-f5d666802dcb tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:20.370312 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-739b586f-eb55-41ee-a80d-f5d666802dcb tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:20.370755 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-739b586f-eb55-41ee-a80d-f5d666802dcb tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:20.371575 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-739b586f-eb55-41ee-a80d-f5d666802dcb tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:20.372010 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-739b586f-eb55-41ee-a80d-f5d666802dcb tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:20.634331 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.network.security_group_api [None req-739b586f-eb55-41ee-a80d-f5d666802dcb tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Removing security group bb1a391c-01df-48f6-a6bf-ad02cf73985c from port 06c1246f-1c4b-48df-98b1-2028fa5b27e5 Jun 17 15:16:20.997214 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-8c32024e-07a5-4fd0-837a-f8e2f27e75f2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:20.999149 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-8c32024e-07a5-4fd0-837a-f8e2f27e75f2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:21.011402 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8c32024e-07a5-4fd0-837a-f8e2f27e75f2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:21.012084 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8c32024e-07a5-4fd0-837a-f8e2f27e75f2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:21.014975 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8c32024e-07a5-4fd0-837a-f8e2f27e75f2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:21.016534 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8c32024e-07a5-4fd0-837a-f8e2f27e75f2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:21.053925 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-8c32024e-07a5-4fd0-837a-f8e2f27e75f2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.064791 Jun 17 15:16:21.054706 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 315/582] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:16:20 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 15:16:21.067181 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-739b586f-eb55-41ee-a80d-f5d666802dcb tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "POST /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/action" status: 202 len: 0 microversion: 2.1 time: 0.708386 Jun 17 15:16:21.068589 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 268/583] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jun 17 15:16:20 2022] POST /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/action => generated 0 bytes in 711 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 15:16:21.085340 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [req-bd962b97-d23f-4b21-bed1-af4c1cf1db6d req-5fdc9512-5d74-4085-8b2e-ec884a8ff4bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91408900-da01-4985-b392-111577935284", "tag": "06c1246f-1c4b-48df-98b1-2028fa5b27e5"}]} {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:16:21.101129 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [req-bd962b97-d23f-4b21-bed1-af4c1cf1db6d req-5fdc9512-5d74-4085-8b2e-ec884a8ff4bf service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:21.101895 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [req-bd962b97-d23f-4b21-bed1-af4c1cf1db6d req-5fdc9512-5d74-4085-8b2e-ec884a8ff4bf service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:21.130385 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.compute.server_external_events [req-bd962b97-d23f-4b21-bed1-af4c1cf1db6d req-5fdc9512-5d74-4085-8b2e-ec884a8ff4bf service nova] Creating event network-changed:06c1246f-1c4b-48df-98b1-2028fa5b27e5 for instance 91408900-da01-4985-b392-111577935284 on hv-cinder-82549 Jun 17 15:16:21.139855 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [req-bd962b97-d23f-4b21-bed1-af4c1cf1db6d req-5fdc9512-5d74-4085-8b2e-ec884a8ff4bf service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061800 Jun 17 15:16:21.141014 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 316/584] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 15:16:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:16:22.067378 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-3f3437bf-e750-4a6e-9830-a064a0bf97fb tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:22.069035 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-3f3437bf-e750-4a6e-9830-a064a0bf97fb tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:22.075579 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3f3437bf-e750-4a6e-9830-a064a0bf97fb tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:22.076029 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3f3437bf-e750-4a6e-9830-a064a0bf97fb tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:22.076835 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3f3437bf-e750-4a6e-9830-a064a0bf97fb tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:22.077274 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3f3437bf-e750-4a6e-9830-a064a0bf97fb tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:22.115539 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-3f3437bf-e750-4a6e-9830-a064a0bf97fb tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052932 Jun 17 15:16:22.116689 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 269/585] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:16:22 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:16:22.457143 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-c406be6e-ca06-45d4-8536-fbc1a952690b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:22.458122 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-c406be6e-ca06-45d4-8536-fbc1a952690b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:22.470477 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c406be6e-ca06-45d4-8536-fbc1a952690b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:22.471299 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c406be6e-ca06-45d4-8536-fbc1a952690b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:22.472771 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c406be6e-ca06-45d4-8536-fbc1a952690b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:22.473595 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c406be6e-ca06-45d4-8536-fbc1a952690b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:22.706770 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.objects.instance [None req-c406be6e-ca06-45d4-8536-fbc1a952690b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lazy-loading 'services' on Instance uuid 91408900-da01-4985-b392-111577935284 {{(pid=117650) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 15:16:22.744523 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=100 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:16:22.839653 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-c406be6e-ca06-45d4-8536-fbc1a952690b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "DELETE /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments/cde658e2-871f-4bf2-8afb-0912666bb314" status: 202 len: 0 microversion: 2.1 time: 0.391626 Jun 17 15:16:22.840456 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 317/586] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Jun 17 15:16:22 2022] DELETE /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments/cde658e2-871f-4bf2-8afb-0912666bb314 => generated 0 bytes in 395 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 15:16:22.855075 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-ee23255f-a870-4e79-a2c9-c2d290e87a19 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:22.857277 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-ee23255f-a870-4e79-a2c9-c2d290e87a19 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:22.868059 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ee23255f-a870-4e79-a2c9-c2d290e87a19 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:22.868908 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ee23255f-a870-4e79-a2c9-c2d290e87a19 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:22.870249 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ee23255f-a870-4e79-a2c9-c2d290e87a19 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:22.871049 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ee23255f-a870-4e79-a2c9-c2d290e87a19 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:22.927287 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-ee23255f-a870-4e79-a2c9-c2d290e87a19 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079461 Jun 17 15:16:22.928370 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 270/587] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:16:22 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:16:23.132193 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-4327b5cc-598f-4d41-bb22-e71822dd0608 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:23.133556 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-4327b5cc-598f-4d41-bb22-e71822dd0608 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:23.142345 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4327b5cc-598f-4d41-bb22-e71822dd0608 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:23.142795 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4327b5cc-598f-4d41-bb22-e71822dd0608 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:23.143579 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4327b5cc-598f-4d41-bb22-e71822dd0608 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:23.145024 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4327b5cc-598f-4d41-bb22-e71822dd0608 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:23.161513 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [req-100ccc5f-8d9a-412b-aec1-1596216154f9 req-0a3a6486-97d7-495d-a0a5-96060eeea2c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91408900-da01-4985-b392-111577935284", "tag": "06c1246f-1c4b-48df-98b1-2028fa5b27e5"}]} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:16:23.171324 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-100ccc5f-8d9a-412b-aec1-1596216154f9 req-0a3a6486-97d7-495d-a0a5-96060eeea2c3 service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:23.172032 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-100ccc5f-8d9a-412b-aec1-1596216154f9 req-0a3a6486-97d7-495d-a0a5-96060eeea2c3 service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:23.186051 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.compute.server_external_events [req-100ccc5f-8d9a-412b-aec1-1596216154f9 req-0a3a6486-97d7-495d-a0a5-96060eeea2c3 service nova] Creating event network-changed:06c1246f-1c4b-48df-98b1-2028fa5b27e5 for instance 91408900-da01-4985-b392-111577935284 on hv-cinder-82549 Jun 17 15:16:23.190475 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-4327b5cc-598f-4d41-bb22-e71822dd0608 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.062258 Jun 17 15:16:23.191713 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 318/588] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:16:23 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 15:16:23.192117 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [req-100ccc5f-8d9a-412b-aec1-1596216154f9 req-0a3a6486-97d7-495d-a0a5-96060eeea2c3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035248 Jun 17 15:16:23.193005 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 271/589] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 15:16:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:16:23.940671 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-6ec4cd85-4a96-4d15-98e2-869be07ca138 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:23.941591 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-6ec4cd85-4a96-4d15-98e2-869be07ca138 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:23.944159 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_api:SELECT=37 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:16:23.949960 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6ec4cd85-4a96-4d15-98e2-869be07ca138 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:23.950397 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6ec4cd85-4a96-4d15-98e2-869be07ca138 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:23.951166 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6ec4cd85-4a96-4d15-98e2-869be07ca138 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:23.951590 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6ec4cd85-4a96-4d15-98e2-869be07ca138 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:23.981908 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-6ec4cd85-4a96-4d15-98e2-869be07ca138 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046112 Jun 17 15:16:23.982472 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 319/590] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:16:23 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:16:24.206443 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-e52206d7-7f23-4a46-a6f8-a574a6d17f6c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:24.207383 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-e52206d7-7f23-4a46-a6f8-a574a6d17f6c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:24.214481 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e52206d7-7f23-4a46-a6f8-a574a6d17f6c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:24.214922 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e52206d7-7f23-4a46-a6f8-a574a6d17f6c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:24.215939 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e52206d7-7f23-4a46-a6f8-a574a6d17f6c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:24.216401 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e52206d7-7f23-4a46-a6f8-a574a6d17f6c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:24.247491 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-e52206d7-7f23-4a46-a6f8-a574a6d17f6c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045565 Jun 17 15:16:24.248063 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 272/591] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:16:24 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:16:24.996799 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-790dd32e-c0ba-425f-b654-965c1d2f4214 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:24.997738 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-790dd32e-c0ba-425f-b654-965c1d2f4214 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:25.006075 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-790dd32e-c0ba-425f-b654-965c1d2f4214 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:25.006595 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-790dd32e-c0ba-425f-b654-965c1d2f4214 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:25.007455 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-790dd32e-c0ba-425f-b654-965c1d2f4214 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:25.007991 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-790dd32e-c0ba-425f-b654-965c1d2f4214 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:25.039559 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-790dd32e-c0ba-425f-b654-965c1d2f4214 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047000 Jun 17 15:16:25.040129 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 320/592] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:16:24 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:16:25.259718 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-c201ce4e-4ea8-4c40-b9a9-3c562d3dd2cc tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:25.260577 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-c201ce4e-4ea8-4c40-b9a9-3c562d3dd2cc tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:25.270447 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c201ce4e-4ea8-4c40-b9a9-3c562d3dd2cc tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:25.271251 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c201ce4e-4ea8-4c40-b9a9-3c562d3dd2cc tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:25.272794 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c201ce4e-4ea8-4c40-b9a9-3c562d3dd2cc tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:25.273577 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c201ce4e-4ea8-4c40-b9a9-3c562d3dd2cc tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:25.318857 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-c201ce4e-4ea8-4c40-b9a9-3c562d3dd2cc tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.063210 Jun 17 15:16:25.319450 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 273/593] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:16:25 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:16:26.052298 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-f20b9f98-6666-4732-bdbd-d5d4fe10fea2 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:26.053332 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-f20b9f98-6666-4732-bdbd-d5d4fe10fea2 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:26.059751 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f20b9f98-6666-4732-bdbd-d5d4fe10fea2 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:26.060200 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f20b9f98-6666-4732-bdbd-d5d4fe10fea2 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:26.061021 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f20b9f98-6666-4732-bdbd-d5d4fe10fea2 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:26.061460 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f20b9f98-6666-4732-bdbd-d5d4fe10fea2 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:26.093514 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-f20b9f98-6666-4732-bdbd-d5d4fe10fea2 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046080 Jun 17 15:16:26.094106 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 321/594] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:16:26 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:16:26.330974 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-4512efeb-e6bd-4333-87ee-f6acdc1a5418 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:26.331793 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-4512efeb-e6bd-4333-87ee-f6acdc1a5418 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:26.338538 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4512efeb-e6bd-4333-87ee-f6acdc1a5418 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:26.339031 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4512efeb-e6bd-4333-87ee-f6acdc1a5418 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:26.339836 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4512efeb-e6bd-4333-87ee-f6acdc1a5418 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:26.340320 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4512efeb-e6bd-4333-87ee-f6acdc1a5418 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:26.374272 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-4512efeb-e6bd-4333-87ee-f6acdc1a5418 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047312 Jun 17 15:16:26.375044 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 274/595] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:16:26 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:16:27.105781 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-7de4d98d-23b8-4df3-9496-18f22cb01f9d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:27.106708 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-7de4d98d-23b8-4df3-9496-18f22cb01f9d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:27.114354 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7de4d98d-23b8-4df3-9496-18f22cb01f9d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:27.114883 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7de4d98d-23b8-4df3-9496-18f22cb01f9d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:27.115774 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7de4d98d-23b8-4df3-9496-18f22cb01f9d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:27.116257 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7de4d98d-23b8-4df3-9496-18f22cb01f9d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:27.150993 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-7de4d98d-23b8-4df3-9496-18f22cb01f9d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049114 Jun 17 15:16:27.151486 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 322/596] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:16:27 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:16:27.387699 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-ef579d64-a566-4036-b955-75acd3565c48 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:27.388752 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-ef579d64-a566-4036-b955-75acd3565c48 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:27.395929 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ef579d64-a566-4036-b955-75acd3565c48 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:27.396399 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ef579d64-a566-4036-b955-75acd3565c48 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:27.397156 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ef579d64-a566-4036-b955-75acd3565c48 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:27.397585 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ef579d64-a566-4036-b955-75acd3565c48 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:27.429065 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-ef579d64-a566-4036-b955-75acd3565c48 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045510 Jun 17 15:16:27.429512 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 275/597] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:16:27 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:16:28.163227 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-4b46a878-8cd7-4297-9d0f-9028fe79be6b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:28.164223 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-4b46a878-8cd7-4297-9d0f-9028fe79be6b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:28.171476 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4b46a878-8cd7-4297-9d0f-9028fe79be6b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:28.171933 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4b46a878-8cd7-4297-9d0f-9028fe79be6b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:28.173279 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4b46a878-8cd7-4297-9d0f-9028fe79be6b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:28.173722 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4b46a878-8cd7-4297-9d0f-9028fe79be6b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:28.206559 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-4b46a878-8cd7-4297-9d0f-9028fe79be6b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047525 Jun 17 15:16:28.207136 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 323/598] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:16:28 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:16:28.442138 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-5050c643-4b5b-4142-a717-d76e1482fa66 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:28.443401 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-5050c643-4b5b-4142-a717-d76e1482fa66 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:28.451553 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5050c643-4b5b-4142-a717-d76e1482fa66 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:28.452004 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5050c643-4b5b-4142-a717-d76e1482fa66 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:28.452808 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5050c643-4b5b-4142-a717-d76e1482fa66 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:28.453240 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5050c643-4b5b-4142-a717-d76e1482fa66 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:28.485890 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-5050c643-4b5b-4142-a717-d76e1482fa66 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048305 Jun 17 15:16:28.486468 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 276/599] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:16:28 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:16:29.218947 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-f87430a8-66d9-4dfd-a13c-41b948c91df9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:29.220436 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-f87430a8-66d9-4dfd-a13c-41b948c91df9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:29.227274 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f87430a8-66d9-4dfd-a13c-41b948c91df9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:29.227727 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f87430a8-66d9-4dfd-a13c-41b948c91df9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:29.228546 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f87430a8-66d9-4dfd-a13c-41b948c91df9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:29.228980 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f87430a8-66d9-4dfd-a13c-41b948c91df9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:29.262392 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-f87430a8-66d9-4dfd-a13c-41b948c91df9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047690 Jun 17 15:16:29.263048 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 324/600] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:16:29 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:16:29.497402 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-7ab1a005-9fb6-4e62-abef-ea00a3196de5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:29.498336 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-7ab1a005-9fb6-4e62-abef-ea00a3196de5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:29.505158 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7ab1a005-9fb6-4e62-abef-ea00a3196de5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:29.505614 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7ab1a005-9fb6-4e62-abef-ea00a3196de5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:29.506397 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7ab1a005-9fb6-4e62-abef-ea00a3196de5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:29.506846 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7ab1a005-9fb6-4e62-abef-ea00a3196de5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:29.538355 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-7ab1a005-9fb6-4e62-abef-ea00a3196de5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044903 Jun 17 15:16:29.538939 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 277/601] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:16:29 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:16:30.274562 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-5087dc73-ca64-4fdf-850a-6d4d35a92dd2 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:30.275518 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-5087dc73-ca64-4fdf-850a-6d4d35a92dd2 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:30.282191 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5087dc73-ca64-4fdf-850a-6d4d35a92dd2 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:30.282666 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5087dc73-ca64-4fdf-850a-6d4d35a92dd2 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:30.283446 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5087dc73-ca64-4fdf-850a-6d4d35a92dd2 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:30.283883 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5087dc73-ca64-4fdf-850a-6d4d35a92dd2 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:30.313780 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-5087dc73-ca64-4fdf-850a-6d4d35a92dd2 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042702 Jun 17 15:16:30.314378 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 325/602] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:16:30 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:16:30.551640 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-0de1fdee-205e-438e-b19a-c4e265bca438 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:30.552642 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-0de1fdee-205e-438e-b19a-c4e265bca438 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:30.560274 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0de1fdee-205e-438e-b19a-c4e265bca438 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:30.560884 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0de1fdee-205e-438e-b19a-c4e265bca438 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:30.561797 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0de1fdee-205e-438e-b19a-c4e265bca438 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:30.562283 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0de1fdee-205e-438e-b19a-c4e265bca438 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:30.596765 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-0de1fdee-205e-438e-b19a-c4e265bca438 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049818 Jun 17 15:16:30.597367 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 278/603] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:16:30 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:16:30.928944 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-3701d785-e952-46a6-845f-a4242ea4d0e4 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:16:30.929478 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-3701d785-e952-46a6-845f-a4242ea4d0e4 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:30.935588 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3701d785-e952-46a6-845f-a4242ea4d0e4 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:30.936235 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3701d785-e952-46a6-845f-a4242ea4d0e4 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:30.937210 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3701d785-e952-46a6-845f-a4242ea4d0e4 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:30.937745 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3701d785-e952-46a6-845f-a4242ea4d0e4 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:30.961718 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.objects.instance [None req-3701d785-e952-46a6-845f-a4242ea4d0e4 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lazy-loading 'flavor' on Instance uuid 5b30f80f-8b8c-4c07-8653-4f9fd128ce77 {{(pid=117650) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 15:16:31.049406 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-3701d785-e952-46a6-845f-a4242ea4d0e4 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "POST /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77/action" status: 202 len: 0 microversion: 2.1 time: 0.123628 Jun 17 15:16:31.051113 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 326/604] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jun 17 15:16:30 2022] POST /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 17 15:16:31.059190 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-ef4d8277-d12f-49d3-b861-76366dfb164d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:31.059808 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-ef4d8277-d12f-49d3-b861-76366dfb164d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:31.066302 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ef4d8277-d12f-49d3-b861-76366dfb164d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:31.066748 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ef4d8277-d12f-49d3-b861-76366dfb164d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:31.067520 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ef4d8277-d12f-49d3-b861-76366dfb164d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:31.067954 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ef4d8277-d12f-49d3-b861-76366dfb164d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:31.247845 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-ef4d8277-d12f-49d3-b861-76366dfb164d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:16:31.255848 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-ef4d8277-d12f-49d3-b861-76366dfb164d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.200758 Jun 17 15:16:31.256447 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 279/605] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:16:31 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:16:31.327020 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-edfe2059-1762-40b8-a2bd-8151fbbeda8c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:31.328448 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-edfe2059-1762-40b8-a2bd-8151fbbeda8c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:31.335568 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-edfe2059-1762-40b8-a2bd-8151fbbeda8c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:31.336013 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-edfe2059-1762-40b8-a2bd-8151fbbeda8c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:31.336813 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-edfe2059-1762-40b8-a2bd-8151fbbeda8c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:31.337264 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-edfe2059-1762-40b8-a2bd-8151fbbeda8c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:31.370218 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-edfe2059-1762-40b8-a2bd-8151fbbeda8c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048585 Jun 17 15:16:31.370800 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 327/606] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:16:31 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:16:31.609259 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-7470ff9c-b23d-48e9-9c97-bc93bbb1a2be tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:31.610296 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-7470ff9c-b23d-48e9-9c97-bc93bbb1a2be tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:31.616985 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7470ff9c-b23d-48e9-9c97-bc93bbb1a2be tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:31.617427 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7470ff9c-b23d-48e9-9c97-bc93bbb1a2be tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:31.618219 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7470ff9c-b23d-48e9-9c97-bc93bbb1a2be tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:31.618629 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7470ff9c-b23d-48e9-9c97-bc93bbb1a2be tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:31.650794 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-7470ff9c-b23d-48e9-9c97-bc93bbb1a2be tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045694 Jun 17 15:16:31.651388 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 280/607] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:16:31 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:16:32.273655 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-44d9070f-28ca-49f4-9989-50f6f655e404 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:32.274322 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-44d9070f-28ca-49f4-9989-50f6f655e404 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:32.280647 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-44d9070f-28ca-49f4-9989-50f6f655e404 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:32.281134 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-44d9070f-28ca-49f4-9989-50f6f655e404 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:32.282425 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-44d9070f-28ca-49f4-9989-50f6f655e404 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:32.282889 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-44d9070f-28ca-49f4-9989-50f6f655e404 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:32.381916 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-642b2b67-edb9-42c6-8300-ef31ec568626 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:32.382942 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-642b2b67-edb9-42c6-8300-ef31ec568626 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:32.390795 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-642b2b67-edb9-42c6-8300-ef31ec568626 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:32.391590 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-642b2b67-edb9-42c6-8300-ef31ec568626 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:32.392942 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-642b2b67-edb9-42c6-8300-ef31ec568626 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:32.393726 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-642b2b67-edb9-42c6-8300-ef31ec568626 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:32.440032 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-642b2b67-edb9-42c6-8300-ef31ec568626 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061817 Jun 17 15:16:32.440913 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 281/608] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:16:32 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:16:32.447114 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-44d9070f-28ca-49f4-9989-50f6f655e404 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:16:32.455067 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-44d9070f-28ca-49f4-9989-50f6f655e404 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.185223 Jun 17 15:16:32.455644 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 328/609] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:16:32 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:16:32.667542 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-0f91c40c-a30e-4667-8d3c-ba823ed98730 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:32.669074 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-0f91c40c-a30e-4667-8d3c-ba823ed98730 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:32.680132 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0f91c40c-a30e-4667-8d3c-ba823ed98730 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:32.680938 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0f91c40c-a30e-4667-8d3c-ba823ed98730 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:32.682266 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0f91c40c-a30e-4667-8d3c-ba823ed98730 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:32.683020 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0f91c40c-a30e-4667-8d3c-ba823ed98730 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:32.712508 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell1:SELECT=100 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:16:32.721127 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-0f91c40c-a30e-4667-8d3c-ba823ed98730 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.061059 Jun 17 15:16:32.722144 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 282/610] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:16:32 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:16:33.453143 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-7bb2b234-15e2-4ef6-a043-76b3b2ded57a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:33.454341 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-7bb2b234-15e2-4ef6-a043-76b3b2ded57a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:33.461461 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7bb2b234-15e2-4ef6-a043-76b3b2ded57a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:33.461906 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7bb2b234-15e2-4ef6-a043-76b3b2ded57a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:33.462674 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7bb2b234-15e2-4ef6-a043-76b3b2ded57a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:33.463106 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7bb2b234-15e2-4ef6-a043-76b3b2ded57a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:33.472286 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-5c5c853c-e731-4f8a-be64-ea8b96a2bd55 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:33.473034 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-5c5c853c-e731-4f8a-be64-ea8b96a2bd55 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:33.479728 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5c5c853c-e731-4f8a-be64-ea8b96a2bd55 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:33.480179 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5c5c853c-e731-4f8a-be64-ea8b96a2bd55 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:33.480983 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5c5c853c-e731-4f8a-be64-ea8b96a2bd55 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:33.481424 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5c5c853c-e731-4f8a-be64-ea8b96a2bd55 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:33.495840 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-7bb2b234-15e2-4ef6-a043-76b3b2ded57a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046960 Jun 17 15:16:33.496449 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 329/611] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:16:33 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:16:33.632683 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-5c5c853c-e731-4f8a-be64-ea8b96a2bd55 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:16:33.640465 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-5c5c853c-e731-4f8a-be64-ea8b96a2bd55 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.172588 Jun 17 15:16:33.641052 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 283/612] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:16:33 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:16:33.733631 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-18887c8f-cfe2-48ef-9158-1db87df68061 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:33.734464 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-18887c8f-cfe2-48ef-9158-1db87df68061 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:33.741400 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-18887c8f-cfe2-48ef-9158-1db87df68061 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:33.741886 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-18887c8f-cfe2-48ef-9158-1db87df68061 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:33.742660 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-18887c8f-cfe2-48ef-9158-1db87df68061 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:33.743095 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-18887c8f-cfe2-48ef-9158-1db87df68061 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:33.774852 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-18887c8f-cfe2-48ef-9158-1db87df68061 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045267 Jun 17 15:16:33.775451 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 330/613] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:16:33 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 15:16:34.508470 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-c9021670-d065-4b3f-a844-435854a09856 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:34.509339 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-c9021670-d065-4b3f-a844-435854a09856 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:34.517064 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c9021670-d065-4b3f-a844-435854a09856 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:34.517520 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c9021670-d065-4b3f-a844-435854a09856 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:34.518333 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c9021670-d065-4b3f-a844-435854a09856 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:34.518800 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c9021670-d065-4b3f-a844-435854a09856 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:34.552032 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-c9021670-d065-4b3f-a844-435854a09856 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047939 Jun 17 15:16:34.552661 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 284/614] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:16:34 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:16:34.658287 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-30a0432c-948d-4c86-8adc-2a841d325df2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:34.658938 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-30a0432c-948d-4c86-8adc-2a841d325df2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:34.666341 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-30a0432c-948d-4c86-8adc-2a841d325df2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:34.666794 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-30a0432c-948d-4c86-8adc-2a841d325df2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:34.667586 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-30a0432c-948d-4c86-8adc-2a841d325df2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:34.668017 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-30a0432c-948d-4c86-8adc-2a841d325df2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:34.790002 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-3503df84-6982-4b10-9845-f8df0cd6587d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:34.791613 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-3503df84-6982-4b10-9845-f8df0cd6587d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:34.802204 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3503df84-6982-4b10-9845-f8df0cd6587d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:34.802982 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3503df84-6982-4b10-9845-f8df0cd6587d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:34.804381 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3503df84-6982-4b10-9845-f8df0cd6587d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:34.804977 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3503df84-6982-4b10-9845-f8df0cd6587d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:34.820572 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-30a0432c-948d-4c86-8adc-2a841d325df2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:16:34.829388 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-30a0432c-948d-4c86-8adc-2a841d325df2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.174787 Jun 17 15:16:34.830350 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 331/615] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:16:34 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:16:34.845661 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-3503df84-6982-4b10-9845-f8df0cd6587d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.063308 Jun 17 15:16:34.846242 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 285/616] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:16:34 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:16:35.570833 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-283c5cac-dc55-43f3-ae20-90c031d922c2 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:35.572466 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-283c5cac-dc55-43f3-ae20-90c031d922c2 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:35.582664 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-283c5cac-dc55-43f3-ae20-90c031d922c2 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:35.583458 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-283c5cac-dc55-43f3-ae20-90c031d922c2 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:35.584817 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-283c5cac-dc55-43f3-ae20-90c031d922c2 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:35.585580 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-283c5cac-dc55-43f3-ae20-90c031d922c2 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:35.592934 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:16:35.646073 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-283c5cac-dc55-43f3-ae20-90c031d922c2 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082146 Jun 17 15:16:35.646996 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 332/617] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:16:35 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:16:35.854993 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-6374b8f8-ddae-4429-8c9a-c06aa8af0e06 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:35.856019 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-6374b8f8-ddae-4429-8c9a-c06aa8af0e06 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:35.860224 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-bd8e7f7c-0a1c-4a70-9321-1148fde2750a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:35.861502 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-bd8e7f7c-0a1c-4a70-9321-1148fde2750a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:35.863817 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6374b8f8-ddae-4429-8c9a-c06aa8af0e06 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:35.865147 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6374b8f8-ddae-4429-8c9a-c06aa8af0e06 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:35.865586 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6374b8f8-ddae-4429-8c9a-c06aa8af0e06 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:35.866100 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6374b8f8-ddae-4429-8c9a-c06aa8af0e06 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:35.869516 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bd8e7f7c-0a1c-4a70-9321-1148fde2750a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:35.870111 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bd8e7f7c-0a1c-4a70-9321-1148fde2750a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:35.871115 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bd8e7f7c-0a1c-4a70-9321-1148fde2750a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:35.871774 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bd8e7f7c-0a1c-4a70-9321-1148fde2750a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:35.905533 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-bd8e7f7c-0a1c-4a70-9321-1148fde2750a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049676 Jun 17 15:16:35.906029 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 333/618] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:16:35 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 15:16:36.023556 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-6374b8f8-ddae-4429-8c9a-c06aa8af0e06 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:16:36.031523 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-6374b8f8-ddae-4429-8c9a-c06aa8af0e06 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.181856 Jun 17 15:16:36.032248 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 286/619] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:16:35 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:16:36.658878 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-60b6b98b-78a5-4411-b1de-7826006373e6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:36.659791 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-60b6b98b-78a5-4411-b1de-7826006373e6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:36.666425 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-60b6b98b-78a5-4411-b1de-7826006373e6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:36.666875 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-60b6b98b-78a5-4411-b1de-7826006373e6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:36.667647 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-60b6b98b-78a5-4411-b1de-7826006373e6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:36.668082 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-60b6b98b-78a5-4411-b1de-7826006373e6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:36.700312 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-60b6b98b-78a5-4411-b1de-7826006373e6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045415 Jun 17 15:16:36.700936 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 334/620] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:16:36 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:16:36.918147 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-b291a090-2a63-4592-ac31-3c8449b2017d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:36.919096 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-b291a090-2a63-4592-ac31-3c8449b2017d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:36.927549 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b291a090-2a63-4592-ac31-3c8449b2017d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:36.928069 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b291a090-2a63-4592-ac31-3c8449b2017d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:36.929094 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b291a090-2a63-4592-ac31-3c8449b2017d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:36.929624 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b291a090-2a63-4592-ac31-3c8449b2017d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:36.962624 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-b291a090-2a63-4592-ac31-3c8449b2017d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048649 Jun 17 15:16:36.963391 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 287/621] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:16:36 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:16:37.051444 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-22877011-7194-4b73-94c5-3416be0592a0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:37.052089 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-22877011-7194-4b73-94c5-3416be0592a0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:37.058741 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-22877011-7194-4b73-94c5-3416be0592a0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:37.059193 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-22877011-7194-4b73-94c5-3416be0592a0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:37.059993 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-22877011-7194-4b73-94c5-3416be0592a0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:37.060462 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-22877011-7194-4b73-94c5-3416be0592a0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:37.218251 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-22877011-7194-4b73-94c5-3416be0592a0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:16:37.227083 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-22877011-7194-4b73-94c5-3416be0592a0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.180172 Jun 17 15:16:37.227676 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 335/622] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:16:37 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:16:37.712614 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-8cc03876-9a31-4790-9529-a5a73e0718d5 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:37.713545 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-8cc03876-9a31-4790-9529-a5a73e0718d5 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:37.720831 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8cc03876-9a31-4790-9529-a5a73e0718d5 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:37.721275 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8cc03876-9a31-4790-9529-a5a73e0718d5 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:37.722051 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8cc03876-9a31-4790-9529-a5a73e0718d5 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:37.722484 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8cc03876-9a31-4790-9529-a5a73e0718d5 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:37.754893 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-8cc03876-9a31-4790-9529-a5a73e0718d5 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046189 Jun 17 15:16:37.755463 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 288/623] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:16:37 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:16:37.976509 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-53999b5b-b16b-4da8-948d-111aa3d7c1eb tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:37.977340 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-53999b5b-b16b-4da8-948d-111aa3d7c1eb tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:37.983760 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-53999b5b-b16b-4da8-948d-111aa3d7c1eb tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:37.984251 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-53999b5b-b16b-4da8-948d-111aa3d7c1eb tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:37.985096 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-53999b5b-b16b-4da8-948d-111aa3d7c1eb tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:37.985569 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-53999b5b-b16b-4da8-948d-111aa3d7c1eb tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:38.015650 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-53999b5b-b16b-4da8-948d-111aa3d7c1eb tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043579 Jun 17 15:16:38.016773 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 336/624] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:16:37 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 15:16:38.255701 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-f55b8ccc-630d-427e-b732-7f2c253a8f8b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:38.256814 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-f55b8ccc-630d-427e-b732-7f2c253a8f8b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:38.268912 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f55b8ccc-630d-427e-b732-7f2c253a8f8b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:38.269733 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f55b8ccc-630d-427e-b732-7f2c253a8f8b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:38.271126 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f55b8ccc-630d-427e-b732-7f2c253a8f8b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:38.271934 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f55b8ccc-630d-427e-b732-7f2c253a8f8b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:38.445041 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-f55b8ccc-630d-427e-b732-7f2c253a8f8b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:16:38.455406 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-f55b8ccc-630d-427e-b732-7f2c253a8f8b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.207516 Jun 17 15:16:38.455986 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 289/625] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:16:38 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:16:38.767672 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-be942c52-1c3f-4fa8-aa02-94309c30642d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:38.768710 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-be942c52-1c3f-4fa8-aa02-94309c30642d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:38.776218 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-be942c52-1c3f-4fa8-aa02-94309c30642d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:38.776829 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-be942c52-1c3f-4fa8-aa02-94309c30642d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:38.777667 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-be942c52-1c3f-4fa8-aa02-94309c30642d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:38.778138 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-be942c52-1c3f-4fa8-aa02-94309c30642d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:38.810775 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-be942c52-1c3f-4fa8-aa02-94309c30642d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047806 Jun 17 15:16:38.811353 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 337/626] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:16:38 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:16:39.028454 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-d80cfb38-fadb-4f37-896c-dfa9438b8410 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:39.029251 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-d80cfb38-fadb-4f37-896c-dfa9438b8410 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:39.035974 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d80cfb38-fadb-4f37-896c-dfa9438b8410 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:39.036458 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d80cfb38-fadb-4f37-896c-dfa9438b8410 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:39.037267 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d80cfb38-fadb-4f37-896c-dfa9438b8410 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:39.037692 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d80cfb38-fadb-4f37-896c-dfa9438b8410 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:39.069621 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-d80cfb38-fadb-4f37-896c-dfa9438b8410 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045231 Jun 17 15:16:39.070210 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 290/627] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:16:39 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 15:16:39.480769 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-d084c1af-43da-4110-b558-8a7feffd9caa tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:39.481482 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-d084c1af-43da-4110-b558-8a7feffd9caa tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:39.487988 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d084c1af-43da-4110-b558-8a7feffd9caa tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:39.488533 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d084c1af-43da-4110-b558-8a7feffd9caa tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:39.489358 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d084c1af-43da-4110-b558-8a7feffd9caa tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:39.489907 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d084c1af-43da-4110-b558-8a7feffd9caa tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:39.633955 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-d084c1af-43da-4110-b558-8a7feffd9caa tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:16:39.642446 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-d084c1af-43da-4110-b558-8a7feffd9caa tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.165756 Jun 17 15:16:39.643019 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 338/628] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:16:39 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:16:39.823063 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-c3e5070e-ce3f-4d56-8f7d-7d6aee9a8b02 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:39.823950 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-c3e5070e-ce3f-4d56-8f7d-7d6aee9a8b02 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:39.831498 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c3e5070e-ce3f-4d56-8f7d-7d6aee9a8b02 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:39.831986 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c3e5070e-ce3f-4d56-8f7d-7d6aee9a8b02 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:39.832880 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c3e5070e-ce3f-4d56-8f7d-7d6aee9a8b02 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:39.833355 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c3e5070e-ce3f-4d56-8f7d-7d6aee9a8b02 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:39.865575 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-c3e5070e-ce3f-4d56-8f7d-7d6aee9a8b02 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046489 Jun 17 15:16:39.866193 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 291/629] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:16:39 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:16:40.086711 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-129171ac-8292-48a7-8fb3-859b0984d13b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:40.088439 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-129171ac-8292-48a7-8fb3-859b0984d13b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:40.095787 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-129171ac-8292-48a7-8fb3-859b0984d13b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:40.096450 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-129171ac-8292-48a7-8fb3-859b0984d13b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:40.097252 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-129171ac-8292-48a7-8fb3-859b0984d13b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:40.097685 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-129171ac-8292-48a7-8fb3-859b0984d13b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:40.130287 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-129171ac-8292-48a7-8fb3-859b0984d13b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051926 Jun 17 15:16:40.130886 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 339/630] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:16:40 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:16:40.660311 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-85bd4586-502a-4eb0-b179-57f973ca61d5 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:40.660958 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-85bd4586-502a-4eb0-b179-57f973ca61d5 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:40.667878 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-85bd4586-502a-4eb0-b179-57f973ca61d5 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:40.668494 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-85bd4586-502a-4eb0-b179-57f973ca61d5 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:40.669327 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-85bd4586-502a-4eb0-b179-57f973ca61d5 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:40.669811 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-85bd4586-502a-4eb0-b179-57f973ca61d5 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:40.846786 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-85bd4586-502a-4eb0-b179-57f973ca61d5 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:16:40.859549 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-85bd4586-502a-4eb0-b179-57f973ca61d5 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.203502 Jun 17 15:16:40.861052 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 292/631] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:16:40 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:16:40.877596 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-7637d9de-700c-4ae0-af87-7ddcc77c3609 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:40.878546 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-7637d9de-700c-4ae0-af87-7ddcc77c3609 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:40.885320 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7637d9de-700c-4ae0-af87-7ddcc77c3609 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:40.885774 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7637d9de-700c-4ae0-af87-7ddcc77c3609 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:40.886597 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7637d9de-700c-4ae0-af87-7ddcc77c3609 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:40.887033 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7637d9de-700c-4ae0-af87-7ddcc77c3609 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:40.922867 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-7637d9de-700c-4ae0-af87-7ddcc77c3609 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048594 Jun 17 15:16:40.923369 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 340/632] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:16:40 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:16:41.143705 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-1f1022e1-f58b-498f-a281-4bfd7d70b7ee tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:41.144730 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-1f1022e1-f58b-498f-a281-4bfd7d70b7ee tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:41.152193 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1f1022e1-f58b-498f-a281-4bfd7d70b7ee tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:41.152673 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1f1022e1-f58b-498f-a281-4bfd7d70b7ee tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:41.153465 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1f1022e1-f58b-498f-a281-4bfd7d70b7ee tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:41.153906 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1f1022e1-f58b-498f-a281-4bfd7d70b7ee tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:41.198363 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-1f1022e1-f58b-498f-a281-4bfd7d70b7ee tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.059113 Jun 17 15:16:41.199138 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 293/633] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:16:41 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 15:16:41.885220 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-ecebf787-0a22-4292-b222-dbdef3fe8b5a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:41.886079 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-ecebf787-0a22-4292-b222-dbdef3fe8b5a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:41.893376 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ecebf787-0a22-4292-b222-dbdef3fe8b5a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:41.893819 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ecebf787-0a22-4292-b222-dbdef3fe8b5a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:41.894593 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ecebf787-0a22-4292-b222-dbdef3fe8b5a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:41.895024 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ecebf787-0a22-4292-b222-dbdef3fe8b5a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:41.935349 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-64bbecce-37c9-472f-8194-b200634a8a47 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:41.936785 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-64bbecce-37c9-472f-8194-b200634a8a47 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:41.945437 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-64bbecce-37c9-472f-8194-b200634a8a47 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:41.946228 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-64bbecce-37c9-472f-8194-b200634a8a47 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:41.947613 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-64bbecce-37c9-472f-8194-b200634a8a47 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:41.948418 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-64bbecce-37c9-472f-8194-b200634a8a47 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:41.995532 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-64bbecce-37c9-472f-8194-b200634a8a47 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064643 Jun 17 15:16:41.996300 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 294/634] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:16:41 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:16:42.058111 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-ecebf787-0a22-4292-b222-dbdef3fe8b5a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:16:42.065844 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-ecebf787-0a22-4292-b222-dbdef3fe8b5a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.184691 Jun 17 15:16:42.066463 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 341/635] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:16:41 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:16:42.211397 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-982ec4ee-04a1-4137-9e69-3d22d7c485f6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:42.212288 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-982ec4ee-04a1-4137-9e69-3d22d7c485f6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:42.219019 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-982ec4ee-04a1-4137-9e69-3d22d7c485f6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:42.219480 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-982ec4ee-04a1-4137-9e69-3d22d7c485f6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:42.220274 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-982ec4ee-04a1-4137-9e69-3d22d7c485f6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:42.220750 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-982ec4ee-04a1-4137-9e69-3d22d7c485f6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:42.256614 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-982ec4ee-04a1-4137-9e69-3d22d7c485f6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049276 Jun 17 15:16:42.257226 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 295/636] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:16:42 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 15:16:43.010120 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-9d487b2a-8d12-4158-91a1-83664147b50c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:43.011052 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-9d487b2a-8d12-4158-91a1-83664147b50c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:43.017942 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9d487b2a-8d12-4158-91a1-83664147b50c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:43.018383 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9d487b2a-8d12-4158-91a1-83664147b50c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:43.019158 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9d487b2a-8d12-4158-91a1-83664147b50c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:43.019594 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9d487b2a-8d12-4158-91a1-83664147b50c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:43.076798 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-9d487b2a-8d12-4158-91a1-83664147b50c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070150 Jun 17 15:16:43.078013 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 342/637] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:16:43 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:16:43.085754 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-955688c4-b0a2-4719-9dbe-3e5329fb702e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:43.086419 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-955688c4-b0a2-4719-9dbe-3e5329fb702e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:43.093983 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-955688c4-b0a2-4719-9dbe-3e5329fb702e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:43.094433 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-955688c4-b0a2-4719-9dbe-3e5329fb702e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:43.095206 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-955688c4-b0a2-4719-9dbe-3e5329fb702e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:43.095670 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-955688c4-b0a2-4719-9dbe-3e5329fb702e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:43.249467 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-955688c4-b0a2-4719-9dbe-3e5329fb702e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:16:43.263309 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-955688c4-b0a2-4719-9dbe-3e5329fb702e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.183208 Jun 17 15:16:43.264437 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 296/638] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:16:43 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:16:43.271456 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-24faf94f-0160-40b0-9966-1b6716ec5ea8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:43.272486 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-24faf94f-0160-40b0-9966-1b6716ec5ea8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:43.279417 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-24faf94f-0160-40b0-9966-1b6716ec5ea8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:43.279864 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-24faf94f-0160-40b0-9966-1b6716ec5ea8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:43.280717 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-24faf94f-0160-40b0-9966-1b6716ec5ea8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:43.281182 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-24faf94f-0160-40b0-9966-1b6716ec5ea8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:43.314358 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-24faf94f-0160-40b0-9966-1b6716ec5ea8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047077 Jun 17 15:16:43.315039 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 343/639] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:16:43 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 15:16:44.091721 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-25935deb-87e8-4d89-a1a3-228af1e1d2bf tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:44.092712 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-25935deb-87e8-4d89-a1a3-228af1e1d2bf tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:44.099589 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-25935deb-87e8-4d89-a1a3-228af1e1d2bf tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:44.100055 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-25935deb-87e8-4d89-a1a3-228af1e1d2bf tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:44.100835 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-25935deb-87e8-4d89-a1a3-228af1e1d2bf tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:44.101270 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-25935deb-87e8-4d89-a1a3-228af1e1d2bf tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:44.132682 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-25935deb-87e8-4d89-a1a3-228af1e1d2bf tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045035 Jun 17 15:16:44.133160 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 297/640] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:16:44 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:16:44.280882 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-92daa0a9-e8ae-4c09-a3f3-425d15bea5ee tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:44.282019 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-92daa0a9-e8ae-4c09-a3f3-425d15bea5ee tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:44.288556 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-92daa0a9-e8ae-4c09-a3f3-425d15bea5ee tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:44.289001 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-92daa0a9-e8ae-4c09-a3f3-425d15bea5ee tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:44.289756 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-92daa0a9-e8ae-4c09-a3f3-425d15bea5ee tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:44.290186 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-92daa0a9-e8ae-4c09-a3f3-425d15bea5ee tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:44.326726 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-063a8b7f-bdb6-453d-8cc8-b9adc9a267a8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:44.327646 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-063a8b7f-bdb6-453d-8cc8-b9adc9a267a8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:44.333996 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-063a8b7f-bdb6-453d-8cc8-b9adc9a267a8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:44.334441 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-063a8b7f-bdb6-453d-8cc8-b9adc9a267a8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:44.335217 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-063a8b7f-bdb6-453d-8cc8-b9adc9a267a8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:44.335655 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-063a8b7f-bdb6-453d-8cc8-b9adc9a267a8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:44.368772 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-063a8b7f-bdb6-453d-8cc8-b9adc9a267a8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045990 Jun 17 15:16:44.369347 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 298/641] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:16:44 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 15:16:44.537364 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-92daa0a9-e8ae-4c09-a3f3-425d15bea5ee tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:16:44.551629 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-92daa0a9-e8ae-4c09-a3f3-425d15bea5ee tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.274252 Jun 17 15:16:44.552444 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 344/642] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:16:44 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:16:44.746813 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-a379e54f-9fda-4c6d-86a0-922811b99161 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:16:44.747772 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-a379e54f-9fda-4c6d-86a0-922811b99161 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:44.750022 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_api:SELECT=68 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:16:44.756903 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a379e54f-9fda-4c6d-86a0-922811b99161 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:44.757358 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a379e54f-9fda-4c6d-86a0-922811b99161 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:44.758162 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a379e54f-9fda-4c6d-86a0-922811b99161 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:44.758600 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a379e54f-9fda-4c6d-86a0-922811b99161 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:44.789861 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell1:SELECT=100 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:16:44.810675 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.objects.instance [None req-a379e54f-9fda-4c6d-86a0-922811b99161 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lazy-loading 'flavor' on Instance uuid ba5d3180-d42a-4678-af13-c99282e054bf {{(pid=117649) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 15:16:44.988676 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-a379e54f-9fda-4c6d-86a0-922811b99161 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "POST /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/action" status: 200 len: 32 microversion: 2.1 time: 0.246296 Jun 17 15:16:44.989619 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 299/643] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jun 17 15:16:44 2022] POST /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/action => generated 32 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 17 15:16:44.999770 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-ee74155d-ea78-44e6-90fb-23881ceaf131 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:45.001037 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-ee74155d-ea78-44e6-90fb-23881ceaf131 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:45.009205 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ee74155d-ea78-44e6-90fb-23881ceaf131 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:45.009670 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ee74155d-ea78-44e6-90fb-23881ceaf131 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:45.010463 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ee74155d-ea78-44e6-90fb-23881ceaf131 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:45.010896 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ee74155d-ea78-44e6-90fb-23881ceaf131 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:45.151523 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-89fa5bd7-3b1d-41c8-93af-dbe7a4762610 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:45.152872 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-89fa5bd7-3b1d-41c8-93af-dbe7a4762610 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:45.160224 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-89fa5bd7-3b1d-41c8-93af-dbe7a4762610 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:45.160800 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-89fa5bd7-3b1d-41c8-93af-dbe7a4762610 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:45.161670 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-89fa5bd7-3b1d-41c8-93af-dbe7a4762610 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:45.162159 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-89fa5bd7-3b1d-41c8-93af-dbe7a4762610 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:45.196639 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-89fa5bd7-3b1d-41c8-93af-dbe7a4762610 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054196 Jun 17 15:16:45.197433 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 300/644] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:16:45 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:16:45.288814 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-ee74155d-ea78-44e6-90fb-23881ceaf131 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:16:45.297514 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-ee74155d-ea78-44e6-90fb-23881ceaf131 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1732 microversion: 2.1 time: 0.301171 Jun 17 15:16:45.298086 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 345/645] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:16:44 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1732 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:16:45.381336 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-b2341643-fc7f-443c-b1ef-d5e2491c0766 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:45.382298 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-b2341643-fc7f-443c-b1ef-d5e2491c0766 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:45.389088 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b2341643-fc7f-443c-b1ef-d5e2491c0766 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:45.389539 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b2341643-fc7f-443c-b1ef-d5e2491c0766 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:45.390305 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b2341643-fc7f-443c-b1ef-d5e2491c0766 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:45.390743 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b2341643-fc7f-443c-b1ef-d5e2491c0766 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:45.420840 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-b2341643-fc7f-443c-b1ef-d5e2491c0766 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044125 Jun 17 15:16:45.421315 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 301/646] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:16:45 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:16:45.572307 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-1bd12d5e-306f-475d-9244-99e1e9e951df tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:45.572767 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-1bd12d5e-306f-475d-9244-99e1e9e951df tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:45.579891 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1bd12d5e-306f-475d-9244-99e1e9e951df tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:45.579891 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1bd12d5e-306f-475d-9244-99e1e9e951df tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:45.581379 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1bd12d5e-306f-475d-9244-99e1e9e951df tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:45.581837 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1bd12d5e-306f-475d-9244-99e1e9e951df tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:45.808509 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-1bd12d5e-306f-475d-9244-99e1e9e951df tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:16:45.817141 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-1bd12d5e-306f-475d-9244-99e1e9e951df tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.249189 Jun 17 15:16:45.817728 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 346/647] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:16:45 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:16:46.209138 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-c96a1613-08a0-43bc-a0f3-ea9302787519 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:46.211074 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-c96a1613-08a0-43bc-a0f3-ea9302787519 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:46.218164 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c96a1613-08a0-43bc-a0f3-ea9302787519 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:46.218618 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c96a1613-08a0-43bc-a0f3-ea9302787519 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:46.219441 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c96a1613-08a0-43bc-a0f3-ea9302787519 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:46.219886 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c96a1613-08a0-43bc-a0f3-ea9302787519 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:46.267493 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-c96a1613-08a0-43bc-a0f3-ea9302787519 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061981 Jun 17 15:16:46.268758 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 302/648] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:16:46 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:16:46.318621 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-9cf4f6dd-aacc-4df9-af90-e921ee21ae38 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:46.319409 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-9cf4f6dd-aacc-4df9-af90-e921ee21ae38 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:46.327634 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9cf4f6dd-aacc-4df9-af90-e921ee21ae38 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:46.328895 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9cf4f6dd-aacc-4df9-af90-e921ee21ae38 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:46.329846 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9cf4f6dd-aacc-4df9-af90-e921ee21ae38 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:46.330523 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9cf4f6dd-aacc-4df9-af90-e921ee21ae38 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:46.433580 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-7273474b-25b1-40d1-91c4-577035371ff0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:46.434533 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-7273474b-25b1-40d1-91c4-577035371ff0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:46.442940 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7273474b-25b1-40d1-91c4-577035371ff0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:46.443399 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7273474b-25b1-40d1-91c4-577035371ff0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:46.444376 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7273474b-25b1-40d1-91c4-577035371ff0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:46.445023 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7273474b-25b1-40d1-91c4-577035371ff0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:46.479138 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-7273474b-25b1-40d1-91c4-577035371ff0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049433 Jun 17 15:16:46.479630 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 303/649] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:16:46 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:16:46.487524 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-9cf4f6dd-aacc-4df9-af90-e921ee21ae38 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:16:46.496267 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-9cf4f6dd-aacc-4df9-af90-e921ee21ae38 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1732 microversion: 2.1 time: 0.181630 Jun 17 15:16:46.496879 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 347/650] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:16:46 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1732 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:16:46.837823 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-2e36997a-9ced-43dd-bce0-b37ad16cde23 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:46.838430 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-2e36997a-9ced-43dd-bce0-b37ad16cde23 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:46.845612 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2e36997a-9ced-43dd-bce0-b37ad16cde23 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:46.846061 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2e36997a-9ced-43dd-bce0-b37ad16cde23 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:46.846862 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2e36997a-9ced-43dd-bce0-b37ad16cde23 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:46.847328 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2e36997a-9ced-43dd-bce0-b37ad16cde23 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:47.002263 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-2e36997a-9ced-43dd-bce0-b37ad16cde23 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:16:47.010043 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-2e36997a-9ced-43dd-bce0-b37ad16cde23 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.175998 Jun 17 15:16:47.010618 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 304/651] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:16:46 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:16:47.281818 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-69f53c64-049c-4b99-bdfd-eb0e5c857cc8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:47.282693 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-69f53c64-049c-4b99-bdfd-eb0e5c857cc8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:47.289162 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-69f53c64-049c-4b99-bdfd-eb0e5c857cc8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:47.289612 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-69f53c64-049c-4b99-bdfd-eb0e5c857cc8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:47.290373 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-69f53c64-049c-4b99-bdfd-eb0e5c857cc8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:47.290800 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-69f53c64-049c-4b99-bdfd-eb0e5c857cc8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:47.317725 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=100 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:16:47.323501 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-69f53c64-049c-4b99-bdfd-eb0e5c857cc8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046547 Jun 17 15:16:47.324344 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 348/652] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:16:47 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:16:47.490980 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-f45d5572-4f8b-44fb-a12a-46d0f9498220 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:47.491895 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-f45d5572-4f8b-44fb-a12a-46d0f9498220 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:47.498650 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f45d5572-4f8b-44fb-a12a-46d0f9498220 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:47.499096 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f45d5572-4f8b-44fb-a12a-46d0f9498220 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:47.499861 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f45d5572-4f8b-44fb-a12a-46d0f9498220 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:47.500292 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f45d5572-4f8b-44fb-a12a-46d0f9498220 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:47.520602 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-689194b8-d0f9-42f6-a7f2-b7266869b4e7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:47.521231 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-689194b8-d0f9-42f6-a7f2-b7266869b4e7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:47.527760 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-689194b8-d0f9-42f6-a7f2-b7266869b4e7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:47.528205 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-689194b8-d0f9-42f6-a7f2-b7266869b4e7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:47.529018 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-689194b8-d0f9-42f6-a7f2-b7266869b4e7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:47.529449 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-689194b8-d0f9-42f6-a7f2-b7266869b4e7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:47.548624 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-f45d5572-4f8b-44fb-a12a-46d0f9498220 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.061088 Jun 17 15:16:47.549576 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 305/653] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:16:47 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:16:47.684966 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-689194b8-d0f9-42f6-a7f2-b7266869b4e7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:16:47.694572 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-689194b8-d0f9-42f6-a7f2-b7266869b4e7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1732 microversion: 2.1 time: 0.180223 Jun 17 15:16:47.695167 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 349/654] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:16:47 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1732 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:16:48.027094 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-76c181f2-96dc-4054-b1e2-b27ccd8b22a7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:48.027709 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-76c181f2-96dc-4054-b1e2-b27ccd8b22a7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:48.034207 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-76c181f2-96dc-4054-b1e2-b27ccd8b22a7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:48.034661 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-76c181f2-96dc-4054-b1e2-b27ccd8b22a7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:48.035442 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-76c181f2-96dc-4054-b1e2-b27ccd8b22a7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:48.035881 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-76c181f2-96dc-4054-b1e2-b27ccd8b22a7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:48.335694 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-ed9cd09d-e187-46ce-be8d-afc6a27d5d58 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:48.337027 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-ed9cd09d-e187-46ce-be8d-afc6a27d5d58 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:48.345511 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ed9cd09d-e187-46ce-be8d-afc6a27d5d58 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:48.346068 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ed9cd09d-e187-46ce-be8d-afc6a27d5d58 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:48.347312 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ed9cd09d-e187-46ce-be8d-afc6a27d5d58 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:48.347926 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ed9cd09d-e187-46ce-be8d-afc6a27d5d58 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:48.385853 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-ed9cd09d-e187-46ce-be8d-afc6a27d5d58 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054303 Jun 17 15:16:48.386437 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 350/655] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:16:48 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:16:48.410909 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-76c181f2-96dc-4054-b1e2-b27ccd8b22a7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:16:48.418756 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-76c181f2-96dc-4054-b1e2-b27ccd8b22a7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.395451 Jun 17 15:16:48.419349 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 306/656] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:16:48 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:16:48.563610 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-c32e2c45-db94-4fff-87e5-5aeced251823 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:48.564479 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-c32e2c45-db94-4fff-87e5-5aeced251823 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:48.571043 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c32e2c45-db94-4fff-87e5-5aeced251823 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:48.571491 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c32e2c45-db94-4fff-87e5-5aeced251823 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:48.572263 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c32e2c45-db94-4fff-87e5-5aeced251823 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:48.572725 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c32e2c45-db94-4fff-87e5-5aeced251823 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:48.603861 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-c32e2c45-db94-4fff-87e5-5aeced251823 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044785 Jun 17 15:16:48.604776 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 351/657] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:16:48 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:16:48.711820 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-27e27476-8cd1-4bd2-be9d-05320ad67934 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:48.712481 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-27e27476-8cd1-4bd2-be9d-05320ad67934 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:48.719453 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-27e27476-8cd1-4bd2-be9d-05320ad67934 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:48.719904 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-27e27476-8cd1-4bd2-be9d-05320ad67934 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:48.720733 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-27e27476-8cd1-4bd2-be9d-05320ad67934 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:48.721167 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-27e27476-8cd1-4bd2-be9d-05320ad67934 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:48.858639 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-27e27476-8cd1-4bd2-be9d-05320ad67934 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:16:48.867441 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-27e27476-8cd1-4bd2-be9d-05320ad67934 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1732 microversion: 2.1 time: 0.159551 Jun 17 15:16:48.868017 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 307/658] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:16:48 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1732 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:16:49.399370 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-9ba46e2a-6acc-410c-843b-9be73f91bedd tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:49.400493 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-9ba46e2a-6acc-410c-843b-9be73f91bedd tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:49.407197 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9ba46e2a-6acc-410c-843b-9be73f91bedd tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:49.407644 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9ba46e2a-6acc-410c-843b-9be73f91bedd tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:49.408443 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9ba46e2a-6acc-410c-843b-9be73f91bedd tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:49.408881 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9ba46e2a-6acc-410c-843b-9be73f91bedd tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:49.436200 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-30cb75b6-d7f0-4463-b6fc-e75bcb5f6af7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:49.437040 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-30cb75b6-d7f0-4463-b6fc-e75bcb5f6af7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:49.440095 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-9ba46e2a-6acc-410c-843b-9be73f91bedd tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045692 Jun 17 15:16:49.440721 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 352/659] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:16:49 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:16:49.443388 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-30cb75b6-d7f0-4463-b6fc-e75bcb5f6af7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:49.443867 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-30cb75b6-d7f0-4463-b6fc-e75bcb5f6af7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:49.444655 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-30cb75b6-d7f0-4463-b6fc-e75bcb5f6af7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:49.445088 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-30cb75b6-d7f0-4463-b6fc-e75bcb5f6af7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:49.589180 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-30cb75b6-d7f0-4463-b6fc-e75bcb5f6af7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:16:49.597663 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-30cb75b6-d7f0-4463-b6fc-e75bcb5f6af7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.165306 Jun 17 15:16:49.598233 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 308/660] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:16:49 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:16:49.615449 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-283e94f4-1825-4028-9a52-a3fa3bf1bbba tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:49.616385 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-283e94f4-1825-4028-9a52-a3fa3bf1bbba tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:49.622961 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-283e94f4-1825-4028-9a52-a3fa3bf1bbba tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:49.623404 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-283e94f4-1825-4028-9a52-a3fa3bf1bbba tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:49.624293 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-283e94f4-1825-4028-9a52-a3fa3bf1bbba tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:49.624634 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-283e94f4-1825-4028-9a52-a3fa3bf1bbba tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:49.654498 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-283e94f4-1825-4028-9a52-a3fa3bf1bbba tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042986 Jun 17 15:16:49.654982 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 353/661] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:16:49 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:16:49.884743 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-fad959a8-83e6-44ed-8b9e-59efe1a93493 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:49.885381 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-fad959a8-83e6-44ed-8b9e-59efe1a93493 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:49.892497 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fad959a8-83e6-44ed-8b9e-59efe1a93493 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:49.892938 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fad959a8-83e6-44ed-8b9e-59efe1a93493 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:49.893697 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fad959a8-83e6-44ed-8b9e-59efe1a93493 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:49.894124 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fad959a8-83e6-44ed-8b9e-59efe1a93493 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:50.033609 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-fad959a8-83e6-44ed-8b9e-59efe1a93493 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:16:50.043527 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-fad959a8-83e6-44ed-8b9e-59efe1a93493 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1732 microversion: 2.1 time: 0.162554 Jun 17 15:16:50.044125 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 309/662] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:16:49 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1732 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:16:50.452411 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-a7b879f5-4e71-4d71-a059-8e5da9403f24 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:50.453387 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-a7b879f5-4e71-4d71-a059-8e5da9403f24 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:50.459637 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a7b879f5-4e71-4d71-a059-8e5da9403f24 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:50.460086 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a7b879f5-4e71-4d71-a059-8e5da9403f24 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:50.460903 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a7b879f5-4e71-4d71-a059-8e5da9403f24 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:50.461335 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a7b879f5-4e71-4d71-a059-8e5da9403f24 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:50.493846 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-a7b879f5-4e71-4d71-a059-8e5da9403f24 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045419 Jun 17 15:16:50.494460 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 354/663] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:16:50 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:16:50.617224 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-17a1517c-0a77-4cfd-8805-ddbf3ab833a9 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:50.617836 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-17a1517c-0a77-4cfd-8805-ddbf3ab833a9 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:50.624221 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-17a1517c-0a77-4cfd-8805-ddbf3ab833a9 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:50.624716 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-17a1517c-0a77-4cfd-8805-ddbf3ab833a9 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:50.626037 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-17a1517c-0a77-4cfd-8805-ddbf3ab833a9 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:50.626463 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-17a1517c-0a77-4cfd-8805-ddbf3ab833a9 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:50.667089 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-9a7df45e-1432-40a0-afba-1253663e7b5a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:50.668021 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-9a7df45e-1432-40a0-afba-1253663e7b5a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:50.675920 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9a7df45e-1432-40a0-afba-1253663e7b5a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:50.676394 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9a7df45e-1432-40a0-afba-1253663e7b5a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:50.677173 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9a7df45e-1432-40a0-afba-1253663e7b5a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:50.677645 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9a7df45e-1432-40a0-afba-1253663e7b5a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:50.708794 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-9a7df45e-1432-40a0-afba-1253663e7b5a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045712 Jun 17 15:16:50.709499 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 355/664] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:16:50 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 15:16:50.771351 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-17a1517c-0a77-4cfd-8805-ddbf3ab833a9 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:16:50.779087 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-17a1517c-0a77-4cfd-8805-ddbf3ab833a9 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.167497 Jun 17 15:16:50.779666 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 310/665] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:16:50 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:16:51.068856 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-ef9293fe-33fb-4bd1-b106-2e358fe863c2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:51.069468 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-ef9293fe-33fb-4bd1-b106-2e358fe863c2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:51.075611 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ef9293fe-33fb-4bd1-b106-2e358fe863c2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:51.076058 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ef9293fe-33fb-4bd1-b106-2e358fe863c2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:51.076857 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ef9293fe-33fb-4bd1-b106-2e358fe863c2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:51.077295 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ef9293fe-33fb-4bd1-b106-2e358fe863c2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:51.220366 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-ef9293fe-33fb-4bd1-b106-2e358fe863c2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:16:51.228646 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-ef9293fe-33fb-4bd1-b106-2e358fe863c2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1732 microversion: 2.1 time: 0.163874 Jun 17 15:16:51.229141 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 356/666] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:16:51 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1732 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:16:51.505657 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-ac45a8f7-b8dd-4098-b671-2a3da1536351 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:51.506575 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-ac45a8f7-b8dd-4098-b671-2a3da1536351 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:51.514127 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ac45a8f7-b8dd-4098-b671-2a3da1536351 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:51.514623 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ac45a8f7-b8dd-4098-b671-2a3da1536351 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:51.515437 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ac45a8f7-b8dd-4098-b671-2a3da1536351 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:51.515911 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ac45a8f7-b8dd-4098-b671-2a3da1536351 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:51.549938 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-ac45a8f7-b8dd-4098-b671-2a3da1536351 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048642 Jun 17 15:16:51.550536 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 311/667] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:16:51 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:16:51.722610 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-6b6460c0-bb2c-4b95-a0f2-41171558ea51 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:51.723817 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-6b6460c0-bb2c-4b95-a0f2-41171558ea51 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:51.732882 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6b6460c0-bb2c-4b95-a0f2-41171558ea51 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:51.733682 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6b6460c0-bb2c-4b95-a0f2-41171558ea51 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:51.735063 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6b6460c0-bb2c-4b95-a0f2-41171558ea51 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:51.736092 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6b6460c0-bb2c-4b95-a0f2-41171558ea51 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:51.766382 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-6b6460c0-bb2c-4b95-a0f2-41171558ea51 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049205 Jun 17 15:16:51.766875 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 357/668] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:16:51 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:16:51.797566 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-b83b6e5a-542d-4f4f-8a6f-2dea9b582709 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:51.798225 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-b83b6e5a-542d-4f4f-8a6f-2dea9b582709 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:51.804393 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b83b6e5a-542d-4f4f-8a6f-2dea9b582709 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:51.804836 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b83b6e5a-542d-4f4f-8a6f-2dea9b582709 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:51.805591 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b83b6e5a-542d-4f4f-8a6f-2dea9b582709 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:51.806016 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b83b6e5a-542d-4f4f-8a6f-2dea9b582709 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:51.942819 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-b83b6e5a-542d-4f4f-8a6f-2dea9b582709 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:16:51.951152 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-b83b6e5a-542d-4f4f-8a6f-2dea9b582709 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.158230 Jun 17 15:16:51.951722 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 312/669] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:16:51 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:16:52.247069 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-bb73f3d0-472a-4133-9987-5d14a707f536 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:52.247667 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-bb73f3d0-472a-4133-9987-5d14a707f536 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:52.254450 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bb73f3d0-472a-4133-9987-5d14a707f536 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:52.254893 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bb73f3d0-472a-4133-9987-5d14a707f536 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:52.255651 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bb73f3d0-472a-4133-9987-5d14a707f536 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:52.256077 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bb73f3d0-472a-4133-9987-5d14a707f536 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:52.395013 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-bb73f3d0-472a-4133-9987-5d14a707f536 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:16:52.402903 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-bb73f3d0-472a-4133-9987-5d14a707f536 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1732 microversion: 2.1 time: 0.159669 Jun 17 15:16:52.403460 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 358/670] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:16:52 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1732 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:16:52.562048 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-0bb5ceda-8f1e-4217-b373-82a4ff24de25 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:52.563431 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-0bb5ceda-8f1e-4217-b373-82a4ff24de25 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:52.570191 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0bb5ceda-8f1e-4217-b373-82a4ff24de25 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:52.570641 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0bb5ceda-8f1e-4217-b373-82a4ff24de25 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:52.571416 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0bb5ceda-8f1e-4217-b373-82a4ff24de25 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:52.571855 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0bb5ceda-8f1e-4217-b373-82a4ff24de25 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:52.603315 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-0bb5ceda-8f1e-4217-b373-82a4ff24de25 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045254 Jun 17 15:16:52.603903 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 313/671] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:16:52 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:16:52.778975 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-4edb9a00-2a12-4301-888e-b6619efa5703 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:52.779936 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-4edb9a00-2a12-4301-888e-b6619efa5703 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:52.786580 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4edb9a00-2a12-4301-888e-b6619efa5703 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:52.787025 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4edb9a00-2a12-4301-888e-b6619efa5703 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:52.787788 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4edb9a00-2a12-4301-888e-b6619efa5703 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:52.788212 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4edb9a00-2a12-4301-888e-b6619efa5703 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:52.821500 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-4edb9a00-2a12-4301-888e-b6619efa5703 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046759 Jun 17 15:16:52.821955 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 359/672] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:16:52 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:16:52.969903 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-02f2aa03-8242-499f-9c49-2ecb0e62758e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:52.970642 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-02f2aa03-8242-499f-9c49-2ecb0e62758e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:52.977077 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-02f2aa03-8242-499f-9c49-2ecb0e62758e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:52.977519 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-02f2aa03-8242-499f-9c49-2ecb0e62758e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:52.978282 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-02f2aa03-8242-499f-9c49-2ecb0e62758e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:52.978705 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-02f2aa03-8242-499f-9c49-2ecb0e62758e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:52.981468 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:16:53.194620 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-02f2aa03-8242-499f-9c49-2ecb0e62758e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:16:53.203145 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-02f2aa03-8242-499f-9c49-2ecb0e62758e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.237752 Jun 17 15:16:53.203732 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 314/673] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:16:52 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:16:53.419425 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-3b2b2170-cb87-4832-ac72-a0b1d4174d33 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:53.420851 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-3b2b2170-cb87-4832-ac72-a0b1d4174d33 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:53.427417 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3b2b2170-cb87-4832-ac72-a0b1d4174d33 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:53.427862 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3b2b2170-cb87-4832-ac72-a0b1d4174d33 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:53.428974 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3b2b2170-cb87-4832-ac72-a0b1d4174d33 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:53.429418 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3b2b2170-cb87-4832-ac72-a0b1d4174d33 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:53.595336 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-3b2b2170-cb87-4832-ac72-a0b1d4174d33 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:16:53.606317 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-3b2b2170-cb87-4832-ac72-a0b1d4174d33 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1732 microversion: 2.1 time: 0.190778 Jun 17 15:16:53.606902 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 360/674] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:16:53 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1732 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:16:53.616564 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-b12c01d1-3c12-43b2-a035-4b2477914c07 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:53.617865 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-b12c01d1-3c12-43b2-a035-4b2477914c07 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:53.626097 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b12c01d1-3c12-43b2-a035-4b2477914c07 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:53.626796 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b12c01d1-3c12-43b2-a035-4b2477914c07 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:53.627979 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b12c01d1-3c12-43b2-a035-4b2477914c07 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:53.628534 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b12c01d1-3c12-43b2-a035-4b2477914c07 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:53.662711 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-b12c01d1-3c12-43b2-a035-4b2477914c07 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051070 Jun 17 15:16:53.663683 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 315/675] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:16:53 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:16:53.834686 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-4a3574a4-fd2c-4d22-9610-5aae3b86bc3e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:53.835611 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-4a3574a4-fd2c-4d22-9610-5aae3b86bc3e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:53.842788 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4a3574a4-fd2c-4d22-9610-5aae3b86bc3e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:53.843239 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4a3574a4-fd2c-4d22-9610-5aae3b86bc3e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:53.844005 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4a3574a4-fd2c-4d22-9610-5aae3b86bc3e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:53.844473 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4a3574a4-fd2c-4d22-9610-5aae3b86bc3e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:53.875702 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-4a3574a4-fd2c-4d22-9610-5aae3b86bc3e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045513 Jun 17 15:16:53.876278 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 361/676] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:16:53 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 15:16:54.221765 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-2dab57ca-6546-421c-bc99-3cbf04a82b21 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:54.222380 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-2dab57ca-6546-421c-bc99-3cbf04a82b21 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:54.228484 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2dab57ca-6546-421c-bc99-3cbf04a82b21 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:54.228934 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2dab57ca-6546-421c-bc99-3cbf04a82b21 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:54.229700 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2dab57ca-6546-421c-bc99-3cbf04a82b21 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:54.230131 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2dab57ca-6546-421c-bc99-3cbf04a82b21 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:54.371819 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-2dab57ca-6546-421c-bc99-3cbf04a82b21 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:16:54.379635 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-2dab57ca-6546-421c-bc99-3cbf04a82b21 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.162350 Jun 17 15:16:54.380255 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 316/677] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:16:54 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:16:54.625854 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-15c9b148-1068-4d19-8335-67c1a3e7c5f9 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:54.626458 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-15c9b148-1068-4d19-8335-67c1a3e7c5f9 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:54.628387 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_api:SELECT=86 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:16:54.634146 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-15c9b148-1068-4d19-8335-67c1a3e7c5f9 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:54.634588 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-15c9b148-1068-4d19-8335-67c1a3e7c5f9 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:54.635351 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-15c9b148-1068-4d19-8335-67c1a3e7c5f9 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:54.635781 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-15c9b148-1068-4d19-8335-67c1a3e7c5f9 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:54.679016 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-1b3ff802-e548-40e5-8cec-f4c4b1b267f3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:54.680699 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-1b3ff802-e548-40e5-8cec-f4c4b1b267f3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:54.692759 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1b3ff802-e548-40e5-8cec-f4c4b1b267f3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:54.693209 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1b3ff802-e548-40e5-8cec-f4c4b1b267f3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:54.694602 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1b3ff802-e548-40e5-8cec-f4c4b1b267f3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:54.695362 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1b3ff802-e548-40e5-8cec-f4c4b1b267f3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:54.733271 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-1b3ff802-e548-40e5-8cec-f4c4b1b267f3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061533 Jun 17 15:16:54.733878 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 317/678] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:16:54 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:16:54.800386 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-15c9b148-1068-4d19-8335-67c1a3e7c5f9 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:16:54.809142 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-15c9b148-1068-4d19-8335-67c1a3e7c5f9 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1732 microversion: 2.1 time: 0.187564 Jun 17 15:16:54.809740 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 362/679] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:16:54 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1732 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:16:54.893138 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-510fcbc0-f3d8-45d2-99a5-76442e4f0aa8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:54.894652 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-510fcbc0-f3d8-45d2-99a5-76442e4f0aa8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:54.904970 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-510fcbc0-f3d8-45d2-99a5-76442e4f0aa8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:54.905749 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-510fcbc0-f3d8-45d2-99a5-76442e4f0aa8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:54.907107 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-510fcbc0-f3d8-45d2-99a5-76442e4f0aa8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:54.907823 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-510fcbc0-f3d8-45d2-99a5-76442e4f0aa8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:54.942031 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-510fcbc0-f3d8-45d2-99a5-76442e4f0aa8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056297 Jun 17 15:16:54.942614 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 318/680] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:16:54 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:16:55.396556 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-b44357de-e0c2-436d-93eb-0a6eff51d24e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:55.397181 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-b44357de-e0c2-436d-93eb-0a6eff51d24e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:55.404193 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b44357de-e0c2-436d-93eb-0a6eff51d24e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:55.404716 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b44357de-e0c2-436d-93eb-0a6eff51d24e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:55.405581 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b44357de-e0c2-436d-93eb-0a6eff51d24e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:55.406580 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b44357de-e0c2-436d-93eb-0a6eff51d24e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:55.554163 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-b44357de-e0c2-436d-93eb-0a6eff51d24e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:16:55.561921 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-b44357de-e0c2-436d-93eb-0a6eff51d24e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.169271 Jun 17 15:16:55.562493 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 363/681] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:16:55 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:16:55.745373 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-d53a2ffb-8d2a-4147-b3b2-6b537ced3f88 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:55.746409 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-d53a2ffb-8d2a-4147-b3b2-6b537ced3f88 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:55.753257 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d53a2ffb-8d2a-4147-b3b2-6b537ced3f88 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:55.753690 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d53a2ffb-8d2a-4147-b3b2-6b537ced3f88 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:55.754478 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d53a2ffb-8d2a-4147-b3b2-6b537ced3f88 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:55.754937 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d53a2ffb-8d2a-4147-b3b2-6b537ced3f88 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:55.787440 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-d53a2ffb-8d2a-4147-b3b2-6b537ced3f88 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046108 Jun 17 15:16:55.788067 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 319/682] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:16:55 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:16:55.828717 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-6d36a8da-ddf7-4e87-93b4-31e3c7f73cbf tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:55.829413 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-6d36a8da-ddf7-4e87-93b4-31e3c7f73cbf tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:55.836650 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6d36a8da-ddf7-4e87-93b4-31e3c7f73cbf tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:55.837113 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6d36a8da-ddf7-4e87-93b4-31e3c7f73cbf tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:55.837900 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6d36a8da-ddf7-4e87-93b4-31e3c7f73cbf tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:55.838340 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6d36a8da-ddf7-4e87-93b4-31e3c7f73cbf tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:55.955055 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-94ce29a4-8129-4592-b6c0-d1acd961a9db tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:55.956196 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-94ce29a4-8129-4592-b6c0-d1acd961a9db tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:55.962736 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-94ce29a4-8129-4592-b6c0-d1acd961a9db tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:55.963179 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-94ce29a4-8129-4592-b6c0-d1acd961a9db tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:55.963952 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-94ce29a4-8129-4592-b6c0-d1acd961a9db tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:55.964407 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-94ce29a4-8129-4592-b6c0-d1acd961a9db tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:55.994723 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-94ce29a4-8129-4592-b6c0-d1acd961a9db tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044518 Jun 17 15:16:55.995523 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 320/683] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:16:55 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 15:16:56.000824 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-6d36a8da-ddf7-4e87-93b4-31e3c7f73cbf tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:16:56.012387 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-6d36a8da-ddf7-4e87-93b4-31e3c7f73cbf tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1732 microversion: 2.1 time: 0.188616 Jun 17 15:16:56.012979 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 364/684] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:16:55 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1732 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:16:56.579406 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-23d34ab7-23fd-45ee-8ce3-73803082325a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:56.580041 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-23d34ab7-23fd-45ee-8ce3-73803082325a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:56.586275 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-23d34ab7-23fd-45ee-8ce3-73803082325a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:56.586721 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-23d34ab7-23fd-45ee-8ce3-73803082325a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:56.587489 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-23d34ab7-23fd-45ee-8ce3-73803082325a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:56.587922 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-23d34ab7-23fd-45ee-8ce3-73803082325a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:56.736501 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-23d34ab7-23fd-45ee-8ce3-73803082325a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:16:56.744803 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-23d34ab7-23fd-45ee-8ce3-73803082325a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.169598 Jun 17 15:16:56.745427 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 321/685] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:16:56 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:16:56.799657 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-f522438b-f118-4e60-bb6e-fe1acac82428 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:56.800636 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-f522438b-f118-4e60-bb6e-fe1acac82428 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:56.807069 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f522438b-f118-4e60-bb6e-fe1acac82428 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:56.807534 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f522438b-f118-4e60-bb6e-fe1acac82428 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:56.808317 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f522438b-f118-4e60-bb6e-fe1acac82428 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:56.808781 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f522438b-f118-4e60-bb6e-fe1acac82428 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:56.829317 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=100 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:16:56.844978 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-f522438b-f118-4e60-bb6e-fe1acac82428 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049255 Jun 17 15:16:56.845582 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 365/686] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:16:56 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:16:57.007436 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-6f14fd80-94d2-4cff-b3ac-4661334ae299 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:57.008401 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-6f14fd80-94d2-4cff-b3ac-4661334ae299 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:57.014935 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6f14fd80-94d2-4cff-b3ac-4661334ae299 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:57.015978 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6f14fd80-94d2-4cff-b3ac-4661334ae299 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:57.016801 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6f14fd80-94d2-4cff-b3ac-4661334ae299 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:57.017247 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6f14fd80-94d2-4cff-b3ac-4661334ae299 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:57.030714 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-5c983570-ebe2-46c9-964a-4861726c465c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:57.031349 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-5c983570-ebe2-46c9-964a-4861726c465c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:57.037551 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5c983570-ebe2-46c9-964a-4861726c465c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:57.038002 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5c983570-ebe2-46c9-964a-4861726c465c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:57.038773 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5c983570-ebe2-46c9-964a-4861726c465c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:57.039206 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5c983570-ebe2-46c9-964a-4861726c465c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:57.050456 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-6f14fd80-94d2-4cff-b3ac-4661334ae299 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046811 Jun 17 15:16:57.051323 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 322/687] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:16:57 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:16:57.187234 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-5c983570-ebe2-46c9-964a-4861726c465c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:16:57.197198 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-5c983570-ebe2-46c9-964a-4861726c465c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1732 microversion: 2.1 time: 0.170291 Jun 17 15:16:57.197769 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 366/688] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:16:57 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1732 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:16:57.762232 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-5d31cb9a-a255-4491-8a25-d8e9fb9e3024 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:57.763565 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-5d31cb9a-a255-4491-8a25-d8e9fb9e3024 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:57.770518 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5d31cb9a-a255-4491-8a25-d8e9fb9e3024 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:57.770966 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5d31cb9a-a255-4491-8a25-d8e9fb9e3024 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:57.771792 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5d31cb9a-a255-4491-8a25-d8e9fb9e3024 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:57.772236 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5d31cb9a-a255-4491-8a25-d8e9fb9e3024 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:57.857004 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-2afe5d52-f68e-4847-a511-5f8902725e4b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:57.857945 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-2afe5d52-f68e-4847-a511-5f8902725e4b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:57.865333 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2afe5d52-f68e-4847-a511-5f8902725e4b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:57.865786 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2afe5d52-f68e-4847-a511-5f8902725e4b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:57.866571 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2afe5d52-f68e-4847-a511-5f8902725e4b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:57.867246 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2afe5d52-f68e-4847-a511-5f8902725e4b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:57.902293 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-2afe5d52-f68e-4847-a511-5f8902725e4b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049235 Jun 17 15:16:57.902893 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 367/689] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:16:57 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:16:57.975023 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-5d31cb9a-a255-4491-8a25-d8e9fb9e3024 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:16:57.983827 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-5d31cb9a-a255-4491-8a25-d8e9fb9e3024 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.225437 Jun 17 15:16:57.984346 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 323/690] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:16:57 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:16:58.061808 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-2c49596b-273c-46bc-8aea-2530d2d55cf0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:58.062716 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-2c49596b-273c-46bc-8aea-2530d2d55cf0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:58.068857 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2c49596b-273c-46bc-8aea-2530d2d55cf0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:58.069302 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2c49596b-273c-46bc-8aea-2530d2d55cf0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:58.070060 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2c49596b-273c-46bc-8aea-2530d2d55cf0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:58.070488 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2c49596b-273c-46bc-8aea-2530d2d55cf0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:58.104491 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-2c49596b-273c-46bc-8aea-2530d2d55cf0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046248 Jun 17 15:16:58.105371 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 368/691] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:16:58 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 15:16:58.214427 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-1b8198ca-5822-43cf-b91f-25ff64743078 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:58.215037 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-1b8198ca-5822-43cf-b91f-25ff64743078 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:58.222505 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1b8198ca-5822-43cf-b91f-25ff64743078 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:58.222965 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1b8198ca-5822-43cf-b91f-25ff64743078 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:58.223732 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1b8198ca-5822-43cf-b91f-25ff64743078 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:58.224168 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1b8198ca-5822-43cf-b91f-25ff64743078 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:58.358040 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-1b8198ca-5822-43cf-b91f-25ff64743078 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:16:58.366751 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-1b8198ca-5822-43cf-b91f-25ff64743078 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1732 microversion: 2.1 time: 0.156204 Jun 17 15:16:58.367336 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 324/692] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:16:58 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1732 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:16:58.915066 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-929d3e82-62d5-4075-afde-5bc3cbf4fbfa tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:58.915996 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-929d3e82-62d5-4075-afde-5bc3cbf4fbfa tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:58.922769 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-929d3e82-62d5-4075-afde-5bc3cbf4fbfa tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:58.923205 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-929d3e82-62d5-4075-afde-5bc3cbf4fbfa tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:58.923976 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-929d3e82-62d5-4075-afde-5bc3cbf4fbfa tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:58.924444 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-929d3e82-62d5-4075-afde-5bc3cbf4fbfa tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:58.955327 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-929d3e82-62d5-4075-afde-5bc3cbf4fbfa tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044327 Jun 17 15:16:58.955895 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 369/693] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:16:58 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:16:59.001635 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-207538f1-7d56-4551-958a-78f6998e3988 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:59.002258 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-207538f1-7d56-4551-958a-78f6998e3988 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:59.008815 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-207538f1-7d56-4551-958a-78f6998e3988 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:59.009258 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-207538f1-7d56-4551-958a-78f6998e3988 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:59.010028 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-207538f1-7d56-4551-958a-78f6998e3988 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:59.010493 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-207538f1-7d56-4551-958a-78f6998e3988 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:59.120420 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-479bb027-cd91-4a89-801f-7734ba6c0e90 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:59.121673 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-479bb027-cd91-4a89-801f-7734ba6c0e90 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:59.130115 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-479bb027-cd91-4a89-801f-7734ba6c0e90 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:59.130563 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-479bb027-cd91-4a89-801f-7734ba6c0e90 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:59.131338 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-479bb027-cd91-4a89-801f-7734ba6c0e90 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:59.131767 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-479bb027-cd91-4a89-801f-7734ba6c0e90 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:59.163761 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-479bb027-cd91-4a89-801f-7734ba6c0e90 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048423 Jun 17 15:16:59.164255 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 370/694] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:16:59 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:16:59.186353 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-207538f1-7d56-4551-958a-78f6998e3988 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:16:59.194656 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-207538f1-7d56-4551-958a-78f6998e3988 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.197418 Jun 17 15:16:59.195230 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 325/695] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:16:58 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:16:59.384581 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-8a23b594-0268-40c8-a549-14d251eaa922 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:59.385192 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-8a23b594-0268-40c8-a549-14d251eaa922 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:59.391724 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8a23b594-0268-40c8-a549-14d251eaa922 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:59.392161 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8a23b594-0268-40c8-a549-14d251eaa922 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:59.392947 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8a23b594-0268-40c8-a549-14d251eaa922 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:59.393376 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8a23b594-0268-40c8-a549-14d251eaa922 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:59.534979 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-8a23b594-0268-40c8-a549-14d251eaa922 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:16:59.543376 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-8a23b594-0268-40c8-a549-14d251eaa922 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1712 microversion: 2.1 time: 0.162587 Jun 17 15:16:59.543948 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 371/696] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:16:59 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1712 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:16:59.609721 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-d5f993ef-011c-4e1a-a815-9e99ebcd2ba9 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:59.610462 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-d5f993ef-011c-4e1a-a815-9e99ebcd2ba9 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:59.618846 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d5f993ef-011c-4e1a-a815-9e99ebcd2ba9 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:59.619343 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d5f993ef-011c-4e1a-a815-9e99ebcd2ba9 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:59.620259 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d5f993ef-011c-4e1a-a815-9e99ebcd2ba9 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:59.620728 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d5f993ef-011c-4e1a-a815-9e99ebcd2ba9 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:59.969894 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-1e89c2f9-2a14-44f8-800f-9dd6a6da6cc3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:16:59.971115 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-1e89c2f9-2a14-44f8-800f-9dd6a6da6cc3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:16:59.978299 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1e89c2f9-2a14-44f8-800f-9dd6a6da6cc3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:59.978753 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1e89c2f9-2a14-44f8-800f-9dd6a6da6cc3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:16:59.979558 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1e89c2f9-2a14-44f8-800f-9dd6a6da6cc3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:16:59.980033 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1e89c2f9-2a14-44f8-800f-9dd6a6da6cc3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:00.015471 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-1e89c2f9-2a14-44f8-800f-9dd6a6da6cc3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051757 Jun 17 15:17:00.016086 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 372/697] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:16:59 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:17:00.161705 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [req-2185d847-c7b4-44ee-8dee-f30fd399ca3e req-3ab6d4a5-9d4a-495d-ab0e-78ec2a6cb44b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b30f80f-8b8c-4c07-8653-4f9fd128ce77", "name": "network-vif-unplugged", "status": "completed", "tag": "8bfd0e33-2b14-4398-b80c-8da478f93229"}]} {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:17:00.170343 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [req-2185d847-c7b4-44ee-8dee-f30fd399ca3e req-3ab6d4a5-9d4a-495d-ab0e-78ec2a6cb44b service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:00.171110 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [req-2185d847-c7b4-44ee-8dee-f30fd399ca3e req-3ab6d4a5-9d4a-495d-ab0e-78ec2a6cb44b service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:00.189702 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.compute.server_external_events [req-2185d847-c7b4-44ee-8dee-f30fd399ca3e req-3ab6d4a5-9d4a-495d-ab0e-78ec2a6cb44b service nova] Creating event network-vif-unplugged:8bfd0e33-2b14-4398-b80c-8da478f93229 for instance 5b30f80f-8b8c-4c07-8653-4f9fd128ce77 on hv-cinder-82549 Jun 17 15:17:00.198512 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [req-2185d847-c7b4-44ee-8dee-f30fd399ca3e req-3ab6d4a5-9d4a-495d-ab0e-78ec2a6cb44b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.108114 Jun 17 15:17:00.199397 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 373/698] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 15:17:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:17:00.205228 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-5d3952e4-ed2e-4f87-b813-668b6638bc62 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:00.206325 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-5d3952e4-ed2e-4f87-b813-668b6638bc62 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:00.212845 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5d3952e4-ed2e-4f87-b813-668b6638bc62 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:00.213293 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5d3952e4-ed2e-4f87-b813-668b6638bc62 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:00.214126 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5d3952e4-ed2e-4f87-b813-668b6638bc62 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:00.214496 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5d3952e4-ed2e-4f87-b813-668b6638bc62 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:00.246300 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-5d3952e4-ed2e-4f87-b813-668b6638bc62 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045661 Jun 17 15:17:00.246872 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 374/699] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:17:00 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:17:00.251726 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-6cf46a20-2df0-4167-ac9e-52ac5182ed39 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:00.252534 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-6cf46a20-2df0-4167-ac9e-52ac5182ed39 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:00.258954 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6cf46a20-2df0-4167-ac9e-52ac5182ed39 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:00.259401 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6cf46a20-2df0-4167-ac9e-52ac5182ed39 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:00.260165 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6cf46a20-2df0-4167-ac9e-52ac5182ed39 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:00.260633 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6cf46a20-2df0-4167-ac9e-52ac5182ed39 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:00.409086 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-6cf46a20-2df0-4167-ac9e-52ac5182ed39 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:17:00.417371 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-6cf46a20-2df0-4167-ac9e-52ac5182ed39 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.169423 Jun 17 15:17:00.417969 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 375/700] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:17:00 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:17:01.028312 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-66ab98d7-76d4-4ae5-8939-07144eadb196 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:01.029406 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-66ab98d7-76d4-4ae5-8939-07144eadb196 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:01.036592 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-66ab98d7-76d4-4ae5-8939-07144eadb196 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:01.037065 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-66ab98d7-76d4-4ae5-8939-07144eadb196 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:01.037890 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-66ab98d7-76d4-4ae5-8939-07144eadb196 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:01.038354 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-66ab98d7-76d4-4ae5-8939-07144eadb196 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:01.072152 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-66ab98d7-76d4-4ae5-8939-07144eadb196 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048324 Jun 17 15:17:01.072785 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 376/701] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:17:01 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:17:01.258966 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-31e5cf21-abd8-4e32-abd9-e8fe35f3dbd2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:01.259879 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-31e5cf21-abd8-4e32-abd9-e8fe35f3dbd2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:01.266267 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-31e5cf21-abd8-4e32-abd9-e8fe35f3dbd2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:01.266713 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-31e5cf21-abd8-4e32-abd9-e8fe35f3dbd2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:01.267492 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-31e5cf21-abd8-4e32-abd9-e8fe35f3dbd2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:01.267926 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-31e5cf21-abd8-4e32-abd9-e8fe35f3dbd2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:01.298338 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-31e5cf21-abd8-4e32-abd9-e8fe35f3dbd2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043552 Jun 17 15:17:01.298899 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 377/702] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:17:01 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 15:17:01.434191 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-f429eb02-0885-455b-9438-f7420f5f380a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:01.434792 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-f429eb02-0885-455b-9438-f7420f5f380a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:01.440764 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f429eb02-0885-455b-9438-f7420f5f380a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:01.441208 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f429eb02-0885-455b-9438-f7420f5f380a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:01.441963 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f429eb02-0885-455b-9438-f7420f5f380a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:01.442389 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f429eb02-0885-455b-9438-f7420f5f380a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:01.576668 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-f429eb02-0885-455b-9438-f7420f5f380a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:17:01.584741 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-f429eb02-0885-455b-9438-f7420f5f380a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.154348 Jun 17 15:17:01.585303 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 378/703] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:17:01 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:17:02.084508 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-784459c9-74d8-4397-b39e-5ae05efedfe3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:02.085418 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-784459c9-74d8-4397-b39e-5ae05efedfe3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:02.092136 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-784459c9-74d8-4397-b39e-5ae05efedfe3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:02.092606 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-784459c9-74d8-4397-b39e-5ae05efedfe3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:02.093372 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-784459c9-74d8-4397-b39e-5ae05efedfe3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:02.093807 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-784459c9-74d8-4397-b39e-5ae05efedfe3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:02.126310 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-784459c9-74d8-4397-b39e-5ae05efedfe3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045671 Jun 17 15:17:02.126894 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 379/704] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:17:02 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:17:02.310302 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-fac8d0d2-5a6f-487e-942f-41fe108d3120 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:02.311219 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-fac8d0d2-5a6f-487e-942f-41fe108d3120 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:02.317894 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fac8d0d2-5a6f-487e-942f-41fe108d3120 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:02.318349 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fac8d0d2-5a6f-487e-942f-41fe108d3120 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:02.319315 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fac8d0d2-5a6f-487e-942f-41fe108d3120 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:02.319753 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fac8d0d2-5a6f-487e-942f-41fe108d3120 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:02.351049 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-fac8d0d2-5a6f-487e-942f-41fe108d3120 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044545 Jun 17 15:17:02.351555 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 380/705] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:17:02 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 15:17:02.602563 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-b0a07ef3-6722-4647-be8f-efb320bb8a8c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:02.603084 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-b0a07ef3-6722-4647-be8f-efb320bb8a8c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:02.609671 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b0a07ef3-6722-4647-be8f-efb320bb8a8c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:02.610114 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b0a07ef3-6722-4647-be8f-efb320bb8a8c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:02.610865 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b0a07ef3-6722-4647-be8f-efb320bb8a8c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:02.611292 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b0a07ef3-6722-4647-be8f-efb320bb8a8c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:02.757074 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-b0a07ef3-6722-4647-be8f-efb320bb8a8c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:17:02.766234 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-b0a07ef3-6722-4647-be8f-efb320bb8a8c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.167495 Jun 17 15:17:02.766866 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 381/706] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:17:02 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:17:03.138371 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-7f746b6c-0db4-4104-a6e9-f15ca07d440a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:03.139299 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-7f746b6c-0db4-4104-a6e9-f15ca07d440a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:03.147429 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7f746b6c-0db4-4104-a6e9-f15ca07d440a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:03.147877 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7f746b6c-0db4-4104-a6e9-f15ca07d440a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:03.148701 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7f746b6c-0db4-4104-a6e9-f15ca07d440a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:03.149136 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7f746b6c-0db4-4104-a6e9-f15ca07d440a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:03.175430 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=100 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:17:03.181077 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-7f746b6c-0db4-4104-a6e9-f15ca07d440a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046871 Jun 17 15:17:03.181648 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 382/707] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:17:03 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:17:03.362829 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-d5137527-d7fd-489c-abc1-5d66e3310060 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:03.363733 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-d5137527-d7fd-489c-abc1-5d66e3310060 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:03.370222 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d5137527-d7fd-489c-abc1-5d66e3310060 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:03.370664 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d5137527-d7fd-489c-abc1-5d66e3310060 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:03.371427 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d5137527-d7fd-489c-abc1-5d66e3310060 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:03.371853 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d5137527-d7fd-489c-abc1-5d66e3310060 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:03.402054 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-d5137527-d7fd-489c-abc1-5d66e3310060 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043157 Jun 17 15:17:03.402614 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 383/708] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:17:03 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 15:17:03.787155 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-6d3e3c78-3346-4bbb-b347-7b55e700e93c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:03.787763 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-6d3e3c78-3346-4bbb-b347-7b55e700e93c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:03.793952 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6d3e3c78-3346-4bbb-b347-7b55e700e93c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:03.794402 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6d3e3c78-3346-4bbb-b347-7b55e700e93c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:03.795167 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6d3e3c78-3346-4bbb-b347-7b55e700e93c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:03.795593 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6d3e3c78-3346-4bbb-b347-7b55e700e93c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:03.928915 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-6d3e3c78-3346-4bbb-b347-7b55e700e93c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:17:03.936546 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-6d3e3c78-3346-4bbb-b347-7b55e700e93c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.153269 Jun 17 15:17:03.937678 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 384/709] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:17:03 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:17:04.192955 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-0f808ec2-67b0-492d-bde6-f253ff7546e2 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:04.193877 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-0f808ec2-67b0-492d-bde6-f253ff7546e2 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:04.200536 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0f808ec2-67b0-492d-bde6-f253ff7546e2 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:04.200990 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0f808ec2-67b0-492d-bde6-f253ff7546e2 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:04.201766 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0f808ec2-67b0-492d-bde6-f253ff7546e2 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:04.202204 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0f808ec2-67b0-492d-bde6-f253ff7546e2 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:04.232215 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-0f808ec2-67b0-492d-bde6-f253ff7546e2 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043197 Jun 17 15:17:04.232830 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 385/710] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:17:04 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:17:04.414123 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-c6c0896b-1a48-4b68-9f9c-f9cc05da167a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:04.415039 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-c6c0896b-1a48-4b68-9f9c-f9cc05da167a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:04.421145 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c6c0896b-1a48-4b68-9f9c-f9cc05da167a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:04.422252 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c6c0896b-1a48-4b68-9f9c-f9cc05da167a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:04.423012 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c6c0896b-1a48-4b68-9f9c-f9cc05da167a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:04.423444 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c6c0896b-1a48-4b68-9f9c-f9cc05da167a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:04.452930 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-c6c0896b-1a48-4b68-9f9c-f9cc05da167a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042619 Jun 17 15:17:04.453425 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 386/711] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:17:04 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 15:17:04.954554 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-157b90ce-a956-4a9a-bc4d-dbb8b9437e47 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:04.955163 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-157b90ce-a956-4a9a-bc4d-dbb8b9437e47 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:04.961507 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-157b90ce-a956-4a9a-bc4d-dbb8b9437e47 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:04.962069 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-157b90ce-a956-4a9a-bc4d-dbb8b9437e47 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:04.962855 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-157b90ce-a956-4a9a-bc4d-dbb8b9437e47 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:04.963778 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-157b90ce-a956-4a9a-bc4d-dbb8b9437e47 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:05.103992 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-157b90ce-a956-4a9a-bc4d-dbb8b9437e47 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:17:05.115775 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-157b90ce-a956-4a9a-bc4d-dbb8b9437e47 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.165808 Jun 17 15:17:05.116366 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 387/712] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:17:04 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:17:05.245560 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-d6733e1f-fe9e-4a62-a866-213d063bfc6e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:05.246385 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-d6733e1f-fe9e-4a62-a866-213d063bfc6e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:05.253711 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d6733e1f-fe9e-4a62-a866-213d063bfc6e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:05.254182 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d6733e1f-fe9e-4a62-a866-213d063bfc6e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:05.254947 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d6733e1f-fe9e-4a62-a866-213d063bfc6e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:05.255373 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d6733e1f-fe9e-4a62-a866-213d063bfc6e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:05.285806 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-d6733e1f-fe9e-4a62-a866-213d063bfc6e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044443 Jun 17 15:17:05.286373 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 388/713] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:17:05 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:17:05.464855 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-1c44b94c-a841-4859-86ef-693fd1d63694 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:05.466127 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-1c44b94c-a841-4859-86ef-693fd1d63694 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:05.473962 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1c44b94c-a841-4859-86ef-693fd1d63694 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:05.473962 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1c44b94c-a841-4859-86ef-693fd1d63694 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:05.473962 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1c44b94c-a841-4859-86ef-693fd1d63694 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:05.474392 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1c44b94c-a841-4859-86ef-693fd1d63694 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:05.505849 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-1c44b94c-a841-4859-86ef-693fd1d63694 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044852 Jun 17 15:17:05.506332 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 389/714] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:17:05 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 15:17:06.133128 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-051e962c-2168-468e-86a1-5af1f609609c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:06.133785 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-051e962c-2168-468e-86a1-5af1f609609c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:06.140980 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-051e962c-2168-468e-86a1-5af1f609609c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:06.141488 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-051e962c-2168-468e-86a1-5af1f609609c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:06.142274 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-051e962c-2168-468e-86a1-5af1f609609c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:06.142712 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-051e962c-2168-468e-86a1-5af1f609609c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:06.276637 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-051e962c-2168-468e-86a1-5af1f609609c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:17:06.284710 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-051e962c-2168-468e-86a1-5af1f609609c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.155477 Jun 17 15:17:06.285276 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 390/715] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:17:06 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:17:06.297212 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-54002974-ccd9-4ebb-9f87-5c62893e3fa4 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:06.298125 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-54002974-ccd9-4ebb-9f87-5c62893e3fa4 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:06.304041 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-54002974-ccd9-4ebb-9f87-5c62893e3fa4 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:06.304540 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-54002974-ccd9-4ebb-9f87-5c62893e3fa4 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:06.305311 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-54002974-ccd9-4ebb-9f87-5c62893e3fa4 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:06.305749 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-54002974-ccd9-4ebb-9f87-5c62893e3fa4 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:06.334352 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-54002974-ccd9-4ebb-9f87-5c62893e3fa4 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040928 Jun 17 15:17:06.334912 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 391/716] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:17:06 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:17:06.517895 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-5e0531ba-bd6e-4076-9226-e21a0c6ef070 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:06.518744 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-5e0531ba-bd6e-4076-9226-e21a0c6ef070 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:06.524726 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5e0531ba-bd6e-4076-9226-e21a0c6ef070 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:06.525168 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5e0531ba-bd6e-4076-9226-e21a0c6ef070 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:06.525915 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5e0531ba-bd6e-4076-9226-e21a0c6ef070 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:06.526341 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5e0531ba-bd6e-4076-9226-e21a0c6ef070 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:06.555607 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-5e0531ba-bd6e-4076-9226-e21a0c6ef070 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041841 Jun 17 15:17:06.556153 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 392/717] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:17:06 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 15:17:07.302129 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-68c404d3-785c-47d0-839c-50db148589c2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:07.302771 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-68c404d3-785c-47d0-839c-50db148589c2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:07.309281 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-68c404d3-785c-47d0-839c-50db148589c2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:07.310168 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-68c404d3-785c-47d0-839c-50db148589c2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:07.310657 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-68c404d3-785c-47d0-839c-50db148589c2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:07.310900 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-68c404d3-785c-47d0-839c-50db148589c2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:07.445685 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-68c404d3-785c-47d0-839c-50db148589c2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:17:07.453163 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-68c404d3-785c-47d0-839c-50db148589c2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.154974 Jun 17 15:17:07.453724 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 393/718] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:17:07 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:17:07.458311 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-f4c95347-578a-4b91-86a9-f47de151e030 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:07.459215 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-f4c95347-578a-4b91-86a9-f47de151e030 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:07.464919 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f4c95347-578a-4b91-86a9-f47de151e030 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:07.465367 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f4c95347-578a-4b91-86a9-f47de151e030 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:07.466382 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f4c95347-578a-4b91-86a9-f47de151e030 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:07.466838 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f4c95347-578a-4b91-86a9-f47de151e030 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:07.495795 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-f4c95347-578a-4b91-86a9-f47de151e030 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041062 Jun 17 15:17:07.496372 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 394/719] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:17:07 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:17:07.571429 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-c7867a2b-61ed-4257-8620-50390db17798 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:07.572249 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-c7867a2b-61ed-4257-8620-50390db17798 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:07.578756 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c7867a2b-61ed-4257-8620-50390db17798 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:07.579193 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c7867a2b-61ed-4257-8620-50390db17798 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:07.579938 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c7867a2b-61ed-4257-8620-50390db17798 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:07.580388 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c7867a2b-61ed-4257-8620-50390db17798 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:07.609038 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-c7867a2b-61ed-4257-8620-50390db17798 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041606 Jun 17 15:17:07.609582 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 395/720] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:17:07 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 15:17:08.470798 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-ab7d3bb4-f7e8-48f1-97c8-8840905a4b34 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:08.471484 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-ab7d3bb4-f7e8-48f1-97c8-8840905a4b34 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:08.478016 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ab7d3bb4-f7e8-48f1-97c8-8840905a4b34 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:08.478450 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ab7d3bb4-f7e8-48f1-97c8-8840905a4b34 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:08.479202 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ab7d3bb4-f7e8-48f1-97c8-8840905a4b34 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:08.479632 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ab7d3bb4-f7e8-48f1-97c8-8840905a4b34 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:08.617079 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-ab7d3bb4-f7e8-48f1-97c8-8840905a4b34 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:17:08.624581 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-ab7d3bb4-f7e8-48f1-97c8-8840905a4b34 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.158142 Jun 17 15:17:08.625142 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 396/721] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:17:08 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:17:08.629739 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-da2be1c7-88a0-48e1-b1aa-c1b270a56323 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:08.630580 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-da2be1c7-88a0-48e1-b1aa-c1b270a56323 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:08.637063 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-da2be1c7-88a0-48e1-b1aa-c1b270a56323 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:08.637530 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-da2be1c7-88a0-48e1-b1aa-c1b270a56323 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:08.638286 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-da2be1c7-88a0-48e1-b1aa-c1b270a56323 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:08.638710 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-da2be1c7-88a0-48e1-b1aa-c1b270a56323 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:08.667997 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-da2be1c7-88a0-48e1-b1aa-c1b270a56323 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041831 Jun 17 15:17:08.668575 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 397/722] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:17:08 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:17:08.673405 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-184f63cc-ebd1-4b84-b97d-009199d6dfe5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:08.674291 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-184f63cc-ebd1-4b84-b97d-009199d6dfe5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:08.680071 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-184f63cc-ebd1-4b84-b97d-009199d6dfe5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:08.680560 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-184f63cc-ebd1-4b84-b97d-009199d6dfe5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:08.681320 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-184f63cc-ebd1-4b84-b97d-009199d6dfe5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:08.681750 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-184f63cc-ebd1-4b84-b97d-009199d6dfe5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:08.711837 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-184f63cc-ebd1-4b84-b97d-009199d6dfe5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041980 Jun 17 15:17:08.712409 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 398/723] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:17:08 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:17:09.614877 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_api:SELECT=55 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:17:09.641718 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell1:SELECT=75 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:17:09.642754 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-72ee01e3-babf-43cc-98af-177d030e3f43 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:09.643478 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-72ee01e3-babf-43cc-98af-177d030e3f43 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:09.650061 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-72ee01e3-babf-43cc-98af-177d030e3f43 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:09.650503 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-72ee01e3-babf-43cc-98af-177d030e3f43 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:09.651260 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-72ee01e3-babf-43cc-98af-177d030e3f43 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:09.651686 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-72ee01e3-babf-43cc-98af-177d030e3f43 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:09.669516 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=100 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:17:09.781673 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-72ee01e3-babf-43cc-98af-177d030e3f43 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:17:09.789310 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-72ee01e3-babf-43cc-98af-177d030e3f43 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.151074 Jun 17 15:17:09.789878 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 399/724] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:17:09 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:17:09.794447 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-2f34fa82-2f81-4c32-9437-1e2be7c61cba tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:09.795350 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-2f34fa82-2f81-4c32-9437-1e2be7c61cba tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:09.801553 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2f34fa82-2f81-4c32-9437-1e2be7c61cba tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:09.801994 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2f34fa82-2f81-4c32-9437-1e2be7c61cba tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:09.802745 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2f34fa82-2f81-4c32-9437-1e2be7c61cba tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:09.803175 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2f34fa82-2f81-4c32-9437-1e2be7c61cba tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:09.831407 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-2f34fa82-2f81-4c32-9437-1e2be7c61cba tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040405 Jun 17 15:17:09.831877 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 400/725] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:17:09 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:17:09.836424 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-4d1c75af-063e-4aad-8f5c-1d2c901332e1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:09.837318 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-4d1c75af-063e-4aad-8f5c-1d2c901332e1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:09.843151 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4d1c75af-063e-4aad-8f5c-1d2c901332e1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:09.843584 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4d1c75af-063e-4aad-8f5c-1d2c901332e1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:09.844352 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4d1c75af-063e-4aad-8f5c-1d2c901332e1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:09.844777 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4d1c75af-063e-4aad-8f5c-1d2c901332e1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:09.873247 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-4d1c75af-063e-4aad-8f5c-1d2c901332e1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040320 Jun 17 15:17:09.873795 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 401/726] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:17:09 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:17:10.806708 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-7f449ce4-958c-4f2f-b693-86ee798a7706 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:10.807365 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-7f449ce4-958c-4f2f-b693-86ee798a7706 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:10.813964 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7f449ce4-958c-4f2f-b693-86ee798a7706 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:10.814405 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7f449ce4-958c-4f2f-b693-86ee798a7706 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:10.815225 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7f449ce4-958c-4f2f-b693-86ee798a7706 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:10.815651 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7f449ce4-958c-4f2f-b693-86ee798a7706 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:10.948043 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-7f449ce4-958c-4f2f-b693-86ee798a7706 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:17:10.956133 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-7f449ce4-958c-4f2f-b693-86ee798a7706 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.153273 Jun 17 15:17:10.956718 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 402/727] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:17:10 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:17:10.961220 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-ce83cf7c-906f-4312-a11b-8b99fa76606e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:10.962118 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-ce83cf7c-906f-4312-a11b-8b99fa76606e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:10.968075 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ce83cf7c-906f-4312-a11b-8b99fa76606e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:10.968550 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ce83cf7c-906f-4312-a11b-8b99fa76606e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:10.969300 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ce83cf7c-906f-4312-a11b-8b99fa76606e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:10.969726 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ce83cf7c-906f-4312-a11b-8b99fa76606e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:10.997509 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-ce83cf7c-906f-4312-a11b-8b99fa76606e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039776 Jun 17 15:17:10.998055 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 403/728] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:17:10 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:17:11.002976 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-4b657376-d5f7-459d-abf5-2b0ec3723b18 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:11.003851 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-4b657376-d5f7-459d-abf5-2b0ec3723b18 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:11.009366 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4b657376-d5f7-459d-abf5-2b0ec3723b18 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:11.009803 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4b657376-d5f7-459d-abf5-2b0ec3723b18 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:11.010544 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4b657376-d5f7-459d-abf5-2b0ec3723b18 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:11.010969 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4b657376-d5f7-459d-abf5-2b0ec3723b18 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:11.038964 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-4b657376-d5f7-459d-abf5-2b0ec3723b18 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039917 Jun 17 15:17:11.039493 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 404/729] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:17:10 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:17:11.973349 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-de987ef4-9b00-4461-92f7-988433a38514 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:11.974037 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-de987ef4-9b00-4461-92f7-988433a38514 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:11.981045 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-de987ef4-9b00-4461-92f7-988433a38514 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:11.981489 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-de987ef4-9b00-4461-92f7-988433a38514 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:11.982271 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-de987ef4-9b00-4461-92f7-988433a38514 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:11.982701 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-de987ef4-9b00-4461-92f7-988433a38514 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:12.120402 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-de987ef4-9b00-4461-92f7-988433a38514 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:17:12.128917 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-de987ef4-9b00-4461-92f7-988433a38514 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.159513 Jun 17 15:17:12.129489 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 405/730] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:17:11 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:17:12.134078 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-c62d1a4f-a857-44cb-a5b6-1be98d486ef0 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:12.134981 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-c62d1a4f-a857-44cb-a5b6-1be98d486ef0 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:12.141175 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c62d1a4f-a857-44cb-a5b6-1be98d486ef0 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:12.141627 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c62d1a4f-a857-44cb-a5b6-1be98d486ef0 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:12.142395 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c62d1a4f-a857-44cb-a5b6-1be98d486ef0 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:12.142831 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c62d1a4f-a857-44cb-a5b6-1be98d486ef0 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:12.171124 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-c62d1a4f-a857-44cb-a5b6-1be98d486ef0 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040598 Jun 17 15:17:12.172162 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 406/731] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:17:12 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:17:12.176789 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-4cb99615-9531-46d2-a158-436dd30ceaa8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:12.177709 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-4cb99615-9531-46d2-a158-436dd30ceaa8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:12.190890 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4cb99615-9531-46d2-a158-436dd30ceaa8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:12.191342 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4cb99615-9531-46d2-a158-436dd30ceaa8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:12.192143 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4cb99615-9531-46d2-a158-436dd30ceaa8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:12.192610 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4cb99615-9531-46d2-a158-436dd30ceaa8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:12.222402 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-4cb99615-9531-46d2-a158-436dd30ceaa8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049163 Jun 17 15:17:12.222962 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 407/732] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:17:12 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:17:13.145621 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-914e08c6-f349-4b87-9b28-7e74d1184ccb tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:13.146296 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-914e08c6-f349-4b87-9b28-7e74d1184ccb tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:13.152688 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-914e08c6-f349-4b87-9b28-7e74d1184ccb tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:13.153125 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-914e08c6-f349-4b87-9b28-7e74d1184ccb tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:13.153874 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-914e08c6-f349-4b87-9b28-7e74d1184ccb tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:13.154299 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-914e08c6-f349-4b87-9b28-7e74d1184ccb tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:13.288661 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-914e08c6-f349-4b87-9b28-7e74d1184ccb tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:17:13.296821 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-914e08c6-f349-4b87-9b28-7e74d1184ccb tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.154478 Jun 17 15:17:13.297385 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 408/733] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:17:13 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:17:13.301907 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-f94f4712-da90-4145-9d34-7390e3e5be94 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:13.302805 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-f94f4712-da90-4145-9d34-7390e3e5be94 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:13.308737 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f94f4712-da90-4145-9d34-7390e3e5be94 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:13.309173 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f94f4712-da90-4145-9d34-7390e3e5be94 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:13.309950 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f94f4712-da90-4145-9d34-7390e3e5be94 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:13.310358 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f94f4712-da90-4145-9d34-7390e3e5be94 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:13.338271 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-f94f4712-da90-4145-9d34-7390e3e5be94 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039874 Jun 17 15:17:13.338834 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 409/734] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:17:13 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:17:13.344096 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-74d6e0d5-423d-475c-a2a2-45552c19792d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:13.344998 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-74d6e0d5-423d-475c-a2a2-45552c19792d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:13.350945 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-74d6e0d5-423d-475c-a2a2-45552c19792d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:13.351515 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-74d6e0d5-423d-475c-a2a2-45552c19792d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:13.352292 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-74d6e0d5-423d-475c-a2a2-45552c19792d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:13.352763 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-74d6e0d5-423d-475c-a2a2-45552c19792d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:13.385331 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-74d6e0d5-423d-475c-a2a2-45552c19792d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045427 Jun 17 15:17:13.385902 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 410/735] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:17:13 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:17:14.314541 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-2fa5ed7b-338c-496c-a4aa-b39bc7a0abc3 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:14.315272 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-2fa5ed7b-338c-496c-a4aa-b39bc7a0abc3 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:14.321814 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2fa5ed7b-338c-496c-a4aa-b39bc7a0abc3 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:14.322251 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2fa5ed7b-338c-496c-a4aa-b39bc7a0abc3 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:14.323690 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2fa5ed7b-338c-496c-a4aa-b39bc7a0abc3 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:14.324130 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2fa5ed7b-338c-496c-a4aa-b39bc7a0abc3 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:14.460534 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-2fa5ed7b-338c-496c-a4aa-b39bc7a0abc3 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:17:14.469720 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-2fa5ed7b-338c-496c-a4aa-b39bc7a0abc3 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.160164 Jun 17 15:17:14.470298 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 411/736] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:17:14 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:17:14.475020 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-27449258-eb33-4500-942b-dbf7aaeb1729 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:14.475933 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-27449258-eb33-4500-942b-dbf7aaeb1729 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:14.477745 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_api:SELECT=100 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:17:14.484164 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-27449258-eb33-4500-942b-dbf7aaeb1729 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:14.484648 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-27449258-eb33-4500-942b-dbf7aaeb1729 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:14.485426 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-27449258-eb33-4500-942b-dbf7aaeb1729 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:14.485855 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-27449258-eb33-4500-942b-dbf7aaeb1729 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:14.515955 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-27449258-eb33-4500-942b-dbf7aaeb1729 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044564 Jun 17 15:17:14.516543 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 412/737] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:17:14 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:17:14.521092 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-689994d2-7279-4044-9563-426cb09fdaf5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:14.521993 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-689994d2-7279-4044-9563-426cb09fdaf5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:14.527706 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-689994d2-7279-4044-9563-426cb09fdaf5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:14.528154 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-689994d2-7279-4044-9563-426cb09fdaf5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:14.528968 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-689994d2-7279-4044-9563-426cb09fdaf5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:14.529394 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-689994d2-7279-4044-9563-426cb09fdaf5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:14.558081 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-689994d2-7279-4044-9563-426cb09fdaf5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040505 Jun 17 15:17:14.558641 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 413/738] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:17:14 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:17:15.486711 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-2271058f-09a1-40d8-ab4a-7f20483615e5 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:15.487394 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-2271058f-09a1-40d8-ab4a-7f20483615e5 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:15.493887 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2271058f-09a1-40d8-ab4a-7f20483615e5 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:15.494337 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2271058f-09a1-40d8-ab4a-7f20483615e5 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:15.495098 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2271058f-09a1-40d8-ab4a-7f20483615e5 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:15.495531 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2271058f-09a1-40d8-ab4a-7f20483615e5 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:15.627613 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-2271058f-09a1-40d8-ab4a-7f20483615e5 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:17:15.635072 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-2271058f-09a1-40d8-ab4a-7f20483615e5 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.152198 Jun 17 15:17:15.635573 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 414/739] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:17:15 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:17:15.640667 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-04d83a02-736b-40de-bda1-12fcbe2888d3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:15.641602 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-04d83a02-736b-40de-bda1-12fcbe2888d3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:15.647235 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-04d83a02-736b-40de-bda1-12fcbe2888d3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:15.647679 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-04d83a02-736b-40de-bda1-12fcbe2888d3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:15.648462 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-04d83a02-736b-40de-bda1-12fcbe2888d3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:15.648898 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-04d83a02-736b-40de-bda1-12fcbe2888d3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:15.676154 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-04d83a02-736b-40de-bda1-12fcbe2888d3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039587 Jun 17 15:17:15.676729 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 415/740] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:17:15 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:17:15.681189 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-8a8b18c7-4104-44a7-b434-1e6bd2b07819 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:15.682101 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-8a8b18c7-4104-44a7-b434-1e6bd2b07819 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:15.687950 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8a8b18c7-4104-44a7-b434-1e6bd2b07819 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:15.688425 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8a8b18c7-4104-44a7-b434-1e6bd2b07819 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:15.689182 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8a8b18c7-4104-44a7-b434-1e6bd2b07819 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:15.689613 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8a8b18c7-4104-44a7-b434-1e6bd2b07819 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:15.693111 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=100 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:17:15.718507 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-8a8b18c7-4104-44a7-b434-1e6bd2b07819 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040747 Jun 17 15:17:15.719056 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 416/741] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:17:15 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:17:16.652442 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-e2f876a2-3645-411d-8401-523e92fc0626 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:16.653148 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-e2f876a2-3645-411d-8401-523e92fc0626 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:16.660090 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e2f876a2-3645-411d-8401-523e92fc0626 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:16.660645 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e2f876a2-3645-411d-8401-523e92fc0626 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:16.661403 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e2f876a2-3645-411d-8401-523e92fc0626 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:16.661837 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e2f876a2-3645-411d-8401-523e92fc0626 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:16.791669 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-e2f876a2-3645-411d-8401-523e92fc0626 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:17:16.799277 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-e2f876a2-3645-411d-8401-523e92fc0626 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.150842 Jun 17 15:17:16.799875 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 417/742] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:17:16 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:17:16.804557 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-cc1c5a26-37ea-434d-be30-034dc5a6900b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:16.805524 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-cc1c5a26-37ea-434d-be30-034dc5a6900b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:16.811355 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cc1c5a26-37ea-434d-be30-034dc5a6900b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:16.811803 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cc1c5a26-37ea-434d-be30-034dc5a6900b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:16.812589 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cc1c5a26-37ea-434d-be30-034dc5a6900b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:16.813019 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cc1c5a26-37ea-434d-be30-034dc5a6900b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:16.841725 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-cc1c5a26-37ea-434d-be30-034dc5a6900b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040792 Jun 17 15:17:16.842279 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 418/743] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:17:16 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:17:16.847766 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-24b941e4-39e7-42fe-a4dc-fbe33b632ecd tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:16.848686 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-24b941e4-39e7-42fe-a4dc-fbe33b632ecd tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:16.854318 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-24b941e4-39e7-42fe-a4dc-fbe33b632ecd tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:16.854764 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-24b941e4-39e7-42fe-a4dc-fbe33b632ecd tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:16.855525 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-24b941e4-39e7-42fe-a4dc-fbe33b632ecd tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:16.855955 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-24b941e4-39e7-42fe-a4dc-fbe33b632ecd tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:16.885204 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-24b941e4-39e7-42fe-a4dc-fbe33b632ecd tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041871 Jun 17 15:17:16.885778 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 419/744] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:17:16 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:17:17.816090 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-5acff0bc-2579-4ef3-a845-58e8988ef869 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:17.816784 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-5acff0bc-2579-4ef3-a845-58e8988ef869 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:17.823167 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5acff0bc-2579-4ef3-a845-58e8988ef869 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:17.823625 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5acff0bc-2579-4ef3-a845-58e8988ef869 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:17.824383 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5acff0bc-2579-4ef3-a845-58e8988ef869 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:17.824811 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5acff0bc-2579-4ef3-a845-58e8988ef869 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:17.954264 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-5acff0bc-2579-4ef3-a845-58e8988ef869 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:17:17.961744 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-5acff0bc-2579-4ef3-a845-58e8988ef869 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.149578 Jun 17 15:17:17.962310 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 420/745] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:17:17 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:17:17.967066 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-a7b435eb-dde8-43d2-9c42-0f1e7820f708 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:17.968484 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-a7b435eb-dde8-43d2-9c42-0f1e7820f708 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:17.974335 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a7b435eb-dde8-43d2-9c42-0f1e7820f708 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:17.974781 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a7b435eb-dde8-43d2-9c42-0f1e7820f708 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:17.975570 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a7b435eb-dde8-43d2-9c42-0f1e7820f708 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:17.976017 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a7b435eb-dde8-43d2-9c42-0f1e7820f708 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:18.005163 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-a7b435eb-dde8-43d2-9c42-0f1e7820f708 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041820 Jun 17 15:17:18.005723 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 421/746] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:17:17 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:17:18.010212 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-56264617-c58a-48ce-90b3-d97097d2b649 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:18.011096 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-56264617-c58a-48ce-90b3-d97097d2b649 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:18.016737 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-56264617-c58a-48ce-90b3-d97097d2b649 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:18.017179 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-56264617-c58a-48ce-90b3-d97097d2b649 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:18.017931 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-56264617-c58a-48ce-90b3-d97097d2b649 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:18.018360 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-56264617-c58a-48ce-90b3-d97097d2b649 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:18.047811 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-56264617-c58a-48ce-90b3-d97097d2b649 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041042 Jun 17 15:17:18.048402 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 422/747] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:17:18 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:17:18.979513 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-cfd55104-baa2-496b-8df6-78127c647652 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:18.980135 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-cfd55104-baa2-496b-8df6-78127c647652 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:18.987234 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cfd55104-baa2-496b-8df6-78127c647652 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:18.987678 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cfd55104-baa2-496b-8df6-78127c647652 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:18.988456 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cfd55104-baa2-496b-8df6-78127c647652 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:18.988881 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cfd55104-baa2-496b-8df6-78127c647652 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:19.125141 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-cfd55104-baa2-496b-8df6-78127c647652 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:17:19.132479 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-cfd55104-baa2-496b-8df6-78127c647652 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.156803 Jun 17 15:17:19.133030 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 423/748] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:17:18 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:17:19.137542 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-41e01f60-d514-4a9d-93ef-f9e4b5981da0 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:19.138440 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-41e01f60-d514-4a9d-93ef-f9e4b5981da0 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:19.144546 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-41e01f60-d514-4a9d-93ef-f9e4b5981da0 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:19.145009 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-41e01f60-d514-4a9d-93ef-f9e4b5981da0 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:19.145794 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-41e01f60-d514-4a9d-93ef-f9e4b5981da0 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:19.146252 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-41e01f60-d514-4a9d-93ef-f9e4b5981da0 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:19.175326 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-41e01f60-d514-4a9d-93ef-f9e4b5981da0 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041161 Jun 17 15:17:19.175802 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 424/749] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:17:19 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:17:19.180701 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-e38309e1-f0a0-4781-a70a-6f0ba7259a17 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:19.181830 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-e38309e1-f0a0-4781-a70a-6f0ba7259a17 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:19.187744 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e38309e1-f0a0-4781-a70a-6f0ba7259a17 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:19.188198 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e38309e1-f0a0-4781-a70a-6f0ba7259a17 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:19.189003 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e38309e1-f0a0-4781-a70a-6f0ba7259a17 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:19.189443 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e38309e1-f0a0-4781-a70a-6f0ba7259a17 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:19.218377 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-e38309e1-f0a0-4781-a70a-6f0ba7259a17 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041051 Jun 17 15:17:19.218944 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 425/750] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:17:19 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:17:19.223281 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-d47640b0-97e7-4aa2-bb95-07a00831969d tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:19.223773 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-d47640b0-97e7-4aa2-bb95-07a00831969d tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:19.229444 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d47640b0-97e7-4aa2-bb95-07a00831969d tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:19.229895 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d47640b0-97e7-4aa2-bb95-07a00831969d tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:19.230653 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d47640b0-97e7-4aa2-bb95-07a00831969d tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:19.231088 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d47640b0-97e7-4aa2-bb95-07a00831969d tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:19.256179 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-d47640b0-97e7-4aa2-bb95-07a00831969d tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Going to try to terminate instance {{(pid=117650) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 15:17:19.329700 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-d47640b0-97e7-4aa2-bb95-07a00831969d tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "DELETE /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 204 len: 0 microversion: 2.1 time: 0.108985 Jun 17 15:17:19.330687 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 426/751] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jun 17 15:17:19 2022] DELETE /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 15:17:19.342284 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-76b2a3a3-ef42-4427-a0f5-1ec9c8ac23b0 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:19.343781 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-76b2a3a3-ef42-4427-a0f5-1ec9c8ac23b0 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:19.349746 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-76b2a3a3-ef42-4427-a0f5-1ec9c8ac23b0 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:19.350189 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-76b2a3a3-ef42-4427-a0f5-1ec9c8ac23b0 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:19.350956 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-76b2a3a3-ef42-4427-a0f5-1ec9c8ac23b0 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:19.351384 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-76b2a3a3-ef42-4427-a0f5-1ec9c8ac23b0 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:19.484798 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-76b2a3a3-ef42-4427-a0f5-1ec9c8ac23b0 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:17:19.492351 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-76b2a3a3-ef42-4427-a0f5-1ec9c8ac23b0 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1574 microversion: 2.1 time: 0.156737 Jun 17 15:17:19.492911 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 427/752] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:17:19 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1574 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:17:20.149708 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-12b6a8a9-b3ae-4b9f-ad95-8e22e99fee41 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:20.150351 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-12b6a8a9-b3ae-4b9f-ad95-8e22e99fee41 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:20.157004 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-12b6a8a9-b3ae-4b9f-ad95-8e22e99fee41 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:20.157457 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-12b6a8a9-b3ae-4b9f-ad95-8e22e99fee41 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:20.158224 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-12b6a8a9-b3ae-4b9f-ad95-8e22e99fee41 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:20.158659 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-12b6a8a9-b3ae-4b9f-ad95-8e22e99fee41 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:20.293860 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-12b6a8a9-b3ae-4b9f-ad95-8e22e99fee41 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:17:20.302711 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-12b6a8a9-b3ae-4b9f-ad95-8e22e99fee41 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.156742 Jun 17 15:17:20.303301 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 428/753] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:17:20 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:17:20.308211 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-c6b56537-bf11-4403-8e7c-b75ac792c6fd tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:20.309240 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-c6b56537-bf11-4403-8e7c-b75ac792c6fd tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:20.316255 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c6b56537-bf11-4403-8e7c-b75ac792c6fd tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:20.316734 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c6b56537-bf11-4403-8e7c-b75ac792c6fd tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:20.317540 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c6b56537-bf11-4403-8e7c-b75ac792c6fd tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:20.317972 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c6b56537-bf11-4403-8e7c-b75ac792c6fd tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:20.349305 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-c6b56537-bf11-4403-8e7c-b75ac792c6fd tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044903 Jun 17 15:17:20.349893 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 429/754] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:17:20 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:17:20.354741 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-73137291-64b0-4870-ac01-62e31683f1fe tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:20.355654 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-73137291-64b0-4870-ac01-62e31683f1fe tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:20.362649 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-73137291-64b0-4870-ac01-62e31683f1fe tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:20.363094 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-73137291-64b0-4870-ac01-62e31683f1fe tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:20.363853 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-73137291-64b0-4870-ac01-62e31683f1fe tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:20.364276 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-73137291-64b0-4870-ac01-62e31683f1fe tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:20.396554 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-73137291-64b0-4870-ac01-62e31683f1fe tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045534 Jun 17 15:17:20.397190 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 430/755] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:17:20 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:17:20.509382 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-a586f715-329d-4ba2-8b4e-a4c0772db55f tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:20.509897 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-a586f715-329d-4ba2-8b4e-a4c0772db55f tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:20.516092 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a586f715-329d-4ba2-8b4e-a4c0772db55f tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:20.516570 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a586f715-329d-4ba2-8b4e-a4c0772db55f tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:20.517993 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a586f715-329d-4ba2-8b4e-a4c0772db55f tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:20.518499 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a586f715-329d-4ba2-8b4e-a4c0772db55f tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:20.524215 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:17:20.652900 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-a586f715-329d-4ba2-8b4e-a4c0772db55f tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:17:20.661405 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-a586f715-329d-4ba2-8b4e-a4c0772db55f tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1574 microversion: 2.1 time: 0.155939 Jun 17 15:17:20.661961 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 431/756] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:17:20 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1574 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:17:21.320668 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-023299ec-f4d1-45ae-af17-34d78e04fde9 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:21.321341 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-023299ec-f4d1-45ae-af17-34d78e04fde9 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:21.328209 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-023299ec-f4d1-45ae-af17-34d78e04fde9 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:21.328690 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-023299ec-f4d1-45ae-af17-34d78e04fde9 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:21.329505 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-023299ec-f4d1-45ae-af17-34d78e04fde9 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:21.329942 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-023299ec-f4d1-45ae-af17-34d78e04fde9 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:21.464441 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-023299ec-f4d1-45ae-af17-34d78e04fde9 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:17:21.472711 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-023299ec-f4d1-45ae-af17-34d78e04fde9 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.155951 Jun 17 15:17:21.473277 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 432/757] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:17:21 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:17:21.477897 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-309a7f83-bce9-4a9e-9ff8-25a1a2289e4d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:21.478823 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-309a7f83-bce9-4a9e-9ff8-25a1a2289e4d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:21.485383 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-309a7f83-bce9-4a9e-9ff8-25a1a2289e4d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:21.485826 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-309a7f83-bce9-4a9e-9ff8-25a1a2289e4d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:21.486597 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-309a7f83-bce9-4a9e-9ff8-25a1a2289e4d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:21.487028 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-309a7f83-bce9-4a9e-9ff8-25a1a2289e4d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:21.515656 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-309a7f83-bce9-4a9e-9ff8-25a1a2289e4d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041235 Jun 17 15:17:21.516139 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 433/758] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:17:21 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:17:21.520863 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-986f7598-acbb-4d28-b3d6-cc3f2dd1a2e1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:21.521764 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-986f7598-acbb-4d28-b3d6-cc3f2dd1a2e1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:21.527530 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-986f7598-acbb-4d28-b3d6-cc3f2dd1a2e1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:21.527976 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-986f7598-acbb-4d28-b3d6-cc3f2dd1a2e1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:21.528758 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-986f7598-acbb-4d28-b3d6-cc3f2dd1a2e1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:21.529193 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-986f7598-acbb-4d28-b3d6-cc3f2dd1a2e1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:21.559356 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-986f7598-acbb-4d28-b3d6-cc3f2dd1a2e1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042128 Jun 17 15:17:21.559930 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 434/759] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:17:21 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:17:21.678576 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-1812445f-3305-4540-92be-9657aa9a8687 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:21.679627 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-1812445f-3305-4540-92be-9657aa9a8687 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:21.685997 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1812445f-3305-4540-92be-9657aa9a8687 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:21.686809 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1812445f-3305-4540-92be-9657aa9a8687 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:21.687349 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1812445f-3305-4540-92be-9657aa9a8687 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:21.687930 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1812445f-3305-4540-92be-9657aa9a8687 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:21.758535 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-1812445f-3305-4540-92be-9657aa9a8687 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:17:21.766807 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-1812445f-3305-4540-92be-9657aa9a8687 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1508 microversion: 2.1 time: 0.092332 Jun 17 15:17:21.768373 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 435/760] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:17:21 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1508 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:17:22.082725 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [req-94e93225-1261-4c1d-9ab3-faadafb14b59 req-7095f677-b427-41d8-bb1a-71f4d405dad4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fee7bc0-cd0e-4c25-8475-b43e79cb933a", "name": "network-vif-deleted", "tag": "4e15dfc0-dc8a-4b19-9fc3-632ff970220b"}]} {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:17:22.091181 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [req-94e93225-1261-4c1d-9ab3-faadafb14b59 req-7095f677-b427-41d8-bb1a-71f4d405dad4 service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:22.091619 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [req-94e93225-1261-4c1d-9ab3-faadafb14b59 req-7095f677-b427-41d8-bb1a-71f4d405dad4 service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:22.104261 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.compute.server_external_events [req-94e93225-1261-4c1d-9ab3-faadafb14b59 req-7095f677-b427-41d8-bb1a-71f4d405dad4 service nova] Creating event network-vif-deleted:4e15dfc0-dc8a-4b19-9fc3-632ff970220b for instance 8fee7bc0-cd0e-4c25-8475-b43e79cb933a on hv-cinder-82549 Jun 17 15:17:22.109623 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [req-94e93225-1261-4c1d-9ab3-faadafb14b59 req-7095f677-b427-41d8-bb1a-71f4d405dad4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094421 Jun 17 15:17:22.110225 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 436/761] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 15:17:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:17:22.491381 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-fdfb82f3-29a9-41a5-858b-c62be8c9f3e6 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:22.492456 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-fdfb82f3-29a9-41a5-858b-c62be8c9f3e6 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:22.501044 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fdfb82f3-29a9-41a5-858b-c62be8c9f3e6 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:22.501326 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fdfb82f3-29a9-41a5-858b-c62be8c9f3e6 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:22.502150 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fdfb82f3-29a9-41a5-858b-c62be8c9f3e6 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:22.502704 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fdfb82f3-29a9-41a5-858b-c62be8c9f3e6 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:22.647689 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-fdfb82f3-29a9-41a5-858b-c62be8c9f3e6 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:17:22.656305 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-fdfb82f3-29a9-41a5-858b-c62be8c9f3e6 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.169299 Jun 17 15:17:22.657190 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 437/762] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:17:22 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:17:22.670807 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-2dc320ce-3b6a-47ab-9789-feede024b90e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:22.672413 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-2dc320ce-3b6a-47ab-9789-feede024b90e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:22.679310 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2dc320ce-3b6a-47ab-9789-feede024b90e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:22.679626 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2dc320ce-3b6a-47ab-9789-feede024b90e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:22.680500 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2dc320ce-3b6a-47ab-9789-feede024b90e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:22.680954 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2dc320ce-3b6a-47ab-9789-feede024b90e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:22.713522 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-2dc320ce-3b6a-47ab-9789-feede024b90e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046694 Jun 17 15:17:22.714104 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 438/763] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:17:22 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:17:22.720073 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-68bfc3ce-e2e3-4337-bcf5-d39fdbaffee3 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:22.720729 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-68bfc3ce-e2e3-4337-bcf5-d39fdbaffee3 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:22.727096 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-68bfc3ce-e2e3-4337-bcf5-d39fdbaffee3 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:22.727535 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-68bfc3ce-e2e3-4337-bcf5-d39fdbaffee3 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:22.728970 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-68bfc3ce-e2e3-4337-bcf5-d39fdbaffee3 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:22.729417 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-68bfc3ce-e2e3-4337-bcf5-d39fdbaffee3 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:22.761816 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-68bfc3ce-e2e3-4337-bcf5-d39fdbaffee3 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046650 Jun 17 15:17:22.762389 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 439/764] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:17:22 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:17:22.784553 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-6320583b-a10d-4fb5-8ed7-11f8d7414c6f tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:22.784553 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-6320583b-a10d-4fb5-8ed7-11f8d7414c6f tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:22.791814 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6320583b-a10d-4fb5-8ed7-11f8d7414c6f tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:22.792261 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6320583b-a10d-4fb5-8ed7-11f8d7414c6f tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:22.793058 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6320583b-a10d-4fb5-8ed7-11f8d7414c6f tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:22.793494 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6320583b-a10d-4fb5-8ed7-11f8d7414c6f tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:22.858357 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-6320583b-a10d-4fb5-8ed7-11f8d7414c6f tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:17:22.868224 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-6320583b-a10d-4fb5-8ed7-11f8d7414c6f tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.087998 Jun 17 15:17:22.869050 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 440/765] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:17:22 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:17:23.673983 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-f1512ab7-14d1-4d56-bf12-67b31ab85534 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:23.674692 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-f1512ab7-14d1-4d56-bf12-67b31ab85534 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:23.681577 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f1512ab7-14d1-4d56-bf12-67b31ab85534 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:23.682070 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f1512ab7-14d1-4d56-bf12-67b31ab85534 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:23.682861 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f1512ab7-14d1-4d56-bf12-67b31ab85534 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:23.683300 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f1512ab7-14d1-4d56-bf12-67b31ab85534 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:23.834206 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-f1512ab7-14d1-4d56-bf12-67b31ab85534 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:17:23.844010 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-f1512ab7-14d1-4d56-bf12-67b31ab85534 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.173992 Jun 17 15:17:23.844234 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 441/766] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:17:23 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:17:23.849026 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-b66092e1-3bd3-4a88-8c11-5fbcc61a67a3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:23.849928 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-b66092e1-3bd3-4a88-8c11-5fbcc61a67a3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:23.856259 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b66092e1-3bd3-4a88-8c11-5fbcc61a67a3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:23.856802 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b66092e1-3bd3-4a88-8c11-5fbcc61a67a3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:23.857622 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b66092e1-3bd3-4a88-8c11-5fbcc61a67a3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:23.858121 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b66092e1-3bd3-4a88-8c11-5fbcc61a67a3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:23.889905 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-b66092e1-3bd3-4a88-8c11-5fbcc61a67a3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044633 Jun 17 15:17:23.890491 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 442/767] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:17:23 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:17:23.895062 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-347e57eb-d038-42d2-aeec-6e545a6ec878 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:23.895971 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-347e57eb-d038-42d2-aeec-6e545a6ec878 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:23.901948 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-347e57eb-d038-42d2-aeec-6e545a6ec878 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:23.902403 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-347e57eb-d038-42d2-aeec-6e545a6ec878 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:23.903170 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-347e57eb-d038-42d2-aeec-6e545a6ec878 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:23.903649 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-347e57eb-d038-42d2-aeec-6e545a6ec878 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:23.933171 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-347e57eb-d038-42d2-aeec-6e545a6ec878 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041509 Jun 17 15:17:23.933660 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 443/768] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:17:23 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:17:23.938751 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-103cd0d0-bfbe-4798-bdef-c13dbe49c63f tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:23.939387 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-103cd0d0-bfbe-4798-bdef-c13dbe49c63f tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:23.945130 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-103cd0d0-bfbe-4798-bdef-c13dbe49c63f tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:23.945622 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-103cd0d0-bfbe-4798-bdef-c13dbe49c63f tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:23.946559 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-103cd0d0-bfbe-4798-bdef-c13dbe49c63f tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:23.946998 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-103cd0d0-bfbe-4798-bdef-c13dbe49c63f tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:24.008886 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-103cd0d0-bfbe-4798-bdef-c13dbe49c63f tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:17:24.016605 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-103cd0d0-bfbe-4798-bdef-c13dbe49c63f tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.081948 Jun 17 15:17:24.017177 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 444/769] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:17:23 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:17:24.860622 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-cfb11ad7-1cf5-40bc-9bb4-9df7674d8538 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:24.861305 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-cfb11ad7-1cf5-40bc-9bb4-9df7674d8538 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:24.867667 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cfb11ad7-1cf5-40bc-9bb4-9df7674d8538 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:24.868112 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cfb11ad7-1cf5-40bc-9bb4-9df7674d8538 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:24.868902 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cfb11ad7-1cf5-40bc-9bb4-9df7674d8538 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:24.869333 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cfb11ad7-1cf5-40bc-9bb4-9df7674d8538 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:25.005395 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-cfb11ad7-1cf5-40bc-9bb4-9df7674d8538 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:17:25.013628 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-cfb11ad7-1cf5-40bc-9bb4-9df7674d8538 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.156883 Jun 17 15:17:25.014213 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 445/770] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:17:24 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:17:25.018918 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-247a4a8d-b6b7-4d72-996e-1a6020ad0608 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:25.019825 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-247a4a8d-b6b7-4d72-996e-1a6020ad0608 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:25.025932 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-247a4a8d-b6b7-4d72-996e-1a6020ad0608 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:25.026381 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-247a4a8d-b6b7-4d72-996e-1a6020ad0608 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:25.027168 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-247a4a8d-b6b7-4d72-996e-1a6020ad0608 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:25.027572 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-247a4a8d-b6b7-4d72-996e-1a6020ad0608 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:25.056784 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-247a4a8d-b6b7-4d72-996e-1a6020ad0608 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041435 Jun 17 15:17:25.057340 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 446/771] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:17:25 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:17:25.061843 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-0230d339-426c-4146-850b-ab65ac480819 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:25.062726 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-0230d339-426c-4146-850b-ab65ac480819 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:25.068277 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0230d339-426c-4146-850b-ab65ac480819 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:25.068755 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0230d339-426c-4146-850b-ab65ac480819 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:25.069510 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0230d339-426c-4146-850b-ab65ac480819 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:25.069942 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0230d339-426c-4146-850b-ab65ac480819 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:25.098363 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-0230d339-426c-4146-850b-ab65ac480819 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039989 Jun 17 15:17:25.098908 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 447/772] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:17:25 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:17:25.103224 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-e6d661bc-8163-446c-9817-50a0d3296aeb tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:25.103836 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-e6d661bc-8163-446c-9817-50a0d3296aeb tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:25.110007 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e6d661bc-8163-446c-9817-50a0d3296aeb tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:25.110455 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e6d661bc-8163-446c-9817-50a0d3296aeb tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:25.111264 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e6d661bc-8163-446c-9817-50a0d3296aeb tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:25.111642 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e6d661bc-8163-446c-9817-50a0d3296aeb tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:25.129220 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=100 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:17:25.176008 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-e6d661bc-8163-446c-9817-50a0d3296aeb tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:17:25.183577 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-e6d661bc-8163-446c-9817-50a0d3296aeb tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.083711 Jun 17 15:17:25.184135 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 448/773] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:17:25 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:17:26.030997 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-468f5c1f-5d4a-45ef-861e-4f08e909cbeb tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:26.031658 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-468f5c1f-5d4a-45ef-861e-4f08e909cbeb tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:26.037683 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-468f5c1f-5d4a-45ef-861e-4f08e909cbeb tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:26.038124 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-468f5c1f-5d4a-45ef-861e-4f08e909cbeb tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:26.038880 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-468f5c1f-5d4a-45ef-861e-4f08e909cbeb tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:26.039310 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-468f5c1f-5d4a-45ef-861e-4f08e909cbeb tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:26.169805 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-468f5c1f-5d4a-45ef-861e-4f08e909cbeb tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:17:26.178119 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-468f5c1f-5d4a-45ef-861e-4f08e909cbeb tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.151088 Jun 17 15:17:26.181546 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 449/774] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:17:26 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:17:26.185321 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-4fdeda55-0193-4a4e-905d-7e164cdaf56c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:26.186243 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-4fdeda55-0193-4a4e-905d-7e164cdaf56c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:26.193111 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4fdeda55-0193-4a4e-905d-7e164cdaf56c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:26.193552 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4fdeda55-0193-4a4e-905d-7e164cdaf56c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:26.194321 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4fdeda55-0193-4a4e-905d-7e164cdaf56c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:26.194757 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4fdeda55-0193-4a4e-905d-7e164cdaf56c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:26.223737 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-4fdeda55-0193-4a4e-905d-7e164cdaf56c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043987 Jun 17 15:17:26.224347 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 450/775] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:17:26 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:17:26.228846 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-fea0fd4a-076e-4cfa-a432-c16493528b17 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:26.229739 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-fea0fd4a-076e-4cfa-a432-c16493528b17 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:26.236246 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fea0fd4a-076e-4cfa-a432-c16493528b17 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:26.236722 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fea0fd4a-076e-4cfa-a432-c16493528b17 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:26.237483 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fea0fd4a-076e-4cfa-a432-c16493528b17 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:26.237914 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fea0fd4a-076e-4cfa-a432-c16493528b17 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:26.267342 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-fea0fd4a-076e-4cfa-a432-c16493528b17 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041962 Jun 17 15:17:26.267924 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 451/776] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:17:26 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:17:26.272297 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-a2566ada-4253-4ce0-ad50-f5cff9e11e0a tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:26.272929 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-a2566ada-4253-4ce0-ad50-f5cff9e11e0a tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:26.278577 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a2566ada-4253-4ce0-ad50-f5cff9e11e0a tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:26.279030 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a2566ada-4253-4ce0-ad50-f5cff9e11e0a tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:26.279769 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a2566ada-4253-4ce0-ad50-f5cff9e11e0a tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:26.280253 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a2566ada-4253-4ce0-ad50-f5cff9e11e0a tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:26.341672 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-a2566ada-4253-4ce0-ad50-f5cff9e11e0a tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:17:26.349759 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-a2566ada-4253-4ce0-ad50-f5cff9e11e0a tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.080815 Jun 17 15:17:26.350321 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 452/777] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:17:26 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:17:27.198548 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-a066ba29-dc51-4ff1-ae6f-4ae391850db8 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:27.199203 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-a066ba29-dc51-4ff1-ae6f-4ae391850db8 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:27.206057 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a066ba29-dc51-4ff1-ae6f-4ae391850db8 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:27.206541 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a066ba29-dc51-4ff1-ae6f-4ae391850db8 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:27.207359 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a066ba29-dc51-4ff1-ae6f-4ae391850db8 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:27.207836 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a066ba29-dc51-4ff1-ae6f-4ae391850db8 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:27.341879 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-a066ba29-dc51-4ff1-ae6f-4ae391850db8 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:17:27.350961 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-a066ba29-dc51-4ff1-ae6f-4ae391850db8 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.156492 Jun 17 15:17:27.351677 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 453/778] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:17:27 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:17:27.356358 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-18f14be5-238e-4165-891e-34c53afb96ab tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:27.357345 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-18f14be5-238e-4165-891e-34c53afb96ab tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:27.364349 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-18f14be5-238e-4165-891e-34c53afb96ab tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:27.364805 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-18f14be5-238e-4165-891e-34c53afb96ab tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:27.365612 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-18f14be5-238e-4165-891e-34c53afb96ab tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:27.366045 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-18f14be5-238e-4165-891e-34c53afb96ab tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:27.395658 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-18f14be5-238e-4165-891e-34c53afb96ab tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042845 Jun 17 15:17:27.396217 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 454/779] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:17:27 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:17:27.400773 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-1230e0de-34e7-48e2-b310-495eb56510c9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:27.401675 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-1230e0de-34e7-48e2-b310-495eb56510c9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:27.408004 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1230e0de-34e7-48e2-b310-495eb56510c9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:27.408482 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1230e0de-34e7-48e2-b310-495eb56510c9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:27.409238 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1230e0de-34e7-48e2-b310-495eb56510c9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:27.409667 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1230e0de-34e7-48e2-b310-495eb56510c9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:27.438187 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-1230e0de-34e7-48e2-b310-495eb56510c9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040908 Jun 17 15:17:27.438742 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 455/780] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:17:27 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:17:27.443105 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-170c2710-d562-485f-9e18-9bb06b349a9f tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:27.443700 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-170c2710-d562-485f-9e18-9bb06b349a9f tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:27.449478 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-170c2710-d562-485f-9e18-9bb06b349a9f tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:27.449856 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-170c2710-d562-485f-9e18-9bb06b349a9f tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:27.450608 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-170c2710-d562-485f-9e18-9bb06b349a9f tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:27.451034 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-170c2710-d562-485f-9e18-9bb06b349a9f tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:27.511733 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-170c2710-d562-485f-9e18-9bb06b349a9f tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:17:27.519584 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-170c2710-d562-485f-9e18-9bb06b349a9f tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.079899 Jun 17 15:17:27.520146 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 456/781] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:17:27 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:17:28.368615 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-b84ce127-6d48-4525-936d-8094468e86f7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:28.369289 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-b84ce127-6d48-4525-936d-8094468e86f7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:28.376531 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b84ce127-6d48-4525-936d-8094468e86f7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:28.376979 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b84ce127-6d48-4525-936d-8094468e86f7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:28.377755 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b84ce127-6d48-4525-936d-8094468e86f7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:28.378189 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b84ce127-6d48-4525-936d-8094468e86f7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:28.506787 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-b84ce127-6d48-4525-936d-8094468e86f7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:17:28.514241 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-b84ce127-6d48-4525-936d-8094468e86f7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.149570 Jun 17 15:17:28.514794 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 457/782] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:17:28 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:17:28.519347 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-edf0174c-26f0-4808-a0f2-a85b9037419b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:28.520252 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-edf0174c-26f0-4808-a0f2-a85b9037419b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:28.525949 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-edf0174c-26f0-4808-a0f2-a85b9037419b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:28.526399 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-edf0174c-26f0-4808-a0f2-a85b9037419b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:28.527155 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-edf0174c-26f0-4808-a0f2-a85b9037419b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:28.527589 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-edf0174c-26f0-4808-a0f2-a85b9037419b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:28.556267 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-edf0174c-26f0-4808-a0f2-a85b9037419b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040470 Jun 17 15:17:28.556847 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 458/783] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:17:28 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:17:28.561299 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-7fa4cf88-5838-4984-8940-84e246fff513 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:28.562175 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-7fa4cf88-5838-4984-8940-84e246fff513 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:28.563741 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:17:28.568972 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7fa4cf88-5838-4984-8940-84e246fff513 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:28.569418 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7fa4cf88-5838-4984-8940-84e246fff513 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:28.570176 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7fa4cf88-5838-4984-8940-84e246fff513 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:28.570608 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7fa4cf88-5838-4984-8940-84e246fff513 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:28.600647 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-7fa4cf88-5838-4984-8940-84e246fff513 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042737 Jun 17 15:17:28.601215 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 459/784] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:17:28 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:17:28.605580 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-61c1f1da-8d4c-4de5-8b89-e577ac54750b tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:28.606181 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-61c1f1da-8d4c-4de5-8b89-e577ac54750b tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:28.612484 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-61c1f1da-8d4c-4de5-8b89-e577ac54750b tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:28.612932 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-61c1f1da-8d4c-4de5-8b89-e577ac54750b tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:28.613688 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-61c1f1da-8d4c-4de5-8b89-e577ac54750b tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:28.614115 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-61c1f1da-8d4c-4de5-8b89-e577ac54750b tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:28.677097 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-61c1f1da-8d4c-4de5-8b89-e577ac54750b tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:17:28.684645 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-61c1f1da-8d4c-4de5-8b89-e577ac54750b tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.082449 Jun 17 15:17:28.685209 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 460/785] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:17:28 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:17:29.530102 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-a98da013-68aa-4815-aadc-e47f09ee4c13 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:29.530815 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-a98da013-68aa-4815-aadc-e47f09ee4c13 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:29.538007 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a98da013-68aa-4815-aadc-e47f09ee4c13 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:29.538453 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a98da013-68aa-4815-aadc-e47f09ee4c13 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:29.539215 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a98da013-68aa-4815-aadc-e47f09ee4c13 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:29.539643 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a98da013-68aa-4815-aadc-e47f09ee4c13 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:29.671565 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-a98da013-68aa-4815-aadc-e47f09ee4c13 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:17:29.679219 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-a98da013-68aa-4815-aadc-e47f09ee4c13 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.152957 Jun 17 15:17:29.679782 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 461/786] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:17:29 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:17:29.684373 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-3f0372eb-020c-4624-87e4-76d9703d320a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:29.685281 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-3f0372eb-020c-4624-87e4-76d9703d320a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:29.691634 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3f0372eb-020c-4624-87e4-76d9703d320a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:29.692082 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3f0372eb-020c-4624-87e4-76d9703d320a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:29.692893 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3f0372eb-020c-4624-87e4-76d9703d320a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:29.693342 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3f0372eb-020c-4624-87e4-76d9703d320a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:29.725308 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-3f0372eb-020c-4624-87e4-76d9703d320a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044469 Jun 17 15:17:29.725881 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 462/787] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:17:29 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:17:29.730497 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-16862283-c3e5-477f-af00-4b627c81d5a7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:29.731394 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-16862283-c3e5-477f-af00-4b627c81d5a7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:29.737173 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-16862283-c3e5-477f-af00-4b627c81d5a7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:29.737627 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-16862283-c3e5-477f-af00-4b627c81d5a7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:29.738400 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-16862283-c3e5-477f-af00-4b627c81d5a7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:29.738836 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-16862283-c3e5-477f-af00-4b627c81d5a7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:29.767466 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-16862283-c3e5-477f-af00-4b627c81d5a7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040546 Jun 17 15:17:29.768030 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 463/788] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:17:29 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:17:29.772559 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-7b77e988-89d8-4cd5-91bc-f7a77add1cd6 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:29.773171 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-7b77e988-89d8-4cd5-91bc-f7a77add1cd6 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:29.779003 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7b77e988-89d8-4cd5-91bc-f7a77add1cd6 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:29.779452 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7b77e988-89d8-4cd5-91bc-f7a77add1cd6 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:29.780221 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7b77e988-89d8-4cd5-91bc-f7a77add1cd6 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:29.780693 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7b77e988-89d8-4cd5-91bc-f7a77add1cd6 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:29.841333 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-7b77e988-89d8-4cd5-91bc-f7a77add1cd6 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:17:29.849430 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-7b77e988-89d8-4cd5-91bc-f7a77add1cd6 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.080348 Jun 17 15:17:29.849994 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 464/789] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:17:29 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:17:30.696069 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-34a3a53a-ea15-4b7e-b9ea-6e7b1f87ecf6 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:30.696752 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-34a3a53a-ea15-4b7e-b9ea-6e7b1f87ecf6 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:30.703328 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-34a3a53a-ea15-4b7e-b9ea-6e7b1f87ecf6 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:30.703969 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-34a3a53a-ea15-4b7e-b9ea-6e7b1f87ecf6 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:30.704869 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-34a3a53a-ea15-4b7e-b9ea-6e7b1f87ecf6 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:30.705298 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-34a3a53a-ea15-4b7e-b9ea-6e7b1f87ecf6 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:30.709283 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=100 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:17:30.838613 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-34a3a53a-ea15-4b7e-b9ea-6e7b1f87ecf6 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:17:30.846731 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-34a3a53a-ea15-4b7e-b9ea-6e7b1f87ecf6 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.154598 Jun 17 15:17:30.847282 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 465/790] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:17:30 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:17:30.851721 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-fe45800f-0976-4f8f-9d0f-c4091aa629ec tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:30.852664 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-fe45800f-0976-4f8f-9d0f-c4091aa629ec tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:30.858144 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fe45800f-0976-4f8f-9d0f-c4091aa629ec tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:30.858578 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fe45800f-0976-4f8f-9d0f-c4091aa629ec tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:30.859923 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fe45800f-0976-4f8f-9d0f-c4091aa629ec tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:30.860367 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fe45800f-0976-4f8f-9d0f-c4091aa629ec tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:30.887570 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-fe45800f-0976-4f8f-9d0f-c4091aa629ec tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039298 Jun 17 15:17:30.888115 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 466/791] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:17:30 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:17:30.892540 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-ee925275-85c1-40b6-94df-b8cb1065e487 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:30.893406 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-ee925275-85c1-40b6-94df-b8cb1065e487 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:30.898885 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ee925275-85c1-40b6-94df-b8cb1065e487 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:30.899324 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ee925275-85c1-40b6-94df-b8cb1065e487 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:30.900070 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ee925275-85c1-40b6-94df-b8cb1065e487 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:30.900535 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ee925275-85c1-40b6-94df-b8cb1065e487 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:30.928833 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-ee925275-85c1-40b6-94df-b8cb1065e487 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039661 Jun 17 15:17:30.929378 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 467/792] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:17:30 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:17:30.933639 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-55a64f03-e257-45dc-be36-a11fcf96a9f4 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:30.934230 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-55a64f03-e257-45dc-be36-a11fcf96a9f4 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:30.939681 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-55a64f03-e257-45dc-be36-a11fcf96a9f4 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:30.940119 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-55a64f03-e257-45dc-be36-a11fcf96a9f4 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:30.940908 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-55a64f03-e257-45dc-be36-a11fcf96a9f4 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:30.941338 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-55a64f03-e257-45dc-be36-a11fcf96a9f4 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:31.001285 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-55a64f03-e257-45dc-be36-a11fcf96a9f4 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:17:31.008923 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-55a64f03-e257-45dc-be36-a11fcf96a9f4 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.078585 Jun 17 15:17:31.009494 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 468/793] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:17:30 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:17:31.863340 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-8ed7f37e-746e-4d23-b708-6e10c9986ea1 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:31.864059 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-8ed7f37e-746e-4d23-b708-6e10c9986ea1 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:31.870455 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8ed7f37e-746e-4d23-b708-6e10c9986ea1 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:31.870898 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8ed7f37e-746e-4d23-b708-6e10c9986ea1 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:31.871680 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8ed7f37e-746e-4d23-b708-6e10c9986ea1 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:31.872109 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8ed7f37e-746e-4d23-b708-6e10c9986ea1 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:32.004168 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-8ed7f37e-746e-4d23-b708-6e10c9986ea1 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:17:32.011781 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-8ed7f37e-746e-4d23-b708-6e10c9986ea1 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.152311 Jun 17 15:17:32.012277 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 469/794] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:17:31 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:17:32.017188 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-1abea379-b720-4223-b61e-73d162b66800 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:32.018128 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-1abea379-b720-4223-b61e-73d162b66800 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:32.024700 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1abea379-b720-4223-b61e-73d162b66800 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:32.025148 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1abea379-b720-4223-b61e-73d162b66800 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:32.025925 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1abea379-b720-4223-b61e-73d162b66800 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:32.026355 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1abea379-b720-4223-b61e-73d162b66800 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:32.058042 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-1abea379-b720-4223-b61e-73d162b66800 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044676 Jun 17 15:17:32.058601 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 470/795] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:17:32 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:17:32.063731 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-88303a90-569a-4cf3-8cba-d5ee6aa76401 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:32.064647 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-88303a90-569a-4cf3-8cba-d5ee6aa76401 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:32.070406 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-88303a90-569a-4cf3-8cba-d5ee6aa76401 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:32.070845 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-88303a90-569a-4cf3-8cba-d5ee6aa76401 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:32.071598 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-88303a90-569a-4cf3-8cba-d5ee6aa76401 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:32.072024 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-88303a90-569a-4cf3-8cba-d5ee6aa76401 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:32.102380 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-88303a90-569a-4cf3-8cba-d5ee6aa76401 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042707 Jun 17 15:17:32.102948 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 471/796] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:17:32 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:17:32.107397 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-e0f1b52c-947d-4049-81ec-85e19db3a2b0 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:32.107994 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-e0f1b52c-947d-4049-81ec-85e19db3a2b0 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:32.114395 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e0f1b52c-947d-4049-81ec-85e19db3a2b0 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:32.114833 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e0f1b52c-947d-4049-81ec-85e19db3a2b0 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:32.115588 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e0f1b52c-947d-4049-81ec-85e19db3a2b0 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:32.116010 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e0f1b52c-947d-4049-81ec-85e19db3a2b0 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:32.181140 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-e0f1b52c-947d-4049-81ec-85e19db3a2b0 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:17:32.189263 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-e0f1b52c-947d-4049-81ec-85e19db3a2b0 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.085323 Jun 17 15:17:32.189819 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 472/797] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:17:32 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:17:33.028974 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-101cfbb2-6d43-49d2-a193-de05c66eba40 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:33.029680 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-101cfbb2-6d43-49d2-a193-de05c66eba40 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:33.036710 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-101cfbb2-6d43-49d2-a193-de05c66eba40 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:33.037162 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-101cfbb2-6d43-49d2-a193-de05c66eba40 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:33.037912 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-101cfbb2-6d43-49d2-a193-de05c66eba40 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:33.038338 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-101cfbb2-6d43-49d2-a193-de05c66eba40 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:33.168565 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-101cfbb2-6d43-49d2-a193-de05c66eba40 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:17:33.176018 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-101cfbb2-6d43-49d2-a193-de05c66eba40 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.151344 Jun 17 15:17:33.176621 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 473/798] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:17:33 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:17:33.279171 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-d31944bb-a8d1-44a4-af0b-708a7fd53487 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:33.280140 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-d31944bb-a8d1-44a4-af0b-708a7fd53487 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:33.286201 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d31944bb-a8d1-44a4-af0b-708a7fd53487 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:33.286646 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d31944bb-a8d1-44a4-af0b-708a7fd53487 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:33.287404 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d31944bb-a8d1-44a4-af0b-708a7fd53487 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:33.287834 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d31944bb-a8d1-44a4-af0b-708a7fd53487 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:33.315928 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-d31944bb-a8d1-44a4-af0b-708a7fd53487 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.138294 Jun 17 15:17:33.316508 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 474/799] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:17:33 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:17:33.321198 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-b5952010-ce6d-48ca-a143-42a7cc711539 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:33.322212 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-b5952010-ce6d-48ca-a143-42a7cc711539 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:33.328494 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b5952010-ce6d-48ca-a143-42a7cc711539 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:33.328951 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b5952010-ce6d-48ca-a143-42a7cc711539 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:33.329708 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b5952010-ce6d-48ca-a143-42a7cc711539 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:33.330140 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b5952010-ce6d-48ca-a143-42a7cc711539 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:33.358768 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-b5952010-ce6d-48ca-a143-42a7cc711539 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041137 Jun 17 15:17:33.359400 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 475/800] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:17:33 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:17:33.363905 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-17ab2369-eb35-4c7c-8563-427cc0ea54c2 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:33.364620 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-17ab2369-eb35-4c7c-8563-427cc0ea54c2 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:33.370220 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-17ab2369-eb35-4c7c-8563-427cc0ea54c2 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:33.370665 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-17ab2369-eb35-4c7c-8563-427cc0ea54c2 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:33.371458 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-17ab2369-eb35-4c7c-8563-427cc0ea54c2 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:33.371888 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-17ab2369-eb35-4c7c-8563-427cc0ea54c2 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:33.433456 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-17ab2369-eb35-4c7c-8563-427cc0ea54c2 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:17:33.441677 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-17ab2369-eb35-4c7c-8563-427cc0ea54c2 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.081319 Jun 17 15:17:33.442240 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 476/801] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:17:33 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:17:34.193794 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-174ebea1-bc90-4a8f-bb0e-5cd91daf4d5c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:34.194455 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-174ebea1-bc90-4a8f-bb0e-5cd91daf4d5c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:34.200919 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-174ebea1-bc90-4a8f-bb0e-5cd91daf4d5c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:34.201363 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-174ebea1-bc90-4a8f-bb0e-5cd91daf4d5c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:34.202126 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-174ebea1-bc90-4a8f-bb0e-5cd91daf4d5c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:34.202568 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-174ebea1-bc90-4a8f-bb0e-5cd91daf4d5c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:34.331846 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-174ebea1-bc90-4a8f-bb0e-5cd91daf4d5c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:17:34.339498 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-174ebea1-bc90-4a8f-bb0e-5cd91daf4d5c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.149581 Jun 17 15:17:34.340069 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 477/802] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:17:34 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:17:34.345031 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-c9cdf31f-5237-40a1-8871-c566cb4c6582 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:34.345992 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-c9cdf31f-5237-40a1-8871-c566cb4c6582 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:34.351973 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c9cdf31f-5237-40a1-8871-c566cb4c6582 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:34.352456 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c9cdf31f-5237-40a1-8871-c566cb4c6582 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:34.353244 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c9cdf31f-5237-40a1-8871-c566cb4c6582 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:34.353661 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c9cdf31f-5237-40a1-8871-c566cb4c6582 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:34.533693 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-c9cdf31f-5237-40a1-8871-c566cb4c6582 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.192548 Jun 17 15:17:34.534246 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 478/803] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:17:34 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:17:34.538923 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-050add74-2aa6-4c0f-885a-7037ec3da4c4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:34.539815 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-050add74-2aa6-4c0f-885a-7037ec3da4c4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:34.545584 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-050add74-2aa6-4c0f-885a-7037ec3da4c4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:34.546030 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-050add74-2aa6-4c0f-885a-7037ec3da4c4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:34.546895 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-050add74-2aa6-4c0f-885a-7037ec3da4c4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:34.547326 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-050add74-2aa6-4c0f-885a-7037ec3da4c4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:34.576051 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-050add74-2aa6-4c0f-885a-7037ec3da4c4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040744 Jun 17 15:17:34.576607 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 479/804] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:17:34 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:17:34.581675 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-fe989b38-734d-4fcb-ad8f-bd5b6e5ada5d tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:34.582283 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-fe989b38-734d-4fcb-ad8f-bd5b6e5ada5d tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:34.587905 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fe989b38-734d-4fcb-ad8f-bd5b6e5ada5d tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:34.588375 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fe989b38-734d-4fcb-ad8f-bd5b6e5ada5d tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:34.589135 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fe989b38-734d-4fcb-ad8f-bd5b6e5ada5d tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:34.589564 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fe989b38-734d-4fcb-ad8f-bd5b6e5ada5d tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:34.649596 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-fe989b38-734d-4fcb-ad8f-bd5b6e5ada5d tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:17:34.657303 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-fe989b38-734d-4fcb-ad8f-bd5b6e5ada5d tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.079721 Jun 17 15:17:34.657855 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 480/805] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:17:34 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:17:35.356734 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-03352484-4325-4d8c-aff6-3a69e332f4db tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:35.357406 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-03352484-4325-4d8c-aff6-3a69e332f4db tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:35.364847 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-03352484-4325-4d8c-aff6-3a69e332f4db tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:35.365294 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-03352484-4325-4d8c-aff6-3a69e332f4db tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:35.366063 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-03352484-4325-4d8c-aff6-3a69e332f4db tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:35.366487 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-03352484-4325-4d8c-aff6-3a69e332f4db tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:35.503238 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-03352484-4325-4d8c-aff6-3a69e332f4db tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:17:35.506678 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=100 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:17:35.511706 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-03352484-4325-4d8c-aff6-3a69e332f4db tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.158852 Jun 17 15:17:35.512394 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 481/806] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:17:35 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:17:35.545169 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-8858c27a-ca33-4fed-8417-2f8729b8f809 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:35.546070 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-8858c27a-ca33-4fed-8417-2f8729b8f809 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:35.553226 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8858c27a-ca33-4fed-8417-2f8729b8f809 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:35.553670 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8858c27a-ca33-4fed-8417-2f8729b8f809 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:35.554430 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8858c27a-ca33-4fed-8417-2f8729b8f809 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:35.554884 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8858c27a-ca33-4fed-8417-2f8729b8f809 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:35.582635 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-8858c27a-ca33-4fed-8417-2f8729b8f809 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041249 Jun 17 15:17:35.583184 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 482/807] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:17:35 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:17:35.587698 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-7839b857-9051-4fab-980b-7f416d641f66 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:35.588612 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-7839b857-9051-4fab-980b-7f416d641f66 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:35.595089 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7839b857-9051-4fab-980b-7f416d641f66 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:35.595523 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7839b857-9051-4fab-980b-7f416d641f66 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:35.596269 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7839b857-9051-4fab-980b-7f416d641f66 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:35.596718 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7839b857-9051-4fab-980b-7f416d641f66 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:35.626532 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-7839b857-9051-4fab-980b-7f416d641f66 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042256 Jun 17 15:17:35.626997 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 483/808] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:17:35 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:17:35.674749 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-f440c8e3-95e8-4078-8979-54555223117c tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:35.675561 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-f440c8e3-95e8-4078-8979-54555223117c tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:35.681842 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f440c8e3-95e8-4078-8979-54555223117c tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:35.682269 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f440c8e3-95e8-4078-8979-54555223117c tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:35.683032 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f440c8e3-95e8-4078-8979-54555223117c tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:35.683461 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f440c8e3-95e8-4078-8979-54555223117c tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:35.975470 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-f440c8e3-95e8-4078-8979-54555223117c tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:17:35.983430 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-f440c8e3-95e8-4078-8979-54555223117c tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.312662 Jun 17 15:17:35.983983 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 484/809] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:17:35 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:17:36.528627 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-3b53caf4-77be-4845-af44-9c372a8cd30a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:36.529292 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-3b53caf4-77be-4845-af44-9c372a8cd30a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:36.535692 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3b53caf4-77be-4845-af44-9c372a8cd30a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:36.536130 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3b53caf4-77be-4845-af44-9c372a8cd30a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:36.536913 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3b53caf4-77be-4845-af44-9c372a8cd30a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:36.537339 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3b53caf4-77be-4845-af44-9c372a8cd30a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:36.663719 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-3b53caf4-77be-4845-af44-9c372a8cd30a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:17:36.671198 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-3b53caf4-77be-4845-af44-9c372a8cd30a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.146448 Jun 17 15:17:36.672255 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 485/810] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:17:36 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:17:36.676912 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-30f80203-2ff4-4880-9ec2-018c3f1e27b8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:36.677822 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-30f80203-2ff4-4880-9ec2-018c3f1e27b8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:36.683352 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-30f80203-2ff4-4880-9ec2-018c3f1e27b8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:36.683809 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-30f80203-2ff4-4880-9ec2-018c3f1e27b8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:36.684598 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-30f80203-2ff4-4880-9ec2-018c3f1e27b8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:36.685034 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-30f80203-2ff4-4880-9ec2-018c3f1e27b8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:36.713436 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-30f80203-2ff4-4880-9ec2-018c3f1e27b8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040131 Jun 17 15:17:36.713998 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 486/811] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:17:36 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:17:36.718965 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-ac29bbeb-497a-4405-b4c0-78b2df30b7bf tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:36.719861 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-ac29bbeb-497a-4405-b4c0-78b2df30b7bf tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:36.725581 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ac29bbeb-497a-4405-b4c0-78b2df30b7bf tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:36.726034 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ac29bbeb-497a-4405-b4c0-78b2df30b7bf tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:36.726794 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ac29bbeb-497a-4405-b4c0-78b2df30b7bf tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:36.727231 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ac29bbeb-497a-4405-b4c0-78b2df30b7bf tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:36.756420 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-ac29bbeb-497a-4405-b4c0-78b2df30b7bf tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041375 Jun 17 15:17:36.756970 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 487/812] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:17:36 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:17:37.000239 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-f7143b1b-65d0-400f-806b-2e62dcb5d7e0 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:37.000878 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-f7143b1b-65d0-400f-806b-2e62dcb5d7e0 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:37.006956 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f7143b1b-65d0-400f-806b-2e62dcb5d7e0 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:37.007404 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f7143b1b-65d0-400f-806b-2e62dcb5d7e0 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:37.008163 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f7143b1b-65d0-400f-806b-2e62dcb5d7e0 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:37.008636 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f7143b1b-65d0-400f-806b-2e62dcb5d7e0 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:37.068667 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-f7143b1b-65d0-400f-806b-2e62dcb5d7e0 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:17:37.076134 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-f7143b1b-65d0-400f-806b-2e62dcb5d7e0 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.079814 Jun 17 15:17:37.076748 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 488/813] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:17:36 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:17:37.688741 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-46218c14-8629-4381-822d-86ea68979f8a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:37.689409 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-46218c14-8629-4381-822d-86ea68979f8a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:37.697247 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-46218c14-8629-4381-822d-86ea68979f8a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:37.697706 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-46218c14-8629-4381-822d-86ea68979f8a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:37.698646 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-46218c14-8629-4381-822d-86ea68979f8a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:37.699407 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-46218c14-8629-4381-822d-86ea68979f8a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:37.839175 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-46218c14-8629-4381-822d-86ea68979f8a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:17:37.847573 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-46218c14-8629-4381-822d-86ea68979f8a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.163234 Jun 17 15:17:37.848154 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 489/814] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:17:37 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:17:37.857019 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-a6771d4a-86f6-4fbf-9945-b519aae3bf5c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:37.857019 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-a6771d4a-86f6-4fbf-9945-b519aae3bf5c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:37.860707 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a6771d4a-86f6-4fbf-9945-b519aae3bf5c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:37.861153 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a6771d4a-86f6-4fbf-9945-b519aae3bf5c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:37.861954 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a6771d4a-86f6-4fbf-9945-b519aae3bf5c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:37.862388 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a6771d4a-86f6-4fbf-9945-b519aae3bf5c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:37.894478 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-a6771d4a-86f6-4fbf-9945-b519aae3bf5c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045117 Jun 17 15:17:37.895055 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 490/815] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:17:37 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:17:37.899901 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-7c68f8f1-5b49-4e15-974b-29daa072537f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:37.900844 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-7c68f8f1-5b49-4e15-974b-29daa072537f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:37.907061 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7c68f8f1-5b49-4e15-974b-29daa072537f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:37.907488 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7c68f8f1-5b49-4e15-974b-29daa072537f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:37.908253 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7c68f8f1-5b49-4e15-974b-29daa072537f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:37.908716 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7c68f8f1-5b49-4e15-974b-29daa072537f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:37.939816 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-7c68f8f1-5b49-4e15-974b-29daa072537f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043617 Jun 17 15:17:37.940297 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 491/816] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:17:37 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:17:38.093321 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-ae00a2c3-86d5-4980-b666-4ec7852f4615 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:38.093921 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-ae00a2c3-86d5-4980-b666-4ec7852f4615 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:38.099983 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ae00a2c3-86d5-4980-b666-4ec7852f4615 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:38.100504 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ae00a2c3-86d5-4980-b666-4ec7852f4615 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:38.101252 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ae00a2c3-86d5-4980-b666-4ec7852f4615 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:38.101678 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ae00a2c3-86d5-4980-b666-4ec7852f4615 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:38.162828 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-ae00a2c3-86d5-4980-b666-4ec7852f4615 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:17:38.170208 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-ae00a2c3-86d5-4980-b666-4ec7852f4615 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.080996 Jun 17 15:17:38.170765 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 492/817] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:17:38 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:17:38.864621 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-447e83bc-43e0-4a7a-bccf-c8aedef175c5 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:38.865257 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-447e83bc-43e0-4a7a-bccf-c8aedef175c5 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:38.871747 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-447e83bc-43e0-4a7a-bccf-c8aedef175c5 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:38.872180 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-447e83bc-43e0-4a7a-bccf-c8aedef175c5 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:38.872968 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-447e83bc-43e0-4a7a-bccf-c8aedef175c5 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:38.873392 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-447e83bc-43e0-4a7a-bccf-c8aedef175c5 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:39.003968 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-447e83bc-43e0-4a7a-bccf-c8aedef175c5 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:17:39.011422 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-447e83bc-43e0-4a7a-bccf-c8aedef175c5 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.150758 Jun 17 15:17:39.011976 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 493/818] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:17:38 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:17:39.016653 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-72717685-ba36-4175-a975-5391ea6bf280 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:39.017543 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-72717685-ba36-4175-a975-5391ea6bf280 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:39.023140 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-72717685-ba36-4175-a975-5391ea6bf280 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:39.023582 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-72717685-ba36-4175-a975-5391ea6bf280 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:39.024350 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-72717685-ba36-4175-a975-5391ea6bf280 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:39.024793 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-72717685-ba36-4175-a975-5391ea6bf280 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:39.054506 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-72717685-ba36-4175-a975-5391ea6bf280 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041378 Jun 17 15:17:39.055054 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 494/819] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:17:39 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:17:39.059717 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-1dbe956d-eb3f-4dac-ab2e-3063396dc1ef tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:39.060632 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-1dbe956d-eb3f-4dac-ab2e-3063396dc1ef tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:39.066161 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1dbe956d-eb3f-4dac-ab2e-3063396dc1ef tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:39.066604 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1dbe956d-eb3f-4dac-ab2e-3063396dc1ef tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:39.067354 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1dbe956d-eb3f-4dac-ab2e-3063396dc1ef tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:39.067790 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1dbe956d-eb3f-4dac-ab2e-3063396dc1ef tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:39.096176 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-1dbe956d-eb3f-4dac-ab2e-3063396dc1ef tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040102 Jun 17 15:17:39.096757 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 495/820] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:17:39 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:17:39.187465 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-ea7dc805-1be1-427b-a068-b5cbc18110d0 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:39.188002 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-ea7dc805-1be1-427b-a068-b5cbc18110d0 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:39.193956 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ea7dc805-1be1-427b-a068-b5cbc18110d0 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:39.194403 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ea7dc805-1be1-427b-a068-b5cbc18110d0 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:39.195158 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ea7dc805-1be1-427b-a068-b5cbc18110d0 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:39.195594 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ea7dc805-1be1-427b-a068-b5cbc18110d0 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:39.258664 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-ea7dc805-1be1-427b-a068-b5cbc18110d0 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:17:39.266062 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-ea7dc805-1be1-427b-a068-b5cbc18110d0 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.082606 Jun 17 15:17:39.266607 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 496/821] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:17:39 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:17:40.028113 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-a8e4471e-3009-4b59-b626-081e74baa21d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:40.028837 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-a8e4471e-3009-4b59-b626-081e74baa21d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:40.035415 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a8e4471e-3009-4b59-b626-081e74baa21d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:40.035855 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a8e4471e-3009-4b59-b626-081e74baa21d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:40.036645 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a8e4471e-3009-4b59-b626-081e74baa21d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:40.037101 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a8e4471e-3009-4b59-b626-081e74baa21d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:40.170001 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-a8e4471e-3009-4b59-b626-081e74baa21d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:17:40.177879 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-a8e4471e-3009-4b59-b626-081e74baa21d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.153658 Jun 17 15:17:40.178438 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 497/822] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:17:40 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:17:40.183086 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-d03f342c-1ced-43b9-8936-46afd94d13e6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:40.184021 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-d03f342c-1ced-43b9-8936-46afd94d13e6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:40.190608 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d03f342c-1ced-43b9-8936-46afd94d13e6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:40.191042 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d03f342c-1ced-43b9-8936-46afd94d13e6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:40.191798 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d03f342c-1ced-43b9-8936-46afd94d13e6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:40.192219 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d03f342c-1ced-43b9-8936-46afd94d13e6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:40.208561 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=100 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:17:40.221471 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-d03f342c-1ced-43b9-8936-46afd94d13e6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042005 Jun 17 15:17:40.222026 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 498/823] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:17:40 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:17:40.226613 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-732dadbd-47cf-48f8-afa8-1d8ff809a88f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:40.227518 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-732dadbd-47cf-48f8-afa8-1d8ff809a88f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:40.234384 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-732dadbd-47cf-48f8-afa8-1d8ff809a88f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:40.234830 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-732dadbd-47cf-48f8-afa8-1d8ff809a88f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:40.235595 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-732dadbd-47cf-48f8-afa8-1d8ff809a88f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:40.236028 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-732dadbd-47cf-48f8-afa8-1d8ff809a88f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:40.264872 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-732dadbd-47cf-48f8-afa8-1d8ff809a88f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041781 Jun 17 15:17:40.265505 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 499/824] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:17:40 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:17:40.282387 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-9ac4de87-07dd-4022-925e-6b417cc65db4 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:40.282924 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-9ac4de87-07dd-4022-925e-6b417cc65db4 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:40.288876 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9ac4de87-07dd-4022-925e-6b417cc65db4 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:40.289336 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9ac4de87-07dd-4022-925e-6b417cc65db4 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:40.290092 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9ac4de87-07dd-4022-925e-6b417cc65db4 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:40.290522 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9ac4de87-07dd-4022-925e-6b417cc65db4 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:40.352997 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-9ac4de87-07dd-4022-925e-6b417cc65db4 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:17:40.361827 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-9ac4de87-07dd-4022-925e-6b417cc65db4 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.083258 Jun 17 15:17:40.362393 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 500/825] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:17:40 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:17:41.196249 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-4b884b54-88f6-4e0c-87e4-192e520bc0df tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:41.196908 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-4b884b54-88f6-4e0c-87e4-192e520bc0df tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:41.203903 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4b884b54-88f6-4e0c-87e4-192e520bc0df tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:41.204382 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4b884b54-88f6-4e0c-87e4-192e520bc0df tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:41.205246 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4b884b54-88f6-4e0c-87e4-192e520bc0df tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:41.205682 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4b884b54-88f6-4e0c-87e4-192e520bc0df tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:41.335829 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-4b884b54-88f6-4e0c-87e4-192e520bc0df tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:17:41.343597 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-4b884b54-88f6-4e0c-87e4-192e520bc0df tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.151304 Jun 17 15:17:41.344161 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 501/826] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:17:41 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:17:41.348875 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-592e2cbd-9142-4754-95f5-cc679110adef tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:41.349796 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-592e2cbd-9142-4754-95f5-cc679110adef tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:41.355824 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-592e2cbd-9142-4754-95f5-cc679110adef tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:41.356277 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-592e2cbd-9142-4754-95f5-cc679110adef tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:41.357076 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-592e2cbd-9142-4754-95f5-cc679110adef tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:41.357514 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-592e2cbd-9142-4754-95f5-cc679110adef tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:41.386468 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-592e2cbd-9142-4754-95f5-cc679110adef tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041254 Jun 17 15:17:41.387020 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 502/827] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:17:41 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:17:41.392242 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-f01fb147-cfe5-48f4-b3f6-c1efb8591af6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:41.393161 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-f01fb147-cfe5-48f4-b3f6-c1efb8591af6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:41.398734 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f01fb147-cfe5-48f4-b3f6-c1efb8591af6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:41.399185 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f01fb147-cfe5-48f4-b3f6-c1efb8591af6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:41.399945 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f01fb147-cfe5-48f4-b3f6-c1efb8591af6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:41.400412 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f01fb147-cfe5-48f4-b3f6-c1efb8591af6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:41.428114 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-f01fb147-cfe5-48f4-b3f6-c1efb8591af6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040010 Jun 17 15:17:41.428690 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 503/828] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:17:41 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:17:41.433231 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-d922e0a3-7aea-414f-8850-ae8899457131 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:41.433876 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-d922e0a3-7aea-414f-8850-ae8899457131 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:41.439855 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d922e0a3-7aea-414f-8850-ae8899457131 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:41.440306 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d922e0a3-7aea-414f-8850-ae8899457131 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:41.441093 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d922e0a3-7aea-414f-8850-ae8899457131 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:41.441563 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d922e0a3-7aea-414f-8850-ae8899457131 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:41.501910 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-d922e0a3-7aea-414f-8850-ae8899457131 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:17:41.509594 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-d922e0a3-7aea-414f-8850-ae8899457131 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.079931 Jun 17 15:17:41.510184 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 504/829] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:17:41 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:17:42.360597 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-3760ba1c-b7b1-461a-aa8c-a1f126b073b3 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:42.361273 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-3760ba1c-b7b1-461a-aa8c-a1f126b073b3 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:42.367722 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3760ba1c-b7b1-461a-aa8c-a1f126b073b3 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:42.368170 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3760ba1c-b7b1-461a-aa8c-a1f126b073b3 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:42.368968 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3760ba1c-b7b1-461a-aa8c-a1f126b073b3 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:42.369401 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3760ba1c-b7b1-461a-aa8c-a1f126b073b3 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:42.505264 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-3760ba1c-b7b1-461a-aa8c-a1f126b073b3 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:17:42.512790 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-3760ba1c-b7b1-461a-aa8c-a1f126b073b3 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.156669 Jun 17 15:17:42.513353 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 505/830] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:17:42 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:17:42.518513 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-17b6915a-47b3-43cd-9d12-8554d223bd39 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:42.519422 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-17b6915a-47b3-43cd-9d12-8554d223bd39 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:42.525424 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-17b6915a-47b3-43cd-9d12-8554d223bd39 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:42.525874 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-17b6915a-47b3-43cd-9d12-8554d223bd39 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:42.526643 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-17b6915a-47b3-43cd-9d12-8554d223bd39 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:42.527083 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-17b6915a-47b3-43cd-9d12-8554d223bd39 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:42.556514 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-17b6915a-47b3-43cd-9d12-8554d223bd39 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042078 Jun 17 15:17:42.557081 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 506/831] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:17:42 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:17:42.561867 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-cc3cd38f-bc67-4f7f-b05e-64bf4014a8f5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:42.562768 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-cc3cd38f-bc67-4f7f-b05e-64bf4014a8f5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:42.568789 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cc3cd38f-bc67-4f7f-b05e-64bf4014a8f5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:42.569234 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cc3cd38f-bc67-4f7f-b05e-64bf4014a8f5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:42.569992 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cc3cd38f-bc67-4f7f-b05e-64bf4014a8f5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:42.570421 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cc3cd38f-bc67-4f7f-b05e-64bf4014a8f5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:42.600153 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-cc3cd38f-bc67-4f7f-b05e-64bf4014a8f5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042036 Jun 17 15:17:42.600740 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 507/832] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:17:42 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:17:42.605089 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-12fb4d0d-c7e0-4cad-a2b2-7faef5c20263 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:42.605676 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-12fb4d0d-c7e0-4cad-a2b2-7faef5c20263 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:42.611392 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-12fb4d0d-c7e0-4cad-a2b2-7faef5c20263 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:42.611767 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-12fb4d0d-c7e0-4cad-a2b2-7faef5c20263 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:42.612550 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-12fb4d0d-c7e0-4cad-a2b2-7faef5c20263 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:42.612990 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-12fb4d0d-c7e0-4cad-a2b2-7faef5c20263 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:42.676525 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-12fb4d0d-c7e0-4cad-a2b2-7faef5c20263 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:17:42.684090 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-12fb4d0d-c7e0-4cad-a2b2-7faef5c20263 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.082415 Jun 17 15:17:42.684675 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 508/833] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:17:42 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:17:43.530354 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-c97d49c3-ed29-4287-b15e-7af156516259 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:43.531487 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-c97d49c3-ed29-4287-b15e-7af156516259 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:43.533814 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_api:SELECT=100 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:17:43.539181 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c97d49c3-ed29-4287-b15e-7af156516259 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:43.539627 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c97d49c3-ed29-4287-b15e-7af156516259 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:43.540422 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c97d49c3-ed29-4287-b15e-7af156516259 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:43.540855 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c97d49c3-ed29-4287-b15e-7af156516259 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:43.674012 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-c97d49c3-ed29-4287-b15e-7af156516259 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:17:43.681552 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-c97d49c3-ed29-4287-b15e-7af156516259 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.155175 Jun 17 15:17:43.682115 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 509/834] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:17:43 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:17:43.686693 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-9194b5b5-15f8-424a-8c30-286c6bfebfcb tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:43.687665 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-9194b5b5-15f8-424a-8c30-286c6bfebfcb tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:43.693637 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9194b5b5-15f8-424a-8c30-286c6bfebfcb tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:43.694081 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9194b5b5-15f8-424a-8c30-286c6bfebfcb tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:43.694876 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9194b5b5-15f8-424a-8c30-286c6bfebfcb tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:43.695316 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9194b5b5-15f8-424a-8c30-286c6bfebfcb tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:43.724576 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-9194b5b5-15f8-424a-8c30-286c6bfebfcb tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041388 Jun 17 15:17:43.725133 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 510/835] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:17:43 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:17:43.729693 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-17c63140-7ff2-431c-8c17-878b9de1c25b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:43.730584 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-17c63140-7ff2-431c-8c17-878b9de1c25b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:43.736968 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-17c63140-7ff2-431c-8c17-878b9de1c25b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:43.737415 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-17c63140-7ff2-431c-8c17-878b9de1c25b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:43.738183 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-17c63140-7ff2-431c-8c17-878b9de1c25b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:43.738623 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-17c63140-7ff2-431c-8c17-878b9de1c25b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:43.771129 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-17c63140-7ff2-431c-8c17-878b9de1c25b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044909 Jun 17 15:17:43.771714 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 511/836] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:17:43 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:17:43.776490 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-ccc95e9d-6bea-48b2-900c-0800c9ba72e5 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:43.777109 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-ccc95e9d-6bea-48b2-900c-0800c9ba72e5 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:43.784516 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ccc95e9d-6bea-48b2-900c-0800c9ba72e5 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:43.784879 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ccc95e9d-6bea-48b2-900c-0800c9ba72e5 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:43.785661 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ccc95e9d-6bea-48b2-900c-0800c9ba72e5 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:43.786180 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ccc95e9d-6bea-48b2-900c-0800c9ba72e5 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:43.850802 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-ccc95e9d-6bea-48b2-900c-0800c9ba72e5 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:17:43.858601 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-ccc95e9d-6bea-48b2-900c-0800c9ba72e5 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.085817 Jun 17 15:17:43.859773 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 512/837] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:17:43 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:17:44.699121 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-eebf8198-b836-482e-a05e-a990ffeb7fd1 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:44.699766 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-eebf8198-b836-482e-a05e-a990ffeb7fd1 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:44.706303 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-eebf8198-b836-482e-a05e-a990ffeb7fd1 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:44.706751 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-eebf8198-b836-482e-a05e-a990ffeb7fd1 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:44.707516 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-eebf8198-b836-482e-a05e-a990ffeb7fd1 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:44.707953 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-eebf8198-b836-482e-a05e-a990ffeb7fd1 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:44.841683 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-eebf8198-b836-482e-a05e-a990ffeb7fd1 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:17:44.849228 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-eebf8198-b836-482e-a05e-a990ffeb7fd1 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.154125 Jun 17 15:17:44.849782 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 513/838] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:17:44 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:17:44.854317 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-7bd78ba8-9e5c-4529-af10-ceec501deee7 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:44.855214 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-7bd78ba8-9e5c-4529-af10-ceec501deee7 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:44.861553 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7bd78ba8-9e5c-4529-af10-ceec501deee7 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:44.861993 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7bd78ba8-9e5c-4529-af10-ceec501deee7 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:44.862747 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7bd78ba8-9e5c-4529-af10-ceec501deee7 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:44.863174 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7bd78ba8-9e5c-4529-af10-ceec501deee7 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:44.892576 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-7bd78ba8-9e5c-4529-af10-ceec501deee7 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041727 Jun 17 15:17:44.893133 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 514/839] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:17:44 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:17:44.897666 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-feea632c-1344-45de-ae2f-51fffd45025d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:44.898552 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-feea632c-1344-45de-ae2f-51fffd45025d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:44.904209 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-feea632c-1344-45de-ae2f-51fffd45025d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:44.904681 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-feea632c-1344-45de-ae2f-51fffd45025d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:44.905744 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-feea632c-1344-45de-ae2f-51fffd45025d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:44.906174 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-feea632c-1344-45de-ae2f-51fffd45025d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:44.909700 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=100 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:17:44.936282 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-feea632c-1344-45de-ae2f-51fffd45025d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042117 Jun 17 15:17:44.941532 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 515/840] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:17:44 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:17:44.942434 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-5fac9f0f-a988-4221-a0ab-ededdfe57341 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:44.943037 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-5fac9f0f-a988-4221-a0ab-ededdfe57341 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:44.948878 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5fac9f0f-a988-4221-a0ab-ededdfe57341 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:44.949378 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5fac9f0f-a988-4221-a0ab-ededdfe57341 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:44.950082 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5fac9f0f-a988-4221-a0ab-ededdfe57341 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:44.950512 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5fac9f0f-a988-4221-a0ab-ededdfe57341 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:45.011749 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-5fac9f0f-a988-4221-a0ab-ededdfe57341 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:17:45.019271 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-5fac9f0f-a988-4221-a0ab-ededdfe57341 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.080558 Jun 17 15:17:45.019830 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 516/841] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:17:44 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:17:45.865832 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-2544aa49-eca1-4113-83cf-0c5128447f3f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:45.866521 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-2544aa49-eca1-4113-83cf-0c5128447f3f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:45.873184 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2544aa49-eca1-4113-83cf-0c5128447f3f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:45.873622 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2544aa49-eca1-4113-83cf-0c5128447f3f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:45.874874 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2544aa49-eca1-4113-83cf-0c5128447f3f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:45.875303 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2544aa49-eca1-4113-83cf-0c5128447f3f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:46.009593 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-2544aa49-eca1-4113-83cf-0c5128447f3f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:17:46.018009 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-2544aa49-eca1-4113-83cf-0c5128447f3f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.156031 Jun 17 15:17:46.018572 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 517/842] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:17:45 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:17:46.023169 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-ca24050b-0aa1-4cc7-a745-7dbd089a4718 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:46.024079 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-ca24050b-0aa1-4cc7-a745-7dbd089a4718 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:46.029975 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ca24050b-0aa1-4cc7-a745-7dbd089a4718 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:46.030423 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ca24050b-0aa1-4cc7-a745-7dbd089a4718 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:46.031191 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ca24050b-0aa1-4cc7-a745-7dbd089a4718 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:46.031625 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ca24050b-0aa1-4cc7-a745-7dbd089a4718 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:46.060859 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-ca24050b-0aa1-4cc7-a745-7dbd089a4718 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041184 Jun 17 15:17:46.061468 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 518/843] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:17:46 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:17:46.066780 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-dca84026-a34f-4e6e-9b38-48710f7e740f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:46.067682 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-dca84026-a34f-4e6e-9b38-48710f7e740f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:46.073549 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-dca84026-a34f-4e6e-9b38-48710f7e740f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:46.074002 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-dca84026-a34f-4e6e-9b38-48710f7e740f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:46.074769 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-dca84026-a34f-4e6e-9b38-48710f7e740f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:46.075206 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-dca84026-a34f-4e6e-9b38-48710f7e740f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:46.104847 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-dca84026-a34f-4e6e-9b38-48710f7e740f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041754 Jun 17 15:17:46.105412 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 519/844] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:17:46 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:17:46.109892 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-a43c74e5-9730-4682-afcf-19416ba991ef tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:46.110496 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-a43c74e5-9730-4682-afcf-19416ba991ef tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:46.116552 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a43c74e5-9730-4682-afcf-19416ba991ef tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:46.116940 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a43c74e5-9730-4682-afcf-19416ba991ef tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:46.117715 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a43c74e5-9730-4682-afcf-19416ba991ef tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:46.118144 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a43c74e5-9730-4682-afcf-19416ba991ef tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:46.196584 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-a43c74e5-9730-4682-afcf-19416ba991ef tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:17:46.204158 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-a43c74e5-9730-4682-afcf-19416ba991ef tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.097786 Jun 17 15:17:46.204740 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 520/845] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:17:46 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:17:47.035228 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-75fdab89-4981-4fe2-9257-7d2204050824 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:47.035993 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-75fdab89-4981-4fe2-9257-7d2204050824 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:47.042479 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-75fdab89-4981-4fe2-9257-7d2204050824 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:47.042968 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-75fdab89-4981-4fe2-9257-7d2204050824 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:47.043753 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-75fdab89-4981-4fe2-9257-7d2204050824 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:47.044187 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-75fdab89-4981-4fe2-9257-7d2204050824 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:47.175212 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-75fdab89-4981-4fe2-9257-7d2204050824 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:17:47.183308 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-75fdab89-4981-4fe2-9257-7d2204050824 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.151848 Jun 17 15:17:47.183870 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 521/846] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:17:47 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:17:47.189217 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-075a16f0-94cd-4566-8ea8-963b9502c254 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:47.190153 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-075a16f0-94cd-4566-8ea8-963b9502c254 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:47.196057 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-075a16f0-94cd-4566-8ea8-963b9502c254 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:47.196536 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-075a16f0-94cd-4566-8ea8-963b9502c254 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:47.197301 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-075a16f0-94cd-4566-8ea8-963b9502c254 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:47.197737 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-075a16f0-94cd-4566-8ea8-963b9502c254 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:47.226276 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-075a16f0-94cd-4566-8ea8-963b9502c254 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041255 Jun 17 15:17:47.226833 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 522/847] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:17:47 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:17:47.231443 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-d98c82b3-a256-465f-b894-664399b0bcc6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:47.232353 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-d98c82b3-a256-465f-b894-664399b0bcc6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:47.238671 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d98c82b3-a256-465f-b894-664399b0bcc6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:47.239117 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d98c82b3-a256-465f-b894-664399b0bcc6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:47.239872 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d98c82b3-a256-465f-b894-664399b0bcc6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:47.240306 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d98c82b3-a256-465f-b894-664399b0bcc6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:47.269300 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-d98c82b3-a256-465f-b894-664399b0bcc6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041444 Jun 17 15:17:47.269848 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 523/848] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:17:47 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:17:47.274129 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-3f15c108-2a4c-489b-ad20-ca1f275e8ed6 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:47.274724 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-3f15c108-2a4c-489b-ad20-ca1f275e8ed6 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:47.280164 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3f15c108-2a4c-489b-ad20-ca1f275e8ed6 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:47.281180 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3f15c108-2a4c-489b-ad20-ca1f275e8ed6 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:47.281930 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3f15c108-2a4c-489b-ad20-ca1f275e8ed6 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:47.282363 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3f15c108-2a4c-489b-ad20-ca1f275e8ed6 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:47.342273 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-3f15c108-2a4c-489b-ad20-ca1f275e8ed6 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:17:47.350555 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-3f15c108-2a4c-489b-ad20-ca1f275e8ed6 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.079709 Jun 17 15:17:47.351121 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 524/849] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:17:47 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:17:48.200801 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-24aa06b1-0a14-4d83-8a85-7d66550d3909 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:48.201455 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-24aa06b1-0a14-4d83-8a85-7d66550d3909 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:48.208541 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-24aa06b1-0a14-4d83-8a85-7d66550d3909 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:48.208983 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-24aa06b1-0a14-4d83-8a85-7d66550d3909 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:48.209742 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-24aa06b1-0a14-4d83-8a85-7d66550d3909 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:48.210174 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-24aa06b1-0a14-4d83-8a85-7d66550d3909 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:48.341945 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-24aa06b1-0a14-4d83-8a85-7d66550d3909 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:17:48.349547 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-24aa06b1-0a14-4d83-8a85-7d66550d3909 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.152678 Jun 17 15:17:48.350109 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 525/850] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:17:48 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:17:48.360255 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-8597ea55-1748-4191-b17d-b95673ea9fd8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:48.361144 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-8597ea55-1748-4191-b17d-b95673ea9fd8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:48.367334 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8597ea55-1748-4191-b17d-b95673ea9fd8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:48.367781 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8597ea55-1748-4191-b17d-b95673ea9fd8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:48.368583 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8597ea55-1748-4191-b17d-b95673ea9fd8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:48.369016 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8597ea55-1748-4191-b17d-b95673ea9fd8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:48.398672 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-8597ea55-1748-4191-b17d-b95673ea9fd8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047528 Jun 17 15:17:48.399231 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 526/851] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:17:48 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:17:48.403754 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-ec364497-97eb-409f-bb67-0d0db432978e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:48.404676 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-ec364497-97eb-409f-bb67-0d0db432978e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:48.410793 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ec364497-97eb-409f-bb67-0d0db432978e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:48.411239 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ec364497-97eb-409f-bb67-0d0db432978e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:48.411995 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ec364497-97eb-409f-bb67-0d0db432978e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:48.412461 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ec364497-97eb-409f-bb67-0d0db432978e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:48.442531 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-ec364497-97eb-409f-bb67-0d0db432978e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042269 Jun 17 15:17:48.443084 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 527/852] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:17:48 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:17:48.447443 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-a70f12d6-6913-48a4-8741-61b58cb0307d tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:48.448046 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-a70f12d6-6913-48a4-8741-61b58cb0307d tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:48.453770 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a70f12d6-6913-48a4-8741-61b58cb0307d tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:48.454213 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a70f12d6-6913-48a4-8741-61b58cb0307d tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:48.454970 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a70f12d6-6913-48a4-8741-61b58cb0307d tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:48.455399 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a70f12d6-6913-48a4-8741-61b58cb0307d tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:48.515526 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-a70f12d6-6913-48a4-8741-61b58cb0307d tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:17:48.523025 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-a70f12d6-6913-48a4-8741-61b58cb0307d tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.078993 Jun 17 15:17:48.523576 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 528/853] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:17:48 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:17:49.366921 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-74283e76-4726-4218-800d-abbd3b027e4f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:49.367606 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-74283e76-4726-4218-800d-abbd3b027e4f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:49.374267 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-74283e76-4726-4218-800d-abbd3b027e4f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:49.374725 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-74283e76-4726-4218-800d-abbd3b027e4f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:49.375493 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-74283e76-4726-4218-800d-abbd3b027e4f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:49.375930 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-74283e76-4726-4218-800d-abbd3b027e4f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:49.513270 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-74283e76-4726-4218-800d-abbd3b027e4f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:17:49.522034 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-74283e76-4726-4218-800d-abbd3b027e4f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.159021 Jun 17 15:17:49.522606 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 529/854] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:17:49 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:17:49.527296 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-f5f8ef54-1793-4ff1-b9ce-fac38811136d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:49.528198 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-f5f8ef54-1793-4ff1-b9ce-fac38811136d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:49.534894 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f5f8ef54-1793-4ff1-b9ce-fac38811136d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:49.535334 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f5f8ef54-1793-4ff1-b9ce-fac38811136d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:49.536097 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f5f8ef54-1793-4ff1-b9ce-fac38811136d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:49.536560 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f5f8ef54-1793-4ff1-b9ce-fac38811136d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:49.566094 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-f5f8ef54-1793-4ff1-b9ce-fac38811136d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042446 Jun 17 15:17:49.566646 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 530/855] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:17:49 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:17:49.571187 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-f71f648c-9b26-4f95-a561-7833835ac0e0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:49.572072 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-f71f648c-9b26-4f95-a561-7833835ac0e0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:49.578373 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f71f648c-9b26-4f95-a561-7833835ac0e0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:49.578811 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f71f648c-9b26-4f95-a561-7833835ac0e0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:49.579568 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f71f648c-9b26-4f95-a561-7833835ac0e0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:49.579989 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f71f648c-9b26-4f95-a561-7833835ac0e0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:49.604166 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=100 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:17:49.608956 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-f71f648c-9b26-4f95-a561-7833835ac0e0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041338 Jun 17 15:17:49.609532 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 531/856] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:17:49 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:17:49.614136 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-eda4700b-69a0-4981-ba6f-9254d0a3ac0a tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:49.614726 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-eda4700b-69a0-4981-ba6f-9254d0a3ac0a tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:49.620631 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-eda4700b-69a0-4981-ba6f-9254d0a3ac0a tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:49.621011 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-eda4700b-69a0-4981-ba6f-9254d0a3ac0a tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:49.621801 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-eda4700b-69a0-4981-ba6f-9254d0a3ac0a tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:49.622228 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-eda4700b-69a0-4981-ba6f-9254d0a3ac0a tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:49.686430 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-eda4700b-69a0-4981-ba6f-9254d0a3ac0a tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:17:49.694498 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-eda4700b-69a0-4981-ba6f-9254d0a3ac0a tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.084023 Jun 17 15:17:49.695059 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 532/857] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:17:49 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:17:50.539231 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-78c6333b-1b27-46b5-82d9-36454fef4848 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:50.539924 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-78c6333b-1b27-46b5-82d9-36454fef4848 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:50.547575 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-78c6333b-1b27-46b5-82d9-36454fef4848 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:50.548903 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-78c6333b-1b27-46b5-82d9-36454fef4848 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:50.548903 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-78c6333b-1b27-46b5-82d9-36454fef4848 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:50.550104 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-78c6333b-1b27-46b5-82d9-36454fef4848 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:50.690469 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-78c6333b-1b27-46b5-82d9-36454fef4848 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:17:50.698025 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-78c6333b-1b27-46b5-82d9-36454fef4848 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.162737 Jun 17 15:17:50.698589 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 533/858] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:17:50 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:17:50.703677 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-6d3e18a5-ed3a-4f8b-9bad-8b2708e32ebb tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:50.704602 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-6d3e18a5-ed3a-4f8b-9bad-8b2708e32ebb tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:50.710559 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6d3e18a5-ed3a-4f8b-9bad-8b2708e32ebb tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:50.711005 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6d3e18a5-ed3a-4f8b-9bad-8b2708e32ebb tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:50.711770 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6d3e18a5-ed3a-4f8b-9bad-8b2708e32ebb tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:50.712206 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6d3e18a5-ed3a-4f8b-9bad-8b2708e32ebb tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:50.741850 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-6d3e18a5-ed3a-4f8b-9bad-8b2708e32ebb tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042208 Jun 17 15:17:50.742414 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 534/859] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:17:50 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:17:50.747043 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-ad702bae-fe0c-4ab6-9eb4-e3e6d25c1518 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:50.747950 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-ad702bae-fe0c-4ab6-9eb4-e3e6d25c1518 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:50.753922 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ad702bae-fe0c-4ab6-9eb4-e3e6d25c1518 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:50.754368 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ad702bae-fe0c-4ab6-9eb4-e3e6d25c1518 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:50.755132 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ad702bae-fe0c-4ab6-9eb4-e3e6d25c1518 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:50.755564 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ad702bae-fe0c-4ab6-9eb4-e3e6d25c1518 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:50.785440 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-ad702bae-fe0c-4ab6-9eb4-e3e6d25c1518 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041971 Jun 17 15:17:50.785998 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 535/860] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:17:50 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:17:50.790405 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-e4b24973-c515-421c-abf6-7e717bc10e5b tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:50.791003 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-e4b24973-c515-421c-abf6-7e717bc10e5b tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:50.796855 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e4b24973-c515-421c-abf6-7e717bc10e5b tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:50.797308 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e4b24973-c515-421c-abf6-7e717bc10e5b tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:50.798072 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e4b24973-c515-421c-abf6-7e717bc10e5b tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:50.798499 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e4b24973-c515-421c-abf6-7e717bc10e5b tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:50.860421 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-e4b24973-c515-421c-abf6-7e717bc10e5b tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:17:50.868113 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-e4b24973-c515-421c-abf6-7e717bc10e5b tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.081145 Jun 17 15:17:50.868708 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 536/861] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:17:50 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:17:51.714927 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-51167970-f9c2-4f03-ae4d-1a5815649991 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:51.715586 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-51167970-f9c2-4f03-ae4d-1a5815649991 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:51.723067 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-51167970-f9c2-4f03-ae4d-1a5815649991 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:51.723512 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-51167970-f9c2-4f03-ae4d-1a5815649991 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:51.724274 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-51167970-f9c2-4f03-ae4d-1a5815649991 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:51.724729 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-51167970-f9c2-4f03-ae4d-1a5815649991 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:51.860856 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-51167970-f9c2-4f03-ae4d-1a5815649991 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:17:51.868251 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-51167970-f9c2-4f03-ae4d-1a5815649991 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.157220 Jun 17 15:17:51.868849 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 537/862] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:17:51 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:17:51.873388 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-78ac4457-2e5b-4090-8645-bed952698c91 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:51.874886 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-78ac4457-2e5b-4090-8645-bed952698c91 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:51.880862 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-78ac4457-2e5b-4090-8645-bed952698c91 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:51.881305 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-78ac4457-2e5b-4090-8645-bed952698c91 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:51.882067 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-78ac4457-2e5b-4090-8645-bed952698c91 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:51.882503 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-78ac4457-2e5b-4090-8645-bed952698c91 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:51.911359 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-78ac4457-2e5b-4090-8645-bed952698c91 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041469 Jun 17 15:17:51.911922 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 538/863] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:17:51 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:17:51.916545 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-0c310a7f-8c8a-4e52-bd0d-beb630d36f30 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:51.917473 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-0c310a7f-8c8a-4e52-bd0d-beb630d36f30 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:51.923236 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0c310a7f-8c8a-4e52-bd0d-beb630d36f30 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:51.923684 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0c310a7f-8c8a-4e52-bd0d-beb630d36f30 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:51.924480 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0c310a7f-8c8a-4e52-bd0d-beb630d36f30 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:51.924910 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0c310a7f-8c8a-4e52-bd0d-beb630d36f30 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:51.953883 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-0c310a7f-8c8a-4e52-bd0d-beb630d36f30 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040811 Jun 17 15:17:51.954356 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 539/864] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:17:51 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:17:51.958788 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-05eb61d5-0868-4baf-9c51-8e5ed769d398 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:51.959387 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-05eb61d5-0868-4baf-9c51-8e5ed769d398 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:51.965199 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-05eb61d5-0868-4baf-9c51-8e5ed769d398 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:51.965647 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-05eb61d5-0868-4baf-9c51-8e5ed769d398 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:51.966658 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-05eb61d5-0868-4baf-9c51-8e5ed769d398 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:51.967093 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-05eb61d5-0868-4baf-9c51-8e5ed769d398 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:52.028144 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-05eb61d5-0868-4baf-9c51-8e5ed769d398 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:17:52.036072 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-05eb61d5-0868-4baf-9c51-8e5ed769d398 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.080689 Jun 17 15:17:52.036686 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 540/865] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:17:51 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:17:52.885598 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-5486c762-86bb-4b51-b324-77876c9ff6d3 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:52.886277 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-5486c762-86bb-4b51-b324-77876c9ff6d3 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:52.893698 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5486c762-86bb-4b51-b324-77876c9ff6d3 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:52.894154 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5486c762-86bb-4b51-b324-77876c9ff6d3 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:52.894933 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5486c762-86bb-4b51-b324-77876c9ff6d3 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:52.895368 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5486c762-86bb-4b51-b324-77876c9ff6d3 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:53.043200 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-5486c762-86bb-4b51-b324-77876c9ff6d3 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:17:53.058950 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-5486c762-86bb-4b51-b324-77876c9ff6d3 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.177199 Jun 17 15:17:53.059571 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 541/866] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:17:52 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:17:53.066349 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-f27152e7-8ea7-4e98-95b3-87ea1d851bcf tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:53.067377 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-f27152e7-8ea7-4e98-95b3-87ea1d851bcf tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:53.075229 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f27152e7-8ea7-4e98-95b3-87ea1d851bcf tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:53.075676 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f27152e7-8ea7-4e98-95b3-87ea1d851bcf tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:53.076683 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f27152e7-8ea7-4e98-95b3-87ea1d851bcf tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:53.077235 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f27152e7-8ea7-4e98-95b3-87ea1d851bcf tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:53.111766 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-f27152e7-8ea7-4e98-95b3-87ea1d851bcf tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050885 Jun 17 15:17:53.112478 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 542/867] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:17:53 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:17:53.117105 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-1097e37d-b8a5-4df9-8a5a-e47e0830c6b2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:53.117972 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-1097e37d-b8a5-4df9-8a5a-e47e0830c6b2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:53.123792 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1097e37d-b8a5-4df9-8a5a-e47e0830c6b2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:53.124991 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1097e37d-b8a5-4df9-8a5a-e47e0830c6b2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:53.125908 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1097e37d-b8a5-4df9-8a5a-e47e0830c6b2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:53.126336 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1097e37d-b8a5-4df9-8a5a-e47e0830c6b2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:53.161015 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-1097e37d-b8a5-4df9-8a5a-e47e0830c6b2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047330 Jun 17 15:17:53.161497 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 543/868] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:17:53 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:17:53.166411 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-8b5e2df2-13fd-42f4-8b2b-f6a34d328f61 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:53.167128 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-8b5e2df2-13fd-42f4-8b2b-f6a34d328f61 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:53.174841 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8b5e2df2-13fd-42f4-8b2b-f6a34d328f61 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:53.175343 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8b5e2df2-13fd-42f4-8b2b-f6a34d328f61 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:53.180004 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8b5e2df2-13fd-42f4-8b2b-f6a34d328f61 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:53.180004 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8b5e2df2-13fd-42f4-8b2b-f6a34d328f61 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:53.251892 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-8b5e2df2-13fd-42f4-8b2b-f6a34d328f61 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:17:53.259738 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-8b5e2df2-13fd-42f4-8b2b-f6a34d328f61 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.097131 Jun 17 15:17:53.260311 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 544/869] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:17:53 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:17:54.078568 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-35193e1f-4f80-49dd-9724-38bff1cf81dc tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:54.079288 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-35193e1f-4f80-49dd-9724-38bff1cf81dc tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:54.086736 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-35193e1f-4f80-49dd-9724-38bff1cf81dc tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:54.087199 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-35193e1f-4f80-49dd-9724-38bff1cf81dc tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:54.088063 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-35193e1f-4f80-49dd-9724-38bff1cf81dc tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:54.088602 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-35193e1f-4f80-49dd-9724-38bff1cf81dc tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:54.242091 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-35193e1f-4f80-49dd-9724-38bff1cf81dc tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:17:54.252887 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-35193e1f-4f80-49dd-9724-38bff1cf81dc tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.178864 Jun 17 15:17:54.253606 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 545/870] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:17:54 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:17:54.259417 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-073a6fc2-f359-4a77-9681-f3d34b3c058d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:54.260518 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-073a6fc2-f359-4a77-9681-f3d34b3c058d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:54.268993 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-073a6fc2-f359-4a77-9681-f3d34b3c058d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:54.269448 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-073a6fc2-f359-4a77-9681-f3d34b3c058d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:54.270231 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-073a6fc2-f359-4a77-9681-f3d34b3c058d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:54.270661 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-073a6fc2-f359-4a77-9681-f3d34b3c058d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:54.303999 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-073a6fc2-f359-4a77-9681-f3d34b3c058d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049232 Jun 17 15:17:54.304719 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 546/871] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:17:54 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:17:54.310136 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-d87d228e-5329-42fc-a6f2-291b60e6bb54 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:54.311069 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-d87d228e-5329-42fc-a6f2-291b60e6bb54 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:54.318485 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d87d228e-5329-42fc-a6f2-291b60e6bb54 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:54.318934 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d87d228e-5329-42fc-a6f2-291b60e6bb54 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:54.319811 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d87d228e-5329-42fc-a6f2-291b60e6bb54 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:54.320245 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d87d228e-5329-42fc-a6f2-291b60e6bb54 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:54.354874 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-d87d228e-5329-42fc-a6f2-291b60e6bb54 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048973 Jun 17 15:17:54.355479 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 547/872] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:17:54 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:17:54.360356 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-ddd01d15-7116-4123-be1f-5393ef7dad2a tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:54.360974 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-ddd01d15-7116-4123-be1f-5393ef7dad2a tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:54.367357 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ddd01d15-7116-4123-be1f-5393ef7dad2a tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:54.367934 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ddd01d15-7116-4123-be1f-5393ef7dad2a tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:54.368741 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ddd01d15-7116-4123-be1f-5393ef7dad2a tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:54.369199 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ddd01d15-7116-4123-be1f-5393ef7dad2a tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:54.391548 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=100 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:17:54.442254 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-ddd01d15-7116-4123-be1f-5393ef7dad2a tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:17:54.450073 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-ddd01d15-7116-4123-be1f-5393ef7dad2a tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.093586 Jun 17 15:17:54.450678 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 548/873] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:17:54 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:17:55.272551 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-3ca99f6d-5b77-43d7-b0af-3ae35629f477 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:55.273399 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-3ca99f6d-5b77-43d7-b0af-3ae35629f477 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:55.283624 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3ca99f6d-5b77-43d7-b0af-3ae35629f477 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:55.284147 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3ca99f6d-5b77-43d7-b0af-3ae35629f477 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:55.285183 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3ca99f6d-5b77-43d7-b0af-3ae35629f477 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:55.285892 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3ca99f6d-5b77-43d7-b0af-3ae35629f477 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:55.426595 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-3ca99f6d-5b77-43d7-b0af-3ae35629f477 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:17:55.434353 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-3ca99f6d-5b77-43d7-b0af-3ae35629f477 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.166095 Jun 17 15:17:55.434926 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 549/874] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:17:55 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:17:55.439739 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-171ad6e7-de1a-4fd8-a919-9e60f661ee9b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:55.440683 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-171ad6e7-de1a-4fd8-a919-9e60f661ee9b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:55.447938 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-171ad6e7-de1a-4fd8-a919-9e60f661ee9b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:55.448575 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-171ad6e7-de1a-4fd8-a919-9e60f661ee9b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:55.449469 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-171ad6e7-de1a-4fd8-a919-9e60f661ee9b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:55.450089 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-171ad6e7-de1a-4fd8-a919-9e60f661ee9b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:55.485732 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-171ad6e7-de1a-4fd8-a919-9e60f661ee9b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049742 Jun 17 15:17:55.486297 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 550/875] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:17:55 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:17:55.491060 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-d3fe9727-e197-4a10-b6bd-b603ccc8893a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:55.491947 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-d3fe9727-e197-4a10-b6bd-b603ccc8893a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:55.497801 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d3fe9727-e197-4a10-b6bd-b603ccc8893a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:55.498240 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d3fe9727-e197-4a10-b6bd-b603ccc8893a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:55.499038 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d3fe9727-e197-4a10-b6bd-b603ccc8893a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:55.499466 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d3fe9727-e197-4a10-b6bd-b603ccc8893a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:55.528848 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-d3fe9727-e197-4a10-b6bd-b603ccc8893a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041301 Jun 17 15:17:55.529321 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 551/876] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:17:55 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:17:55.534405 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-cdfcfdf9-1b2b-4bdf-ad56-cb6755568d30 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:55.535006 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-cdfcfdf9-1b2b-4bdf-ad56-cb6755568d30 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:55.540893 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cdfcfdf9-1b2b-4bdf-ad56-cb6755568d30 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:55.541336 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cdfcfdf9-1b2b-4bdf-ad56-cb6755568d30 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:55.542094 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cdfcfdf9-1b2b-4bdf-ad56-cb6755568d30 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:55.542521 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cdfcfdf9-1b2b-4bdf-ad56-cb6755568d30 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:55.607096 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-cdfcfdf9-1b2b-4bdf-ad56-cb6755568d30 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:17:55.616166 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-cdfcfdf9-1b2b-4bdf-ad56-cb6755568d30 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.085858 Jun 17 15:17:55.616860 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 552/877] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:17:55 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:17:56.451420 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-b2ab0ad5-17f6-49cf-81ec-757ff86c096b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:56.452062 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-b2ab0ad5-17f6-49cf-81ec-757ff86c096b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:56.458807 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b2ab0ad5-17f6-49cf-81ec-757ff86c096b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:56.459261 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b2ab0ad5-17f6-49cf-81ec-757ff86c096b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:56.460062 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b2ab0ad5-17f6-49cf-81ec-757ff86c096b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:56.460544 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b2ab0ad5-17f6-49cf-81ec-757ff86c096b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:56.590624 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-b2ab0ad5-17f6-49cf-81ec-757ff86c096b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:17:56.599183 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-b2ab0ad5-17f6-49cf-81ec-757ff86c096b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.151751 Jun 17 15:17:56.599781 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 553/878] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:17:56 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:17:56.604858 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-07f05bb0-8cd1-480c-a0a3-7c50171cf8df tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:56.605806 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-07f05bb0-8cd1-480c-a0a3-7c50171cf8df tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:56.612226 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-07f05bb0-8cd1-480c-a0a3-7c50171cf8df tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:56.612694 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-07f05bb0-8cd1-480c-a0a3-7c50171cf8df tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:56.613464 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-07f05bb0-8cd1-480c-a0a3-7c50171cf8df tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:56.613896 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-07f05bb0-8cd1-480c-a0a3-7c50171cf8df tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:56.645462 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-07f05bb0-8cd1-480c-a0a3-7c50171cf8df tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044555 Jun 17 15:17:56.646052 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 554/879] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:17:56 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:17:56.651070 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-09ac0ea4-5d11-449d-ba18-512cd77ceb12 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:56.651998 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-09ac0ea4-5d11-449d-ba18-512cd77ceb12 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:56.658657 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-09ac0ea4-5d11-449d-ba18-512cd77ceb12 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:56.659106 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-09ac0ea4-5d11-449d-ba18-512cd77ceb12 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:56.659886 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-09ac0ea4-5d11-449d-ba18-512cd77ceb12 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:56.660318 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-09ac0ea4-5d11-449d-ba18-512cd77ceb12 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:56.693100 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-09ac0ea4-5d11-449d-ba18-512cd77ceb12 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045942 Jun 17 15:17:56.693682 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 555/880] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:17:56 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:17:56.698190 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-24589a29-20ff-4236-b5f9-a896952db9d8 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:56.698789 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-24589a29-20ff-4236-b5f9-a896952db9d8 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:56.704777 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-24589a29-20ff-4236-b5f9-a896952db9d8 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:56.705188 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-24589a29-20ff-4236-b5f9-a896952db9d8 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:56.705941 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-24589a29-20ff-4236-b5f9-a896952db9d8 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:56.706366 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-24589a29-20ff-4236-b5f9-a896952db9d8 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:56.771806 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-24589a29-20ff-4236-b5f9-a896952db9d8 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:17:56.779605 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-24589a29-20ff-4236-b5f9-a896952db9d8 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.084898 Jun 17 15:17:56.780155 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 556/881] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:17:56 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:17:57.617236 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-1370e77d-02f8-4a35-b6ad-1b077345be8d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:57.618033 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-1370e77d-02f8-4a35-b6ad-1b077345be8d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:57.625460 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1370e77d-02f8-4a35-b6ad-1b077345be8d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:57.625919 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1370e77d-02f8-4a35-b6ad-1b077345be8d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:57.626698 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1370e77d-02f8-4a35-b6ad-1b077345be8d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:57.627138 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1370e77d-02f8-4a35-b6ad-1b077345be8d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:57.763052 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-1370e77d-02f8-4a35-b6ad-1b077345be8d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:17:57.770609 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-1370e77d-02f8-4a35-b6ad-1b077345be8d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.157389 Jun 17 15:17:57.771169 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 557/882] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:17:57 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:17:57.775842 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-fd8212e1-f2ad-4e2f-8844-1be754cff49e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:57.776785 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-fd8212e1-f2ad-4e2f-8844-1be754cff49e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:57.783391 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fd8212e1-f2ad-4e2f-8844-1be754cff49e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:57.783839 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fd8212e1-f2ad-4e2f-8844-1be754cff49e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:57.784660 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fd8212e1-f2ad-4e2f-8844-1be754cff49e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:57.785093 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fd8212e1-f2ad-4e2f-8844-1be754cff49e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:57.814587 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-fd8212e1-f2ad-4e2f-8844-1be754cff49e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042369 Jun 17 15:17:57.815151 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 558/883] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:17:57 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:17:57.819707 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-7cc05799-5739-44ab-92b4-d44fbfca6b0a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:57.820640 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-7cc05799-5739-44ab-92b4-d44fbfca6b0a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:57.822273 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_api:SELECT=100 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:17:57.827515 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7cc05799-5739-44ab-92b4-d44fbfca6b0a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:57.827958 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7cc05799-5739-44ab-92b4-d44fbfca6b0a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:57.828755 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7cc05799-5739-44ab-92b4-d44fbfca6b0a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:57.829188 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7cc05799-5739-44ab-92b4-d44fbfca6b0a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:57.859151 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-7cc05799-5739-44ab-92b4-d44fbfca6b0a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042339 Jun 17 15:17:57.859714 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 559/884] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:17:57 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:17:57.864126 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-6e861faa-28eb-4276-9efd-9c1094f3910b tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:57.864759 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-6e861faa-28eb-4276-9efd-9c1094f3910b tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:57.870590 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6e861faa-28eb-4276-9efd-9c1094f3910b tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:57.871033 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6e861faa-28eb-4276-9efd-9c1094f3910b tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:57.871800 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6e861faa-28eb-4276-9efd-9c1094f3910b tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:57.872230 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6e861faa-28eb-4276-9efd-9c1094f3910b tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:57.934333 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-6e861faa-28eb-4276-9efd-9c1094f3910b tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:17:57.942168 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-6e861faa-28eb-4276-9efd-9c1094f3910b tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.081439 Jun 17 15:17:57.942730 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 560/885] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:17:57 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:17:58.787875 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-83f6cf01-8ff3-4d38-bf44-522a91ad0fdf tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:58.788604 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-83f6cf01-8ff3-4d38-bf44-522a91ad0fdf tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:58.795284 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-83f6cf01-8ff3-4d38-bf44-522a91ad0fdf tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:58.795736 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-83f6cf01-8ff3-4d38-bf44-522a91ad0fdf tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:58.796627 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-83f6cf01-8ff3-4d38-bf44-522a91ad0fdf tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:58.797100 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-83f6cf01-8ff3-4d38-bf44-522a91ad0fdf tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:58.957047 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-83f6cf01-8ff3-4d38-bf44-522a91ad0fdf tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:17:58.966371 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-83f6cf01-8ff3-4d38-bf44-522a91ad0fdf tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.182177 Jun 17 15:17:58.967077 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 561/886] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:17:58 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:17:58.972682 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-5f1ba6a8-0606-4d71-989b-563a71108ab8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:58.973626 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-5f1ba6a8-0606-4d71-989b-563a71108ab8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:58.980467 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5f1ba6a8-0606-4d71-989b-563a71108ab8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:58.980917 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5f1ba6a8-0606-4d71-989b-563a71108ab8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:58.981704 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5f1ba6a8-0606-4d71-989b-563a71108ab8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:58.982135 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5f1ba6a8-0606-4d71-989b-563a71108ab8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:59.014247 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-5f1ba6a8-0606-4d71-989b-563a71108ab8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045780 Jun 17 15:17:59.015287 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 562/887] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:17:58 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:17:59.020406 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-59981d28-0705-485b-8ee1-287432076147 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:59.021326 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-59981d28-0705-485b-8ee1-287432076147 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:59.028029 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-59981d28-0705-485b-8ee1-287432076147 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:59.028511 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-59981d28-0705-485b-8ee1-287432076147 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:59.029282 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-59981d28-0705-485b-8ee1-287432076147 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:59.029715 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-59981d28-0705-485b-8ee1-287432076147 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:59.062157 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-59981d28-0705-485b-8ee1-287432076147 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045458 Jun 17 15:17:59.062643 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 563/888] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:17:59 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:17:59.067296 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-1c9ab887-d5a8-4ab1-be27-462e71d52c81 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:59.067883 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-1c9ab887-d5a8-4ab1-be27-462e71d52c81 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:59.074232 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1c9ab887-d5a8-4ab1-be27-462e71d52c81 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:59.074680 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1c9ab887-d5a8-4ab1-be27-462e71d52c81 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:59.075762 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1c9ab887-d5a8-4ab1-be27-462e71d52c81 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:59.076199 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1c9ab887-d5a8-4ab1-be27-462e71d52c81 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:59.144220 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-1c9ab887-d5a8-4ab1-be27-462e71d52c81 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:17:59.152519 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-1c9ab887-d5a8-4ab1-be27-462e71d52c81 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.088768 Jun 17 15:17:59.153095 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 564/889] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:17:59 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:17:59.665081 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-1499edca-1705-4033-b7a1-b8f97ef1316e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:17:59.665605 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-1499edca-1705-4033-b7a1-b8f97ef1316e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:17:59.672188 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1499edca-1705-4033-b7a1-b8f97ef1316e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:59.672700 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1499edca-1705-4033-b7a1-b8f97ef1316e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:59.673580 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1499edca-1705-4033-b7a1-b8f97ef1316e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:17:59.674017 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1499edca-1705-4033-b7a1-b8f97ef1316e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:17:59.678166 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=100 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:18:09.669572 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_api:SELECT=13 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:18:09.693882 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=2 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:18:44.884664 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.wsgi [None req-d5f993ef-011c-4e1a-a815-9e99ebcd2ba9 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] HTTP exception thrown: Cannot 'detach_volume' instance ba5d3180-d42a-4678-af13-c99282e054bf while it is in vm_state rescued Jun 17 15:18:44.888538 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-d5f993ef-011c-4e1a-a815-9e99ebcd2ba9 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Request method failure captured: Jun 17 15:18:44.888538 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: request: DELETE /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments/713822dc-11e8-4f5c-ae7c-bcf41e01b06d HTTP/1.1 Jun 17 15:18:44.888538 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Accept: application/json Jun 17 15:18:44.888538 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Accept-Encoding: identity Jun 17 15:18:44.888538 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Connection: close Jun 17 15:18:44.888538 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Content-Length: 0 Jun 17 15:18:44.888538 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Content-Type: application/json Jun 17 15:18:44.888538 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Host: 10.222.0.48 Jun 17 15:18:44.888538 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Openstack-System-Scope: None Jun 17 15:18:44.888538 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: User-Agent: python-urllib3/1.26.9 Jun 17 15:18:44.888538 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Auth-Token: gAAAAABirJmQC7m757v9yyJD0BsI2MhqMNm1yc2WpkBWgAGOwCYW524pgy_6_7F6gBQez89A-LSNviRE5zDFwqgj2BZoXTsMX0NmzFHDYuHo31ibepKT71785ic3IrIvGY4IglQk81nqgsevYUUWYR-s69vMdAmv9JQXTwFMOwaCzN_3w4dwj6k Jun 17 15:18:44.888538 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Domain-Id: None Jun 17 15:18:44.888538 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Domain-Name: None Jun 17 15:18:44.888538 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Identity-Status: Confirmed Jun 17 15:18:44.888538 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Is-Admin-Project: True Jun 17 15:18:44.888538 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Domain-Id: default Jun 17 15:18:44.888538 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Domain-Name: Default Jun 17 15:18:44.888538 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Id: 50408ec18fa04036a0abb6236343e258 Jun 17 15:18:44.888538 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1478734135 Jun 17 15:18:44.888538 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Role: reader,member Jun 17 15:18:44.888538 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Roles: reader,member Jun 17 15:18:44.890147 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_50408ec18fa04036a0abb6236343e258", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/50408ec18fa04036a0abb6236343e258"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/50408ec18fa04036a0abb6236343e258"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/50408ec18fa04036a0abb6236343e258"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Jun 17 15:18:44.890147 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1478734135 Jun 17 15:18:44.890147 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant-Id: 50408ec18fa04036a0abb6236343e258 Jun 17 15:18:44.890147 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1478734135 Jun 17 15:18:44.890147 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User: tempest-ServerRescueNegativeTestJSON-1478734135-project Jun 17 15:18:44.890147 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Domain-Id: default Jun 17 15:18:44.890147 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Domain-Name: Default Jun 17 15:18:44.890147 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Id: 562485deaf214fa29eac132464ef93e3 Jun 17 15:18:44.890147 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1478734135-project Jun 17 15:18:44.890147 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: method: > Jun 17 15:18:44.890147 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: exception: Cannot 'detach_volume' instance ba5d3180-d42a-4678-af13-c99282e054bf while it is in vm_state rescued Jun 17 15:18:44.890884 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: action_args: {'server_id': 'ba5d3180-d42a-4678-af13-c99282e054bf', 'id': '713822dc-11e8-4f5c-ae7c-bcf41e01b06d'} Jun 17 15:18:44.890884 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 15:18:44.890884 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:18:44.890884 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 17 15:18:44.890884 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 17 15:18:44.890884 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 17 15:18:44.890884 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 15:18:44.890884 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 17 15:18:44.890884 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 17 15:18:44.890884 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ba5d3180-d42a-4678-af13-c99282e054bf in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 17 15:18:44.890884 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:18:44.890884 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:18:44.890884 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:18:44.890884 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:18:44.890884 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:18:44.890884 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:18:44.890884 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 15:18:44.890884 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 15:18:44.890884 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 15:18:44.890884 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 15:18:44.892410 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 17 15:18:44.892410 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 17 15:18:44.892410 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 17 15:18:44.892410 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 17 15:18:44.892410 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance ba5d3180-d42a-4678-af13-c99282e054bf while it is in vm_state rescued Jun 17 15:18:44.892410 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:18:44.892410 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:18:44.892410 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:18:44.892410 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:18:44.892410 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:18:44.892410 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:18:44.892410 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 15:18:44.892410 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 15:18:44.892410 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance ba5d3180-d42a-4678-af13-c99282e054bf while it is in vm_state rescued Jun 17 15:18:44.892410 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:18:44.892410 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-d5f993ef-011c-4e1a-a815-9e99ebcd2ba9 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Returning 409 to user: Cannot 'detach_volume' instance ba5d3180-d42a-4678-af13-c99282e054bf while it is in vm_state rescued {{(pid=117649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 15:18:44.893638 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-d5f993ef-011c-4e1a-a815-9e99ebcd2ba9 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "DELETE /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments/713822dc-11e8-4f5c-ae7c-bcf41e01b06d" status: 409 len: 152 microversion: 2.1 time: 105.288838 Jun 17 15:18:44.893638 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 326/890] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Jun 17 15:16:59 2022] DELETE /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments/713822dc-11e8-4f5c-ae7c-bcf41e01b06d => generated 152 bytes in 105291 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 17 15:18:45.031292 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-d485e353-d94f-43a9-b93e-adcc94f590d8 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:18:45.031915 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-d485e353-d94f-43a9-b93e-adcc94f590d8 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:18:45.039025 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d485e353-d94f-43a9-b93e-adcc94f590d8 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:18:45.039472 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d485e353-d94f-43a9-b93e-adcc94f590d8 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:18:45.040397 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d485e353-d94f-43a9-b93e-adcc94f590d8 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:18:45.041067 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d485e353-d94f-43a9-b93e-adcc94f590d8 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:18:45.200949 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-d485e353-d94f-43a9-b93e-adcc94f590d8 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:18:45.214703 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-d485e353-d94f-43a9-b93e-adcc94f590d8 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.320279 Jun 17 15:18:45.215619 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 327/891] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:18:44 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:18:45.222657 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-3c319003-275e-4f08-bd4f-c90a4dadd3a9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:18:45.223889 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-3c319003-275e-4f08-bd4f-c90a4dadd3a9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:18:45.232934 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3c319003-275e-4f08-bd4f-c90a4dadd3a9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:18:45.233728 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3c319003-275e-4f08-bd4f-c90a4dadd3a9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:18:45.235001 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3c319003-275e-4f08-bd4f-c90a4dadd3a9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:18:45.235819 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3c319003-275e-4f08-bd4f-c90a4dadd3a9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:18:45.270772 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-3c319003-275e-4f08-bd4f-c90a4dadd3a9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052680 Jun 17 15:18:45.271378 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 328/892] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:18:45 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:18:45.276946 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-fb61d25c-35d7-4cd6-99e1-4e02c99f5340 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:18:45.277880 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-fb61d25c-35d7-4cd6-99e1-4e02c99f5340 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:18:45.285578 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fb61d25c-35d7-4cd6-99e1-4e02c99f5340 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:18:45.286078 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fb61d25c-35d7-4cd6-99e1-4e02c99f5340 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:18:45.286852 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fb61d25c-35d7-4cd6-99e1-4e02c99f5340 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:18:45.287340 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fb61d25c-35d7-4cd6-99e1-4e02c99f5340 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:18:45.319883 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-fb61d25c-35d7-4cd6-99e1-4e02c99f5340 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047335 Jun 17 15:18:45.320583 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 329/893] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:18:45 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:18:45.325605 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-cc961347-216f-4a91-8c93-7e170eb44165 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:18:45.326384 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-cc961347-216f-4a91-8c93-7e170eb44165 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:18:45.333049 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cc961347-216f-4a91-8c93-7e170eb44165 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:18:45.333558 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cc961347-216f-4a91-8c93-7e170eb44165 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:18:45.334380 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cc961347-216f-4a91-8c93-7e170eb44165 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:18:45.334865 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cc961347-216f-4a91-8c93-7e170eb44165 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:18:45.416764 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-cc961347-216f-4a91-8c93-7e170eb44165 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:18:45.425047 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-cc961347-216f-4a91-8c93-7e170eb44165 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.103336 Jun 17 15:18:45.425625 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 330/894] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:18:45 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:18:46.233548 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-fd3604a9-8d8d-4997-a9e9-ac2327fb5cd2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:18:46.234286 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-fd3604a9-8d8d-4997-a9e9-ac2327fb5cd2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:18:46.240407 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fd3604a9-8d8d-4997-a9e9-ac2327fb5cd2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:18:46.240855 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fd3604a9-8d8d-4997-a9e9-ac2327fb5cd2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:18:46.241619 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fd3604a9-8d8d-4997-a9e9-ac2327fb5cd2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:18:46.242051 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fd3604a9-8d8d-4997-a9e9-ac2327fb5cd2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:18:46.393793 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-fd3604a9-8d8d-4997-a9e9-ac2327fb5cd2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:18:46.403627 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-fd3604a9-8d8d-4997-a9e9-ac2327fb5cd2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.174467 Jun 17 15:18:46.404219 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 331/895] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:18:46 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:18:46.409212 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-00e11d82-7d96-414a-b9c3-f96e9f349346 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:18:46.410082 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-00e11d82-7d96-414a-b9c3-f96e9f349346 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:18:46.418431 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-00e11d82-7d96-414a-b9c3-f96e9f349346 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:18:46.419209 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-00e11d82-7d96-414a-b9c3-f96e9f349346 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:18:46.421155 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-00e11d82-7d96-414a-b9c3-f96e9f349346 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:18:46.421898 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-00e11d82-7d96-414a-b9c3-f96e9f349346 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:18:46.470102 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-00e11d82-7d96-414a-b9c3-f96e9f349346 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064398 Jun 17 15:18:46.471146 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 332/896] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:18:46 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:18:46.479746 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-c36b87c2-ea42-478c-a69a-f849bacc1762 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:18:46.481396 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-c36b87c2-ea42-478c-a69a-f849bacc1762 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:18:46.491409 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c36b87c2-ea42-478c-a69a-f849bacc1762 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:18:46.491983 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c36b87c2-ea42-478c-a69a-f849bacc1762 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:18:46.493208 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c36b87c2-ea42-478c-a69a-f849bacc1762 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:18:46.493861 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c36b87c2-ea42-478c-a69a-f849bacc1762 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:18:46.535398 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-c36b87c2-ea42-478c-a69a-f849bacc1762 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.062625 Jun 17 15:18:46.536137 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 333/897] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:18:46 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:18:46.540981 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-eefe8f9c-4058-400c-b98c-9d5c69ffe324 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:18:46.541742 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-eefe8f9c-4058-400c-b98c-9d5c69ffe324 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:18:46.549839 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-eefe8f9c-4058-400c-b98c-9d5c69ffe324 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:18:46.550444 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-eefe8f9c-4058-400c-b98c-9d5c69ffe324 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:18:46.551257 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-eefe8f9c-4058-400c-b98c-9d5c69ffe324 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:18:46.551815 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-eefe8f9c-4058-400c-b98c-9d5c69ffe324 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:18:46.621919 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-eefe8f9c-4058-400c-b98c-9d5c69ffe324 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:18:46.630189 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-eefe8f9c-4058-400c-b98c-9d5c69ffe324 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.092895 Jun 17 15:18:46.630780 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 334/898] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:18:46 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:18:47.423428 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-90b1f4cb-c1cb-4942-ac84-34466156c533 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:18:47.424369 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-90b1f4cb-c1cb-4942-ac84-34466156c533 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:18:47.431651 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-90b1f4cb-c1cb-4942-ac84-34466156c533 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:18:47.432118 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-90b1f4cb-c1cb-4942-ac84-34466156c533 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:18:47.432999 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-90b1f4cb-c1cb-4942-ac84-34466156c533 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:18:47.433442 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-90b1f4cb-c1cb-4942-ac84-34466156c533 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:18:47.590490 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-90b1f4cb-c1cb-4942-ac84-34466156c533 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:18:47.599284 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-90b1f4cb-c1cb-4942-ac84-34466156c533 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.180086 Jun 17 15:18:47.599860 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 335/899] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:18:47 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:18:47.604669 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-cfc163e7-fcc7-4663-885b-607cb3922f73 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:18:47.605591 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-cfc163e7-fcc7-4663-885b-607cb3922f73 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:18:47.611888 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cfc163e7-fcc7-4663-885b-607cb3922f73 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:18:47.612348 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cfc163e7-fcc7-4663-885b-607cb3922f73 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:18:47.613145 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cfc163e7-fcc7-4663-885b-607cb3922f73 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:18:47.613549 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cfc163e7-fcc7-4663-885b-607cb3922f73 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:18:47.644776 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-cfc163e7-fcc7-4663-885b-607cb3922f73 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043565 Jun 17 15:18:47.645437 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 336/900] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:18:47 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:18:47.650433 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-92a753ee-44c3-4d8f-9cb3-5b79ad8485af tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:18:47.651340 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-92a753ee-44c3-4d8f-9cb3-5b79ad8485af tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:18:47.657687 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-92a753ee-44c3-4d8f-9cb3-5b79ad8485af tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:18:47.658129 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-92a753ee-44c3-4d8f-9cb3-5b79ad8485af tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:18:47.658963 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-92a753ee-44c3-4d8f-9cb3-5b79ad8485af tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:18:47.659458 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-92a753ee-44c3-4d8f-9cb3-5b79ad8485af tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:18:47.691602 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-92a753ee-44c3-4d8f-9cb3-5b79ad8485af tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045014 Jun 17 15:18:47.692185 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 337/901] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:18:47 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:18:47.696879 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-188ff690-2dc1-4e7f-aac8-333497786db1 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:18:47.697485 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-188ff690-2dc1-4e7f-aac8-333497786db1 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:18:47.704060 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-188ff690-2dc1-4e7f-aac8-333497786db1 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:18:47.704585 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-188ff690-2dc1-4e7f-aac8-333497786db1 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:18:47.705440 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-188ff690-2dc1-4e7f-aac8-333497786db1 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:18:47.706005 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-188ff690-2dc1-4e7f-aac8-333497786db1 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:18:47.775247 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-188ff690-2dc1-4e7f-aac8-333497786db1 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:18:47.783932 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-188ff690-2dc1-4e7f-aac8-333497786db1 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.090672 Jun 17 15:18:47.784542 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 338/902] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:18:47 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:18:48.620783 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-31c601fb-30a6-413f-8d18-11f8914a4368 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:18:48.621543 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-31c601fb-30a6-413f-8d18-11f8914a4368 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:18:48.628979 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-31c601fb-30a6-413f-8d18-11f8914a4368 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:18:48.629483 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-31c601fb-30a6-413f-8d18-11f8914a4368 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:18:48.630214 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-31c601fb-30a6-413f-8d18-11f8914a4368 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:18:48.630649 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-31c601fb-30a6-413f-8d18-11f8914a4368 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:18:48.790155 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-31c601fb-30a6-413f-8d18-11f8914a4368 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:18:48.800235 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-31c601fb-30a6-413f-8d18-11f8914a4368 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.184549 Jun 17 15:18:48.801023 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 339/903] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:18:48 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:18:48.806295 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-1c2d4a80-8ab7-4e15-9bf8-969a2fd12fab tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:18:48.807388 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-1c2d4a80-8ab7-4e15-9bf8-969a2fd12fab tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:18:48.815062 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1c2d4a80-8ab7-4e15-9bf8-969a2fd12fab tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:18:48.815605 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1c2d4a80-8ab7-4e15-9bf8-969a2fd12fab tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:18:48.816409 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1c2d4a80-8ab7-4e15-9bf8-969a2fd12fab tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:18:48.816875 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1c2d4a80-8ab7-4e15-9bf8-969a2fd12fab tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:18:48.850960 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-1c2d4a80-8ab7-4e15-9bf8-969a2fd12fab tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048814 Jun 17 15:18:48.851688 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 340/904] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:18:48 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:18:48.856551 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-c2de244e-5b04-458c-bcf9-07331d47d0ab tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:18:48.857497 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-c2de244e-5b04-458c-bcf9-07331d47d0ab tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:18:48.864359 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c2de244e-5b04-458c-bcf9-07331d47d0ab tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:18:48.864995 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c2de244e-5b04-458c-bcf9-07331d47d0ab tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:18:48.865931 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c2de244e-5b04-458c-bcf9-07331d47d0ab tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:18:48.866563 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c2de244e-5b04-458c-bcf9-07331d47d0ab tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:18:48.901538 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-c2de244e-5b04-458c-bcf9-07331d47d0ab tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048539 Jun 17 15:18:48.902064 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 341/905] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:18:48 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:18:48.907350 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-0a663a1c-95b1-4419-803b-4c50ac96142f tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:18:48.908023 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-0a663a1c-95b1-4419-803b-4c50ac96142f tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:18:48.915653 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0a663a1c-95b1-4419-803b-4c50ac96142f tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:18:48.916114 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0a663a1c-95b1-4419-803b-4c50ac96142f tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:18:48.916905 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0a663a1c-95b1-4419-803b-4c50ac96142f tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:18:48.917341 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0a663a1c-95b1-4419-803b-4c50ac96142f tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:18:48.986289 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-0a663a1c-95b1-4419-803b-4c50ac96142f tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:18:48.999731 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-0a663a1c-95b1-4419-803b-4c50ac96142f tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.096325 Jun 17 15:18:49.000861 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 342/906] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:18:48 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:18:49.821243 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-74a409ea-6515-44d6-9ce6-675ac488cb63 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:18:49.822126 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-74a409ea-6515-44d6-9ce6-675ac488cb63 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:18:49.831522 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-74a409ea-6515-44d6-9ce6-675ac488cb63 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:18:49.832271 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-74a409ea-6515-44d6-9ce6-675ac488cb63 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:18:49.833703 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-74a409ea-6515-44d6-9ce6-675ac488cb63 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:18:49.834528 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-74a409ea-6515-44d6-9ce6-675ac488cb63 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:18:49.841150 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell1:SELECT=100 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:18:50.011421 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-74a409ea-6515-44d6-9ce6-675ac488cb63 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:18:50.020195 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-74a409ea-6515-44d6-9ce6-675ac488cb63 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.205358 Jun 17 15:18:50.020835 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 343/907] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:18:49 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:18:50.025816 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-2736b39d-2861-410c-91b4-39748eccdd95 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:18:50.027096 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-2736b39d-2861-410c-91b4-39748eccdd95 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:18:50.035917 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2736b39d-2861-410c-91b4-39748eccdd95 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:18:50.036583 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2736b39d-2861-410c-91b4-39748eccdd95 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:18:50.037450 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2736b39d-2861-410c-91b4-39748eccdd95 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:18:50.037905 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2736b39d-2861-410c-91b4-39748eccdd95 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:18:50.070873 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-2736b39d-2861-410c-91b4-39748eccdd95 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048878 Jun 17 15:18:50.071535 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 344/908] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:18:50 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:18:50.076775 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-0a2ff460-17e1-4fe7-936f-16ff61627134 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:18:50.077884 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-0a2ff460-17e1-4fe7-936f-16ff61627134 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:18:50.084928 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0a2ff460-17e1-4fe7-936f-16ff61627134 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:18:50.085380 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0a2ff460-17e1-4fe7-936f-16ff61627134 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:18:50.086189 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0a2ff460-17e1-4fe7-936f-16ff61627134 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:18:50.086631 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0a2ff460-17e1-4fe7-936f-16ff61627134 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:18:50.119125 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-0a2ff460-17e1-4fe7-936f-16ff61627134 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046582 Jun 17 15:18:50.119997 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 345/909] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:18:50 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:18:50.125089 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-e27af0c4-b251-4f58-80bb-2799cce45701 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:18:50.125711 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-e27af0c4-b251-4f58-80bb-2799cce45701 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:18:50.131746 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e27af0c4-b251-4f58-80bb-2799cce45701 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:18:50.132197 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e27af0c4-b251-4f58-80bb-2799cce45701 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:18:50.133005 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e27af0c4-b251-4f58-80bb-2799cce45701 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:18:50.133628 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e27af0c4-b251-4f58-80bb-2799cce45701 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:18:50.204991 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-e27af0c4-b251-4f58-80bb-2799cce45701 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:18:50.213386 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-e27af0c4-b251-4f58-80bb-2799cce45701 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.092297 Jun 17 15:18:50.213968 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 346/910] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:18:50 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:18:51.040425 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-71bd3fe1-b882-4930-8ed1-6466ae06882a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:18:51.041121 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-71bd3fe1-b882-4930-8ed1-6466ae06882a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:18:51.048459 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-71bd3fe1-b882-4930-8ed1-6466ae06882a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:18:51.048897 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-71bd3fe1-b882-4930-8ed1-6466ae06882a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:18:51.049664 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-71bd3fe1-b882-4930-8ed1-6466ae06882a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:18:51.050155 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-71bd3fe1-b882-4930-8ed1-6466ae06882a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:18:51.192628 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-71bd3fe1-b882-4930-8ed1-6466ae06882a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:18:51.201521 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-71bd3fe1-b882-4930-8ed1-6466ae06882a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.164945 Jun 17 15:18:51.202163 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 347/911] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:18:51 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:18:51.207480 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-5b11c121-eecc-437e-99b6-07b4d80f6c77 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:18:51.208280 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-5b11c121-eecc-437e-99b6-07b4d80f6c77 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:18:51.215645 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5b11c121-eecc-437e-99b6-07b4d80f6c77 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:18:51.216977 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5b11c121-eecc-437e-99b6-07b4d80f6c77 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:18:51.217760 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5b11c121-eecc-437e-99b6-07b4d80f6c77 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:18:51.218194 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5b11c121-eecc-437e-99b6-07b4d80f6c77 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:18:51.249858 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-5b11c121-eecc-437e-99b6-07b4d80f6c77 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046594 Jun 17 15:18:51.250487 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 348/912] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:18:51 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:18:51.255240 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-8412b9af-37e4-4623-afda-84e947ee3c99 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:18:51.256152 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-8412b9af-37e4-4623-afda-84e947ee3c99 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:18:51.262325 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8412b9af-37e4-4623-afda-84e947ee3c99 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:18:51.262827 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8412b9af-37e4-4623-afda-84e947ee3c99 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:18:51.263608 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8412b9af-37e4-4623-afda-84e947ee3c99 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:18:51.264057 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8412b9af-37e4-4623-afda-84e947ee3c99 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:18:51.294506 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-8412b9af-37e4-4623-afda-84e947ee3c99 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042834 Jun 17 15:18:51.295598 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 349/913] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:18:51 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:18:51.300187 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-5f1f1cbf-5ebc-4668-af44-56585f135350 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:18:51.300824 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-5f1f1cbf-5ebc-4668-af44-56585f135350 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:18:51.306887 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5f1f1cbf-5ebc-4668-af44-56585f135350 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:18:51.307329 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5f1f1cbf-5ebc-4668-af44-56585f135350 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:18:51.308085 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5f1f1cbf-5ebc-4668-af44-56585f135350 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:18:51.308552 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5f1f1cbf-5ebc-4668-af44-56585f135350 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:18:51.381009 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-5f1f1cbf-5ebc-4668-af44-56585f135350 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:18:51.391320 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-5f1f1cbf-5ebc-4668-af44-56585f135350 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.094466 Jun 17 15:18:51.392146 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 350/914] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:18:51 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:18:52.219900 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-d7541bce-5b95-4fdb-bc19-f5578d2a43ed tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:18:52.220617 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-d7541bce-5b95-4fdb-bc19-f5578d2a43ed tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:18:52.227538 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d7541bce-5b95-4fdb-bc19-f5578d2a43ed tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:18:52.227988 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d7541bce-5b95-4fdb-bc19-f5578d2a43ed tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:18:52.228837 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d7541bce-5b95-4fdb-bc19-f5578d2a43ed tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:18:52.229348 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d7541bce-5b95-4fdb-bc19-f5578d2a43ed tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:18:52.381344 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-d7541bce-5b95-4fdb-bc19-f5578d2a43ed tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:18:52.393914 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-d7541bce-5b95-4fdb-bc19-f5578d2a43ed tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.177933 Jun 17 15:18:52.394936 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 351/915] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:18:52 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:18:52.400091 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-e13b9a59-4ac2-490f-992e-9a576f089755 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:18:52.401041 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-e13b9a59-4ac2-490f-992e-9a576f089755 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:18:52.407567 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e13b9a59-4ac2-490f-992e-9a576f089755 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:18:52.408013 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e13b9a59-4ac2-490f-992e-9a576f089755 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:18:52.408836 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e13b9a59-4ac2-490f-992e-9a576f089755 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:18:52.409262 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e13b9a59-4ac2-490f-992e-9a576f089755 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:18:52.441983 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-e13b9a59-4ac2-490f-992e-9a576f089755 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044879 Jun 17 15:18:52.442639 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 352/916] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:18:52 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:18:52.447899 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-8c70cc71-f210-4d98-88f8-ebe9d81211b0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:18:52.448931 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-8c70cc71-f210-4d98-88f8-ebe9d81211b0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:18:52.455335 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8c70cc71-f210-4d98-88f8-ebe9d81211b0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:18:52.455782 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8c70cc71-f210-4d98-88f8-ebe9d81211b0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:18:52.456569 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8c70cc71-f210-4d98-88f8-ebe9d81211b0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:18:52.456995 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8c70cc71-f210-4d98-88f8-ebe9d81211b0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:18:52.489639 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-8c70cc71-f210-4d98-88f8-ebe9d81211b0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045763 Jun 17 15:18:52.490200 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 353/917] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:18:52 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:18:52.494919 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-28133acc-ac42-4939-92d5-4663016b4bbe tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:18:52.495596 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-28133acc-ac42-4939-92d5-4663016b4bbe tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:18:52.502336 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-28133acc-ac42-4939-92d5-4663016b4bbe tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:18:52.502778 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-28133acc-ac42-4939-92d5-4663016b4bbe tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:18:52.503529 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-28133acc-ac42-4939-92d5-4663016b4bbe tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:18:52.503997 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-28133acc-ac42-4939-92d5-4663016b4bbe tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:18:52.571768 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-28133acc-ac42-4939-92d5-4663016b4bbe tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:18:52.581798 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-28133acc-ac42-4939-92d5-4663016b4bbe tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.090562 Jun 17 15:18:52.582386 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 354/918] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:18:52 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:18:53.411739 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-cdfb7800-e7fb-4928-9ada-18d906bb5390 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:18:53.412444 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-cdfb7800-e7fb-4928-9ada-18d906bb5390 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:18:53.418825 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cdfb7800-e7fb-4928-9ada-18d906bb5390 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:18:53.419263 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cdfb7800-e7fb-4928-9ada-18d906bb5390 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:18:53.420017 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cdfb7800-e7fb-4928-9ada-18d906bb5390 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:18:53.420475 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cdfb7800-e7fb-4928-9ada-18d906bb5390 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:18:53.561066 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-cdfb7800-e7fb-4928-9ada-18d906bb5390 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:18:53.569034 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-cdfb7800-e7fb-4928-9ada-18d906bb5390 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.161070 Jun 17 15:18:53.569712 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 355/919] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:18:53 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:18:53.574280 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-c88c99a4-e656-4dd6-a311-4aa3119c2290 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:18:53.575181 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-c88c99a4-e656-4dd6-a311-4aa3119c2290 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:18:53.581749 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c88c99a4-e656-4dd6-a311-4aa3119c2290 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:18:53.582190 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c88c99a4-e656-4dd6-a311-4aa3119c2290 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:18:53.582938 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c88c99a4-e656-4dd6-a311-4aa3119c2290 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:18:53.583364 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c88c99a4-e656-4dd6-a311-4aa3119c2290 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:18:53.613572 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-c88c99a4-e656-4dd6-a311-4aa3119c2290 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042838 Jun 17 15:18:53.614187 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 356/920] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:18:53 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:18:53.619140 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-75a2d40a-b575-4a89-bb13-6f5d7768ce71 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:18:53.620096 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-75a2d40a-b575-4a89-bb13-6f5d7768ce71 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:18:53.627006 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-75a2d40a-b575-4a89-bb13-6f5d7768ce71 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:18:53.627449 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-75a2d40a-b575-4a89-bb13-6f5d7768ce71 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:18:53.628250 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-75a2d40a-b575-4a89-bb13-6f5d7768ce71 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:18:53.628799 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-75a2d40a-b575-4a89-bb13-6f5d7768ce71 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:18:53.660183 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-75a2d40a-b575-4a89-bb13-6f5d7768ce71 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044943 Jun 17 15:18:53.660777 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 357/921] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:18:53 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:18:53.665703 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-1572b9a8-65c1-4a2c-a2ae-762a4ef11ecf tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:18:53.666367 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-1572b9a8-65c1-4a2c-a2ae-762a4ef11ecf tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:18:53.673093 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1572b9a8-65c1-4a2c-a2ae-762a4ef11ecf tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:18:53.673574 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1572b9a8-65c1-4a2c-a2ae-762a4ef11ecf tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:18:53.674326 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1572b9a8-65c1-4a2c-a2ae-762a4ef11ecf tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:18:53.674754 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1572b9a8-65c1-4a2c-a2ae-762a4ef11ecf tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:18:53.745664 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-1572b9a8-65c1-4a2c-a2ae-762a4ef11ecf tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:18:53.756637 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-1572b9a8-65c1-4a2c-a2ae-762a4ef11ecf tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.094656 Jun 17 15:18:53.757338 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 358/922] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:18:53 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:18:54.590123 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-aa38aacc-80ab-4296-a39c-e286f6efbe3d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:18:54.591072 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-aa38aacc-80ab-4296-a39c-e286f6efbe3d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:18:54.598239 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-aa38aacc-80ab-4296-a39c-e286f6efbe3d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:18:54.598687 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-aa38aacc-80ab-4296-a39c-e286f6efbe3d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:18:54.599459 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-aa38aacc-80ab-4296-a39c-e286f6efbe3d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:18:54.599889 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-aa38aacc-80ab-4296-a39c-e286f6efbe3d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:18:54.992107 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-aa38aacc-80ab-4296-a39c-e286f6efbe3d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:18:54.995731 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell1:SELECT=100 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:18:55.001341 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-aa38aacc-80ab-4296-a39c-e286f6efbe3d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.415333 Jun 17 15:18:55.001510 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 359/923] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:18:54 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:18:55.006780 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-24b73ac0-5a7c-484a-9763-91b7e1522c1f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:18:55.007712 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-24b73ac0-5a7c-484a-9763-91b7e1522c1f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:18:55.014125 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-24b73ac0-5a7c-484a-9763-91b7e1522c1f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:18:55.014574 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-24b73ac0-5a7c-484a-9763-91b7e1522c1f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:18:55.015530 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-24b73ac0-5a7c-484a-9763-91b7e1522c1f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:18:55.016066 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-24b73ac0-5a7c-484a-9763-91b7e1522c1f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:18:55.052926 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-24b73ac0-5a7c-484a-9763-91b7e1522c1f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050312 Jun 17 15:18:55.053512 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 360/924] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:18:55 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:18:55.058482 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-af9e2cbc-8308-4d5a-94ee-db5c8f7e947c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:18:55.059470 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-af9e2cbc-8308-4d5a-94ee-db5c8f7e947c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:18:55.065567 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-af9e2cbc-8308-4d5a-94ee-db5c8f7e947c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:18:55.066016 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-af9e2cbc-8308-4d5a-94ee-db5c8f7e947c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:18:55.066783 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-af9e2cbc-8308-4d5a-94ee-db5c8f7e947c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:18:55.067213 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-af9e2cbc-8308-4d5a-94ee-db5c8f7e947c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:18:55.097822 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-af9e2cbc-8308-4d5a-94ee-db5c8f7e947c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043238 Jun 17 15:18:55.098382 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 361/925] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:18:55 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:18:55.102783 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-fa6651f1-338f-4c04-acc3-ad9cfd904e32 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:18:55.103437 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-fa6651f1-338f-4c04-acc3-ad9cfd904e32 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:18:55.109831 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fa6651f1-338f-4c04-acc3-ad9cfd904e32 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:18:55.110274 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fa6651f1-338f-4c04-acc3-ad9cfd904e32 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:18:55.111026 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fa6651f1-338f-4c04-acc3-ad9cfd904e32 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:18:55.111454 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fa6651f1-338f-4c04-acc3-ad9cfd904e32 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:18:55.174863 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-fa6651f1-338f-4c04-acc3-ad9cfd904e32 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:18:55.183314 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-fa6651f1-338f-4c04-acc3-ad9cfd904e32 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.083856 Jun 17 15:18:55.183935 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 362/926] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:18:55 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:18:55.811676 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.wsgi [None req-1499edca-1705-4033-b7a1-b8f97ef1316e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] HTTP exception thrown: Cannot 'detach_volume' instance ba5d3180-d42a-4678-af13-c99282e054bf while it is in vm_state rescued Jun 17 15:18:55.813513 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-1499edca-1705-4033-b7a1-b8f97ef1316e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Request method failure captured: Jun 17 15:18:55.813513 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: request: DELETE /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments/713822dc-11e8-4f5c-ae7c-bcf41e01b06d HTTP/1.1 Jun 17 15:18:55.813513 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Accept: application/json Jun 17 15:18:55.813513 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Accept-Encoding: identity Jun 17 15:18:55.813513 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Connection: close Jun 17 15:18:55.813513 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Content-Length: 0 Jun 17 15:18:55.813513 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Content-Type: application/json Jun 17 15:18:55.813513 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Host: 10.222.0.48 Jun 17 15:18:55.813513 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Openstack-System-Scope: None Jun 17 15:18:55.813513 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: User-Agent: python-urllib3/1.26.9 Jun 17 15:18:55.813513 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Auth-Token: gAAAAABirJmQC7m757v9yyJD0BsI2MhqMNm1yc2WpkBWgAGOwCYW524pgy_6_7F6gBQez89A-LSNviRE5zDFwqgj2BZoXTsMX0NmzFHDYuHo31ibepKT71785ic3IrIvGY4IglQk81nqgsevYUUWYR-s69vMdAmv9JQXTwFMOwaCzN_3w4dwj6k Jun 17 15:18:55.813513 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Domain-Id: None Jun 17 15:18:55.813513 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Domain-Name: None Jun 17 15:18:55.813513 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Identity-Status: Confirmed Jun 17 15:18:55.813513 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Is-Admin-Project: True Jun 17 15:18:55.813513 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Domain-Id: default Jun 17 15:18:55.813513 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Domain-Name: Default Jun 17 15:18:55.813513 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Id: 50408ec18fa04036a0abb6236343e258 Jun 17 15:18:55.813513 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1478734135 Jun 17 15:18:55.813513 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Role: reader,member Jun 17 15:18:55.813513 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Roles: reader,member Jun 17 15:18:55.815331 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_50408ec18fa04036a0abb6236343e258", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/50408ec18fa04036a0abb6236343e258"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/50408ec18fa04036a0abb6236343e258"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/50408ec18fa04036a0abb6236343e258"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Jun 17 15:18:55.815331 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1478734135 Jun 17 15:18:55.815331 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant-Id: 50408ec18fa04036a0abb6236343e258 Jun 17 15:18:55.815331 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1478734135 Jun 17 15:18:55.815331 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User: tempest-ServerRescueNegativeTestJSON-1478734135-project Jun 17 15:18:55.815331 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Domain-Id: default Jun 17 15:18:55.815331 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Domain-Name: Default Jun 17 15:18:55.815331 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Id: 562485deaf214fa29eac132464ef93e3 Jun 17 15:18:55.815331 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1478734135-project Jun 17 15:18:55.815331 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: method: > Jun 17 15:18:55.815331 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: exception: Cannot 'detach_volume' instance ba5d3180-d42a-4678-af13-c99282e054bf while it is in vm_state rescued Jun 17 15:18:55.816176 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: action_args: {'server_id': 'ba5d3180-d42a-4678-af13-c99282e054bf', 'id': '713822dc-11e8-4f5c-ae7c-bcf41e01b06d'} Jun 17 15:18:55.816176 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 15:18:55.816176 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:18:55.816176 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 17 15:18:55.816176 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 17 15:18:55.816176 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 17 15:18:55.816176 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 15:18:55.816176 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 17 15:18:55.816176 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 17 15:18:55.816176 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ba5d3180-d42a-4678-af13-c99282e054bf in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 17 15:18:55.816176 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:18:55.816176 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:18:55.816176 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:18:55.816176 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:18:55.816176 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:18:55.816176 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:18:55.816176 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 15:18:55.816176 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 15:18:55.816176 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 15:18:55.816176 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 15:18:55.817775 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 17 15:18:55.817775 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 17 15:18:55.817775 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 17 15:18:55.817775 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 17 15:18:55.817775 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance ba5d3180-d42a-4678-af13-c99282e054bf while it is in vm_state rescued Jun 17 15:18:55.817775 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:18:55.817775 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:18:55.817775 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:18:55.817775 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:18:55.817775 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:18:55.817775 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:18:55.817775 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 15:18:55.817775 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 15:18:55.817775 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance ba5d3180-d42a-4678-af13-c99282e054bf while it is in vm_state rescued Jun 17 15:18:55.817775 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:18:55.817775 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-1499edca-1705-4033-b7a1-b8f97ef1316e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Returning 409 to user: Cannot 'detach_volume' instance ba5d3180-d42a-4678-af13-c99282e054bf while it is in vm_state rescued {{(pid=117650) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 15:18:55.818996 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-1499edca-1705-4033-b7a1-b8f97ef1316e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "DELETE /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments/713822dc-11e8-4f5c-ae7c-bcf41e01b06d" status: 409 len: 152 microversion: 2.1 time: 56.156212 Jun 17 15:18:55.818996 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 565/927] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Jun 17 15:17:59 2022] DELETE /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments/713822dc-11e8-4f5c-ae7c-bcf41e01b06d => generated 152 bytes in 56159 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jun 17 15:18:55.828807 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-552e56c2-efdb-451c-a4b0-d7d56d51b94a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:18:55.830993 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-552e56c2-efdb-451c-a4b0-d7d56d51b94a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:18:55.840792 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-552e56c2-efdb-451c-a4b0-d7d56d51b94a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:18:55.841483 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-552e56c2-efdb-451c-a4b0-d7d56d51b94a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:18:55.842346 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-552e56c2-efdb-451c-a4b0-d7d56d51b94a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:18:55.842778 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-552e56c2-efdb-451c-a4b0-d7d56d51b94a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:18:55.914586 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-552e56c2-efdb-451c-a4b0-d7d56d51b94a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "POST /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/action" status: 202 len: 0 microversion: 2.1 time: 0.091457 Jun 17 15:18:55.915489 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 363/928] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jun 17 15:18:55 2022] POST /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 15:18:55.928546 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-75017f3b-a815-494d-a2ba-9557fad4645c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:18:55.929413 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-75017f3b-a815-494d-a2ba-9557fad4645c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:18:55.940752 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-75017f3b-a815-494d-a2ba-9557fad4645c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:18:55.941536 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-75017f3b-a815-494d-a2ba-9557fad4645c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:18:55.942930 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-75017f3b-a815-494d-a2ba-9557fad4645c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:18:55.943698 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-75017f3b-a815-494d-a2ba-9557fad4645c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:18:56.020683 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-374a9822-066f-47a9-845b-291030fe7b3f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:18:56.021498 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-374a9822-066f-47a9-845b-291030fe7b3f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:18:56.029621 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-374a9822-066f-47a9-845b-291030fe7b3f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:18:56.030200 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-374a9822-066f-47a9-845b-291030fe7b3f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:18:56.031127 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-374a9822-066f-47a9-845b-291030fe7b3f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:18:56.031600 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-374a9822-066f-47a9-845b-291030fe7b3f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:18:56.124743 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-75017f3b-a815-494d-a2ba-9557fad4645c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:18:56.133576 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-75017f3b-a815-494d-a2ba-9557fad4645c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1720 microversion: 2.1 time: 0.210582 Jun 17 15:18:56.134247 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 566/929] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:18:55 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1720 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:18:56.143716 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-ae08042d-1d8f-4896-b104-d87f05d8ea45 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:18:56.143716 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-ae08042d-1d8f-4896-b104-d87f05d8ea45 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:18:56.147894 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ae08042d-1d8f-4896-b104-d87f05d8ea45 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:18:56.148559 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ae08042d-1d8f-4896-b104-d87f05d8ea45 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:18:56.149481 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ae08042d-1d8f-4896-b104-d87f05d8ea45 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:18:56.149989 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ae08042d-1d8f-4896-b104-d87f05d8ea45 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:18:56.191148 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-ae08042d-1d8f-4896-b104-d87f05d8ea45 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054890 Jun 17 15:18:56.192688 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 567/930] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:18:56 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:18:56.201376 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-68a17fe0-a9c9-49dc-b8b2-0da6682d2393 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:18:56.202496 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-68a17fe0-a9c9-49dc-b8b2-0da6682d2393 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:18:56.210224 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-68a17fe0-a9c9-49dc-b8b2-0da6682d2393 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:18:56.210702 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-68a17fe0-a9c9-49dc-b8b2-0da6682d2393 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:18:56.211543 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-68a17fe0-a9c9-49dc-b8b2-0da6682d2393 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:18:56.211991 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-68a17fe0-a9c9-49dc-b8b2-0da6682d2393 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:18:56.252849 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-68a17fe0-a9c9-49dc-b8b2-0da6682d2393 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058491 Jun 17 15:18:56.253420 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 568/931] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:18:56 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:18:56.257997 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-90c345f5-00a3-40d0-85e8-2f2dcf767ed5 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:18:56.258804 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-90c345f5-00a3-40d0-85e8-2f2dcf767ed5 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:18:56.265176 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-90c345f5-00a3-40d0-85e8-2f2dcf767ed5 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:18:56.265620 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-90c345f5-00a3-40d0-85e8-2f2dcf767ed5 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:18:56.266477 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-90c345f5-00a3-40d0-85e8-2f2dcf767ed5 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:18:56.266817 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-90c345f5-00a3-40d0-85e8-2f2dcf767ed5 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:18:56.292949 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-374a9822-066f-47a9-845b-291030fe7b3f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:18:56.302780 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-374a9822-066f-47a9-845b-291030fe7b3f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.286849 Jun 17 15:18:56.303857 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 364/932] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:18:56 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:18:56.346501 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-90c345f5-00a3-40d0-85e8-2f2dcf767ed5 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:18:56.356629 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-90c345f5-00a3-40d0-85e8-2f2dcf767ed5 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.102040 Jun 17 15:18:56.357839 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 569/933] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:18:56 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:18:57.152266 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-84618bee-ec65-42d2-b4a5-239eb62991a4 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:18:57.152938 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-84618bee-ec65-42d2-b4a5-239eb62991a4 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:18:57.160551 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-84618bee-ec65-42d2-b4a5-239eb62991a4 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:18:57.161035 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-84618bee-ec65-42d2-b4a5-239eb62991a4 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:18:57.161983 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-84618bee-ec65-42d2-b4a5-239eb62991a4 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:18:57.162504 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-84618bee-ec65-42d2-b4a5-239eb62991a4 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:18:57.205402 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-1d46dc23-1360-4db2-8e5a-73c5f7f52e24 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:18:57.207500 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-1d46dc23-1360-4db2-8e5a-73c5f7f52e24 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:18:57.215091 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1d46dc23-1360-4db2-8e5a-73c5f7f52e24 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:18:57.215727 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1d46dc23-1360-4db2-8e5a-73c5f7f52e24 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:18:57.216845 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1d46dc23-1360-4db2-8e5a-73c5f7f52e24 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:18:57.217666 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1d46dc23-1360-4db2-8e5a-73c5f7f52e24 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:18:57.249712 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-1d46dc23-1360-4db2-8e5a-73c5f7f52e24 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050094 Jun 17 15:18:57.250274 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 570/934] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:18:57 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:18:57.264920 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-169d1859-2e44-4595-9bca-09d41d1c334f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:18:57.265839 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-169d1859-2e44-4595-9bca-09d41d1c334f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:18:57.272204 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-169d1859-2e44-4595-9bca-09d41d1c334f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:18:57.272696 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-169d1859-2e44-4595-9bca-09d41d1c334f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:18:57.273475 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-169d1859-2e44-4595-9bca-09d41d1c334f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:18:57.273934 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-169d1859-2e44-4595-9bca-09d41d1c334f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:18:57.304504 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-169d1859-2e44-4595-9bca-09d41d1c334f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043995 Jun 17 15:18:57.305077 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 571/935] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:18:57 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 15:18:57.321741 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-84618bee-ec65-42d2-b4a5-239eb62991a4 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:18:57.326139 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-d2e3347e-7b71-4ab6-be7c-1dca1c7f059a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:18:57.327162 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-d2e3347e-7b71-4ab6-be7c-1dca1c7f059a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:18:57.336894 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d2e3347e-7b71-4ab6-be7c-1dca1c7f059a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:18:57.337319 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-84618bee-ec65-42d2-b4a5-239eb62991a4 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1720 microversion: 2.1 time: 0.188496 Jun 17 15:18:57.337656 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d2e3347e-7b71-4ab6-be7c-1dca1c7f059a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:18:57.338450 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 365/936] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:18:57 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1720 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:18:57.338923 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d2e3347e-7b71-4ab6-be7c-1dca1c7f059a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:18:57.339693 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d2e3347e-7b71-4ab6-be7c-1dca1c7f059a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:18:57.378531 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-591ac3c8-9295-4529-990f-695372e6315c tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:18:57.379294 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-591ac3c8-9295-4529-990f-695372e6315c tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:18:57.385599 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-591ac3c8-9295-4529-990f-695372e6315c tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:18:57.386050 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-591ac3c8-9295-4529-990f-695372e6315c tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:18:57.386820 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-591ac3c8-9295-4529-990f-695372e6315c tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:18:57.387252 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-591ac3c8-9295-4529-990f-695372e6315c tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:18:57.453308 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-591ac3c8-9295-4529-990f-695372e6315c tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:18:57.468352 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-591ac3c8-9295-4529-990f-695372e6315c tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.093609 Jun 17 15:18:57.469169 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 366/937] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:18:57 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:18:57.522977 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-d2e3347e-7b71-4ab6-be7c-1dca1c7f059a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:18:57.531074 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-d2e3347e-7b71-4ab6-be7c-1dca1c7f059a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.212188 Jun 17 15:18:57.531652 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 572/938] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:18:57 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:18:58.262185 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-448de566-0553-40a3-83f2-faba8e6847cf tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:18:58.263637 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-448de566-0553-40a3-83f2-faba8e6847cf tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:18:58.271788 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-448de566-0553-40a3-83f2-faba8e6847cf tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:18:58.272373 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-448de566-0553-40a3-83f2-faba8e6847cf tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:18:58.273187 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-448de566-0553-40a3-83f2-faba8e6847cf tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:18:58.273622 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-448de566-0553-40a3-83f2-faba8e6847cf tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:18:58.306494 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-448de566-0553-40a3-83f2-faba8e6847cf tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048658 Jun 17 15:18:58.307069 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 367/939] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:18:58 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:18:58.320083 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-12e4bc8f-841e-48cd-bd9e-c117abc9797a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:18:58.321162 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-12e4bc8f-841e-48cd-bd9e-c117abc9797a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:18:58.328340 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-12e4bc8f-841e-48cd-bd9e-c117abc9797a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:18:58.328807 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-12e4bc8f-841e-48cd-bd9e-c117abc9797a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:18:58.329585 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-12e4bc8f-841e-48cd-bd9e-c117abc9797a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:18:58.330018 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-12e4bc8f-841e-48cd-bd9e-c117abc9797a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:18:58.366375 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-ae0e69fa-03a9-4625-8a2e-6ddca0ff96f7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:18:58.367099 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-12e4bc8f-841e-48cd-bd9e-c117abc9797a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051822 Jun 17 15:18:58.367365 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-ae0e69fa-03a9-4625-8a2e-6ddca0ff96f7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:18:58.373532 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 573/940] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:18:58 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:18:58.379536 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ae0e69fa-03a9-4625-8a2e-6ddca0ff96f7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:18:58.380235 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ae0e69fa-03a9-4625-8a2e-6ddca0ff96f7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:18:58.381476 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ae0e69fa-03a9-4625-8a2e-6ddca0ff96f7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:18:58.381967 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ae0e69fa-03a9-4625-8a2e-6ddca0ff96f7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:18:58.486208 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-295d3865-7108-4935-a197-5552d70aa7d3 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:18:58.486820 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-295d3865-7108-4935-a197-5552d70aa7d3 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:18:58.494065 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-295d3865-7108-4935-a197-5552d70aa7d3 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:18:58.494558 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-295d3865-7108-4935-a197-5552d70aa7d3 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:18:58.495431 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-295d3865-7108-4935-a197-5552d70aa7d3 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:18:58.495896 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-295d3865-7108-4935-a197-5552d70aa7d3 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:18:58.539367 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-ae0e69fa-03a9-4625-8a2e-6ddca0ff96f7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:18:58.550951 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-ae0e69fa-03a9-4625-8a2e-6ddca0ff96f7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1726 microversion: 2.1 time: 0.188553 Jun 17 15:18:58.551959 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 368/941] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:18:58 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1726 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:18:58.560785 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-baa50ac7-9243-4092-a613-041208f46a40 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:18:58.561894 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-baa50ac7-9243-4092-a613-041208f46a40 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:18:58.562289 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-295d3865-7108-4935-a197-5552d70aa7d3 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:18:58.569798 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-baa50ac7-9243-4092-a613-041208f46a40 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:18:58.570247 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-baa50ac7-9243-4092-a613-041208f46a40 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:18:58.571094 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-baa50ac7-9243-4092-a613-041208f46a40 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:18:58.571541 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-baa50ac7-9243-4092-a613-041208f46a40 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:18:58.574894 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-295d3865-7108-4935-a197-5552d70aa7d3 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.092469 Jun 17 15:18:58.576458 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 574/942] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:18:58 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:18:58.581889 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-d45c2fca-d463-447b-876d-e875e2648326 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:18:58.582385 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-d45c2fca-d463-447b-876d-e875e2648326 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:18:58.588783 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d45c2fca-d463-447b-876d-e875e2648326 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:18:58.589240 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d45c2fca-d463-447b-876d-e875e2648326 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:18:58.590039 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d45c2fca-d463-447b-876d-e875e2648326 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:18:58.590470 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d45c2fca-d463-447b-876d-e875e2648326 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:18:58.677303 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-d45c2fca-d463-447b-876d-e875e2648326 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.099328 Jun 17 15:18:58.678432 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 575/943] 10.222.0.48 () {58 vars in 1274 bytes} [Fri Jun 17 15:18:58 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-interface => generated 284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:18:58.760179 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-baa50ac7-9243-4092-a613-041208f46a40 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:18:58.773466 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-baa50ac7-9243-4092-a613-041208f46a40 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.219691 Jun 17 15:18:58.774487 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 369/944] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:18:58 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:18:59.317563 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-171a6ba2-3218-4492-8b0c-43290866019b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:18:59.319132 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-171a6ba2-3218-4492-8b0c-43290866019b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:18:59.328172 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-171a6ba2-3218-4492-8b0c-43290866019b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:18:59.329025 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-171a6ba2-3218-4492-8b0c-43290866019b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:18:59.329899 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-171a6ba2-3218-4492-8b0c-43290866019b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:18:59.330538 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-171a6ba2-3218-4492-8b0c-43290866019b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:18:59.375379 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-171a6ba2-3218-4492-8b0c-43290866019b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060328 Jun 17 15:18:59.375379 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 576/945] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:18:59 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:18:59.381332 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-2fc78f61-0d7e-4557-abce-453a6da330ae tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:18:59.382376 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-2fc78f61-0d7e-4557-abce-453a6da330ae tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:18:59.389569 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2fc78f61-0d7e-4557-abce-453a6da330ae tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:18:59.390042 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2fc78f61-0d7e-4557-abce-453a6da330ae tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:18:59.390816 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2fc78f61-0d7e-4557-abce-453a6da330ae tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:18:59.391291 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2fc78f61-0d7e-4557-abce-453a6da330ae tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:18:59.425168 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-2fc78f61-0d7e-4557-abce-453a6da330ae tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047753 Jun 17 15:18:59.425725 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 370/946] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:18:59 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 15:18:59.593882 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-8fd695f5-d504-4e39-b74b-0249e66b699a tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:18:59.594483 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-8fd695f5-d504-4e39-b74b-0249e66b699a tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:18:59.600886 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8fd695f5-d504-4e39-b74b-0249e66b699a tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:18:59.601337 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8fd695f5-d504-4e39-b74b-0249e66b699a tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:18:59.602118 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8fd695f5-d504-4e39-b74b-0249e66b699a tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:18:59.602557 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8fd695f5-d504-4e39-b74b-0249e66b699a tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:18:59.676762 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-8fd695f5-d504-4e39-b74b-0249e66b699a tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:18:59.685714 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-8fd695f5-d504-4e39-b74b-0249e66b699a tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.096912 Jun 17 15:18:59.687052 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 577/947] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:18:59 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:18:59.715795 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [req-c163192e-bd4b-4662-b0c0-5a9e2eb9b65e req-7809a514-7c0c-457c-9128-4aace4d12cac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba5d3180-d42a-4678-af13-c99282e054bf", "tag": "06e8bb11-060d-47aa-9950-9bdbeda221ff"}]} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:18:59.725499 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-c163192e-bd4b-4662-b0c0-5a9e2eb9b65e req-7809a514-7c0c-457c-9128-4aace4d12cac service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:18:59.725950 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-c163192e-bd4b-4662-b0c0-5a9e2eb9b65e req-7809a514-7c0c-457c-9128-4aace4d12cac service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:18:59.737985 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.compute.server_external_events [req-c163192e-bd4b-4662-b0c0-5a9e2eb9b65e req-7809a514-7c0c-457c-9128-4aace4d12cac service nova] Creating event network-changed:06e8bb11-060d-47aa-9950-9bdbeda221ff for instance ba5d3180-d42a-4678-af13-c99282e054bf on hv-cinder-82549 Jun 17 15:18:59.743050 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [req-c163192e-bd4b-4662-b0c0-5a9e2eb9b65e req-7809a514-7c0c-457c-9128-4aace4d12cac service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030768 Jun 17 15:18:59.744104 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 371/948] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 15:18:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:18:59.796352 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-16f12325-0268-4f08-b806-c5118c502411 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:18:59.796930 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-16f12325-0268-4f08-b806-c5118c502411 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:18:59.803648 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-16f12325-0268-4f08-b806-c5118c502411 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:18:59.804100 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-16f12325-0268-4f08-b806-c5118c502411 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:18:59.804917 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-16f12325-0268-4f08-b806-c5118c502411 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:18:59.805348 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-16f12325-0268-4f08-b806-c5118c502411 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:18:59.964357 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-16f12325-0268-4f08-b806-c5118c502411 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:18:59.979438 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-16f12325-0268-4f08-b806-c5118c502411 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.186872 Jun 17 15:18:59.981035 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 578/949] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:18:59 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:19:00.392365 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-53851e9f-92dc-44b0-ba6e-c076fdff8ccf tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:00.393756 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-53851e9f-92dc-44b0-ba6e-c076fdff8ccf tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:00.405940 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-53851e9f-92dc-44b0-ba6e-c076fdff8ccf tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:00.405940 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-53851e9f-92dc-44b0-ba6e-c076fdff8ccf tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:00.405940 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-53851e9f-92dc-44b0-ba6e-c076fdff8ccf tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:00.406344 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-53851e9f-92dc-44b0-ba6e-c076fdff8ccf tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:00.438749 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-53851e9f-92dc-44b0-ba6e-c076fdff8ccf tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052348 Jun 17 15:19:00.440653 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-c1fe9fc5-c508-464e-935d-6d0e8b8556df tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:00.448551 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-c1fe9fc5-c508-464e-935d-6d0e8b8556df tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:00.448771 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 372/950] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:19:00 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:19:00.451914 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c1fe9fc5-c508-464e-935d-6d0e8b8556df tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:00.452496 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c1fe9fc5-c508-464e-935d-6d0e8b8556df tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:00.453714 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c1fe9fc5-c508-464e-935d-6d0e8b8556df tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:00.454507 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c1fe9fc5-c508-464e-935d-6d0e8b8556df tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:00.494613 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-c1fe9fc5-c508-464e-935d-6d0e8b8556df tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.060824 Jun 17 15:19:00.495187 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 579/951] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:19:00 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 15:19:00.704272 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-950e8c83-1de9-4f0e-a1d7-7697a5414c60 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:00.705269 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-950e8c83-1de9-4f0e-a1d7-7697a5414c60 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:00.711930 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-950e8c83-1de9-4f0e-a1d7-7697a5414c60 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:00.712401 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-950e8c83-1de9-4f0e-a1d7-7697a5414c60 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:00.713187 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-950e8c83-1de9-4f0e-a1d7-7697a5414c60 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:00.713623 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-950e8c83-1de9-4f0e-a1d7-7697a5414c60 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:00.780733 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-950e8c83-1de9-4f0e-a1d7-7697a5414c60 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:19:00.788736 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-950e8c83-1de9-4f0e-a1d7-7697a5414c60 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.089604 Jun 17 15:19:00.789308 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 373/952] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:19:00 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:19:01.008350 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-8371ea8d-195b-4676-b035-1ce25fec43de tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:01.009055 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-8371ea8d-195b-4676-b035-1ce25fec43de tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:01.016295 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8371ea8d-195b-4676-b035-1ce25fec43de tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:01.016761 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8371ea8d-195b-4676-b035-1ce25fec43de tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:01.017531 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8371ea8d-195b-4676-b035-1ce25fec43de tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:01.017964 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8371ea8d-195b-4676-b035-1ce25fec43de tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:01.165596 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-8371ea8d-195b-4676-b035-1ce25fec43de tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:19:01.175129 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-8371ea8d-195b-4676-b035-1ce25fec43de tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.172179 Jun 17 15:19:01.176128 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 580/953] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:19:01 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:19:01.451957 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-f8a0219a-cbd0-4eb8-bc87-01541f3c1958 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:01.455628 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-f8a0219a-cbd0-4eb8-bc87-01541f3c1958 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:01.460601 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f8a0219a-cbd0-4eb8-bc87-01541f3c1958 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:01.461046 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f8a0219a-cbd0-4eb8-bc87-01541f3c1958 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:01.461824 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f8a0219a-cbd0-4eb8-bc87-01541f3c1958 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:01.462255 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f8a0219a-cbd0-4eb8-bc87-01541f3c1958 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:01.493835 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-f8a0219a-cbd0-4eb8-bc87-01541f3c1958 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046686 Jun 17 15:19:01.494450 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 374/954] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:19:01 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:19:01.506635 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-446c95df-9c1b-4394-9269-213ab68fd712 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:01.507569 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-446c95df-9c1b-4394-9269-213ab68fd712 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:01.516795 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-446c95df-9c1b-4394-9269-213ab68fd712 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:01.517494 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-446c95df-9c1b-4394-9269-213ab68fd712 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:01.518718 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-446c95df-9c1b-4394-9269-213ab68fd712 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:01.519417 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-446c95df-9c1b-4394-9269-213ab68fd712 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:01.561545 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-446c95df-9c1b-4394-9269-213ab68fd712 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.059715 Jun 17 15:19:01.562118 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 581/955] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:19:01 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 15:19:01.760813 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [req-e7a9a875-bde3-489d-9bab-cda0aaa260aa req-e85680d3-fe5f-491c-a3b0-3a5eed9c1f15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba5d3180-d42a-4678-af13-c99282e054bf", "tag": "06e8bb11-060d-47aa-9950-9bdbeda221ff"}]} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:19:01.775687 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-e7a9a875-bde3-489d-9bab-cda0aaa260aa req-e85680d3-fe5f-491c-a3b0-3a5eed9c1f15 service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:01.776498 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-e7a9a875-bde3-489d-9bab-cda0aaa260aa req-e85680d3-fe5f-491c-a3b0-3a5eed9c1f15 service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:01.793529 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.compute.server_external_events [req-e7a9a875-bde3-489d-9bab-cda0aaa260aa req-e85680d3-fe5f-491c-a3b0-3a5eed9c1f15 service nova] Creating event network-changed:06e8bb11-060d-47aa-9950-9bdbeda221ff for instance ba5d3180-d42a-4678-af13-c99282e054bf on hv-cinder-82549 Jun 17 15:19:01.799875 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [req-e7a9a875-bde3-489d-9bab-cda0aaa260aa req-e85680d3-fe5f-491c-a3b0-3a5eed9c1f15 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044993 Jun 17 15:19:01.800531 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 375/956] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 15:19:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:19:01.806531 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-d5aeb191-c47a-444d-ac33-997daf1da055 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:01.807070 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-d5aeb191-c47a-444d-ac33-997daf1da055 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:01.813990 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d5aeb191-c47a-444d-ac33-997daf1da055 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:01.814429 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d5aeb191-c47a-444d-ac33-997daf1da055 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:01.815195 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d5aeb191-c47a-444d-ac33-997daf1da055 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:01.815619 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d5aeb191-c47a-444d-ac33-997daf1da055 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:01.835309 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=100 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:19:01.892118 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-d5aeb191-c47a-444d-ac33-997daf1da055 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:19:01.900107 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-d5aeb191-c47a-444d-ac33-997daf1da055 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.097518 Jun 17 15:19:01.900711 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 582/957] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:19:01 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:19:02.199503 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-acfc2ebf-1007-44b5-957f-28fecc278432 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:02.200995 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-acfc2ebf-1007-44b5-957f-28fecc278432 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:02.204552 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_api:SELECT=100 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:19:02.209718 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-acfc2ebf-1007-44b5-957f-28fecc278432 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:02.210170 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-acfc2ebf-1007-44b5-957f-28fecc278432 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:02.210952 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-acfc2ebf-1007-44b5-957f-28fecc278432 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:02.211426 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-acfc2ebf-1007-44b5-957f-28fecc278432 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:02.440358 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-acfc2ebf-1007-44b5-957f-28fecc278432 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:19:02.445469 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:19:02.453119 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-acfc2ebf-1007-44b5-957f-28fecc278432 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.258811 Jun 17 15:19:02.453798 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 376/958] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:19:02 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:19:02.506165 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-81e55ec4-7d75-4fcc-a8d3-74fefd0a8485 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:02.507258 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-81e55ec4-7d75-4fcc-a8d3-74fefd0a8485 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:02.517774 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-81e55ec4-7d75-4fcc-a8d3-74fefd0a8485 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:02.518500 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-81e55ec4-7d75-4fcc-a8d3-74fefd0a8485 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:02.519608 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-81e55ec4-7d75-4fcc-a8d3-74fefd0a8485 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:02.520211 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-81e55ec4-7d75-4fcc-a8d3-74fefd0a8485 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:02.564513 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-81e55ec4-7d75-4fcc-a8d3-74fefd0a8485 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062495 Jun 17 15:19:02.565193 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 583/959] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:19:02 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:19:02.574449 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-eb4ccc5e-087b-491f-b4e4-e593f2bce21a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:02.575333 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-eb4ccc5e-087b-491f-b4e4-e593f2bce21a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:02.583078 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-eb4ccc5e-087b-491f-b4e4-e593f2bce21a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:02.583573 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-eb4ccc5e-087b-491f-b4e4-e593f2bce21a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:02.584356 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-eb4ccc5e-087b-491f-b4e4-e593f2bce21a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:02.584787 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-eb4ccc5e-087b-491f-b4e4-e593f2bce21a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:02.616498 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-eb4ccc5e-087b-491f-b4e4-e593f2bce21a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046870 Jun 17 15:19:02.617078 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 377/960] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:19:02 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:19:02.922790 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-1dde42aa-184d-4787-8512-162b7eaff26a tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:02.923593 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-1dde42aa-184d-4787-8512-162b7eaff26a tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:02.929906 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1dde42aa-184d-4787-8512-162b7eaff26a tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:02.930350 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1dde42aa-184d-4787-8512-162b7eaff26a tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:02.931116 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1dde42aa-184d-4787-8512-162b7eaff26a tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:02.931540 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1dde42aa-184d-4787-8512-162b7eaff26a tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:03.002962 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-1dde42aa-184d-4787-8512-162b7eaff26a tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:19:03.011041 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-1dde42aa-184d-4787-8512-162b7eaff26a tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.092025 Jun 17 15:19:03.011768 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 584/961] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:19:02 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:19:03.471095 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-14839ca1-925a-4f78-8aa2-b19773031398 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:03.471803 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-14839ca1-925a-4f78-8aa2-b19773031398 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:03.478727 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-14839ca1-925a-4f78-8aa2-b19773031398 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:03.479276 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-14839ca1-925a-4f78-8aa2-b19773031398 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:03.480074 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-14839ca1-925a-4f78-8aa2-b19773031398 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:03.480532 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-14839ca1-925a-4f78-8aa2-b19773031398 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:03.577204 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-6a6a77db-50c0-4f28-a68b-25554b49269a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:03.578403 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-6a6a77db-50c0-4f28-a68b-25554b49269a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:03.585954 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6a6a77db-50c0-4f28-a68b-25554b49269a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:03.586405 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6a6a77db-50c0-4f28-a68b-25554b49269a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:03.587213 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6a6a77db-50c0-4f28-a68b-25554b49269a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:03.587765 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6a6a77db-50c0-4f28-a68b-25554b49269a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:03.623727 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-6a6a77db-50c0-4f28-a68b-25554b49269a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050673 Jun 17 15:19:03.624313 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 585/962] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:19:03 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:19:03.630309 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-3f921fb0-dca7-4a8f-b44a-bb1b9edbe7cc tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:03.631157 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-3f921fb0-dca7-4a8f-b44a-bb1b9edbe7cc tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:03.637986 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3f921fb0-dca7-4a8f-b44a-bb1b9edbe7cc tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:03.638570 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3f921fb0-dca7-4a8f-b44a-bb1b9edbe7cc tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:03.639318 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3f921fb0-dca7-4a8f-b44a-bb1b9edbe7cc tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:03.639749 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3f921fb0-dca7-4a8f-b44a-bb1b9edbe7cc tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:03.643769 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-14839ca1-925a-4f78-8aa2-b19773031398 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:19:03.652587 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-14839ca1-925a-4f78-8aa2-b19773031398 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.185443 Jun 17 15:19:03.653599 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 378/963] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:19:03 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:19:03.676803 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-3f921fb0-dca7-4a8f-b44a-bb1b9edbe7cc tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050546 Jun 17 15:19:03.677375 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 586/964] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:19:03 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 15:19:04.028685 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-30297009-1b2c-481f-8949-bdfa4436bf4d tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:04.029233 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-30297009-1b2c-481f-8949-bdfa4436bf4d tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:04.035512 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-30297009-1b2c-481f-8949-bdfa4436bf4d tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:04.036020 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-30297009-1b2c-481f-8949-bdfa4436bf4d tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:04.036808 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-30297009-1b2c-481f-8949-bdfa4436bf4d tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:04.037245 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-30297009-1b2c-481f-8949-bdfa4436bf4d tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:04.101859 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-30297009-1b2c-481f-8949-bdfa4436bf4d tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:19:04.110159 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-30297009-1b2c-481f-8949-bdfa4436bf4d tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.085411 Jun 17 15:19:04.110744 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 379/965] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:19:04 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:19:04.635938 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-ae9e60e5-34ae-4479-89b3-f254c5994c83 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:04.636859 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-ae9e60e5-34ae-4479-89b3-f254c5994c83 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:04.643778 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ae9e60e5-34ae-4479-89b3-f254c5994c83 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:04.644219 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ae9e60e5-34ae-4479-89b3-f254c5994c83 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:04.645013 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ae9e60e5-34ae-4479-89b3-f254c5994c83 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:04.645468 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ae9e60e5-34ae-4479-89b3-f254c5994c83 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:04.670525 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-26b7baee-eb49-47d1-bec7-c42a2129791d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:04.671135 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-26b7baee-eb49-47d1-bec7-c42a2129791d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:04.677290 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-ae9e60e5-34ae-4479-89b3-f254c5994c83 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045131 Jun 17 15:19:04.677901 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 587/966] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:19:04 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:19:04.680705 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-26b7baee-eb49-47d1-bec7-c42a2129791d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:04.681174 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-26b7baee-eb49-47d1-bec7-c42a2129791d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:04.681934 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-26b7baee-eb49-47d1-bec7-c42a2129791d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:04.682420 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-26b7baee-eb49-47d1-bec7-c42a2129791d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:04.690570 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-37c2b56c-997d-4e83-b110-8b284c805b67 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:04.691604 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-37c2b56c-997d-4e83-b110-8b284c805b67 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:04.698754 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-37c2b56c-997d-4e83-b110-8b284c805b67 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:04.699178 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-37c2b56c-997d-4e83-b110-8b284c805b67 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:04.700021 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-37c2b56c-997d-4e83-b110-8b284c805b67 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:04.700578 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-37c2b56c-997d-4e83-b110-8b284c805b67 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:04.737354 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-37c2b56c-997d-4e83-b110-8b284c805b67 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052241 Jun 17 15:19:04.737926 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 588/967] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:19:04 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:19:04.846626 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-26b7baee-eb49-47d1-bec7-c42a2129791d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:19:04.857252 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-26b7baee-eb49-47d1-bec7-c42a2129791d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.189775 Jun 17 15:19:04.858060 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 380/968] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:19:04 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:19:05.129239 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-fc2313f4-9e58-47ce-98d9-8b110d1c0fa1 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:05.130215 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-fc2313f4-9e58-47ce-98d9-8b110d1c0fa1 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:05.140448 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fc2313f4-9e58-47ce-98d9-8b110d1c0fa1 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:05.141110 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fc2313f4-9e58-47ce-98d9-8b110d1c0fa1 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:05.142219 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fc2313f4-9e58-47ce-98d9-8b110d1c0fa1 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:05.142876 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fc2313f4-9e58-47ce-98d9-8b110d1c0fa1 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:05.231636 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-fc2313f4-9e58-47ce-98d9-8b110d1c0fa1 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:19:05.241333 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-fc2313f4-9e58-47ce-98d9-8b110d1c0fa1 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.117658 Jun 17 15:19:05.241948 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 589/969] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:19:05 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:19:05.689790 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-056602be-0bde-4b90-816b-314ee2664555 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:05.690738 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-056602be-0bde-4b90-816b-314ee2664555 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:05.698413 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-056602be-0bde-4b90-816b-314ee2664555 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:05.698883 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-056602be-0bde-4b90-816b-314ee2664555 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:05.699683 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-056602be-0bde-4b90-816b-314ee2664555 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:05.700796 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-056602be-0bde-4b90-816b-314ee2664555 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:05.733828 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-056602be-0bde-4b90-816b-314ee2664555 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048243 Jun 17 15:19:05.734442 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 381/970] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:19:05 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:19:05.749893 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-30123be4-5471-49c1-b115-4530ee74c202 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:05.750823 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-30123be4-5471-49c1-b115-4530ee74c202 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:05.757769 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-30123be4-5471-49c1-b115-4530ee74c202 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:05.758302 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-30123be4-5471-49c1-b115-4530ee74c202 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:05.759168 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-30123be4-5471-49c1-b115-4530ee74c202 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:05.759679 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-30123be4-5471-49c1-b115-4530ee74c202 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:05.793916 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-30123be4-5471-49c1-b115-4530ee74c202 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048362 Jun 17 15:19:05.794505 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 590/971] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:19:05 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:19:05.878260 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-7627b286-cc4b-41c1-823b-4abd5ddd16ea tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:05.878872 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-7627b286-cc4b-41c1-823b-4abd5ddd16ea tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:05.885296 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7627b286-cc4b-41c1-823b-4abd5ddd16ea tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:05.885738 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7627b286-cc4b-41c1-823b-4abd5ddd16ea tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:05.886508 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7627b286-cc4b-41c1-823b-4abd5ddd16ea tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:05.886955 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7627b286-cc4b-41c1-823b-4abd5ddd16ea tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:06.039370 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-7627b286-cc4b-41c1-823b-4abd5ddd16ea tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:19:06.049662 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-7627b286-cc4b-41c1-823b-4abd5ddd16ea tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.175243 Jun 17 15:19:06.050293 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 382/972] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:19:05 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:19:06.259195 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-24306c30-2a51-4a7b-971b-83552006e2a2 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:06.259717 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-24306c30-2a51-4a7b-971b-83552006e2a2 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:06.267149 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-24306c30-2a51-4a7b-971b-83552006e2a2 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:06.267600 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-24306c30-2a51-4a7b-971b-83552006e2a2 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:06.268694 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-24306c30-2a51-4a7b-971b-83552006e2a2 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:06.269131 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-24306c30-2a51-4a7b-971b-83552006e2a2 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:06.337896 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-24306c30-2a51-4a7b-971b-83552006e2a2 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:19:06.346167 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-24306c30-2a51-4a7b-971b-83552006e2a2 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.090935 Jun 17 15:19:06.346831 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 591/973] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:19:06 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:19:06.745160 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-79d6da53-cef9-4fd8-a6b2-679da2a19f64 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:06.746086 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-79d6da53-cef9-4fd8-a6b2-679da2a19f64 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:06.753315 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-79d6da53-cef9-4fd8-a6b2-679da2a19f64 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:06.753759 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-79d6da53-cef9-4fd8-a6b2-679da2a19f64 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:06.754517 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-79d6da53-cef9-4fd8-a6b2-679da2a19f64 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:06.754946 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-79d6da53-cef9-4fd8-a6b2-679da2a19f64 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:06.785618 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-79d6da53-cef9-4fd8-a6b2-679da2a19f64 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044334 Jun 17 15:19:06.786193 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 383/974] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:19:06 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:19:06.806604 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-4e3732d6-3139-4776-b460-1a0101da5c08 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:06.807518 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-4e3732d6-3139-4776-b460-1a0101da5c08 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:06.814414 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4e3732d6-3139-4776-b460-1a0101da5c08 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:06.814875 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4e3732d6-3139-4776-b460-1a0101da5c08 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:06.815616 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4e3732d6-3139-4776-b460-1a0101da5c08 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:06.816046 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4e3732d6-3139-4776-b460-1a0101da5c08 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:06.846982 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-4e3732d6-3139-4776-b460-1a0101da5c08 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044495 Jun 17 15:19:06.847545 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 592/975] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:19:06 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 15:19:07.068980 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-3bfa082c-762b-4173-86ce-de5524b10b41 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:07.069598 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-3bfa082c-762b-4173-86ce-de5524b10b41 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:07.075657 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3bfa082c-762b-4173-86ce-de5524b10b41 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:07.076106 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3bfa082c-762b-4173-86ce-de5524b10b41 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:07.076915 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3bfa082c-762b-4173-86ce-de5524b10b41 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:07.077338 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3bfa082c-762b-4173-86ce-de5524b10b41 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:07.372658 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-c03703fe-6a4d-466d-ac40-0e622c099401 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:07.378644 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-c03703fe-6a4d-466d-ac40-0e622c099401 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:07.386066 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c03703fe-6a4d-466d-ac40-0e622c099401 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:07.386887 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c03703fe-6a4d-466d-ac40-0e622c099401 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:07.387883 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c03703fe-6a4d-466d-ac40-0e622c099401 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:07.388567 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c03703fe-6a4d-466d-ac40-0e622c099401 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:07.457810 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-c03703fe-6a4d-466d-ac40-0e622c099401 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:19:07.466579 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-c03703fe-6a4d-466d-ac40-0e622c099401 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.102328 Jun 17 15:19:07.467170 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 593/976] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:19:07 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:19:07.529202 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-3bfa082c-762b-4173-86ce-de5524b10b41 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:19:07.536998 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-3bfa082c-762b-4173-86ce-de5524b10b41 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.472159 Jun 17 15:19:07.537586 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 384/977] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:19:07 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:19:07.798947 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-f24b89b6-4277-46ef-bf0f-e4baf5edd704 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:07.799926 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-f24b89b6-4277-46ef-bf0f-e4baf5edd704 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:07.806304 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f24b89b6-4277-46ef-bf0f-e4baf5edd704 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:07.806800 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f24b89b6-4277-46ef-bf0f-e4baf5edd704 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:07.807649 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f24b89b6-4277-46ef-bf0f-e4baf5edd704 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:07.808024 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f24b89b6-4277-46ef-bf0f-e4baf5edd704 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:07.839462 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-f24b89b6-4277-46ef-bf0f-e4baf5edd704 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045117 Jun 17 15:19:07.840045 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 594/978] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:19:07 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:19:07.859678 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-4beffa8e-53c1-4695-9122-164e02302151 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:07.860685 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-4beffa8e-53c1-4695-9122-164e02302151 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:07.867676 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4beffa8e-53c1-4695-9122-164e02302151 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:07.868131 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4beffa8e-53c1-4695-9122-164e02302151 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:07.869057 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4beffa8e-53c1-4695-9122-164e02302151 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:07.869496 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4beffa8e-53c1-4695-9122-164e02302151 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:07.901535 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-4beffa8e-53c1-4695-9122-164e02302151 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046778 Jun 17 15:19:07.902159 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 385/979] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:19:07 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 15:19:08.483815 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-0a7bac1b-63d9-4a6f-8010-326982bbafe0 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:08.484443 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-0a7bac1b-63d9-4a6f-8010-326982bbafe0 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:08.490601 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0a7bac1b-63d9-4a6f-8010-326982bbafe0 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:08.491042 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0a7bac1b-63d9-4a6f-8010-326982bbafe0 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:08.491817 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0a7bac1b-63d9-4a6f-8010-326982bbafe0 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:08.492242 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0a7bac1b-63d9-4a6f-8010-326982bbafe0 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:08.553946 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-0a7bac1b-63d9-4a6f-8010-326982bbafe0 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:19:08.554985 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-c6456959-a2df-4ee2-9dd8-210b2a8654a6 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:08.555667 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-c6456959-a2df-4ee2-9dd8-210b2a8654a6 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:08.561781 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c6456959-a2df-4ee2-9dd8-210b2a8654a6 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:08.562222 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-0a7bac1b-63d9-4a6f-8010-326982bbafe0 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.082981 Jun 17 15:19:08.562480 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c6456959-a2df-4ee2-9dd8-210b2a8654a6 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:08.562840 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 595/980] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:19:08 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:19:08.563095 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c6456959-a2df-4ee2-9dd8-210b2a8654a6 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:08.563397 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c6456959-a2df-4ee2-9dd8-210b2a8654a6 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:08.701056 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-c6456959-a2df-4ee2-9dd8-210b2a8654a6 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:19:08.708845 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-c6456959-a2df-4ee2-9dd8-210b2a8654a6 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.157902 Jun 17 15:19:08.709425 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 386/981] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:19:08 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:19:08.851191 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-3e7b8a4f-014f-47a0-9197-a2d9309ac50f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:08.852120 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-3e7b8a4f-014f-47a0-9197-a2d9309ac50f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:08.858720 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3e7b8a4f-014f-47a0-9197-a2d9309ac50f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:08.859168 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3e7b8a4f-014f-47a0-9197-a2d9309ac50f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:08.859930 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3e7b8a4f-014f-47a0-9197-a2d9309ac50f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:08.860389 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3e7b8a4f-014f-47a0-9197-a2d9309ac50f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:08.888793 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-3e7b8a4f-014f-47a0-9197-a2d9309ac50f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041535 Jun 17 15:19:08.889347 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 596/982] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:19:08 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:19:08.915160 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-9a96a536-b8ba-4125-9a8c-c3b3d2acccb5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:08.916073 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-9a96a536-b8ba-4125-9a8c-c3b3d2acccb5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:08.922620 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9a96a536-b8ba-4125-9a8c-c3b3d2acccb5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:08.923061 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9a96a536-b8ba-4125-9a8c-c3b3d2acccb5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:08.923815 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9a96a536-b8ba-4125-9a8c-c3b3d2acccb5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:08.924241 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9a96a536-b8ba-4125-9a8c-c3b3d2acccb5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:08.952803 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-9a96a536-b8ba-4125-9a8c-c3b3d2acccb5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041633 Jun 17 15:19:08.953347 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 387/983] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:19:08 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:19:09.580904 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-815c8031-805e-47e1-8f04-0b760b8be88b tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:09.581533 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-815c8031-805e-47e1-8f04-0b760b8be88b tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:09.587576 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-815c8031-805e-47e1-8f04-0b760b8be88b tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:09.588019 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-815c8031-805e-47e1-8f04-0b760b8be88b tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:09.588800 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-815c8031-805e-47e1-8f04-0b760b8be88b tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:09.589225 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-815c8031-805e-47e1-8f04-0b760b8be88b tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:09.653921 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-815c8031-805e-47e1-8f04-0b760b8be88b tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:19:09.661412 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-815c8031-805e-47e1-8f04-0b760b8be88b tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.084390 Jun 17 15:19:09.661962 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 597/984] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:19:09 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:19:09.725948 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-215063d8-583e-4e0e-8e0f-d09d83e50561 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:09.726560 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-215063d8-583e-4e0e-8e0f-d09d83e50561 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:09.732560 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-215063d8-583e-4e0e-8e0f-d09d83e50561 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:09.733016 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-215063d8-583e-4e0e-8e0f-d09d83e50561 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:09.733770 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-215063d8-583e-4e0e-8e0f-d09d83e50561 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:09.734205 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-215063d8-583e-4e0e-8e0f-d09d83e50561 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:09.863660 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-215063d8-583e-4e0e-8e0f-d09d83e50561 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:19:09.872476 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-215063d8-583e-4e0e-8e0f-d09d83e50561 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.149745 Jun 17 15:19:09.873333 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 388/985] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:19:09 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:19:09.900280 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-00b38f14-6b66-48f6-a2d1-a77495f10403 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:09.901313 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-00b38f14-6b66-48f6-a2d1-a77495f10403 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:09.907748 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-00b38f14-6b66-48f6-a2d1-a77495f10403 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:09.908213 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-00b38f14-6b66-48f6-a2d1-a77495f10403 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:09.909004 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-00b38f14-6b66-48f6-a2d1-a77495f10403 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:09.909437 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-00b38f14-6b66-48f6-a2d1-a77495f10403 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:09.937948 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-00b38f14-6b66-48f6-a2d1-a77495f10403 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041620 Jun 17 15:19:09.938501 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 598/986] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:19:09 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:19:09.963426 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-f5e848c1-a9dd-4136-8c42-0a0d89801a7c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:09.964393 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-f5e848c1-a9dd-4136-8c42-0a0d89801a7c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:09.970926 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f5e848c1-a9dd-4136-8c42-0a0d89801a7c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:09.971364 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f5e848c1-a9dd-4136-8c42-0a0d89801a7c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:09.972114 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f5e848c1-a9dd-4136-8c42-0a0d89801a7c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:09.972601 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f5e848c1-a9dd-4136-8c42-0a0d89801a7c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:10.001707 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-f5e848c1-a9dd-4136-8c42-0a0d89801a7c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042211 Jun 17 15:19:10.002248 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 389/987] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:19:09 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:19:10.678428 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-9c043c3c-6f98-4ee1-832a-9944dcd3de5b tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:10.678946 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-9c043c3c-6f98-4ee1-832a-9944dcd3de5b tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:10.684966 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9c043c3c-6f98-4ee1-832a-9944dcd3de5b tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:10.685408 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9c043c3c-6f98-4ee1-832a-9944dcd3de5b tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:10.686158 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9c043c3c-6f98-4ee1-832a-9944dcd3de5b tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:10.686587 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9c043c3c-6f98-4ee1-832a-9944dcd3de5b tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:10.690613 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=100 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:19:10.748300 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-9c043c3c-6f98-4ee1-832a-9944dcd3de5b tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:19:10.755862 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-9c043c3c-6f98-4ee1-832a-9944dcd3de5b tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.081404 Jun 17 15:19:10.756444 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 599/988] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:19:10 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:19:10.890113 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-3a27d491-1c8d-49d7-a8d0-ba6b4bf094a8 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:10.890714 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-3a27d491-1c8d-49d7-a8d0-ba6b4bf094a8 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:10.896793 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3a27d491-1c8d-49d7-a8d0-ba6b4bf094a8 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:10.897236 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3a27d491-1c8d-49d7-a8d0-ba6b4bf094a8 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:10.898017 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3a27d491-1c8d-49d7-a8d0-ba6b4bf094a8 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:10.898442 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3a27d491-1c8d-49d7-a8d0-ba6b4bf094a8 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:10.949741 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-c2838328-87e7-457e-93ce-31be04dfe57c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:10.951058 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-c2838328-87e7-457e-93ce-31be04dfe57c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:10.957757 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c2838328-87e7-457e-93ce-31be04dfe57c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:10.958204 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c2838328-87e7-457e-93ce-31be04dfe57c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:10.958967 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c2838328-87e7-457e-93ce-31be04dfe57c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:10.959390 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c2838328-87e7-457e-93ce-31be04dfe57c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:10.990458 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-c2838328-87e7-457e-93ce-31be04dfe57c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044749 Jun 17 15:19:10.991025 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 600/989] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:19:10 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:19:11.013969 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-d42aed35-d316-4b8a-867a-0e7b19c10f9a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:11.014883 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-d42aed35-d316-4b8a-867a-0e7b19c10f9a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:11.021197 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d42aed35-d316-4b8a-867a-0e7b19c10f9a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:11.021640 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d42aed35-d316-4b8a-867a-0e7b19c10f9a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:11.022408 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d42aed35-d316-4b8a-867a-0e7b19c10f9a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:11.022836 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d42aed35-d316-4b8a-867a-0e7b19c10f9a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:11.037865 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-3a27d491-1c8d-49d7-a8d0-ba6b4bf094a8 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:19:11.045859 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-3a27d491-1c8d-49d7-a8d0-ba6b4bf094a8 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.160042 Jun 17 15:19:11.046446 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 390/990] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:19:10 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:19:11.054136 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-d42aed35-d316-4b8a-867a-0e7b19c10f9a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044625 Jun 17 15:19:11.054728 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 601/991] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:19:11 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 15:19:11.774392 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-b4506c77-cbca-468f-b0f4-85b0903d6b2f tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:11.774944 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-b4506c77-cbca-468f-b0f4-85b0903d6b2f tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:11.781154 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b4506c77-cbca-468f-b0f4-85b0903d6b2f tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:11.782600 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b4506c77-cbca-468f-b0f4-85b0903d6b2f tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:11.783439 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b4506c77-cbca-468f-b0f4-85b0903d6b2f tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:11.783883 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b4506c77-cbca-468f-b0f4-85b0903d6b2f tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:11.847227 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-b4506c77-cbca-468f-b0f4-85b0903d6b2f tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:19:11.854528 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-b4506c77-cbca-468f-b0f4-85b0903d6b2f tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.085253 Jun 17 15:19:11.855092 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 391/992] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:19:11 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:19:12.002550 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-d756f29b-1198-4fc5-ae63-1874d9834ec8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:12.003468 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-d756f29b-1198-4fc5-ae63-1874d9834ec8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:12.009941 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d756f29b-1198-4fc5-ae63-1874d9834ec8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:12.010386 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d756f29b-1198-4fc5-ae63-1874d9834ec8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:12.011145 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d756f29b-1198-4fc5-ae63-1874d9834ec8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:12.011578 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d756f29b-1198-4fc5-ae63-1874d9834ec8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:12.040570 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-d756f29b-1198-4fc5-ae63-1874d9834ec8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041840 Jun 17 15:19:12.041044 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 602/993] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:19:11 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:19:12.063048 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-5df31f4e-7a3d-4a17-b628-73741905368e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:12.063941 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-5df31f4e-7a3d-4a17-b628-73741905368e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:12.067123 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-9d296917-e5ef-4bb9-bc11-d447d76a59e8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:12.068034 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-9d296917-e5ef-4bb9-bc11-d447d76a59e8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:12.070419 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5df31f4e-7a3d-4a17-b628-73741905368e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:12.070934 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5df31f4e-7a3d-4a17-b628-73741905368e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:12.071703 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5df31f4e-7a3d-4a17-b628-73741905368e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:12.072302 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5df31f4e-7a3d-4a17-b628-73741905368e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:12.074502 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9d296917-e5ef-4bb9-bc11-d447d76a59e8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:12.074953 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9d296917-e5ef-4bb9-bc11-d447d76a59e8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:12.075722 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9d296917-e5ef-4bb9-bc11-d447d76a59e8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:12.076460 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9d296917-e5ef-4bb9-bc11-d447d76a59e8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:12.109536 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-9d296917-e5ef-4bb9-bc11-d447d76a59e8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047064 Jun 17 15:19:12.110130 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 603/994] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:19:12 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 15:19:12.217378 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-5df31f4e-7a3d-4a17-b628-73741905368e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:19:12.225233 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-5df31f4e-7a3d-4a17-b628-73741905368e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.166062 Jun 17 15:19:12.225835 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 392/995] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:19:12 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:19:12.873344 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-804e47de-ebac-44c6-bc8c-c37d60db2a45 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:12.874340 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-804e47de-ebac-44c6-bc8c-c37d60db2a45 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:12.880359 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-804e47de-ebac-44c6-bc8c-c37d60db2a45 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:12.880811 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-804e47de-ebac-44c6-bc8c-c37d60db2a45 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:12.881570 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-804e47de-ebac-44c6-bc8c-c37d60db2a45 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:12.881996 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-804e47de-ebac-44c6-bc8c-c37d60db2a45 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:12.941854 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-804e47de-ebac-44c6-bc8c-c37d60db2a45 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:19:12.949395 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-804e47de-ebac-44c6-bc8c-c37d60db2a45 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.081291 Jun 17 15:19:12.949944 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 604/996] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:19:12 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:19:13.052837 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-8b1ba617-965d-4c6c-b15f-9376ff1cbab7 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:13.053787 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-8b1ba617-965d-4c6c-b15f-9376ff1cbab7 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:13.060214 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8b1ba617-965d-4c6c-b15f-9376ff1cbab7 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:13.060694 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8b1ba617-965d-4c6c-b15f-9376ff1cbab7 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:13.061451 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8b1ba617-965d-4c6c-b15f-9376ff1cbab7 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:13.061883 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8b1ba617-965d-4c6c-b15f-9376ff1cbab7 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:13.078512 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell1:SELECT=100 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:19:13.091299 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-8b1ba617-965d-4c6c-b15f-9376ff1cbab7 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042125 Jun 17 15:19:13.091865 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 393/997] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:19:13 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:19:13.121411 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-43e23ff6-7424-443a-9c53-3b3d110fcdf4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:13.122850 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-43e23ff6-7424-443a-9c53-3b3d110fcdf4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:13.129340 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-43e23ff6-7424-443a-9c53-3b3d110fcdf4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:13.129724 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-43e23ff6-7424-443a-9c53-3b3d110fcdf4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:13.130478 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-43e23ff6-7424-443a-9c53-3b3d110fcdf4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:13.130908 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-43e23ff6-7424-443a-9c53-3b3d110fcdf4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:13.161822 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-43e23ff6-7424-443a-9c53-3b3d110fcdf4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044314 Jun 17 15:19:13.162575 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 605/998] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:19:13 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:19:13.242818 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-cbe3ca3b-c4b9-47d3-90bd-38c2ffac8dc5 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:13.243435 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-cbe3ca3b-c4b9-47d3-90bd-38c2ffac8dc5 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:13.250093 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cbe3ca3b-c4b9-47d3-90bd-38c2ffac8dc5 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:13.250541 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cbe3ca3b-c4b9-47d3-90bd-38c2ffac8dc5 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:13.251455 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cbe3ca3b-c4b9-47d3-90bd-38c2ffac8dc5 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:13.251895 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cbe3ca3b-c4b9-47d3-90bd-38c2ffac8dc5 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:13.386728 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-cbe3ca3b-c4b9-47d3-90bd-38c2ffac8dc5 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:19:13.394525 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-cbe3ca3b-c4b9-47d3-90bd-38c2ffac8dc5 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.155554 Jun 17 15:19:13.395082 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 394/999] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:19:13 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:19:13.967117 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-be491ab0-c756-4d3a-bc45-3d79d8da352a tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:13.967779 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-be491ab0-c756-4d3a-bc45-3d79d8da352a tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:13.973774 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-be491ab0-c756-4d3a-bc45-3d79d8da352a tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:13.974230 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-be491ab0-c756-4d3a-bc45-3d79d8da352a tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:13.974987 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-be491ab0-c756-4d3a-bc45-3d79d8da352a tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:13.975422 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-be491ab0-c756-4d3a-bc45-3d79d8da352a tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:14.035793 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-be491ab0-c756-4d3a-bc45-3d79d8da352a tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:19:14.043344 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-be491ab0-c756-4d3a-bc45-3d79d8da352a tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.080380 Jun 17 15:19:14.044435 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 606/1000] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:19:13 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:19:14.102159 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-8b4e31ca-01e4-4a97-8f7c-10d313ebcbd1 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:14.103103 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-8b4e31ca-01e4-4a97-8f7c-10d313ebcbd1 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:14.110109 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8b4e31ca-01e4-4a97-8f7c-10d313ebcbd1 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:14.110558 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8b4e31ca-01e4-4a97-8f7c-10d313ebcbd1 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:14.111315 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8b4e31ca-01e4-4a97-8f7c-10d313ebcbd1 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:14.111749 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8b4e31ca-01e4-4a97-8f7c-10d313ebcbd1 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:14.140490 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-8b4e31ca-01e4-4a97-8f7c-10d313ebcbd1 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042251 Jun 17 15:19:14.141087 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 395/1001] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:19:14 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:19:14.176497 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-6a31f104-4431-47e3-9594-e394644d048c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:14.177603 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-6a31f104-4431-47e3-9594-e394644d048c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:14.185842 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6a31f104-4431-47e3-9594-e394644d048c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:14.186353 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6a31f104-4431-47e3-9594-e394644d048c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:14.187200 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6a31f104-4431-47e3-9594-e394644d048c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:14.187709 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6a31f104-4431-47e3-9594-e394644d048c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:14.222403 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-6a31f104-4431-47e3-9594-e394644d048c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050709 Jun 17 15:19:14.222932 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 607/1002] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:19:14 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:19:14.411078 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-091f6062-6ae6-4034-a986-daa080f8f938 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:14.411687 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-091f6062-6ae6-4034-a986-daa080f8f938 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:14.417834 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-091f6062-6ae6-4034-a986-daa080f8f938 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:14.418278 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-091f6062-6ae6-4034-a986-daa080f8f938 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:14.419620 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-091f6062-6ae6-4034-a986-daa080f8f938 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:14.420052 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-091f6062-6ae6-4034-a986-daa080f8f938 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:14.550680 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-091f6062-6ae6-4034-a986-daa080f8f938 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:19:14.558145 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-091f6062-6ae6-4034-a986-daa080f8f938 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.150958 Jun 17 15:19:14.558716 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 396/1003] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:19:14 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:19:15.061006 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-54d2d1ac-a53c-4214-a29f-7fa1ef559805 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:15.061642 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-54d2d1ac-a53c-4214-a29f-7fa1ef559805 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:15.067640 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-54d2d1ac-a53c-4214-a29f-7fa1ef559805 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:15.068087 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-54d2d1ac-a53c-4214-a29f-7fa1ef559805 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:15.068871 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-54d2d1ac-a53c-4214-a29f-7fa1ef559805 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:15.069304 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-54d2d1ac-a53c-4214-a29f-7fa1ef559805 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:15.134617 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-54d2d1ac-a53c-4214-a29f-7fa1ef559805 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:19:15.142801 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-54d2d1ac-a53c-4214-a29f-7fa1ef559805 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.086253 Jun 17 15:19:15.143364 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 608/1004] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:19:15 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:19:15.151109 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-6fd4c65a-9dd4-4ed8-b043-35257a61c954 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:15.152171 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-6fd4c65a-9dd4-4ed8-b043-35257a61c954 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:15.158360 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6fd4c65a-9dd4-4ed8-b043-35257a61c954 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:15.158794 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6fd4c65a-9dd4-4ed8-b043-35257a61c954 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:15.159551 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6fd4c65a-9dd4-4ed8-b043-35257a61c954 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:15.159975 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6fd4c65a-9dd4-4ed8-b043-35257a61c954 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:15.191797 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-6fd4c65a-9dd4-4ed8-b043-35257a61c954 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044593 Jun 17 15:19:15.192414 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 397/1005] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:19:15 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:19:15.238874 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-fa07b7be-4ef0-425a-9d1e-c3373291bd26 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:15.240713 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-fa07b7be-4ef0-425a-9d1e-c3373291bd26 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:15.247791 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fa07b7be-4ef0-425a-9d1e-c3373291bd26 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:15.248236 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fa07b7be-4ef0-425a-9d1e-c3373291bd26 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:15.249029 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fa07b7be-4ef0-425a-9d1e-c3373291bd26 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:15.249462 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fa07b7be-4ef0-425a-9d1e-c3373291bd26 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:15.278924 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-fa07b7be-4ef0-425a-9d1e-c3373291bd26 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047534 Jun 17 15:19:15.279480 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 609/1006] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:19:15 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:19:15.575025 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-c43147af-d404-4a11-b18a-2b8cf7cf7e01 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:15.575550 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-c43147af-d404-4a11-b18a-2b8cf7cf7e01 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:15.582005 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c43147af-d404-4a11-b18a-2b8cf7cf7e01 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:15.582443 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c43147af-d404-4a11-b18a-2b8cf7cf7e01 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:15.583191 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c43147af-d404-4a11-b18a-2b8cf7cf7e01 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:15.583619 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c43147af-d404-4a11-b18a-2b8cf7cf7e01 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:15.719165 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-c43147af-d404-4a11-b18a-2b8cf7cf7e01 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:19:15.726963 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-c43147af-d404-4a11-b18a-2b8cf7cf7e01 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.155816 Jun 17 15:19:15.727530 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 398/1007] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:19:15 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:19:16.159556 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-8a1642d2-7aa6-4ffb-b8a2-1e91bd290944 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:16.160239 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-8a1642d2-7aa6-4ffb-b8a2-1e91bd290944 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:16.167777 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8a1642d2-7aa6-4ffb-b8a2-1e91bd290944 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:16.168227 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8a1642d2-7aa6-4ffb-b8a2-1e91bd290944 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:16.169021 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8a1642d2-7aa6-4ffb-b8a2-1e91bd290944 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:16.169456 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8a1642d2-7aa6-4ffb-b8a2-1e91bd290944 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:16.204167 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-07c2f529-18d8-4345-9975-2e41b7f16483 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:16.205287 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-07c2f529-18d8-4345-9975-2e41b7f16483 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:16.211569 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-07c2f529-18d8-4345-9975-2e41b7f16483 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:16.212200 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-07c2f529-18d8-4345-9975-2e41b7f16483 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:16.213085 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-07c2f529-18d8-4345-9975-2e41b7f16483 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:16.213521 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-07c2f529-18d8-4345-9975-2e41b7f16483 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:16.243653 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-07c2f529-18d8-4345-9975-2e41b7f16483 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044176 Jun 17 15:19:16.244217 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 399/1008] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:19:16 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:19:16.244432 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-8a1642d2-7aa6-4ffb-b8a2-1e91bd290944 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:19:16.252885 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-8a1642d2-7aa6-4ffb-b8a2-1e91bd290944 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.097145 Jun 17 15:19:16.253465 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 610/1009] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:19:16 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:19:16.290166 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-61ea13e7-9bb0-4822-8b78-935dc0af5be1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:16.291076 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-61ea13e7-9bb0-4822-8b78-935dc0af5be1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:16.297012 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-61ea13e7-9bb0-4822-8b78-935dc0af5be1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:16.297451 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-61ea13e7-9bb0-4822-8b78-935dc0af5be1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:16.298203 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-61ea13e7-9bb0-4822-8b78-935dc0af5be1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:16.298630 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-61ea13e7-9bb0-4822-8b78-935dc0af5be1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:16.327517 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-61ea13e7-9bb0-4822-8b78-935dc0af5be1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041411 Jun 17 15:19:16.328064 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 400/1010] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:19:16 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:19:16.743628 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-7dceb588-88fa-45d7-9812-7ee5a0f2f6eb tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:16.744221 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-7dceb588-88fa-45d7-9812-7ee5a0f2f6eb tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:16.750958 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7dceb588-88fa-45d7-9812-7ee5a0f2f6eb tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:16.751412 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7dceb588-88fa-45d7-9812-7ee5a0f2f6eb tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:16.752207 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7dceb588-88fa-45d7-9812-7ee5a0f2f6eb tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:16.752777 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7dceb588-88fa-45d7-9812-7ee5a0f2f6eb tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:16.882715 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-7dceb588-88fa-45d7-9812-7ee5a0f2f6eb tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:19:16.890886 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-7dceb588-88fa-45d7-9812-7ee5a0f2f6eb tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.151213 Jun 17 15:19:16.891450 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 611/1011] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:19:16 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:19:17.255219 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-e4ccd6da-da78-4e44-ab14-95f88975805c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:17.256132 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-e4ccd6da-da78-4e44-ab14-95f88975805c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:17.262515 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e4ccd6da-da78-4e44-ab14-95f88975805c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:17.262959 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e4ccd6da-da78-4e44-ab14-95f88975805c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:17.263744 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e4ccd6da-da78-4e44-ab14-95f88975805c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:17.265342 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e4ccd6da-da78-4e44-ab14-95f88975805c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:17.270513 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-1ec7598e-9132-4a1e-8c3b-0efb37e06c90 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:17.271121 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-1ec7598e-9132-4a1e-8c3b-0efb37e06c90 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:17.277570 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1ec7598e-9132-4a1e-8c3b-0efb37e06c90 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:17.278506 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1ec7598e-9132-4a1e-8c3b-0efb37e06c90 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:17.279271 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1ec7598e-9132-4a1e-8c3b-0efb37e06c90 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:17.279697 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1ec7598e-9132-4a1e-8c3b-0efb37e06c90 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:17.294473 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-e4ccd6da-da78-4e44-ab14-95f88975805c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042581 Jun 17 15:19:17.295040 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 401/1012] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:19:17 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:19:17.339292 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-4cc9a060-07e8-4e93-8e78-d3af2175b3b2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:17.340213 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-4cc9a060-07e8-4e93-8e78-d3af2175b3b2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:17.341740 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-1ec7598e-9132-4a1e-8c3b-0efb37e06c90 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:19:17.347164 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4cc9a060-07e8-4e93-8e78-d3af2175b3b2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:17.347687 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4cc9a060-07e8-4e93-8e78-d3af2175b3b2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:17.348505 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4cc9a060-07e8-4e93-8e78-d3af2175b3b2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:17.348989 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4cc9a060-07e8-4e93-8e78-d3af2175b3b2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:17.354933 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-1ec7598e-9132-4a1e-8c3b-0efb37e06c90 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.088216 Jun 17 15:19:17.355503 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 612/1013] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:19:17 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:19:17.378151 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-4cc9a060-07e8-4e93-8e78-d3af2175b3b2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042800 Jun 17 15:19:17.378911 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 402/1014] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:19:17 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 15:19:17.906984 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-1e0745ed-5ba8-45b3-8ca6-26abcc5fb8bb tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:17.907589 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-1e0745ed-5ba8-45b3-8ca6-26abcc5fb8bb tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:17.913637 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1e0745ed-5ba8-45b3-8ca6-26abcc5fb8bb tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:17.914078 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1e0745ed-5ba8-45b3-8ca6-26abcc5fb8bb tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:17.914827 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1e0745ed-5ba8-45b3-8ca6-26abcc5fb8bb tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:17.915257 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1e0745ed-5ba8-45b3-8ca6-26abcc5fb8bb tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:18.048200 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-1e0745ed-5ba8-45b3-8ca6-26abcc5fb8bb tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:19:18.055185 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-1e0745ed-5ba8-45b3-8ca6-26abcc5fb8bb tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.152122 Jun 17 15:19:18.055735 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 613/1015] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:19:17 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:19:18.306287 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-0748ec2c-053b-4b8f-99aa-f1c88b91a6e3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:18.307119 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-0748ec2c-053b-4b8f-99aa-f1c88b91a6e3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:18.313505 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0748ec2c-053b-4b8f-99aa-f1c88b91a6e3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:18.313949 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0748ec2c-053b-4b8f-99aa-f1c88b91a6e3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:18.314695 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0748ec2c-053b-4b8f-99aa-f1c88b91a6e3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:18.315120 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0748ec2c-053b-4b8f-99aa-f1c88b91a6e3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:18.344823 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-0748ec2c-053b-4b8f-99aa-f1c88b91a6e3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042314 Jun 17 15:19:18.345416 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 403/1016] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:19:18 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:19:18.372279 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-039af644-0dff-4ccd-ad9d-f6f41202c4fb tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:18.372928 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-039af644-0dff-4ccd-ad9d-f6f41202c4fb tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:18.379569 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-039af644-0dff-4ccd-ad9d-f6f41202c4fb tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:18.380023 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-039af644-0dff-4ccd-ad9d-f6f41202c4fb tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:18.380822 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-039af644-0dff-4ccd-ad9d-f6f41202c4fb tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:18.381263 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-039af644-0dff-4ccd-ad9d-f6f41202c4fb tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:18.390516 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-38a60a0f-9ec0-47ee-8b12-69cb319a9ed7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:18.391422 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-38a60a0f-9ec0-47ee-8b12-69cb319a9ed7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:18.397360 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-38a60a0f-9ec0-47ee-8b12-69cb319a9ed7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:18.397800 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-38a60a0f-9ec0-47ee-8b12-69cb319a9ed7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:18.398551 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-38a60a0f-9ec0-47ee-8b12-69cb319a9ed7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:18.398976 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-38a60a0f-9ec0-47ee-8b12-69cb319a9ed7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:18.429544 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-38a60a0f-9ec0-47ee-8b12-69cb319a9ed7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043631 Jun 17 15:19:18.430115 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 404/1017] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:19:18 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 15:19:18.444473 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-039af644-0dff-4ccd-ad9d-f6f41202c4fb tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:19:18.452692 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-039af644-0dff-4ccd-ad9d-f6f41202c4fb tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.084301 Jun 17 15:19:18.453253 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 614/1018] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:19:18 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:19:19.071805 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-9af2a74b-87a3-4204-8a12-2be7c0cb03f3 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:19.072479 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-9af2a74b-87a3-4204-8a12-2be7c0cb03f3 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:19.079220 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9af2a74b-87a3-4204-8a12-2be7c0cb03f3 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:19.079669 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9af2a74b-87a3-4204-8a12-2be7c0cb03f3 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:19.080447 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9af2a74b-87a3-4204-8a12-2be7c0cb03f3 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:19.080877 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9af2a74b-87a3-4204-8a12-2be7c0cb03f3 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:19.227245 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-9af2a74b-87a3-4204-8a12-2be7c0cb03f3 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:19:19.236030 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-9af2a74b-87a3-4204-8a12-2be7c0cb03f3 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.168037 Jun 17 15:19:19.236745 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 405/1019] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:19:19 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:19:19.356827 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-bbddff22-ad9f-4634-b7cf-96978db00c39 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:19.357751 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-bbddff22-ad9f-4634-b7cf-96978db00c39 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:19.360678 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_api:SELECT=100 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:19:19.364405 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bbddff22-ad9f-4634-b7cf-96978db00c39 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:19.364869 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bbddff22-ad9f-4634-b7cf-96978db00c39 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:19.365639 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bbddff22-ad9f-4634-b7cf-96978db00c39 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:19.366074 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bbddff22-ad9f-4634-b7cf-96978db00c39 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:19.391527 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=100 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:19:19.396537 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-bbddff22-ad9f-4634-b7cf-96978db00c39 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043857 Jun 17 15:19:19.397103 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 615/1020] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:19:19 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:19:19.441431 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-bb4ff81a-0642-4dec-bace-1461b9953ca2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:19.442352 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-bb4ff81a-0642-4dec-bace-1461b9953ca2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:19.448832 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bb4ff81a-0642-4dec-bace-1461b9953ca2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:19.449286 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bb4ff81a-0642-4dec-bace-1461b9953ca2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:19.450797 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bb4ff81a-0642-4dec-bace-1461b9953ca2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:19.451240 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bb4ff81a-0642-4dec-bace-1461b9953ca2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:19.470254 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-63990b0d-c1df-4cdf-b148-0a4a7bacde91 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:19.470854 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-63990b0d-c1df-4cdf-b148-0a4a7bacde91 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:19.476833 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-63990b0d-c1df-4cdf-b148-0a4a7bacde91 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:19.477210 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-63990b0d-c1df-4cdf-b148-0a4a7bacde91 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:19.477962 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-63990b0d-c1df-4cdf-b148-0a4a7bacde91 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:19.478397 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-63990b0d-c1df-4cdf-b148-0a4a7bacde91 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:19.481301 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-bb4ff81a-0642-4dec-bace-1461b9953ca2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043748 Jun 17 15:19:19.481875 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 406/1021] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:19:19 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:19:19.541511 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-63990b0d-c1df-4cdf-b148-0a4a7bacde91 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:19:19.549033 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-63990b0d-c1df-4cdf-b148-0a4a7bacde91 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.083620 Jun 17 15:19:19.549604 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 616/1022] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:19:19 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:19:20.253878 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-06010306-cf9e-44e7-89e4-016af536b624 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:20.254402 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-06010306-cf9e-44e7-89e4-016af536b624 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:20.260633 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-06010306-cf9e-44e7-89e4-016af536b624 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:20.261074 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-06010306-cf9e-44e7-89e4-016af536b624 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:20.261849 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-06010306-cf9e-44e7-89e4-016af536b624 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:20.262810 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-06010306-cf9e-44e7-89e4-016af536b624 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:20.394326 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-06010306-cf9e-44e7-89e4-016af536b624 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:19:20.401978 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-06010306-cf9e-44e7-89e4-016af536b624 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.151942 Jun 17 15:19:20.402540 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 407/1023] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:19:20 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:19:20.408479 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-5ebbfe0d-60ee-4925-bc95-5a4f660f04cd tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:20.409396 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-5ebbfe0d-60ee-4925-bc95-5a4f660f04cd tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:20.415852 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5ebbfe0d-60ee-4925-bc95-5a4f660f04cd tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:20.416293 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5ebbfe0d-60ee-4925-bc95-5a4f660f04cd tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:20.417092 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5ebbfe0d-60ee-4925-bc95-5a4f660f04cd tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:20.417519 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5ebbfe0d-60ee-4925-bc95-5a4f660f04cd tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:20.448428 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-5ebbfe0d-60ee-4925-bc95-5a4f660f04cd tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043801 Jun 17 15:19:20.448978 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 617/1024] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:19:20 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:19:20.492984 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-b426971b-1e42-45cc-8e89-3535fbfd1dde tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:20.493904 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-b426971b-1e42-45cc-8e89-3535fbfd1dde tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:20.500762 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b426971b-1e42-45cc-8e89-3535fbfd1dde tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:20.501201 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b426971b-1e42-45cc-8e89-3535fbfd1dde tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:20.501980 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b426971b-1e42-45cc-8e89-3535fbfd1dde tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:20.502405 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b426971b-1e42-45cc-8e89-3535fbfd1dde tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:20.531651 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-b426971b-1e42-45cc-8e89-3535fbfd1dde tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042527 Jun 17 15:19:20.532133 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 408/1025] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:19:20 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:19:20.566023 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-5cc4547b-ee73-454c-8ed6-98bd1498373b tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:20.566664 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-5cc4547b-ee73-454c-8ed6-98bd1498373b tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:20.572635 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5cc4547b-ee73-454c-8ed6-98bd1498373b tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:20.573083 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5cc4547b-ee73-454c-8ed6-98bd1498373b tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:20.573857 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5cc4547b-ee73-454c-8ed6-98bd1498373b tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:20.574279 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5cc4547b-ee73-454c-8ed6-98bd1498373b tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:20.638404 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-5cc4547b-ee73-454c-8ed6-98bd1498373b tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:19:20.645877 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-5cc4547b-ee73-454c-8ed6-98bd1498373b tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.083714 Jun 17 15:19:20.646437 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 618/1026] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:19:20 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:19:21.418863 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-bd2a3129-8ed4-42ee-ab46-4704a4878430 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:21.419500 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-bd2a3129-8ed4-42ee-ab46-4704a4878430 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:21.425453 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bd2a3129-8ed4-42ee-ab46-4704a4878430 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:21.425897 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bd2a3129-8ed4-42ee-ab46-4704a4878430 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:21.426642 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bd2a3129-8ed4-42ee-ab46-4704a4878430 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:21.427067 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bd2a3129-8ed4-42ee-ab46-4704a4878430 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:21.460874 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-b8e8fcaf-cd11-4f33-a8c0-8149c298a6e3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:21.461907 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-b8e8fcaf-cd11-4f33-a8c0-8149c298a6e3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:21.469685 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b8e8fcaf-cd11-4f33-a8c0-8149c298a6e3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:21.470219 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b8e8fcaf-cd11-4f33-a8c0-8149c298a6e3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:21.471082 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b8e8fcaf-cd11-4f33-a8c0-8149c298a6e3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:21.471613 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b8e8fcaf-cd11-4f33-a8c0-8149c298a6e3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:21.503836 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-b8e8fcaf-cd11-4f33-a8c0-8149c298a6e3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047041 Jun 17 15:19:21.504432 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 619/1027] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:19:21 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:19:21.543258 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-9e3cdf1a-15f2-4d68-a14f-a91b27c6707d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:21.544189 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-9e3cdf1a-15f2-4d68-a14f-a91b27c6707d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:21.550198 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9e3cdf1a-15f2-4d68-a14f-a91b27c6707d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:21.550661 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9e3cdf1a-15f2-4d68-a14f-a91b27c6707d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:21.551446 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9e3cdf1a-15f2-4d68-a14f-a91b27c6707d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:21.551881 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9e3cdf1a-15f2-4d68-a14f-a91b27c6707d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:21.562750 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-bd2a3129-8ed4-42ee-ab46-4704a4878430 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:19:21.570382 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-bd2a3129-8ed4-42ee-ab46-4704a4878430 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.155457 Jun 17 15:19:21.570949 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 409/1028] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:19:21 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:19:21.582592 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-9e3cdf1a-15f2-4d68-a14f-a91b27c6707d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043371 Jun 17 15:19:21.583169 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 620/1029] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:19:21 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 15:19:21.662399 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-f7924d56-0b31-4688-838d-17763b276ee6 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:21.662931 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-f7924d56-0b31-4688-838d-17763b276ee6 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:21.669240 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f7924d56-0b31-4688-838d-17763b276ee6 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:21.669689 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f7924d56-0b31-4688-838d-17763b276ee6 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:21.670466 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f7924d56-0b31-4688-838d-17763b276ee6 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:21.670915 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f7924d56-0b31-4688-838d-17763b276ee6 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:21.675665 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell1:SELECT=100 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:19:21.739148 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-f7924d56-0b31-4688-838d-17763b276ee6 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:19:21.747430 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-f7924d56-0b31-4688-838d-17763b276ee6 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.089044 Jun 17 15:19:21.748001 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 410/1030] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:19:21 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:19:22.516111 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-505574a2-19b2-4e8f-8b92-3e67425734c5 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:22.517135 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-505574a2-19b2-4e8f-8b92-3e67425734c5 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:22.523618 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-505574a2-19b2-4e8f-8b92-3e67425734c5 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:22.524068 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-505574a2-19b2-4e8f-8b92-3e67425734c5 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:22.524874 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-505574a2-19b2-4e8f-8b92-3e67425734c5 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:22.525313 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-505574a2-19b2-4e8f-8b92-3e67425734c5 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:22.553624 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-505574a2-19b2-4e8f-8b92-3e67425734c5 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042179 Jun 17 15:19:22.554175 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 621/1031] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:19:22 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:19:22.586832 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-42fb1e2f-486e-4784-bcff-7cd351d56507 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:22.587445 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-42fb1e2f-486e-4784-bcff-7cd351d56507 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:22.594271 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-27a5c077-83e5-4dcb-8d3b-b0b523c0ca11 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:22.594460 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-42fb1e2f-486e-4784-bcff-7cd351d56507 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:22.594761 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-42fb1e2f-486e-4784-bcff-7cd351d56507 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:22.595181 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-27a5c077-83e5-4dcb-8d3b-b0b523c0ca11 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:22.595549 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-42fb1e2f-486e-4784-bcff-7cd351d56507 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:22.595983 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-42fb1e2f-486e-4784-bcff-7cd351d56507 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:22.601248 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-27a5c077-83e5-4dcb-8d3b-b0b523c0ca11 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:22.601697 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-27a5c077-83e5-4dcb-8d3b-b0b523c0ca11 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:22.602480 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-27a5c077-83e5-4dcb-8d3b-b0b523c0ca11 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:22.602912 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-27a5c077-83e5-4dcb-8d3b-b0b523c0ca11 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:22.633224 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-27a5c077-83e5-4dcb-8d3b-b0b523c0ca11 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042945 Jun 17 15:19:22.633716 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 622/1032] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:19:22 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 15:19:22.729217 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-42fb1e2f-486e-4784-bcff-7cd351d56507 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:19:22.736668 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-42fb1e2f-486e-4784-bcff-7cd351d56507 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.153640 Jun 17 15:19:22.737267 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 411/1033] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:19:22 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:19:22.764740 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-b8bca8f4-de1b-4598-9b8d-6b3876c6df40 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:22.765357 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-b8bca8f4-de1b-4598-9b8d-6b3876c6df40 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:22.771398 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b8bca8f4-de1b-4598-9b8d-6b3876c6df40 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:22.771847 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b8bca8f4-de1b-4598-9b8d-6b3876c6df40 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:22.772666 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b8bca8f4-de1b-4598-9b8d-6b3876c6df40 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:22.773101 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b8bca8f4-de1b-4598-9b8d-6b3876c6df40 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:22.833854 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-b8bca8f4-de1b-4598-9b8d-6b3876c6df40 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:19:22.841917 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-b8bca8f4-de1b-4598-9b8d-6b3876c6df40 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.081722 Jun 17 15:19:22.842473 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 623/1034] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:19:22 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:19:23.565745 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-2b27198d-f420-40a9-8c78-06fea1e8fed4 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:23.566581 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-2b27198d-f420-40a9-8c78-06fea1e8fed4 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:23.572601 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2b27198d-f420-40a9-8c78-06fea1e8fed4 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:23.573047 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2b27198d-f420-40a9-8c78-06fea1e8fed4 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:23.573794 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2b27198d-f420-40a9-8c78-06fea1e8fed4 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:23.574221 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2b27198d-f420-40a9-8c78-06fea1e8fed4 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:23.602655 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-2b27198d-f420-40a9-8c78-06fea1e8fed4 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040924 Jun 17 15:19:23.603298 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 412/1035] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:19:23 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:19:23.644931 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-15708545-0dcf-4c38-9b19-1b7bbcdb67af tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:23.645866 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-15708545-0dcf-4c38-9b19-1b7bbcdb67af tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:23.652977 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-15708545-0dcf-4c38-9b19-1b7bbcdb67af tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:23.653430 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-15708545-0dcf-4c38-9b19-1b7bbcdb67af tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:23.654212 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-15708545-0dcf-4c38-9b19-1b7bbcdb67af tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:23.654645 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-15708545-0dcf-4c38-9b19-1b7bbcdb67af tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:23.686416 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-15708545-0dcf-4c38-9b19-1b7bbcdb67af tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045589 Jun 17 15:19:23.686977 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 624/1036] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:19:23 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:19:23.754128 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-1782efda-dfde-4a90-bf37-55b28700b5fa tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:23.754732 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-1782efda-dfde-4a90-bf37-55b28700b5fa tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:23.760721 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1782efda-dfde-4a90-bf37-55b28700b5fa tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:23.761158 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1782efda-dfde-4a90-bf37-55b28700b5fa tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:23.761910 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1782efda-dfde-4a90-bf37-55b28700b5fa tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:23.762387 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1782efda-dfde-4a90-bf37-55b28700b5fa tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:23.859060 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-19346364-9487-456c-ab32-ef2c9346ba62 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:23.859778 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-19346364-9487-456c-ab32-ef2c9346ba62 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:23.866287 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-19346364-9487-456c-ab32-ef2c9346ba62 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:23.866743 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-19346364-9487-456c-ab32-ef2c9346ba62 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:23.867525 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-19346364-9487-456c-ab32-ef2c9346ba62 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:23.867953 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-19346364-9487-456c-ab32-ef2c9346ba62 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:23.898697 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-1782efda-dfde-4a90-bf37-55b28700b5fa tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:19:23.906504 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-1782efda-dfde-4a90-bf37-55b28700b5fa tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.156223 Jun 17 15:19:23.907110 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 413/1037] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:19:23 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:19:23.929373 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-19346364-9487-456c-ab32-ef2c9346ba62 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:19:23.937522 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-19346364-9487-456c-ab32-ef2c9346ba62 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.082907 Jun 17 15:19:23.938082 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 625/1038] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:19:23 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:19:24.614521 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-8fe9edfc-1e19-47f8-9a5c-22052fb0123e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:24.615495 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-8fe9edfc-1e19-47f8-9a5c-22052fb0123e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:24.621998 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8fe9edfc-1e19-47f8-9a5c-22052fb0123e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:24.622436 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8fe9edfc-1e19-47f8-9a5c-22052fb0123e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:24.623194 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8fe9edfc-1e19-47f8-9a5c-22052fb0123e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:24.623620 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8fe9edfc-1e19-47f8-9a5c-22052fb0123e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:24.652064 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-8fe9edfc-1e19-47f8-9a5c-22052fb0123e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041572 Jun 17 15:19:24.652569 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 414/1039] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:19:24 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:19:24.698224 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-2a141787-55f8-43f8-b65d-ddef060c83b5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:24.699144 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-2a141787-55f8-43f8-b65d-ddef060c83b5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:24.706106 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2a141787-55f8-43f8-b65d-ddef060c83b5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:24.706553 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2a141787-55f8-43f8-b65d-ddef060c83b5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:24.707311 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2a141787-55f8-43f8-b65d-ddef060c83b5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:24.707741 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2a141787-55f8-43f8-b65d-ddef060c83b5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:24.737177 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-2a141787-55f8-43f8-b65d-ddef060c83b5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042950 Jun 17 15:19:24.737867 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 626/1040] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:19:24 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:19:24.923092 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-1490db71-b55c-4ea2-9b96-1722a6653029 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:24.923613 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-1490db71-b55c-4ea2-9b96-1722a6653029 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:24.929541 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1490db71-b55c-4ea2-9b96-1722a6653029 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:24.930009 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1490db71-b55c-4ea2-9b96-1722a6653029 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:24.930758 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1490db71-b55c-4ea2-9b96-1722a6653029 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:24.931187 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1490db71-b55c-4ea2-9b96-1722a6653029 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:24.954756 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-1f2291a3-a8c6-4659-bdfd-0cc563d1765f tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:24.955522 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-1f2291a3-a8c6-4659-bdfd-0cc563d1765f tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:24.962586 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1f2291a3-a8c6-4659-bdfd-0cc563d1765f tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:24.963052 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1f2291a3-a8c6-4659-bdfd-0cc563d1765f tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:24.963823 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1f2291a3-a8c6-4659-bdfd-0cc563d1765f tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:24.964250 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1f2291a3-a8c6-4659-bdfd-0cc563d1765f tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:25.027333 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-1f2291a3-a8c6-4659-bdfd-0cc563d1765f tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:19:25.035004 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-1f2291a3-a8c6-4659-bdfd-0cc563d1765f tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.084048 Jun 17 15:19:25.035569 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 627/1041] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:19:24 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:19:25.065572 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-1490db71-b55c-4ea2-9b96-1722a6653029 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:19:25.073107 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-1490db71-b55c-4ea2-9b96-1722a6653029 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.153940 Jun 17 15:19:25.073666 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 415/1042] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:19:24 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:19:25.664847 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-1c13d8f4-cb3c-45e7-8e07-6d2391f73637 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:25.665677 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-1c13d8f4-cb3c-45e7-8e07-6d2391f73637 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:25.672164 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1c13d8f4-cb3c-45e7-8e07-6d2391f73637 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:25.672640 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1c13d8f4-cb3c-45e7-8e07-6d2391f73637 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:25.673391 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1c13d8f4-cb3c-45e7-8e07-6d2391f73637 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:25.673821 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1c13d8f4-cb3c-45e7-8e07-6d2391f73637 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:25.701356 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-1c13d8f4-cb3c-45e7-8e07-6d2391f73637 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040628 Jun 17 15:19:25.702007 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 628/1043] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:19:25 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:19:25.751117 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-776994f0-a58e-4357-865d-212640231c86 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:25.752047 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-776994f0-a58e-4357-865d-212640231c86 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:25.758646 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-776994f0-a58e-4357-865d-212640231c86 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:25.759116 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-776994f0-a58e-4357-865d-212640231c86 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:25.759867 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-776994f0-a58e-4357-865d-212640231c86 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:25.760347 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-776994f0-a58e-4357-865d-212640231c86 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:25.788895 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-776994f0-a58e-4357-865d-212640231c86 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041757 Jun 17 15:19:25.789510 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 416/1044] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:19:25 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:19:26.052261 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-b6880f47-6950-45e9-bc7d-c0f5ac2d8581 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:26.052858 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-b6880f47-6950-45e9-bc7d-c0f5ac2d8581 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:26.059724 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b6880f47-6950-45e9-bc7d-c0f5ac2d8581 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:26.060172 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b6880f47-6950-45e9-bc7d-c0f5ac2d8581 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:26.060975 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b6880f47-6950-45e9-bc7d-c0f5ac2d8581 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:26.061414 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b6880f47-6950-45e9-bc7d-c0f5ac2d8581 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:26.090308 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-b19bd444-8ac8-4c37-bac7-685b59b59a12 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:26.091169 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-b19bd444-8ac8-4c37-bac7-685b59b59a12 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:26.097326 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b19bd444-8ac8-4c37-bac7-685b59b59a12 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:26.097770 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b19bd444-8ac8-4c37-bac7-685b59b59a12 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:26.098534 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b19bd444-8ac8-4c37-bac7-685b59b59a12 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:26.098965 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b19bd444-8ac8-4c37-bac7-685b59b59a12 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:26.125848 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-b6880f47-6950-45e9-bc7d-c0f5ac2d8581 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:19:26.133639 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-b6880f47-6950-45e9-bc7d-c0f5ac2d8581 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.085358 Jun 17 15:19:26.134302 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 629/1045] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:19:26 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:19:26.233825 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-b19bd444-8ac8-4c37-bac7-685b59b59a12 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:19:26.241465 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-b19bd444-8ac8-4c37-bac7-685b59b59a12 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.154969 Jun 17 15:19:26.242029 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 417/1046] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:19:26 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:19:26.713148 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-9239c60d-90a4-47ff-8156-2a78003a5276 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:26.713974 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-9239c60d-90a4-47ff-8156-2a78003a5276 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:26.720293 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9239c60d-90a4-47ff-8156-2a78003a5276 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:26.720768 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9239c60d-90a4-47ff-8156-2a78003a5276 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:26.721523 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9239c60d-90a4-47ff-8156-2a78003a5276 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:26.721954 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9239c60d-90a4-47ff-8156-2a78003a5276 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:26.752502 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-9239c60d-90a4-47ff-8156-2a78003a5276 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043313 Jun 17 15:19:26.753257 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 630/1047] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:19:26 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:19:26.800682 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-cd1e7d09-9e16-49af-b5f5-b006e81c324f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:26.801595 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-cd1e7d09-9e16-49af-b5f5-b006e81c324f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:26.808088 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cd1e7d09-9e16-49af-b5f5-b006e81c324f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:26.808550 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cd1e7d09-9e16-49af-b5f5-b006e81c324f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:26.809910 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cd1e7d09-9e16-49af-b5f5-b006e81c324f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:26.810334 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cd1e7d09-9e16-49af-b5f5-b006e81c324f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:26.839643 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-cd1e7d09-9e16-49af-b5f5-b006e81c324f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042927 Jun 17 15:19:26.840193 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 418/1048] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:19:26 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:19:27.150025 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-cd45847e-0e6d-4b05-86db-0398645f5200 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:27.150641 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-cd45847e-0e6d-4b05-86db-0398645f5200 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:27.157988 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cd45847e-0e6d-4b05-86db-0398645f5200 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:27.158436 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cd45847e-0e6d-4b05-86db-0398645f5200 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:27.159227 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cd45847e-0e6d-4b05-86db-0398645f5200 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:27.159659 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cd45847e-0e6d-4b05-86db-0398645f5200 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:27.224731 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-cd45847e-0e6d-4b05-86db-0398645f5200 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:19:27.232510 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-cd45847e-0e6d-4b05-86db-0398645f5200 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.086299 Jun 17 15:19:27.233088 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 631/1049] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:19:27 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:19:27.258353 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-656bd73a-254c-41af-91e2-e57e30606e4f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:27.258958 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-656bd73a-254c-41af-91e2-e57e30606e4f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:27.265527 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-656bd73a-254c-41af-91e2-e57e30606e4f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:27.265972 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-656bd73a-254c-41af-91e2-e57e30606e4f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:27.266729 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-656bd73a-254c-41af-91e2-e57e30606e4f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:27.267157 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-656bd73a-254c-41af-91e2-e57e30606e4f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:27.401665 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-656bd73a-254c-41af-91e2-e57e30606e4f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:19:27.409282 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-656bd73a-254c-41af-91e2-e57e30606e4f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.154798 Jun 17 15:19:27.409852 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 419/1050] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:19:27 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:19:27.764861 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-b6d68d46-a9c7-44ab-b21e-dec4f9a1f8e2 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:27.765894 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-b6d68d46-a9c7-44ab-b21e-dec4f9a1f8e2 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:27.772173 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b6d68d46-a9c7-44ab-b21e-dec4f9a1f8e2 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:27.772652 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b6d68d46-a9c7-44ab-b21e-dec4f9a1f8e2 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:27.773427 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b6d68d46-a9c7-44ab-b21e-dec4f9a1f8e2 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:27.773861 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b6d68d46-a9c7-44ab-b21e-dec4f9a1f8e2 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:27.791015 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=100 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:19:27.805967 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-b6d68d46-a9c7-44ab-b21e-dec4f9a1f8e2 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045131 Jun 17 15:19:27.806527 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 632/1051] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:19:27 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:19:27.852571 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-e04b201d-396c-4583-aa2a-e265715bb964 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:27.853511 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-e04b201d-396c-4583-aa2a-e265715bb964 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:27.860678 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e04b201d-396c-4583-aa2a-e265715bb964 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:27.861130 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e04b201d-396c-4583-aa2a-e265715bb964 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:27.861897 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e04b201d-396c-4583-aa2a-e265715bb964 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:27.862334 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e04b201d-396c-4583-aa2a-e265715bb964 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:27.893452 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-e04b201d-396c-4583-aa2a-e265715bb964 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045788 Jun 17 15:19:27.894017 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 420/1052] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:19:27 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:19:28.249368 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-701336ba-9224-4962-9267-c94b2f547c4b tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:28.249989 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-701336ba-9224-4962-9267-c94b2f547c4b tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:28.256710 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-701336ba-9224-4962-9267-c94b2f547c4b tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:28.257169 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-701336ba-9224-4962-9267-c94b2f547c4b tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:28.257948 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-701336ba-9224-4962-9267-c94b2f547c4b tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:28.258383 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-701336ba-9224-4962-9267-c94b2f547c4b tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:28.321924 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-701336ba-9224-4962-9267-c94b2f547c4b tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:19:28.330385 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-701336ba-9224-4962-9267-c94b2f547c4b tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.084965 Jun 17 15:19:28.330963 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 633/1053] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:19:28 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:19:28.426699 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-62605986-f4bf-4205-9715-b4b5576ae6b5 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:28.427298 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-62605986-f4bf-4205-9715-b4b5576ae6b5 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:28.433446 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-62605986-f4bf-4205-9715-b4b5576ae6b5 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:28.433820 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-62605986-f4bf-4205-9715-b4b5576ae6b5 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:28.434577 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-62605986-f4bf-4205-9715-b4b5576ae6b5 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:28.435012 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-62605986-f4bf-4205-9715-b4b5576ae6b5 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:28.575790 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-62605986-f4bf-4205-9715-b4b5576ae6b5 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:19:28.583329 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-62605986-f4bf-4205-9715-b4b5576ae6b5 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.160450 Jun 17 15:19:28.583892 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 421/1054] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:19:28 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:19:28.817861 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-9c8f92cf-6a69-467a-9a0e-beee3c164019 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:28.818692 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-9c8f92cf-6a69-467a-9a0e-beee3c164019 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:28.825450 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9c8f92cf-6a69-467a-9a0e-beee3c164019 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:28.825955 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9c8f92cf-6a69-467a-9a0e-beee3c164019 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:28.826741 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9c8f92cf-6a69-467a-9a0e-beee3c164019 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:28.827171 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9c8f92cf-6a69-467a-9a0e-beee3c164019 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:28.855740 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-9c8f92cf-6a69-467a-9a0e-beee3c164019 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041925 Jun 17 15:19:28.856311 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 634/1055] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:19:28 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:19:28.904740 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-fe968031-6326-4f16-b19b-dab6babc22bc tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:28.905679 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-fe968031-6326-4f16-b19b-dab6babc22bc tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:28.912032 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fe968031-6326-4f16-b19b-dab6babc22bc tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:28.912509 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fe968031-6326-4f16-b19b-dab6babc22bc tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:28.913267 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fe968031-6326-4f16-b19b-dab6babc22bc tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:28.913691 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fe968031-6326-4f16-b19b-dab6babc22bc tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:28.946084 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-fe968031-6326-4f16-b19b-dab6babc22bc tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045314 Jun 17 15:19:28.946657 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 422/1056] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:19:28 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 15:19:29.347767 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-bf6e75de-3a2b-4876-91bd-1f9e19b97ccf tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:29.348414 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-bf6e75de-3a2b-4876-91bd-1f9e19b97ccf tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:29.355434 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bf6e75de-3a2b-4876-91bd-1f9e19b97ccf tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:29.356517 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bf6e75de-3a2b-4876-91bd-1f9e19b97ccf tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:29.357300 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bf6e75de-3a2b-4876-91bd-1f9e19b97ccf tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:29.357738 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bf6e75de-3a2b-4876-91bd-1f9e19b97ccf tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:29.434480 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-bf6e75de-3a2b-4876-91bd-1f9e19b97ccf tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:19:29.442449 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-bf6e75de-3a2b-4876-91bd-1f9e19b97ccf tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.098597 Jun 17 15:19:29.443026 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 635/1057] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:19:29 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:19:29.600794 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-5da97466-0005-4069-88cc-b22100d5ce01 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:29.601323 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-5da97466-0005-4069-88cc-b22100d5ce01 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:29.608164 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5da97466-0005-4069-88cc-b22100d5ce01 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:29.608640 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5da97466-0005-4069-88cc-b22100d5ce01 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:29.609406 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5da97466-0005-4069-88cc-b22100d5ce01 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:29.609838 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5da97466-0005-4069-88cc-b22100d5ce01 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:29.750457 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-5da97466-0005-4069-88cc-b22100d5ce01 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:19:29.758499 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-5da97466-0005-4069-88cc-b22100d5ce01 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.161659 Jun 17 15:19:29.759092 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 423/1058] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:19:29 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:19:29.867576 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-cbe3d8ad-e8b5-4242-8912-1952091d5122 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:29.868485 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-cbe3d8ad-e8b5-4242-8912-1952091d5122 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:29.874925 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cbe3d8ad-e8b5-4242-8912-1952091d5122 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:29.875444 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cbe3d8ad-e8b5-4242-8912-1952091d5122 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:29.876300 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cbe3d8ad-e8b5-4242-8912-1952091d5122 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:29.876834 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cbe3d8ad-e8b5-4242-8912-1952091d5122 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:29.908344 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-cbe3d8ad-e8b5-4242-8912-1952091d5122 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044879 Jun 17 15:19:29.908978 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 636/1059] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:19:29 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:19:29.958285 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-c3e9ee93-f8a5-48cb-8f5a-83c27205ebb6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:29.959204 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-c3e9ee93-f8a5-48cb-8f5a-83c27205ebb6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:29.967175 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c3e9ee93-f8a5-48cb-8f5a-83c27205ebb6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:29.967628 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c3e9ee93-f8a5-48cb-8f5a-83c27205ebb6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:29.968552 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c3e9ee93-f8a5-48cb-8f5a-83c27205ebb6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:29.969056 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c3e9ee93-f8a5-48cb-8f5a-83c27205ebb6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:29.999128 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-c3e9ee93-f8a5-48cb-8f5a-83c27205ebb6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045002 Jun 17 15:19:29.999696 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 424/1060] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:19:29 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:19:30.459084 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-9022a98f-d869-4abe-be17-d2a8313a6857 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:30.459701 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-9022a98f-d869-4abe-be17-d2a8313a6857 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:30.466604 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9022a98f-d869-4abe-be17-d2a8313a6857 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:30.467052 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9022a98f-d869-4abe-be17-d2a8313a6857 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:30.467822 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9022a98f-d869-4abe-be17-d2a8313a6857 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:30.468254 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9022a98f-d869-4abe-be17-d2a8313a6857 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:30.538529 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-9022a98f-d869-4abe-be17-d2a8313a6857 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:19:30.546795 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-9022a98f-d869-4abe-be17-d2a8313a6857 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.091616 Jun 17 15:19:30.547435 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 637/1061] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:19:30 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:19:30.775255 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-2e9e65c5-77b7-4149-891a-a1f4a8462518 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:30.775784 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-2e9e65c5-77b7-4149-891a-a1f4a8462518 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:30.782554 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2e9e65c5-77b7-4149-891a-a1f4a8462518 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:30.783007 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2e9e65c5-77b7-4149-891a-a1f4a8462518 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:30.783777 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2e9e65c5-77b7-4149-891a-a1f4a8462518 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:30.784215 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2e9e65c5-77b7-4149-891a-a1f4a8462518 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:30.921284 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-2e9e65c5-77b7-4149-891a-a1f4a8462518 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:19:30.923820 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-c0a4ff91-3928-4305-9c50-1588ca32f80a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:30.925368 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-c0a4ff91-3928-4305-9c50-1588ca32f80a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:30.934923 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-2e9e65c5-77b7-4149-891a-a1f4a8462518 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.162775 Jun 17 15:19:30.935636 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c0a4ff91-3928-4305-9c50-1588ca32f80a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:30.935896 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 425/1062] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:19:30 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:19:30.936529 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c0a4ff91-3928-4305-9c50-1588ca32f80a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:30.938045 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c0a4ff91-3928-4305-9c50-1588ca32f80a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:30.938844 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c0a4ff91-3928-4305-9c50-1588ca32f80a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:30.977736 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-c0a4ff91-3928-4305-9c50-1588ca32f80a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060933 Jun 17 15:19:30.978332 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 638/1063] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:19:30 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:19:31.011883 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-f3a357ad-c7e0-4a48-aba3-a7bae935334d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:31.013411 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-f3a357ad-c7e0-4a48-aba3-a7bae935334d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:31.017473 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_api:SELECT=100 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:19:31.022922 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f3a357ad-c7e0-4a48-aba3-a7bae935334d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:31.023459 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f3a357ad-c7e0-4a48-aba3-a7bae935334d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:31.024427 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f3a357ad-c7e0-4a48-aba3-a7bae935334d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:31.025006 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f3a357ad-c7e0-4a48-aba3-a7bae935334d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:31.054204 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell1:SELECT=100 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:19:31.060225 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-f3a357ad-c7e0-4a48-aba3-a7bae935334d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052698 Jun 17 15:19:31.060938 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 426/1064] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:19:31 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:19:31.536674 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 15:19:31.536960 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Fri Jun 17 15:19:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 15:19:31.563881 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-0f647369-93f2-482f-874b-56cc5134116c tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:31.564621 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-0f647369-93f2-482f-874b-56cc5134116c tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:31.571651 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0f647369-93f2-482f-874b-56cc5134116c tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:31.572143 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0f647369-93f2-482f-874b-56cc5134116c tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:31.572992 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0f647369-93f2-482f-874b-56cc5134116c tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:31.573445 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0f647369-93f2-482f-874b-56cc5134116c tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:31.638986 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-0f647369-93f2-482f-874b-56cc5134116c tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:19:31.647331 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-0f647369-93f2-482f-874b-56cc5134116c tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.087523 Jun 17 15:19:31.647917 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 639/1065] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:19:31 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:19:31.962738 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-f177ba70-0aa6-4809-9a3e-815bda0b8dea tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:31.963735 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-f177ba70-0aa6-4809-9a3e-815bda0b8dea tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:31.973244 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f177ba70-0aa6-4809-9a3e-815bda0b8dea tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:31.974022 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f177ba70-0aa6-4809-9a3e-815bda0b8dea tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:31.975493 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f177ba70-0aa6-4809-9a3e-815bda0b8dea tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:31.976256 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f177ba70-0aa6-4809-9a3e-815bda0b8dea tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:31.990746 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-6e47be6c-e891-4793-aceb-78f8244f9207 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:31.991852 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-6e47be6c-e891-4793-aceb-78f8244f9207 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:32.001825 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6e47be6c-e891-4793-aceb-78f8244f9207 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:32.002555 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6e47be6c-e891-4793-aceb-78f8244f9207 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:32.003878 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6e47be6c-e891-4793-aceb-78f8244f9207 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:32.004733 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6e47be6c-e891-4793-aceb-78f8244f9207 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:32.048583 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-6e47be6c-e891-4793-aceb-78f8244f9207 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062753 Jun 17 15:19:32.049182 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 640/1066] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:19:31 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:19:32.073103 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-0a9acfeb-9ec1-468c-86e6-f9c67b9a34d9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:32.074049 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-0a9acfeb-9ec1-468c-86e6-f9c67b9a34d9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:32.080605 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0a9acfeb-9ec1-468c-86e6-f9c67b9a34d9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:32.081063 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0a9acfeb-9ec1-468c-86e6-f9c67b9a34d9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:32.081850 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0a9acfeb-9ec1-468c-86e6-f9c67b9a34d9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:32.082290 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0a9acfeb-9ec1-468c-86e6-f9c67b9a34d9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:32.126840 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-0a9acfeb-9ec1-468c-86e6-f9c67b9a34d9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058055 Jun 17 15:19:32.127421 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 641/1067] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:19:32 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 15:19:32.166235 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-f177ba70-0aa6-4809-9a3e-815bda0b8dea tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:19:32.174489 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-f177ba70-0aa6-4809-9a3e-815bda0b8dea tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.217060 Jun 17 15:19:32.175222 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 427/1068] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:19:31 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:19:32.665091 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-36d765c9-2985-4279-b6e7-40f414424b54 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:32.665673 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-36d765c9-2985-4279-b6e7-40f414424b54 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:32.673801 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-36d765c9-2985-4279-b6e7-40f414424b54 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:32.674289 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-36d765c9-2985-4279-b6e7-40f414424b54 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:32.675166 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-36d765c9-2985-4279-b6e7-40f414424b54 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:32.675636 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-36d765c9-2985-4279-b6e7-40f414424b54 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:32.753543 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-36d765c9-2985-4279-b6e7-40f414424b54 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:19:32.761720 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-36d765c9-2985-4279-b6e7-40f414424b54 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.101104 Jun 17 15:19:32.762335 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 642/1069] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:19:32 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:19:33.064113 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-0c792eb2-1247-470a-b94a-8e25eac4d77d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:33.065256 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-0c792eb2-1247-470a-b94a-8e25eac4d77d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:33.072571 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0c792eb2-1247-470a-b94a-8e25eac4d77d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:33.073015 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0c792eb2-1247-470a-b94a-8e25eac4d77d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:33.073789 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0c792eb2-1247-470a-b94a-8e25eac4d77d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:33.074239 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0c792eb2-1247-470a-b94a-8e25eac4d77d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:33.106431 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-0c792eb2-1247-470a-b94a-8e25eac4d77d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046857 Jun 17 15:19:33.107154 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 428/1070] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:19:33 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:19:33.138952 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-947691ac-8ecc-4a98-8837-8bce540252a0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:33.139909 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-947691ac-8ecc-4a98-8837-8bce540252a0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:33.146736 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-947691ac-8ecc-4a98-8837-8bce540252a0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:33.147210 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-947691ac-8ecc-4a98-8837-8bce540252a0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:33.148078 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-947691ac-8ecc-4a98-8837-8bce540252a0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:33.148564 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-947691ac-8ecc-4a98-8837-8bce540252a0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:33.183692 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-947691ac-8ecc-4a98-8837-8bce540252a0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048802 Jun 17 15:19:33.184403 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 643/1071] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:19:33 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:19:33.193080 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-0307f1e3-d2b3-4f76-b7f1-8434920f97c4 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:33.193655 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-0307f1e3-d2b3-4f76-b7f1-8434920f97c4 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:33.200578 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0307f1e3-d2b3-4f76-b7f1-8434920f97c4 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:33.201120 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0307f1e3-d2b3-4f76-b7f1-8434920f97c4 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:33.201996 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0307f1e3-d2b3-4f76-b7f1-8434920f97c4 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:33.202510 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0307f1e3-d2b3-4f76-b7f1-8434920f97c4 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:33.372506 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-0307f1e3-d2b3-4f76-b7f1-8434920f97c4 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:19:33.381011 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-0307f1e3-d2b3-4f76-b7f1-8434920f97c4 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.192148 Jun 17 15:19:33.381657 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 429/1072] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:19:33 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:19:33.781002 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-7372e520-8ae3-456f-a0dc-8979913eda2d tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:33.781718 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-7372e520-8ae3-456f-a0dc-8979913eda2d tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:33.790018 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7372e520-8ae3-456f-a0dc-8979913eda2d tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:33.790464 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7372e520-8ae3-456f-a0dc-8979913eda2d tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:33.791261 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7372e520-8ae3-456f-a0dc-8979913eda2d tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:33.791762 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7372e520-8ae3-456f-a0dc-8979913eda2d tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:33.863219 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-7372e520-8ae3-456f-a0dc-8979913eda2d tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:19:33.871841 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-7372e520-8ae3-456f-a0dc-8979913eda2d tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.095335 Jun 17 15:19:33.872500 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 644/1073] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:19:33 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:19:34.118953 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-dc1694fb-596d-4037-a912-6f295ab0a3ac tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:34.119870 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-dc1694fb-596d-4037-a912-6f295ab0a3ac tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:34.128624 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-dc1694fb-596d-4037-a912-6f295ab0a3ac tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:34.129143 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-dc1694fb-596d-4037-a912-6f295ab0a3ac tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:34.130139 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-dc1694fb-596d-4037-a912-6f295ab0a3ac tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:34.130575 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-dc1694fb-596d-4037-a912-6f295ab0a3ac tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:34.166227 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-dc1694fb-596d-4037-a912-6f295ab0a3ac tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051292 Jun 17 15:19:34.166857 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 430/1074] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:19:34 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:19:34.197177 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-3a5e67bf-1e66-45a4-9c7d-be4689e707e7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:34.198094 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-3a5e67bf-1e66-45a4-9c7d-be4689e707e7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:34.206672 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3a5e67bf-1e66-45a4-9c7d-be4689e707e7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:34.207593 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3a5e67bf-1e66-45a4-9c7d-be4689e707e7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:34.209567 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3a5e67bf-1e66-45a4-9c7d-be4689e707e7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:34.210018 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3a5e67bf-1e66-45a4-9c7d-be4689e707e7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:34.242783 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-3a5e67bf-1e66-45a4-9c7d-be4689e707e7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049590 Jun 17 15:19:34.243356 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 645/1075] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:19:34 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:19:34.403305 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-20cbd122-fe70-40f2-b88c-9f27337dce79 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:34.403939 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-20cbd122-fe70-40f2-b88c-9f27337dce79 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:34.412970 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-20cbd122-fe70-40f2-b88c-9f27337dce79 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:34.413791 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-20cbd122-fe70-40f2-b88c-9f27337dce79 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:34.415108 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-20cbd122-fe70-40f2-b88c-9f27337dce79 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:34.415686 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-20cbd122-fe70-40f2-b88c-9f27337dce79 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:34.593179 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-20cbd122-fe70-40f2-b88c-9f27337dce79 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:19:34.601667 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-20cbd122-fe70-40f2-b88c-9f27337dce79 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.204212 Jun 17 15:19:34.602325 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 431/1076] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:19:34 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:19:34.890464 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-f89631c2-bfde-4e08-8c33-c4b9d2841abc tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:34.891204 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-f89631c2-bfde-4e08-8c33-c4b9d2841abc tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:34.898011 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f89631c2-bfde-4e08-8c33-c4b9d2841abc tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:34.898451 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f89631c2-bfde-4e08-8c33-c4b9d2841abc tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:34.899228 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f89631c2-bfde-4e08-8c33-c4b9d2841abc tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:34.899653 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f89631c2-bfde-4e08-8c33-c4b9d2841abc tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:34.970551 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-f89631c2-bfde-4e08-8c33-c4b9d2841abc tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:19:34.979382 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-f89631c2-bfde-4e08-8c33-c4b9d2841abc tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.093673 Jun 17 15:19:34.980263 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 646/1077] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:19:34 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:19:35.178890 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-47cf87d3-2537-4830-a490-ec6903d0098c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:35.179810 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-47cf87d3-2537-4830-a490-ec6903d0098c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:35.186995 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-47cf87d3-2537-4830-a490-ec6903d0098c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:35.187440 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-47cf87d3-2537-4830-a490-ec6903d0098c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:35.188246 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-47cf87d3-2537-4830-a490-ec6903d0098c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:35.188879 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-47cf87d3-2537-4830-a490-ec6903d0098c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:35.225092 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-47cf87d3-2537-4830-a490-ec6903d0098c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050248 Jun 17 15:19:35.229573 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 432/1078] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:19:35 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:19:35.257142 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-5a0e2228-5699-4717-adb8-9ff1a25e13ba tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:35.258223 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-5a0e2228-5699-4717-adb8-9ff1a25e13ba tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:35.265856 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5a0e2228-5699-4717-adb8-9ff1a25e13ba tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:35.266348 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5a0e2228-5699-4717-adb8-9ff1a25e13ba tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:35.267191 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5a0e2228-5699-4717-adb8-9ff1a25e13ba tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:35.267655 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5a0e2228-5699-4717-adb8-9ff1a25e13ba tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:35.300270 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-5a0e2228-5699-4717-adb8-9ff1a25e13ba tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048604 Jun 17 15:19:35.300911 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 647/1079] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:19:35 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:19:35.358899 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 15:19:35.359162 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Fri Jun 17 15:19:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 15:19:35.622140 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-c5e30294-5639-4e82-8b99-126612432ccf tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:35.622850 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-c5e30294-5639-4e82-8b99-126612432ccf tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:35.630108 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c5e30294-5639-4e82-8b99-126612432ccf tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:35.630623 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c5e30294-5639-4e82-8b99-126612432ccf tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:35.631539 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c5e30294-5639-4e82-8b99-126612432ccf tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:35.632042 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c5e30294-5639-4e82-8b99-126612432ccf tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:35.787642 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-c5e30294-5639-4e82-8b99-126612432ccf tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:19:35.796786 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-c5e30294-5639-4e82-8b99-126612432ccf tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.178898 Jun 17 15:19:35.797428 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 433/1080] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:19:35 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:19:36.000380 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-122cead3-bba0-47db-b429-9d6bd63d48b7 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:36.001169 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-122cead3-bba0-47db-b429-9d6bd63d48b7 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:36.011391 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-122cead3-bba0-47db-b429-9d6bd63d48b7 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:36.012375 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-122cead3-bba0-47db-b429-9d6bd63d48b7 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:36.013840 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-122cead3-bba0-47db-b429-9d6bd63d48b7 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:36.014625 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-122cead3-bba0-47db-b429-9d6bd63d48b7 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:36.085640 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-122cead3-bba0-47db-b429-9d6bd63d48b7 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:19:36.100684 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-122cead3-bba0-47db-b429-9d6bd63d48b7 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.106572 Jun 17 15:19:36.101825 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 648/1081] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:19:35 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:19:36.238586 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-bd674f17-5b02-43d6-9728-be5981f9400e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:36.239586 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-bd674f17-5b02-43d6-9728-be5981f9400e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:36.246880 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bd674f17-5b02-43d6-9728-be5981f9400e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:36.247425 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bd674f17-5b02-43d6-9728-be5981f9400e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:36.248203 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bd674f17-5b02-43d6-9728-be5981f9400e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:36.248659 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bd674f17-5b02-43d6-9728-be5981f9400e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:36.279090 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-bd674f17-5b02-43d6-9728-be5981f9400e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044927 Jun 17 15:19:36.279564 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 434/1082] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:19:36 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:19:36.313212 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-02da6ad2-939c-4465-9a81-559427ed894a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:36.314152 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-02da6ad2-939c-4465-9a81-559427ed894a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:36.320526 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-02da6ad2-939c-4465-9a81-559427ed894a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:36.320996 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-02da6ad2-939c-4465-9a81-559427ed894a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:36.321757 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-02da6ad2-939c-4465-9a81-559427ed894a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:36.322190 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-02da6ad2-939c-4465-9a81-559427ed894a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:36.326122 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=100 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:19:36.357898 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-02da6ad2-939c-4465-9a81-559427ed894a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048953 Jun 17 15:19:36.358570 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 649/1083] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:19:36 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:19:36.731834 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 15:19:36.732129 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Fri Jun 17 15:19:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 15:19:36.815117 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-a20d14e8-e0de-4454-9b7f-80d11c1c4e5a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:36.816739 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-a20d14e8-e0de-4454-9b7f-80d11c1c4e5a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:36.827875 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a20d14e8-e0de-4454-9b7f-80d11c1c4e5a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:36.828411 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a20d14e8-e0de-4454-9b7f-80d11c1c4e5a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:36.829290 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a20d14e8-e0de-4454-9b7f-80d11c1c4e5a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:36.829766 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a20d14e8-e0de-4454-9b7f-80d11c1c4e5a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:36.978272 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-a20d14e8-e0de-4454-9b7f-80d11c1c4e5a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:19:36.990093 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-a20d14e8-e0de-4454-9b7f-80d11c1c4e5a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.178373 Jun 17 15:19:36.991150 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 435/1084] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:19:36 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:19:37.120320 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-ff71a968-defe-4d58-b232-462bfa541bf7 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:37.120966 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-ff71a968-defe-4d58-b232-462bfa541bf7 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:37.128171 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ff71a968-defe-4d58-b232-462bfa541bf7 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:37.128656 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ff71a968-defe-4d58-b232-462bfa541bf7 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:37.129429 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ff71a968-defe-4d58-b232-462bfa541bf7 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:37.129858 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ff71a968-defe-4d58-b232-462bfa541bf7 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:37.198135 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-ff71a968-defe-4d58-b232-462bfa541bf7 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:19:37.209822 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-ff71a968-defe-4d58-b232-462bfa541bf7 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.093320 Jun 17 15:19:37.210606 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 650/1085] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:19:37 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:19:37.291530 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-2542652a-bf22-4f37-bbe1-b2562f249feb tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:37.292400 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-2542652a-bf22-4f37-bbe1-b2562f249feb tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:37.299569 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2542652a-bf22-4f37-bbe1-b2562f249feb tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:37.300010 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2542652a-bf22-4f37-bbe1-b2562f249feb tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:37.300806 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2542652a-bf22-4f37-bbe1-b2562f249feb tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:37.301232 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2542652a-bf22-4f37-bbe1-b2562f249feb tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:37.333378 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-2542652a-bf22-4f37-bbe1-b2562f249feb tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045892 Jun 17 15:19:37.333978 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 436/1086] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:19:37 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:19:37.371015 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-403fefef-d355-470a-a899-0e415fbd93ed tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:37.373062 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-403fefef-d355-470a-a899-0e415fbd93ed tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:37.384078 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-403fefef-d355-470a-a899-0e415fbd93ed tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:37.384577 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-403fefef-d355-470a-a899-0e415fbd93ed tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:37.385358 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-403fefef-d355-470a-a899-0e415fbd93ed tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:37.385789 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-403fefef-d355-470a-a899-0e415fbd93ed tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:37.424700 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-403fefef-d355-470a-a899-0e415fbd93ed tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058156 Jun 17 15:19:37.425453 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 651/1087] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:19:37 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:19:38.015334 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-518c0ab5-44e6-4a5f-bfaf-f1749b4a6bea tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:38.015955 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-518c0ab5-44e6-4a5f-bfaf-f1749b4a6bea tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:38.022316 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-518c0ab5-44e6-4a5f-bfaf-f1749b4a6bea tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:38.022745 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-518c0ab5-44e6-4a5f-bfaf-f1749b4a6bea tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:38.023498 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-518c0ab5-44e6-4a5f-bfaf-f1749b4a6bea tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:38.023933 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-518c0ab5-44e6-4a5f-bfaf-f1749b4a6bea tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:38.185307 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-518c0ab5-44e6-4a5f-bfaf-f1749b4a6bea tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:19:38.193649 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-518c0ab5-44e6-4a5f-bfaf-f1749b4a6bea tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.182700 Jun 17 15:19:38.194223 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 437/1088] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:19:38 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:19:38.228702 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-6624624a-8d43-4115-9a71-558cfc20f24c tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:38.229304 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-6624624a-8d43-4115-9a71-558cfc20f24c tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:38.238724 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6624624a-8d43-4115-9a71-558cfc20f24c tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:38.239951 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6624624a-8d43-4115-9a71-558cfc20f24c tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:38.241325 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6624624a-8d43-4115-9a71-558cfc20f24c tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:38.242120 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6624624a-8d43-4115-9a71-558cfc20f24c tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:38.315990 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-6624624a-8d43-4115-9a71-558cfc20f24c tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:19:38.323732 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-6624624a-8d43-4115-9a71-558cfc20f24c tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.099243 Jun 17 15:19:38.324951 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 652/1089] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:19:38 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:19:38.345605 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-9407efef-ed02-4cc7-8446-c5bac51d9140 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:38.346527 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-9407efef-ed02-4cc7-8446-c5bac51d9140 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:38.353469 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9407efef-ed02-4cc7-8446-c5bac51d9140 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:38.353902 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9407efef-ed02-4cc7-8446-c5bac51d9140 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:38.354668 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9407efef-ed02-4cc7-8446-c5bac51d9140 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:38.355093 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9407efef-ed02-4cc7-8446-c5bac51d9140 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:38.390730 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-9407efef-ed02-4cc7-8446-c5bac51d9140 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049267 Jun 17 15:19:38.391362 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 438/1090] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:19:38 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:19:38.437248 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-2389e299-a2f6-4919-bd60-63c51975ea26 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:38.438169 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-2389e299-a2f6-4919-bd60-63c51975ea26 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:38.444552 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2389e299-a2f6-4919-bd60-63c51975ea26 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:38.445002 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2389e299-a2f6-4919-bd60-63c51975ea26 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:38.445776 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2389e299-a2f6-4919-bd60-63c51975ea26 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:38.446207 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2389e299-a2f6-4919-bd60-63c51975ea26 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:38.477327 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-2389e299-a2f6-4919-bd60-63c51975ea26 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044684 Jun 17 15:19:38.477945 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 653/1091] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:19:38 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:19:38.828868 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 15:19:38.829136 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Fri Jun 17 15:19:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 15:19:39.212995 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-dbb641b9-f950-4e77-9dec-e9aaeec585aa tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:39.213711 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-dbb641b9-f950-4e77-9dec-e9aaeec585aa tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:39.221587 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-dbb641b9-f950-4e77-9dec-e9aaeec585aa tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:39.222076 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-dbb641b9-f950-4e77-9dec-e9aaeec585aa tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:39.222935 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-dbb641b9-f950-4e77-9dec-e9aaeec585aa tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:39.223433 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-dbb641b9-f950-4e77-9dec-e9aaeec585aa tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:39.343218 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-f42c4d2d-785c-45b9-9d09-af82029e23d8 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:39.343969 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-f42c4d2d-785c-45b9-9d09-af82029e23d8 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:39.351419 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f42c4d2d-785c-45b9-9d09-af82029e23d8 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:39.351859 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f42c4d2d-785c-45b9-9d09-af82029e23d8 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:39.352674 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f42c4d2d-785c-45b9-9d09-af82029e23d8 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:39.353203 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f42c4d2d-785c-45b9-9d09-af82029e23d8 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:39.371924 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-dbb641b9-f950-4e77-9dec-e9aaeec585aa tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:19:39.381685 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-dbb641b9-f950-4e77-9dec-e9aaeec585aa tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.172987 Jun 17 15:19:39.382368 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 439/1092] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:19:39 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:19:39.403145 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-17eff5ed-0833-41c1-aabf-53006f3d7db4 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:39.404311 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-17eff5ed-0833-41c1-aabf-53006f3d7db4 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:39.410884 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-17eff5ed-0833-41c1-aabf-53006f3d7db4 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:39.411341 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-17eff5ed-0833-41c1-aabf-53006f3d7db4 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:39.412170 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-17eff5ed-0833-41c1-aabf-53006f3d7db4 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:39.412700 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-17eff5ed-0833-41c1-aabf-53006f3d7db4 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:39.427201 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-f42c4d2d-785c-45b9-9d09-af82029e23d8 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:19:39.435456 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-f42c4d2d-785c-45b9-9d09-af82029e23d8 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.097535 Jun 17 15:19:39.436454 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 654/1093] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:19:39 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:19:39.445387 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-17eff5ed-0833-41c1-aabf-53006f3d7db4 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047154 Jun 17 15:19:39.446006 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 440/1094] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:19:39 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:19:39.490280 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-a26292d9-7058-4cb6-bc8b-5eecf6266d50 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:39.491206 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-a26292d9-7058-4cb6-bc8b-5eecf6266d50 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:39.497631 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a26292d9-7058-4cb6-bc8b-5eecf6266d50 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:39.498081 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a26292d9-7058-4cb6-bc8b-5eecf6266d50 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:39.498958 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a26292d9-7058-4cb6-bc8b-5eecf6266d50 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:39.499398 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a26292d9-7058-4cb6-bc8b-5eecf6266d50 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:39.533612 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-a26292d9-7058-4cb6-bc8b-5eecf6266d50 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047667 Jun 17 15:19:39.534197 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 655/1095] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:19:39 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:19:40.406847 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-f3c4e9cc-6940-4ad3-ba1d-8410820ac2d2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:40.407476 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-f3c4e9cc-6940-4ad3-ba1d-8410820ac2d2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:40.414951 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f3c4e9cc-6940-4ad3-ba1d-8410820ac2d2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:40.415406 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f3c4e9cc-6940-4ad3-ba1d-8410820ac2d2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:40.416210 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f3c4e9cc-6940-4ad3-ba1d-8410820ac2d2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:40.416687 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f3c4e9cc-6940-4ad3-ba1d-8410820ac2d2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:40.454349 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-831a5b18-a4d0-462c-b368-8a4ad1b2fbfd tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:40.454984 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-831a5b18-a4d0-462c-b368-8a4ad1b2fbfd tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:40.462130 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-831a5b18-a4d0-462c-b368-8a4ad1b2fbfd tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:40.462590 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-831a5b18-a4d0-462c-b368-8a4ad1b2fbfd tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:40.463384 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-831a5b18-a4d0-462c-b368-8a4ad1b2fbfd tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:40.463839 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-831a5b18-a4d0-462c-b368-8a4ad1b2fbfd tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:40.542706 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-831a5b18-a4d0-462c-b368-8a4ad1b2fbfd tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:19:40.552151 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-831a5b18-a4d0-462c-b368-8a4ad1b2fbfd tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.101726 Jun 17 15:19:40.552800 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 656/1096] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:19:40 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:19:40.558131 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-d138d884-ebe4-4a4f-bace-fb8f91b00180 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:40.559097 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-d138d884-ebe4-4a4f-bace-fb8f91b00180 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:40.566141 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d138d884-ebe4-4a4f-bace-fb8f91b00180 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:40.566594 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d138d884-ebe4-4a4f-bace-fb8f91b00180 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:40.567403 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d138d884-ebe4-4a4f-bace-fb8f91b00180 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:40.567834 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d138d884-ebe4-4a4f-bace-fb8f91b00180 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:40.578295 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-f3c4e9cc-6940-4ad3-ba1d-8410820ac2d2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:19:40.586615 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-f3c4e9cc-6940-4ad3-ba1d-8410820ac2d2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.183861 Jun 17 15:19:40.587640 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 441/1097] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:19:40 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:19:40.593902 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-20a0fbce-5a81-4ea3-8cb5-6c8c49f94e9f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:40.594840 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-20a0fbce-5a81-4ea3-8cb5-6c8c49f94e9f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:40.601601 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-20a0fbce-5a81-4ea3-8cb5-6c8c49f94e9f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:40.602052 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-20a0fbce-5a81-4ea3-8cb5-6c8c49f94e9f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:40.602973 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-20a0fbce-5a81-4ea3-8cb5-6c8c49f94e9f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:40.603408 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-20a0fbce-5a81-4ea3-8cb5-6c8c49f94e9f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:40.604578 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-d138d884-ebe4-4a4f-bace-fb8f91b00180 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050654 Jun 17 15:19:40.605168 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 657/1098] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:19:40 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:19:40.637068 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-20a0fbce-5a81-4ea3-8cb5-6c8c49f94e9f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047933 Jun 17 15:19:40.637568 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 442/1099] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:19:40 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:19:41.569299 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-6cf53929-0a87-435d-b043-7a7ae751867a tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:41.569903 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-6cf53929-0a87-435d-b043-7a7ae751867a tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:41.577158 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6cf53929-0a87-435d-b043-7a7ae751867a tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:41.577601 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6cf53929-0a87-435d-b043-7a7ae751867a tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:41.578356 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6cf53929-0a87-435d-b043-7a7ae751867a tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:41.578789 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6cf53929-0a87-435d-b043-7a7ae751867a tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:41.606621 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-16650bf7-53ad-4792-9a78-53c04240610f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:41.607233 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-16650bf7-53ad-4792-9a78-53c04240610f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:41.614045 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-16650bf7-53ad-4792-9a78-53c04240610f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:41.614561 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-16650bf7-53ad-4792-9a78-53c04240610f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:41.615333 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-16650bf7-53ad-4792-9a78-53c04240610f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:41.615770 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-16650bf7-53ad-4792-9a78-53c04240610f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:41.634469 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell1:SELECT=100 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:19:41.641635 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-6cf53929-0a87-435d-b043-7a7ae751867a tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:19:41.649848 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-6cf53929-0a87-435d-b043-7a7ae751867a tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.084430 Jun 17 15:19:41.650505 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 658/1100] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:19:41 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:19:41.655262 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-0c8e4f21-7a43-4346-9d00-9ad617411005 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:41.656167 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-0c8e4f21-7a43-4346-9d00-9ad617411005 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:41.662253 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0c8e4f21-7a43-4346-9d00-9ad617411005 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:41.662707 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0c8e4f21-7a43-4346-9d00-9ad617411005 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:41.663477 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0c8e4f21-7a43-4346-9d00-9ad617411005 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:41.663913 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0c8e4f21-7a43-4346-9d00-9ad617411005 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:41.693516 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-0c8e4f21-7a43-4346-9d00-9ad617411005 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041948 Jun 17 15:19:41.694095 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 659/1101] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:19:41 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:19:41.698793 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-2711d340-f4a1-4103-a014-37bed816b840 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:41.699712 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-2711d340-f4a1-4103-a014-37bed816b840 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:41.705854 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2711d340-f4a1-4103-a014-37bed816b840 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:41.706303 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2711d340-f4a1-4103-a014-37bed816b840 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:41.707074 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2711d340-f4a1-4103-a014-37bed816b840 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:41.707511 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2711d340-f4a1-4103-a014-37bed816b840 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:41.737807 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-2711d340-f4a1-4103-a014-37bed816b840 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042641 Jun 17 15:19:41.738575 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 660/1102] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:19:41 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:19:41.753067 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-16650bf7-53ad-4792-9a78-53c04240610f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:19:41.760703 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-16650bf7-53ad-4792-9a78-53c04240610f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.157910 Jun 17 15:19:41.761271 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 443/1103] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:19:41 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:19:42.666806 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-92c20a68-6009-4f79-9ee4-e2a4d58677d4 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:42.667358 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-92c20a68-6009-4f79-9ee4-e2a4d58677d4 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:42.673975 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-92c20a68-6009-4f79-9ee4-e2a4d58677d4 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:42.674422 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-92c20a68-6009-4f79-9ee4-e2a4d58677d4 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:42.675195 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-92c20a68-6009-4f79-9ee4-e2a4d58677d4 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:42.675629 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-92c20a68-6009-4f79-9ee4-e2a4d58677d4 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:42.705093 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-4e282374-26c9-434d-9b1f-37d8b751bf44 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:42.706025 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-4e282374-26c9-434d-9b1f-37d8b751bf44 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:42.712727 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4e282374-26c9-434d-9b1f-37d8b751bf44 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:42.713177 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4e282374-26c9-434d-9b1f-37d8b751bf44 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:42.713936 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4e282374-26c9-434d-9b1f-37d8b751bf44 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:42.714368 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4e282374-26c9-434d-9b1f-37d8b751bf44 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:42.737569 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-92c20a68-6009-4f79-9ee4-e2a4d58677d4 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:19:42.743737 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-4e282374-26c9-434d-9b1f-37d8b751bf44 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042491 Jun 17 15:19:42.745454 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-92c20a68-6009-4f79-9ee4-e2a4d58677d4 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.082637 Jun 17 15:19:42.746036 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 661/1104] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:19:42 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:19:42.747475 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 444/1105] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:19:42 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:19:42.751422 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-b3ebf778-3a1c-4731-9b92-695ac4c32ec8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:42.752395 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-b3ebf778-3a1c-4731-9b92-695ac4c32ec8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:42.758303 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b3ebf778-3a1c-4731-9b92-695ac4c32ec8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:42.758751 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b3ebf778-3a1c-4731-9b92-695ac4c32ec8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:42.759518 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b3ebf778-3a1c-4731-9b92-695ac4c32ec8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:42.759953 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b3ebf778-3a1c-4731-9b92-695ac4c32ec8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:42.778176 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-12f87d9d-494d-4b58-9ba4-093bf5a63eff tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:42.778784 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-12f87d9d-494d-4b58-9ba4-093bf5a63eff tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:42.785649 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-12f87d9d-494d-4b58-9ba4-093bf5a63eff tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:42.786091 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-12f87d9d-494d-4b58-9ba4-093bf5a63eff tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:42.786833 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-12f87d9d-494d-4b58-9ba4-093bf5a63eff tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:42.787258 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-12f87d9d-494d-4b58-9ba4-093bf5a63eff tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:42.789984 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-b3ebf778-3a1c-4731-9b92-695ac4c32ec8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042270 Jun 17 15:19:42.790805 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 662/1106] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:19:42 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:19:42.922247 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-12f87d9d-494d-4b58-9ba4-093bf5a63eff tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:19:42.931091 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-12f87d9d-494d-4b58-9ba4-093bf5a63eff tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.157176 Jun 17 15:19:42.931667 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 445/1107] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:19:42 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:19:43.755297 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-9aa8cce3-5515-4f45-bcb7-e888a9aa2a41 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:43.756137 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-9aa8cce3-5515-4f45-bcb7-e888a9aa2a41 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:43.761677 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-1a9e7af5-e923-4116-a723-2d929059cc36 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:43.762321 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-1a9e7af5-e923-4116-a723-2d929059cc36 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:43.762682 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9aa8cce3-5515-4f45-bcb7-e888a9aa2a41 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:43.763131 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9aa8cce3-5515-4f45-bcb7-e888a9aa2a41 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:43.763893 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9aa8cce3-5515-4f45-bcb7-e888a9aa2a41 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:43.764320 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9aa8cce3-5515-4f45-bcb7-e888a9aa2a41 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:43.768817 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1a9e7af5-e923-4116-a723-2d929059cc36 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:43.769270 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1a9e7af5-e923-4116-a723-2d929059cc36 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:43.770034 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1a9e7af5-e923-4116-a723-2d929059cc36 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:43.770466 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1a9e7af5-e923-4116-a723-2d929059cc36 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:43.794554 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-9aa8cce3-5515-4f45-bcb7-e888a9aa2a41 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042984 Jun 17 15:19:43.796389 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 663/1108] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:19:43 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:19:43.801707 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-2cabbd7c-782b-4912-ac23-cf6fde09becf tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:43.802615 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-2cabbd7c-782b-4912-ac23-cf6fde09becf tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:43.808741 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2cabbd7c-782b-4912-ac23-cf6fde09becf tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:43.809225 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2cabbd7c-782b-4912-ac23-cf6fde09becf tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:43.809990 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2cabbd7c-782b-4912-ac23-cf6fde09becf tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:43.810420 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2cabbd7c-782b-4912-ac23-cf6fde09becf tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:43.832773 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-1a9e7af5-e923-4116-a723-2d929059cc36 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:19:43.840202 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-2cabbd7c-782b-4912-ac23-cf6fde09becf tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041970 Jun 17 15:19:43.840800 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 664/1109] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:19:43 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:19:43.841263 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-1a9e7af5-e923-4116-a723-2d929059cc36 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.083154 Jun 17 15:19:43.841815 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 446/1110] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:19:43 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:19:43.948614 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-c4bff458-6ead-4a13-86af-d1e6b5bafa8a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:43.949723 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-c4bff458-6ead-4a13-86af-d1e6b5bafa8a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:43.952649 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_api:SELECT=100 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:19:43.956687 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c4bff458-6ead-4a13-86af-d1e6b5bafa8a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:43.957140 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c4bff458-6ead-4a13-86af-d1e6b5bafa8a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:43.957908 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c4bff458-6ead-4a13-86af-d1e6b5bafa8a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:43.958348 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c4bff458-6ead-4a13-86af-d1e6b5bafa8a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:44.095645 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-c4bff458-6ead-4a13-86af-d1e6b5bafa8a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:19:44.099129 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=100 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:19:44.104072 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-c4bff458-6ead-4a13-86af-d1e6b5bafa8a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.159374 Jun 17 15:19:44.104678 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 665/1111] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:19:43 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:19:44.806426 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-17471cf5-3ed4-45a3-b857-44baf1443c08 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:44.807346 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-17471cf5-3ed4-45a3-b857-44baf1443c08 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:44.814404 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-17471cf5-3ed4-45a3-b857-44baf1443c08 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:44.814843 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-17471cf5-3ed4-45a3-b857-44baf1443c08 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:44.815594 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-17471cf5-3ed4-45a3-b857-44baf1443c08 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:44.816022 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-17471cf5-3ed4-45a3-b857-44baf1443c08 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:44.844867 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-17471cf5-3ed4-45a3-b857-44baf1443c08 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042573 Jun 17 15:19:44.845417 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 447/1112] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:19:44 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:19:44.852943 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-d2fe851d-2782-449e-b118-2617a7b444f6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:44.854066 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-d2fe851d-2782-449e-b118-2617a7b444f6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:44.857527 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-024c661e-ba48-40a1-86b0-0645ebd1ac12 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:44.858131 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-024c661e-ba48-40a1-86b0-0645ebd1ac12 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:44.861121 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d2fe851d-2782-449e-b118-2617a7b444f6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:44.861568 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d2fe851d-2782-449e-b118-2617a7b444f6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:44.862338 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d2fe851d-2782-449e-b118-2617a7b444f6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:44.862768 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d2fe851d-2782-449e-b118-2617a7b444f6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:44.864154 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-024c661e-ba48-40a1-86b0-0645ebd1ac12 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:44.864636 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-024c661e-ba48-40a1-86b0-0645ebd1ac12 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:44.865390 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-024c661e-ba48-40a1-86b0-0645ebd1ac12 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:44.865825 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-024c661e-ba48-40a1-86b0-0645ebd1ac12 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:44.892714 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-d2fe851d-2782-449e-b118-2617a7b444f6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044016 Jun 17 15:19:44.893293 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 666/1113] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:19:44 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:19:44.936962 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-024c661e-ba48-40a1-86b0-0645ebd1ac12 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:19:44.944786 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-024c661e-ba48-40a1-86b0-0645ebd1ac12 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.091404 Jun 17 15:19:44.945438 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 448/1114] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:19:44 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:19:45.123105 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-db724e6f-ae97-4674-92d2-939bb940eac3 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:45.123758 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-db724e6f-ae97-4674-92d2-939bb940eac3 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:45.131026 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-db724e6f-ae97-4674-92d2-939bb940eac3 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:45.131468 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-db724e6f-ae97-4674-92d2-939bb940eac3 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:45.132249 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-db724e6f-ae97-4674-92d2-939bb940eac3 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:45.132705 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-db724e6f-ae97-4674-92d2-939bb940eac3 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:45.282578 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-db724e6f-ae97-4674-92d2-939bb940eac3 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:19:45.290496 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-db724e6f-ae97-4674-92d2-939bb940eac3 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.173230 Jun 17 15:19:45.291091 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 667/1115] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:19:45 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:19:45.856540 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-c47de285-a879-45a8-b52a-9f92cb2a4799 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:45.857464 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-c47de285-a879-45a8-b52a-9f92cb2a4799 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:45.863849 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c47de285-a879-45a8-b52a-9f92cb2a4799 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:45.864300 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c47de285-a879-45a8-b52a-9f92cb2a4799 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:45.865088 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c47de285-a879-45a8-b52a-9f92cb2a4799 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:45.865524 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c47de285-a879-45a8-b52a-9f92cb2a4799 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:45.895093 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-c47de285-a879-45a8-b52a-9f92cb2a4799 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042537 Jun 17 15:19:45.895654 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 449/1116] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:19:45 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:19:45.906104 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-7e7b9775-ca0a-4396-a462-78379fbead0d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:45.907011 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-7e7b9775-ca0a-4396-a462-78379fbead0d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:45.913627 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7e7b9775-ca0a-4396-a462-78379fbead0d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:45.914080 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7e7b9775-ca0a-4396-a462-78379fbead0d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:45.914892 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7e7b9775-ca0a-4396-a462-78379fbead0d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:45.915363 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7e7b9775-ca0a-4396-a462-78379fbead0d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:45.945346 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-7e7b9775-ca0a-4396-a462-78379fbead0d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043315 Jun 17 15:19:45.945901 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 668/1117] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:19:45 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:19:45.961173 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-8db61fdd-d4bd-4a53-be0b-694058d45ea0 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:45.961780 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-8db61fdd-d4bd-4a53-be0b-694058d45ea0 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:45.968009 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8db61fdd-d4bd-4a53-be0b-694058d45ea0 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:45.968490 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8db61fdd-d4bd-4a53-be0b-694058d45ea0 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:45.969239 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8db61fdd-d4bd-4a53-be0b-694058d45ea0 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:45.969667 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8db61fdd-d4bd-4a53-be0b-694058d45ea0 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:46.032147 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-8db61fdd-d4bd-4a53-be0b-694058d45ea0 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:19:46.039803 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-8db61fdd-d4bd-4a53-be0b-694058d45ea0 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.082407 Jun 17 15:19:46.040415 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 450/1118] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:19:45 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:19:46.308232 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-c95af255-ef89-4134-9ec1-da0f521baa32 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:46.309488 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-c95af255-ef89-4134-9ec1-da0f521baa32 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:46.315488 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c95af255-ef89-4134-9ec1-da0f521baa32 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:46.315928 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c95af255-ef89-4134-9ec1-da0f521baa32 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:46.316700 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c95af255-ef89-4134-9ec1-da0f521baa32 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:46.317129 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c95af255-ef89-4134-9ec1-da0f521baa32 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:46.451518 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-c95af255-ef89-4134-9ec1-da0f521baa32 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:19:46.459100 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-c95af255-ef89-4134-9ec1-da0f521baa32 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.154750 Jun 17 15:19:46.459656 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 669/1119] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:19:46 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:19:46.907735 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-b33be01a-887d-4a02-9100-4f54b2cd5937 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:46.908691 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-b33be01a-887d-4a02-9100-4f54b2cd5937 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:46.915563 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b33be01a-887d-4a02-9100-4f54b2cd5937 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:46.915999 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b33be01a-887d-4a02-9100-4f54b2cd5937 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:46.916802 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b33be01a-887d-4a02-9100-4f54b2cd5937 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:46.917226 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b33be01a-887d-4a02-9100-4f54b2cd5937 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:46.947015 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-b33be01a-887d-4a02-9100-4f54b2cd5937 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043330 Jun 17 15:19:46.947862 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 451/1120] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:19:46 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:19:46.957693 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-0df55ddd-3336-4c6c-bb2e-c43e08061207 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:46.958645 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-0df55ddd-3336-4c6c-bb2e-c43e08061207 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:46.965851 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0df55ddd-3336-4c6c-bb2e-c43e08061207 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:46.966547 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0df55ddd-3336-4c6c-bb2e-c43e08061207 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:46.967318 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0df55ddd-3336-4c6c-bb2e-c43e08061207 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:46.967749 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0df55ddd-3336-4c6c-bb2e-c43e08061207 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:46.996583 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-0df55ddd-3336-4c6c-bb2e-c43e08061207 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042816 Jun 17 15:19:46.997146 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 670/1121] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:19:46 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 15:19:47.056271 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-cc41a2df-c8f5-4b2d-a4a0-2c7b2f132f63 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:47.056901 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-cc41a2df-c8f5-4b2d-a4a0-2c7b2f132f63 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:47.062869 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cc41a2df-c8f5-4b2d-a4a0-2c7b2f132f63 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:47.063325 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cc41a2df-c8f5-4b2d-a4a0-2c7b2f132f63 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:47.064096 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cc41a2df-c8f5-4b2d-a4a0-2c7b2f132f63 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:47.064551 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cc41a2df-c8f5-4b2d-a4a0-2c7b2f132f63 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:47.127657 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-cc41a2df-c8f5-4b2d-a4a0-2c7b2f132f63 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:19:47.135056 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-cc41a2df-c8f5-4b2d-a4a0-2c7b2f132f63 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.082619 Jun 17 15:19:47.135607 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 452/1122] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:19:47 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:19:47.476679 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-ab593735-5011-49c4-b68d-d5dac10608d2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:47.477326 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-ab593735-5011-49c4-b68d-d5dac10608d2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:47.483391 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ab593735-5011-49c4-b68d-d5dac10608d2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:47.483839 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ab593735-5011-49c4-b68d-d5dac10608d2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:47.484642 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ab593735-5011-49c4-b68d-d5dac10608d2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:47.485076 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ab593735-5011-49c4-b68d-d5dac10608d2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:47.613010 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-ab593735-5011-49c4-b68d-d5dac10608d2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:19:47.620527 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-ab593735-5011-49c4-b68d-d5dac10608d2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.147816 Jun 17 15:19:47.621678 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 671/1123] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:19:47 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:19:47.960467 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-968eee3c-f150-40ba-9a6b-a5d55c61bb47 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:47.961386 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-968eee3c-f150-40ba-9a6b-a5d55c61bb47 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:47.968025 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-968eee3c-f150-40ba-9a6b-a5d55c61bb47 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:47.968507 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-968eee3c-f150-40ba-9a6b-a5d55c61bb47 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:47.969259 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-968eee3c-f150-40ba-9a6b-a5d55c61bb47 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:47.969687 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-968eee3c-f150-40ba-9a6b-a5d55c61bb47 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:48.000434 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-968eee3c-f150-40ba-9a6b-a5d55c61bb47 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044486 Jun 17 15:19:48.001000 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 453/1124] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:19:47 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:19:48.008591 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-b706a4d9-3ace-480c-a39f-52ef4e043e4a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:48.009507 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-b706a4d9-3ace-480c-a39f-52ef4e043e4a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:48.015952 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b706a4d9-3ace-480c-a39f-52ef4e043e4a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:48.016430 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b706a4d9-3ace-480c-a39f-52ef4e043e4a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:48.017199 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b706a4d9-3ace-480c-a39f-52ef4e043e4a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:48.017632 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b706a4d9-3ace-480c-a39f-52ef4e043e4a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:48.051192 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-b706a4d9-3ace-480c-a39f-52ef4e043e4a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046938 Jun 17 15:19:48.051763 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 672/1125] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:19:48 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:19:48.152541 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-fa763002-25ad-49e2-9b1e-71d04ce02214 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:48.153180 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-fa763002-25ad-49e2-9b1e-71d04ce02214 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:48.159182 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fa763002-25ad-49e2-9b1e-71d04ce02214 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:48.159625 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fa763002-25ad-49e2-9b1e-71d04ce02214 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:48.160490 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fa763002-25ad-49e2-9b1e-71d04ce02214 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:48.160845 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fa763002-25ad-49e2-9b1e-71d04ce02214 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:48.229678 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-fa763002-25ad-49e2-9b1e-71d04ce02214 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:19:48.238034 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-fa763002-25ad-49e2-9b1e-71d04ce02214 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.089817 Jun 17 15:19:48.238614 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 454/1126] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:19:48 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:19:48.644804 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-9e27fb2b-53f4-4b38-869a-fe2cc9cec720 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:48.645418 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-9e27fb2b-53f4-4b38-869a-fe2cc9cec720 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:48.651362 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9e27fb2b-53f4-4b38-869a-fe2cc9cec720 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:48.651812 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9e27fb2b-53f4-4b38-869a-fe2cc9cec720 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:48.653200 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9e27fb2b-53f4-4b38-869a-fe2cc9cec720 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:48.653631 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9e27fb2b-53f4-4b38-869a-fe2cc9cec720 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:48.786051 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-9e27fb2b-53f4-4b38-869a-fe2cc9cec720 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:19:48.793524 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-9e27fb2b-53f4-4b38-869a-fe2cc9cec720 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.154178 Jun 17 15:19:48.794077 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 673/1127] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:19:48 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:19:49.011211 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-a920b8bc-950b-46aa-b9e4-9242da554660 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:49.012837 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-a920b8bc-950b-46aa-b9e4-9242da554660 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:49.019740 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a920b8bc-950b-46aa-b9e4-9242da554660 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:49.020186 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a920b8bc-950b-46aa-b9e4-9242da554660 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:49.020997 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a920b8bc-950b-46aa-b9e4-9242da554660 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:49.021436 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a920b8bc-950b-46aa-b9e4-9242da554660 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:49.052799 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-a920b8bc-950b-46aa-b9e4-9242da554660 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045413 Jun 17 15:19:49.053384 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 455/1128] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:19:49 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:19:49.063035 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-d0103ffb-64bb-489f-bbe9-9dce42c79718 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:49.064016 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-d0103ffb-64bb-489f-bbe9-9dce42c79718 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:49.070944 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d0103ffb-64bb-489f-bbe9-9dce42c79718 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:49.071391 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d0103ffb-64bb-489f-bbe9-9dce42c79718 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:49.072162 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d0103ffb-64bb-489f-bbe9-9dce42c79718 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:49.072626 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d0103ffb-64bb-489f-bbe9-9dce42c79718 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:49.105652 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-d0103ffb-64bb-489f-bbe9-9dce42c79718 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047103 Jun 17 15:19:49.106230 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 674/1129] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:19:49 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:19:49.254792 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-e7634978-d35e-4869-bad0-e744677f3bfd tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:49.255323 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-e7634978-d35e-4869-bad0-e744677f3bfd tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:49.261732 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e7634978-d35e-4869-bad0-e744677f3bfd tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:49.262181 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e7634978-d35e-4869-bad0-e744677f3bfd tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:49.263008 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e7634978-d35e-4869-bad0-e744677f3bfd tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:49.263466 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e7634978-d35e-4869-bad0-e744677f3bfd tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:49.327506 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-e7634978-d35e-4869-bad0-e744677f3bfd tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:19:49.335302 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-e7634978-d35e-4869-bad0-e744677f3bfd tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.084706 Jun 17 15:19:49.335877 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 456/1130] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:19:49 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:19:49.810884 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-b8d48fe6-7a55-4149-800f-9315f63f8c9e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:49.811503 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-b8d48fe6-7a55-4149-800f-9315f63f8c9e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:49.817824 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b8d48fe6-7a55-4149-800f-9315f63f8c9e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:49.818267 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b8d48fe6-7a55-4149-800f-9315f63f8c9e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:49.819026 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b8d48fe6-7a55-4149-800f-9315f63f8c9e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:49.819457 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b8d48fe6-7a55-4149-800f-9315f63f8c9e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:49.958812 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-b8d48fe6-7a55-4149-800f-9315f63f8c9e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:19:49.967311 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-b8d48fe6-7a55-4149-800f-9315f63f8c9e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.160785 Jun 17 15:19:49.967887 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 675/1131] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:19:49 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:19:50.065290 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-cb1cbb3c-29c4-4285-8705-27147169ed99 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:50.066078 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-cb1cbb3c-29c4-4285-8705-27147169ed99 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:50.072825 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cb1cbb3c-29c4-4285-8705-27147169ed99 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:50.073270 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cb1cbb3c-29c4-4285-8705-27147169ed99 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:50.074050 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cb1cbb3c-29c4-4285-8705-27147169ed99 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:50.074480 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cb1cbb3c-29c4-4285-8705-27147169ed99 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:50.106615 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-cb1cbb3c-29c4-4285-8705-27147169ed99 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045324 Jun 17 15:19:50.107172 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 457/1132] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:19:50 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:19:50.117179 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-0c54d7e5-e80f-4a14-b5c2-fe3a8a291f1e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:50.118094 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-0c54d7e5-e80f-4a14-b5c2-fe3a8a291f1e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:50.125987 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0c54d7e5-e80f-4a14-b5c2-fe3a8a291f1e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:50.126430 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0c54d7e5-e80f-4a14-b5c2-fe3a8a291f1e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:50.127205 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0c54d7e5-e80f-4a14-b5c2-fe3a8a291f1e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:50.127633 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0c54d7e5-e80f-4a14-b5c2-fe3a8a291f1e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:50.158397 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-0c54d7e5-e80f-4a14-b5c2-fe3a8a291f1e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045161 Jun 17 15:19:50.158971 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 676/1133] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:19:50 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:19:50.352541 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-98d59249-b621-44ac-8947-44b574dc370d tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:50.353149 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-98d59249-b621-44ac-8947-44b574dc370d tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:50.359885 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-98d59249-b621-44ac-8947-44b574dc370d tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:50.360348 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-98d59249-b621-44ac-8947-44b574dc370d tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:50.361121 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-98d59249-b621-44ac-8947-44b574dc370d tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:50.361545 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-98d59249-b621-44ac-8947-44b574dc370d tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:50.424058 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-98d59249-b621-44ac-8947-44b574dc370d tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:19:50.431884 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-98d59249-b621-44ac-8947-44b574dc370d tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.083220 Jun 17 15:19:50.432468 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 458/1134] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:19:50 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:19:50.985129 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-62477014-6725-4f3a-a011-16d3369b1778 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:50.985771 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-62477014-6725-4f3a-a011-16d3369b1778 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:50.993185 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-62477014-6725-4f3a-a011-16d3369b1778 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:50.993641 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-62477014-6725-4f3a-a011-16d3369b1778 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:50.994426 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-62477014-6725-4f3a-a011-16d3369b1778 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:50.994858 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-62477014-6725-4f3a-a011-16d3369b1778 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:51.118348 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-b5a63b33-b49e-47c2-9023-f7efc949347d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:51.119273 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-b5a63b33-b49e-47c2-9023-f7efc949347d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:51.126367 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b5a63b33-b49e-47c2-9023-f7efc949347d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:51.126791 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b5a63b33-b49e-47c2-9023-f7efc949347d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:51.127556 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b5a63b33-b49e-47c2-9023-f7efc949347d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:51.127985 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b5a63b33-b49e-47c2-9023-f7efc949347d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:51.135367 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-62477014-6725-4f3a-a011-16d3369b1778 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:19:51.155031 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-62477014-6725-4f3a-a011-16d3369b1778 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.174303 Jun 17 15:19:51.159936 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 677/1135] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:19:50 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:19:51.164787 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-b5a63b33-b49e-47c2-9023-f7efc949347d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050293 Jun 17 15:19:51.165649 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 459/1136] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:19:51 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:19:51.174477 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-1d1455a4-7d21-4d9a-8fc4-bab56e6fb57b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:51.175933 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-1d1455a4-7d21-4d9a-8fc4-bab56e6fb57b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:51.183426 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1d1455a4-7d21-4d9a-8fc4-bab56e6fb57b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:51.184406 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1d1455a4-7d21-4d9a-8fc4-bab56e6fb57b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:51.185287 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1d1455a4-7d21-4d9a-8fc4-bab56e6fb57b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:51.185751 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1d1455a4-7d21-4d9a-8fc4-bab56e6fb57b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:51.224735 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-1d1455a4-7d21-4d9a-8fc4-bab56e6fb57b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057474 Jun 17 15:19:51.225318 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 678/1137] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:19:51 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:19:51.449586 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-3843b30e-06b8-4db3-9e49-3ef5beec7f76 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:51.450196 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-3843b30e-06b8-4db3-9e49-3ef5beec7f76 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:51.456527 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3843b30e-06b8-4db3-9e49-3ef5beec7f76 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:51.457145 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3843b30e-06b8-4db3-9e49-3ef5beec7f76 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:51.457913 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3843b30e-06b8-4db3-9e49-3ef5beec7f76 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:51.458351 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3843b30e-06b8-4db3-9e49-3ef5beec7f76 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:51.462502 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell1:SELECT=100 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:19:51.523999 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-3843b30e-06b8-4db3-9e49-3ef5beec7f76 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:19:51.532039 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-3843b30e-06b8-4db3-9e49-3ef5beec7f76 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.087415 Jun 17 15:19:51.532866 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 460/1138] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:19:51 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:19:52.173324 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-a1a00a40-a030-44a8-bf1e-fc652136a26c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:52.173960 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-a1a00a40-a030-44a8-bf1e-fc652136a26c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:52.177466 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-16c01e00-4a66-409e-a2d3-4979268cce52 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:52.178401 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-16c01e00-4a66-409e-a2d3-4979268cce52 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:52.182068 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a1a00a40-a030-44a8-bf1e-fc652136a26c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:52.182646 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a1a00a40-a030-44a8-bf1e-fc652136a26c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:52.183658 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a1a00a40-a030-44a8-bf1e-fc652136a26c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:52.184878 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a1a00a40-a030-44a8-bf1e-fc652136a26c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:52.186780 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-16c01e00-4a66-409e-a2d3-4979268cce52 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:52.187409 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-16c01e00-4a66-409e-a2d3-4979268cce52 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:52.188227 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-16c01e00-4a66-409e-a2d3-4979268cce52 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:52.188726 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-16c01e00-4a66-409e-a2d3-4979268cce52 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:52.224465 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-16c01e00-4a66-409e-a2d3-4979268cce52 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050734 Jun 17 15:19:52.225195 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 461/1139] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:19:52 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:19:52.238142 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-f1430fb3-0b37-4ee1-abe3-9873f8af0639 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:52.239113 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-f1430fb3-0b37-4ee1-abe3-9873f8af0639 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:52.246090 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f1430fb3-0b37-4ee1-abe3-9873f8af0639 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:52.247027 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f1430fb3-0b37-4ee1-abe3-9873f8af0639 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:52.247794 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f1430fb3-0b37-4ee1-abe3-9873f8af0639 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:52.248225 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f1430fb3-0b37-4ee1-abe3-9873f8af0639 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:52.280166 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-f1430fb3-0b37-4ee1-abe3-9873f8af0639 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045706 Jun 17 15:19:52.283681 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 462/1140] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:19:52 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 15:19:52.334400 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-a1a00a40-a030-44a8-bf1e-fc652136a26c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:19:52.342448 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-a1a00a40-a030-44a8-bf1e-fc652136a26c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.173347 Jun 17 15:19:52.343008 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 679/1141] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:19:52 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:19:52.549345 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-6b205537-1095-4dd9-97a0-ea89ae05a1bd tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:52.549874 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-6b205537-1095-4dd9-97a0-ea89ae05a1bd tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:52.555928 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6b205537-1095-4dd9-97a0-ea89ae05a1bd tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:52.556397 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6b205537-1095-4dd9-97a0-ea89ae05a1bd tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:52.557150 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6b205537-1095-4dd9-97a0-ea89ae05a1bd tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:52.557584 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6b205537-1095-4dd9-97a0-ea89ae05a1bd tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:52.625862 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-6b205537-1095-4dd9-97a0-ea89ae05a1bd tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:19:52.633565 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-6b205537-1095-4dd9-97a0-ea89ae05a1bd tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.088120 Jun 17 15:19:52.634133 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 463/1142] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:19:52 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:19:53.237384 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-6b11aede-ccb2-470e-a8c8-806f4f485300 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:53.238462 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-6b11aede-ccb2-470e-a8c8-806f4f485300 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:53.245886 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6b11aede-ccb2-470e-a8c8-806f4f485300 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:53.246873 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6b11aede-ccb2-470e-a8c8-806f4f485300 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:53.247687 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6b11aede-ccb2-470e-a8c8-806f4f485300 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:53.248176 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6b11aede-ccb2-470e-a8c8-806f4f485300 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:53.286693 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-6b11aede-ccb2-470e-a8c8-806f4f485300 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053849 Jun 17 15:19:53.287259 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 680/1143] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:19:53 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:19:53.291436 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-25ff1a60-4612-4c47-b5e1-d3bcbb0d8f6a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:53.292386 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-25ff1a60-4612-4c47-b5e1-d3bcbb0d8f6a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:53.299054 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-25ff1a60-4612-4c47-b5e1-d3bcbb0d8f6a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:53.299492 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-25ff1a60-4612-4c47-b5e1-d3bcbb0d8f6a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:53.300256 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-25ff1a60-4612-4c47-b5e1-d3bcbb0d8f6a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:53.300717 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-25ff1a60-4612-4c47-b5e1-d3bcbb0d8f6a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:53.331920 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-25ff1a60-4612-4c47-b5e1-d3bcbb0d8f6a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044572 Jun 17 15:19:53.332592 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 464/1144] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:19:53 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 15:19:53.359602 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-8fea5ed5-33d0-433c-877a-0c502cd74e58 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:53.360480 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-8fea5ed5-33d0-433c-877a-0c502cd74e58 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:53.369145 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8fea5ed5-33d0-433c-877a-0c502cd74e58 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:53.369814 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8fea5ed5-33d0-433c-877a-0c502cd74e58 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:53.370970 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8fea5ed5-33d0-433c-877a-0c502cd74e58 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:53.372163 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8fea5ed5-33d0-433c-877a-0c502cd74e58 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:53.512989 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-8fea5ed5-33d0-433c-877a-0c502cd74e58 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:19:53.520663 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-8fea5ed5-33d0-433c-877a-0c502cd74e58 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.165049 Jun 17 15:19:53.521265 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 681/1145] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:19:53 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:19:53.650591 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-9d790288-a9cc-4499-bf5a-c700050039b6 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:53.651199 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-9d790288-a9cc-4499-bf5a-c700050039b6 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:53.657314 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9d790288-a9cc-4499-bf5a-c700050039b6 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:53.657763 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9d790288-a9cc-4499-bf5a-c700050039b6 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:53.658524 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9d790288-a9cc-4499-bf5a-c700050039b6 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:53.658957 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9d790288-a9cc-4499-bf5a-c700050039b6 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:53.728438 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-9d790288-a9cc-4499-bf5a-c700050039b6 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:19:53.736570 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-9d790288-a9cc-4499-bf5a-c700050039b6 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.089831 Jun 17 15:19:53.737133 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 465/1146] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:19:53 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:19:54.299190 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-1bdb8be8-6578-4f2e-8dd8-68152dc9d948 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:54.301194 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-1bdb8be8-6578-4f2e-8dd8-68152dc9d948 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:54.308055 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1bdb8be8-6578-4f2e-8dd8-68152dc9d948 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:54.308585 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1bdb8be8-6578-4f2e-8dd8-68152dc9d948 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:54.309374 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1bdb8be8-6578-4f2e-8dd8-68152dc9d948 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:54.309820 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1bdb8be8-6578-4f2e-8dd8-68152dc9d948 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:54.327745 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=100 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:19:54.342545 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-1bdb8be8-6578-4f2e-8dd8-68152dc9d948 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047443 Jun 17 15:19:54.343106 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 682/1147] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:19:54 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:19:54.343993 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-a614df2a-ed86-4066-87bf-c8db84953e40 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:54.344970 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-a614df2a-ed86-4066-87bf-c8db84953e40 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:54.351528 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a614df2a-ed86-4066-87bf-c8db84953e40 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:54.351977 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a614df2a-ed86-4066-87bf-c8db84953e40 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:54.352773 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a614df2a-ed86-4066-87bf-c8db84953e40 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:54.353215 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a614df2a-ed86-4066-87bf-c8db84953e40 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:54.383243 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-a614df2a-ed86-4066-87bf-c8db84953e40 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043894 Jun 17 15:19:54.383820 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 466/1148] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:19:54 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 15:19:54.537561 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-90e6c95d-141a-4263-a961-be56f803765f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:54.538167 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-90e6c95d-141a-4263-a961-be56f803765f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:54.544234 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-90e6c95d-141a-4263-a961-be56f803765f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:54.544704 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-90e6c95d-141a-4263-a961-be56f803765f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:54.545454 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-90e6c95d-141a-4263-a961-be56f803765f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:54.545879 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-90e6c95d-141a-4263-a961-be56f803765f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:54.684210 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-90e6c95d-141a-4263-a961-be56f803765f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:19:54.692343 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-90e6c95d-141a-4263-a961-be56f803765f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.158533 Jun 17 15:19:54.692924 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 683/1149] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:19:54 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:19:54.753504 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-475051da-f703-431f-9d7c-3222e5a03f49 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:54.754113 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-475051da-f703-431f-9d7c-3222e5a03f49 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:54.760257 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-475051da-f703-431f-9d7c-3222e5a03f49 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:54.760757 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-475051da-f703-431f-9d7c-3222e5a03f49 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:54.761521 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-475051da-f703-431f-9d7c-3222e5a03f49 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:54.761997 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-475051da-f703-431f-9d7c-3222e5a03f49 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:54.825682 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-475051da-f703-431f-9d7c-3222e5a03f49 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:19:54.833526 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-475051da-f703-431f-9d7c-3222e5a03f49 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.083861 Jun 17 15:19:54.834093 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 467/1150] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:19:54 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:19:55.280032 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 15:19:55.280032 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Fri Jun 17 15:19:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 15:19:55.354331 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-beffebbd-2bfb-402c-8da1-87c6c3c59ac4 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:55.355264 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-beffebbd-2bfb-402c-8da1-87c6c3c59ac4 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:55.362529 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-beffebbd-2bfb-402c-8da1-87c6c3c59ac4 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:55.362987 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-beffebbd-2bfb-402c-8da1-87c6c3c59ac4 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:55.363763 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-beffebbd-2bfb-402c-8da1-87c6c3c59ac4 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:55.364197 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-beffebbd-2bfb-402c-8da1-87c6c3c59ac4 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:55.395744 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-beffebbd-2bfb-402c-8da1-87c6c3c59ac4 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045354 Jun 17 15:19:55.396151 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-efea6d1a-8279-43d1-9c08-582e0d109fe6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:55.396669 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 684/1151] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:19:55 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:19:55.397311 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-efea6d1a-8279-43d1-9c08-582e0d109fe6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:55.403913 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-efea6d1a-8279-43d1-9c08-582e0d109fe6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:55.404391 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-efea6d1a-8279-43d1-9c08-582e0d109fe6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:55.405164 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-efea6d1a-8279-43d1-9c08-582e0d109fe6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:55.405601 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-efea6d1a-8279-43d1-9c08-582e0d109fe6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:55.435518 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-efea6d1a-8279-43d1-9c08-582e0d109fe6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043558 Jun 17 15:19:55.436086 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 468/1152] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:19:55 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 15:19:55.710152 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-33cc0f28-5ff8-4eac-921f-b78592ec22e4 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:55.710755 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-33cc0f28-5ff8-4eac-921f-b78592ec22e4 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:55.717011 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-33cc0f28-5ff8-4eac-921f-b78592ec22e4 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:55.717458 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-33cc0f28-5ff8-4eac-921f-b78592ec22e4 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:55.718247 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-33cc0f28-5ff8-4eac-921f-b78592ec22e4 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:55.718676 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-33cc0f28-5ff8-4eac-921f-b78592ec22e4 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:55.850509 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-9b48416c-d316-47f8-b3f7-f05a2c80239e tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:55.851134 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-9b48416c-d316-47f8-b3f7-f05a2c80239e tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:55.851475 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-33cc0f28-5ff8-4eac-921f-b78592ec22e4 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:19:55.857416 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9b48416c-d316-47f8-b3f7-f05a2c80239e tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:55.858394 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9b48416c-d316-47f8-b3f7-f05a2c80239e tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:55.858609 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9b48416c-d316-47f8-b3f7-f05a2c80239e tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:55.859421 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9b48416c-d316-47f8-b3f7-f05a2c80239e tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:55.859562 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-33cc0f28-5ff8-4eac-921f-b78592ec22e4 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.152903 Jun 17 15:19:55.859805 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 685/1153] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:19:55 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:19:55.930735 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-9b48416c-d316-47f8-b3f7-f05a2c80239e tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:19:55.939085 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-9b48416c-d316-47f8-b3f7-f05a2c80239e tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.092517 Jun 17 15:19:55.939663 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 469/1154] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:19:55 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:19:56.407963 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-713d51f5-dd9a-41ab-b922-0d79f12c60a9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:56.408976 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-713d51f5-dd9a-41ab-b922-0d79f12c60a9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:56.415374 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-713d51f5-dd9a-41ab-b922-0d79f12c60a9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:56.415829 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-713d51f5-dd9a-41ab-b922-0d79f12c60a9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:56.416638 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-713d51f5-dd9a-41ab-b922-0d79f12c60a9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:56.417107 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-713d51f5-dd9a-41ab-b922-0d79f12c60a9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:56.447554 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-6a180a1d-45f5-4e08-8265-09ad1079ecaf tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:56.448144 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-713d51f5-dd9a-41ab-b922-0d79f12c60a9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044133 Jun 17 15:19:56.448589 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-6a180a1d-45f5-4e08-8265-09ad1079ecaf tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:56.449092 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 686/1155] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:19:56 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:19:56.455215 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6a180a1d-45f5-4e08-8265-09ad1079ecaf tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:56.455649 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6a180a1d-45f5-4e08-8265-09ad1079ecaf tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:56.456435 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6a180a1d-45f5-4e08-8265-09ad1079ecaf tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:56.456865 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6a180a1d-45f5-4e08-8265-09ad1079ecaf tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:56.488047 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-6a180a1d-45f5-4e08-8265-09ad1079ecaf tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044423 Jun 17 15:19:56.488635 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 470/1156] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:19:56 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 15:19:56.876308 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-bfbbe035-50bc-4e5e-b222-db3c703fa119 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:56.876940 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-bfbbe035-50bc-4e5e-b222-db3c703fa119 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:56.883500 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bfbbe035-50bc-4e5e-b222-db3c703fa119 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:56.883943 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bfbbe035-50bc-4e5e-b222-db3c703fa119 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:56.884740 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bfbbe035-50bc-4e5e-b222-db3c703fa119 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:56.885165 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bfbbe035-50bc-4e5e-b222-db3c703fa119 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:56.956945 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-3d92e4e2-0b65-4889-a516-d7f51212d523 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:56.958198 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-3d92e4e2-0b65-4889-a516-d7f51212d523 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:56.970107 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3d92e4e2-0b65-4889-a516-d7f51212d523 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:56.970908 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3d92e4e2-0b65-4889-a516-d7f51212d523 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:56.981862 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3d92e4e2-0b65-4889-a516-d7f51212d523 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:56.982944 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3d92e4e2-0b65-4889-a516-d7f51212d523 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:57.034930 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-bfbbe035-50bc-4e5e-b222-db3c703fa119 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:19:57.042770 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-bfbbe035-50bc-4e5e-b222-db3c703fa119 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.170366 Jun 17 15:19:57.043403 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 687/1157] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:19:56 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:19:57.054066 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-3d92e4e2-0b65-4889-a516-d7f51212d523 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:19:57.062143 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-3d92e4e2-0b65-4889-a516-d7f51212d523 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.109715 Jun 17 15:19:57.062709 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 471/1158] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:19:56 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:19:57.461588 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-c150dec9-567d-4fcc-8b6a-e75c83ccf444 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:57.462538 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-c150dec9-567d-4fcc-8b6a-e75c83ccf444 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:57.469934 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c150dec9-567d-4fcc-8b6a-e75c83ccf444 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:57.470386 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c150dec9-567d-4fcc-8b6a-e75c83ccf444 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:57.471232 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c150dec9-567d-4fcc-8b6a-e75c83ccf444 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:57.471667 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c150dec9-567d-4fcc-8b6a-e75c83ccf444 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:57.500193 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-5a5cdf98-5865-476f-9163-9edeb7fdd9cb tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:57.501150 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-5a5cdf98-5865-476f-9163-9edeb7fdd9cb tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:57.503343 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-c150dec9-567d-4fcc-8b6a-e75c83ccf444 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046030 Jun 17 15:19:57.503920 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 688/1159] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:19:57 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:19:57.507723 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5a5cdf98-5865-476f-9163-9edeb7fdd9cb tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:57.508179 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5a5cdf98-5865-476f-9163-9edeb7fdd9cb tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:57.508982 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5a5cdf98-5865-476f-9163-9edeb7fdd9cb tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:57.509416 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5a5cdf98-5865-476f-9163-9edeb7fdd9cb tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:57.539041 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-5a5cdf98-5865-476f-9163-9edeb7fdd9cb tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043326 Jun 17 15:19:57.539618 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 472/1160] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:19:57 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 15:19:58.062034 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-d0945c5e-9ffd-41db-af37-c40f84cb717d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:58.062674 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-d0945c5e-9ffd-41db-af37-c40f84cb717d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:58.069174 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d0945c5e-9ffd-41db-af37-c40f84cb717d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:58.069624 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d0945c5e-9ffd-41db-af37-c40f84cb717d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:58.070391 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d0945c5e-9ffd-41db-af37-c40f84cb717d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:58.070824 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d0945c5e-9ffd-41db-af37-c40f84cb717d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:58.078695 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-5cd9bc86-2157-4fb6-87a1-c7ff09ce56a2 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:58.079308 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-5cd9bc86-2157-4fb6-87a1-c7ff09ce56a2 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:58.085484 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5cd9bc86-2157-4fb6-87a1-c7ff09ce56a2 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:58.085938 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5cd9bc86-2157-4fb6-87a1-c7ff09ce56a2 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:58.086705 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5cd9bc86-2157-4fb6-87a1-c7ff09ce56a2 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:58.087136 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5cd9bc86-2157-4fb6-87a1-c7ff09ce56a2 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:58.150892 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-5cd9bc86-2157-4fb6-87a1-c7ff09ce56a2 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:19:58.159889 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-5cd9bc86-2157-4fb6-87a1-c7ff09ce56a2 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.084929 Jun 17 15:19:58.160501 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 473/1161] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:19:58 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:19:58.207452 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-d0945c5e-9ffd-41db-af37-c40f84cb717d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:19:58.214885 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-d0945c5e-9ffd-41db-af37-c40f84cb717d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.156745 Jun 17 15:19:58.216315 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 689/1162] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:19:58 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:19:58.515748 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-db6fc943-11a9-4087-9635-1fec7ad04ac6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:58.516687 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-db6fc943-11a9-4087-9635-1fec7ad04ac6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:58.523107 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-db6fc943-11a9-4087-9635-1fec7ad04ac6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:58.523545 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-db6fc943-11a9-4087-9635-1fec7ad04ac6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:58.524295 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-db6fc943-11a9-4087-9635-1fec7ad04ac6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:58.524757 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-db6fc943-11a9-4087-9635-1fec7ad04ac6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:58.550848 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-70ce6773-5772-4e78-9758-59bbcd2d9400 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:58.551798 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-70ce6773-5772-4e78-9758-59bbcd2d9400 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:58.552899 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-db6fc943-11a9-4087-9635-1fec7ad04ac6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041650 Jun 17 15:19:58.553453 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 474/1163] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:19:58 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:19:58.557857 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-70ce6773-5772-4e78-9758-59bbcd2d9400 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:58.558309 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-70ce6773-5772-4e78-9758-59bbcd2d9400 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:58.559616 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-70ce6773-5772-4e78-9758-59bbcd2d9400 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:58.560050 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-70ce6773-5772-4e78-9758-59bbcd2d9400 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:58.588553 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-70ce6773-5772-4e78-9758-59bbcd2d9400 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041652 Jun 17 15:19:58.589090 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 690/1164] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:19:58 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 15:19:59.177021 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-5f987ae6-8fe8-4e7d-9963-32031df55fcd tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:59.177637 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-5f987ae6-8fe8-4e7d-9963-32031df55fcd tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:59.183643 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5f987ae6-8fe8-4e7d-9963-32031df55fcd tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:59.184679 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5f987ae6-8fe8-4e7d-9963-32031df55fcd tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:59.185443 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5f987ae6-8fe8-4e7d-9963-32031df55fcd tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:59.185876 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5f987ae6-8fe8-4e7d-9963-32031df55fcd tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:59.233437 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-8294a7c0-e362-4b50-ada8-9799ed669c7d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:59.234046 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-8294a7c0-e362-4b50-ada8-9799ed669c7d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:59.240546 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8294a7c0-e362-4b50-ada8-9799ed669c7d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:59.240996 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8294a7c0-e362-4b50-ada8-9799ed669c7d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:59.241762 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8294a7c0-e362-4b50-ada8-9799ed669c7d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:59.242191 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8294a7c0-e362-4b50-ada8-9799ed669c7d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:59.245698 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-5f987ae6-8fe8-4e7d-9963-32031df55fcd tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:19:59.253943 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-5f987ae6-8fe8-4e7d-9963-32031df55fcd tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.080786 Jun 17 15:19:59.254731 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 475/1165] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:19:59 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:19:59.385710 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-8294a7c0-e362-4b50-ada8-9799ed669c7d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:19:59.393315 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-8294a7c0-e362-4b50-ada8-9799ed669c7d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.164211 Jun 17 15:19:59.393878 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 691/1166] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:19:59 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:19:59.564701 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-03dfafaf-48fb-46dd-b74a-ae443b5632a6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:59.565549 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-03dfafaf-48fb-46dd-b74a-ae443b5632a6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:59.569016 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_api:SELECT=100 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:19:59.573027 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-03dfafaf-48fb-46dd-b74a-ae443b5632a6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:59.573625 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-03dfafaf-48fb-46dd-b74a-ae443b5632a6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:59.574399 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-03dfafaf-48fb-46dd-b74a-ae443b5632a6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:59.575032 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-03dfafaf-48fb-46dd-b74a-ae443b5632a6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:59.599733 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-b4463847-1f95-4f47-ae70-72a2dd1e321f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:19:59.600392 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell1:SELECT=100 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:19:59.600785 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-b4463847-1f95-4f47-ae70-72a2dd1e321f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:19:59.605059 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-03dfafaf-48fb-46dd-b74a-ae443b5632a6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044515 Jun 17 15:19:59.606169 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 476/1167] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:19:59 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:19:59.607768 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b4463847-1f95-4f47-ae70-72a2dd1e321f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:59.608224 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b4463847-1f95-4f47-ae70-72a2dd1e321f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:59.609029 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b4463847-1f95-4f47-ae70-72a2dd1e321f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:19:59.609513 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b4463847-1f95-4f47-ae70-72a2dd1e321f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:19:59.639058 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-b4463847-1f95-4f47-ae70-72a2dd1e321f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043295 Jun 17 15:19:59.639624 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 692/1168] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:19:59 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 15:20:00.270796 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-23740fee-4d51-4d9a-919f-1cf043f5cf20 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:00.271311 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-23740fee-4d51-4d9a-919f-1cf043f5cf20 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:00.277388 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-23740fee-4d51-4d9a-919f-1cf043f5cf20 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:00.277830 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-23740fee-4d51-4d9a-919f-1cf043f5cf20 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:00.278576 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-23740fee-4d51-4d9a-919f-1cf043f5cf20 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:00.279004 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-23740fee-4d51-4d9a-919f-1cf043f5cf20 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:00.342649 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-23740fee-4d51-4d9a-919f-1cf043f5cf20 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:20:00.350132 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-23740fee-4d51-4d9a-919f-1cf043f5cf20 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.083567 Jun 17 15:20:00.350692 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 477/1169] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:20:00 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:20:00.410912 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-bdb91d98-f2fc-40dd-a6fa-e17a9e450405 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:00.411520 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-bdb91d98-f2fc-40dd-a6fa-e17a9e450405 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:00.418473 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bdb91d98-f2fc-40dd-a6fa-e17a9e450405 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:00.418925 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bdb91d98-f2fc-40dd-a6fa-e17a9e450405 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:00.419673 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bdb91d98-f2fc-40dd-a6fa-e17a9e450405 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:00.420100 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bdb91d98-f2fc-40dd-a6fa-e17a9e450405 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:00.552378 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-bdb91d98-f2fc-40dd-a6fa-e17a9e450405 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:20:00.560658 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-bdb91d98-f2fc-40dd-a6fa-e17a9e450405 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.153543 Jun 17 15:20:00.561223 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 693/1170] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:20:00 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:20:00.617176 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-60759449-1e77-4138-acd2-7ffcf9981aa3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:00.618103 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-60759449-1e77-4138-acd2-7ffcf9981aa3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:00.625631 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-60759449-1e77-4138-acd2-7ffcf9981aa3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:00.626085 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-60759449-1e77-4138-acd2-7ffcf9981aa3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:00.626850 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-60759449-1e77-4138-acd2-7ffcf9981aa3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:00.627290 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-60759449-1e77-4138-acd2-7ffcf9981aa3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:00.650439 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-edfbabea-1e90-4dc6-9eac-77c3dcb86032 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:00.651360 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-edfbabea-1e90-4dc6-9eac-77c3dcb86032 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:00.656703 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-60759449-1e77-4138-acd2-7ffcf9981aa3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043394 Jun 17 15:20:00.657278 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 478/1171] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:20:00 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:20:00.657437 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-edfbabea-1e90-4dc6-9eac-77c3dcb86032 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:00.657754 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-edfbabea-1e90-4dc6-9eac-77c3dcb86032 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:00.658533 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-edfbabea-1e90-4dc6-9eac-77c3dcb86032 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:00.658967 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-edfbabea-1e90-4dc6-9eac-77c3dcb86032 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:00.692041 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-edfbabea-1e90-4dc6-9eac-77c3dcb86032 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045546 Jun 17 15:20:00.692666 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 694/1172] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:20:00 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 15:20:01.366452 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-407b6965-3ce8-4d9b-b1b9-afcbb37f68d9 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:01.367064 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-407b6965-3ce8-4d9b-b1b9-afcbb37f68d9 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:01.373261 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-407b6965-3ce8-4d9b-b1b9-afcbb37f68d9 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:01.373712 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-407b6965-3ce8-4d9b-b1b9-afcbb37f68d9 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:01.374475 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-407b6965-3ce8-4d9b-b1b9-afcbb37f68d9 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:01.374909 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-407b6965-3ce8-4d9b-b1b9-afcbb37f68d9 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:01.434684 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-407b6965-3ce8-4d9b-b1b9-afcbb37f68d9 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:20:01.442334 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-407b6965-3ce8-4d9b-b1b9-afcbb37f68d9 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.079695 Jun 17 15:20:01.442894 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 479/1173] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:20:01 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:20:01.577979 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-63125849-e295-454d-8f89-ede45aa57ba0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:01.578584 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-63125849-e295-454d-8f89-ede45aa57ba0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:01.585069 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-63125849-e295-454d-8f89-ede45aa57ba0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:01.585512 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-63125849-e295-454d-8f89-ede45aa57ba0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:01.586259 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-63125849-e295-454d-8f89-ede45aa57ba0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:01.586687 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-63125849-e295-454d-8f89-ede45aa57ba0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:01.668441 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-a5d890a2-46a0-4d40-89c5-9e4f8eaed410 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:01.669368 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-a5d890a2-46a0-4d40-89c5-9e4f8eaed410 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:01.675823 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a5d890a2-46a0-4d40-89c5-9e4f8eaed410 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:01.676269 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a5d890a2-46a0-4d40-89c5-9e4f8eaed410 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:01.677072 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a5d890a2-46a0-4d40-89c5-9e4f8eaed410 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:01.677506 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a5d890a2-46a0-4d40-89c5-9e4f8eaed410 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:01.709642 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-a5d890a2-46a0-4d40-89c5-9e4f8eaed410 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045147 Jun 17 15:20:01.710200 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 480/1174] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:20:01 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:20:01.714719 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-b8fc5e46-c718-47f4-956e-4be7a76ed0b1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:01.715623 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-63125849-e295-454d-8f89-ede45aa57ba0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:20:01.716387 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-b8fc5e46-c718-47f4-956e-4be7a76ed0b1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:01.721803 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b8fc5e46-c718-47f4-956e-4be7a76ed0b1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:01.722248 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b8fc5e46-c718-47f4-956e-4be7a76ed0b1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:01.723002 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b8fc5e46-c718-47f4-956e-4be7a76ed0b1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:01.723436 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b8fc5e46-c718-47f4-956e-4be7a76ed0b1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:01.723552 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-63125849-e295-454d-8f89-ede45aa57ba0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.149994 Jun 17 15:20:01.724073 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 695/1175] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:20:01 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:20:01.752270 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-b8fc5e46-c718-47f4-956e-4be7a76ed0b1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041061 Jun 17 15:20:01.752858 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 481/1176] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:20:01 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:20:02.461829 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-f6cf2a9c-7400-496c-ae97-4b2b3529c2ee tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:02.462602 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-f6cf2a9c-7400-496c-ae97-4b2b3529c2ee tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:02.471289 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f6cf2a9c-7400-496c-ae97-4b2b3529c2ee tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:02.471744 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f6cf2a9c-7400-496c-ae97-4b2b3529c2ee tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:02.472591 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f6cf2a9c-7400-496c-ae97-4b2b3529c2ee tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:02.473031 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f6cf2a9c-7400-496c-ae97-4b2b3529c2ee tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:02.539448 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-f6cf2a9c-7400-496c-ae97-4b2b3529c2ee tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:20:02.547629 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-f6cf2a9c-7400-496c-ae97-4b2b3529c2ee tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.090880 Jun 17 15:20:02.548191 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 696/1177] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:20:02 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:20:02.722331 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-ce511ff4-2d50-4abd-bb47-6cdde7dec2f8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:02.723165 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-ce511ff4-2d50-4abd-bb47-6cdde7dec2f8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:02.729974 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ce511ff4-2d50-4abd-bb47-6cdde7dec2f8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:02.730419 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ce511ff4-2d50-4abd-bb47-6cdde7dec2f8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:02.731183 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ce511ff4-2d50-4abd-bb47-6cdde7dec2f8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:02.731610 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ce511ff4-2d50-4abd-bb47-6cdde7dec2f8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:02.740487 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-b7d4149d-db74-4d64-8069-a3528ac79a20 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:02.741091 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-b7d4149d-db74-4d64-8069-a3528ac79a20 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:02.747321 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b7d4149d-db74-4d64-8069-a3528ac79a20 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:02.747703 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b7d4149d-db74-4d64-8069-a3528ac79a20 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:02.748505 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b7d4149d-db74-4d64-8069-a3528ac79a20 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:02.748935 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b7d4149d-db74-4d64-8069-a3528ac79a20 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:02.771030 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-ce511ff4-2d50-4abd-bb47-6cdde7dec2f8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052475 Jun 17 15:20:02.771880 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 482/1178] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:20:02 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:20:02.781678 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-e5e0189f-c639-4ce3-829a-5a1117381809 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:02.783290 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-e5e0189f-c639-4ce3-829a-5a1117381809 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:02.790086 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e5e0189f-c639-4ce3-829a-5a1117381809 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:02.790523 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e5e0189f-c639-4ce3-829a-5a1117381809 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:02.791308 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e5e0189f-c639-4ce3-829a-5a1117381809 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:02.791745 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e5e0189f-c639-4ce3-829a-5a1117381809 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:02.829690 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-e5e0189f-c639-4ce3-829a-5a1117381809 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056112 Jun 17 15:20:02.830616 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 483/1179] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:20:02 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:20:02.894628 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-b7d4149d-db74-4d64-8069-a3528ac79a20 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:20:02.903127 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-b7d4149d-db74-4d64-8069-a3528ac79a20 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.165745 Jun 17 15:20:02.903707 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 697/1180] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:20:02 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:20:03.564794 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-97811dbf-b0fb-451b-9832-fd682fc82c67 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:03.565403 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-97811dbf-b0fb-451b-9832-fd682fc82c67 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:03.571460 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-97811dbf-b0fb-451b-9832-fd682fc82c67 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:03.571909 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-97811dbf-b0fb-451b-9832-fd682fc82c67 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:03.572694 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-97811dbf-b0fb-451b-9832-fd682fc82c67 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:03.573126 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-97811dbf-b0fb-451b-9832-fd682fc82c67 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:03.634059 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-97811dbf-b0fb-451b-9832-fd682fc82c67 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:20:03.641503 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-97811dbf-b0fb-451b-9832-fd682fc82c67 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.080623 Jun 17 15:20:03.642061 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 484/1181] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:20:03 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:20:03.783491 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-e9f80d3a-a46b-42ae-b299-f0b84f46a7c7 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:03.784437 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-e9f80d3a-a46b-42ae-b299-f0b84f46a7c7 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:03.791010 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e9f80d3a-a46b-42ae-b299-f0b84f46a7c7 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:03.791454 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e9f80d3a-a46b-42ae-b299-f0b84f46a7c7 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:03.792240 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e9f80d3a-a46b-42ae-b299-f0b84f46a7c7 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:03.792754 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e9f80d3a-a46b-42ae-b299-f0b84f46a7c7 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:03.823134 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-e9f80d3a-a46b-42ae-b299-f0b84f46a7c7 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043568 Jun 17 15:20:03.823693 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 698/1182] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:20:03 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:20:03.844252 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-998d0e4d-3cb2-488d-877c-43134b1a2c27 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:03.845215 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-998d0e4d-3cb2-488d-877c-43134b1a2c27 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:03.852815 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-998d0e4d-3cb2-488d-877c-43134b1a2c27 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:03.853265 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-998d0e4d-3cb2-488d-877c-43134b1a2c27 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:03.854040 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-998d0e4d-3cb2-488d-877c-43134b1a2c27 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:03.854508 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-998d0e4d-3cb2-488d-877c-43134b1a2c27 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:03.885691 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-998d0e4d-3cb2-488d-877c-43134b1a2c27 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046423 Jun 17 15:20:03.886175 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 485/1183] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:20:03 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:20:03.919918 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-092f8d57-2a54-41f4-bf32-5b192e0b6716 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:03.920681 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-092f8d57-2a54-41f4-bf32-5b192e0b6716 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:03.926965 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-092f8d57-2a54-41f4-bf32-5b192e0b6716 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:03.927415 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-092f8d57-2a54-41f4-bf32-5b192e0b6716 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:03.928193 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-092f8d57-2a54-41f4-bf32-5b192e0b6716 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:03.928661 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-092f8d57-2a54-41f4-bf32-5b192e0b6716 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:03.933196 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=100 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:20:04.068167 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-092f8d57-2a54-41f4-bf32-5b192e0b6716 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:20:04.075846 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-092f8d57-2a54-41f4-bf32-5b192e0b6716 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.160474 Jun 17 15:20:04.076445 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 699/1184] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:20:03 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:20:04.657556 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-bcfbfbe2-9f0e-4c28-8f9d-351e6d5ef736 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:04.658115 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-bcfbfbe2-9f0e-4c28-8f9d-351e6d5ef736 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:04.664231 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bcfbfbe2-9f0e-4c28-8f9d-351e6d5ef736 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:04.664710 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bcfbfbe2-9f0e-4c28-8f9d-351e6d5ef736 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:04.665472 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bcfbfbe2-9f0e-4c28-8f9d-351e6d5ef736 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:04.665907 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bcfbfbe2-9f0e-4c28-8f9d-351e6d5ef736 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:04.737626 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-bcfbfbe2-9f0e-4c28-8f9d-351e6d5ef736 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:20:04.745933 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-bcfbfbe2-9f0e-4c28-8f9d-351e6d5ef736 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.092249 Jun 17 15:20:04.746995 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 486/1185] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:20:04 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:20:04.835673 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-dca711d2-c757-454b-824e-bd250749d810 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:04.836616 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-dca711d2-c757-454b-824e-bd250749d810 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:04.843722 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-dca711d2-c757-454b-824e-bd250749d810 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:04.844170 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-dca711d2-c757-454b-824e-bd250749d810 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:04.844966 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-dca711d2-c757-454b-824e-bd250749d810 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:04.845401 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-dca711d2-c757-454b-824e-bd250749d810 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:04.877951 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-dca711d2-c757-454b-824e-bd250749d810 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046819 Jun 17 15:20:04.878505 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 700/1186] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:20:04 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:20:04.897629 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-9b012b62-14b2-4226-8460-be2b37fc88ee tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:04.898547 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-9b012b62-14b2-4226-8460-be2b37fc88ee tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:04.905012 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9b012b62-14b2-4226-8460-be2b37fc88ee tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:04.905463 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9b012b62-14b2-4226-8460-be2b37fc88ee tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:04.906219 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9b012b62-14b2-4226-8460-be2b37fc88ee tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:04.906653 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9b012b62-14b2-4226-8460-be2b37fc88ee tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:04.936721 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-9b012b62-14b2-4226-8460-be2b37fc88ee tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043217 Jun 17 15:20:04.937196 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 487/1187] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:20:04 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 15:20:05.092717 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-450ccfdb-b409-4063-8e36-9e6978554cc4 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:05.093323 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-450ccfdb-b409-4063-8e36-9e6978554cc4 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:05.099374 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-450ccfdb-b409-4063-8e36-9e6978554cc4 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:05.099815 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-450ccfdb-b409-4063-8e36-9e6978554cc4 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:05.100607 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-450ccfdb-b409-4063-8e36-9e6978554cc4 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:05.101036 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-450ccfdb-b409-4063-8e36-9e6978554cc4 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:05.234932 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-450ccfdb-b409-4063-8e36-9e6978554cc4 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:20:05.242575 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-450ccfdb-b409-4063-8e36-9e6978554cc4 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.154159 Jun 17 15:20:05.243217 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 701/1188] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:20:05 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:20:05.763000 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-1eff694d-70fa-45c5-b05a-7e086511ea32 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:05.763611 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-1eff694d-70fa-45c5-b05a-7e086511ea32 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:05.769688 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1eff694d-70fa-45c5-b05a-7e086511ea32 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:05.770138 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1eff694d-70fa-45c5-b05a-7e086511ea32 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:05.770904 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1eff694d-70fa-45c5-b05a-7e086511ea32 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:05.771349 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1eff694d-70fa-45c5-b05a-7e086511ea32 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:05.835669 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-1eff694d-70fa-45c5-b05a-7e086511ea32 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:20:05.843429 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-1eff694d-70fa-45c5-b05a-7e086511ea32 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.084253 Jun 17 15:20:05.843989 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 488/1189] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:20:05 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:20:05.890989 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-97997ea8-07a2-4399-a618-8eee266e2e96 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:05.891913 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-97997ea8-07a2-4399-a618-8eee266e2e96 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:05.898472 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-97997ea8-07a2-4399-a618-8eee266e2e96 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:05.898913 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-97997ea8-07a2-4399-a618-8eee266e2e96 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:05.899693 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-97997ea8-07a2-4399-a618-8eee266e2e96 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:05.900120 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-97997ea8-07a2-4399-a618-8eee266e2e96 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:05.928972 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-97997ea8-07a2-4399-a618-8eee266e2e96 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043057 Jun 17 15:20:05.929525 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 702/1190] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:20:05 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:20:05.948850 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-6d8b134a-7ad5-4ceb-9c31-381082204067 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:05.949839 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-6d8b134a-7ad5-4ceb-9c31-381082204067 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:05.956429 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6d8b134a-7ad5-4ceb-9c31-381082204067 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:05.956875 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6d8b134a-7ad5-4ceb-9c31-381082204067 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:05.957635 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6d8b134a-7ad5-4ceb-9c31-381082204067 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:05.958065 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6d8b134a-7ad5-4ceb-9c31-381082204067 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:05.987727 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-6d8b134a-7ad5-4ceb-9c31-381082204067 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042898 Jun 17 15:20:05.988277 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 489/1191] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:20:05 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 15:20:06.261497 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-ee7ff2ff-ebe6-44aa-adae-4226bc13d6fc tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:06.262100 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-ee7ff2ff-ebe6-44aa-adae-4226bc13d6fc tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:06.268079 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ee7ff2ff-ebe6-44aa-adae-4226bc13d6fc tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:06.268552 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ee7ff2ff-ebe6-44aa-adae-4226bc13d6fc tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:06.269315 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ee7ff2ff-ebe6-44aa-adae-4226bc13d6fc tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:06.269743 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ee7ff2ff-ebe6-44aa-adae-4226bc13d6fc tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:06.402358 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-ee7ff2ff-ebe6-44aa-adae-4226bc13d6fc tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:20:06.410345 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-ee7ff2ff-ebe6-44aa-adae-4226bc13d6fc tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.152793 Jun 17 15:20:06.410916 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 703/1192] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:20:06 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:20:06.860424 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-078f4410-b687-45d9-ba1b-684b03b1ab3f tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:06.861057 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-078f4410-b687-45d9-ba1b-684b03b1ab3f tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:06.867807 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-078f4410-b687-45d9-ba1b-684b03b1ab3f tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:06.868256 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-078f4410-b687-45d9-ba1b-684b03b1ab3f tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:06.869096 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-078f4410-b687-45d9-ba1b-684b03b1ab3f tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:06.869540 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-078f4410-b687-45d9-ba1b-684b03b1ab3f tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:06.940641 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-4ba97909-f9ed-46e1-be9f-7803b4b3927a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:06.941587 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-4ba97909-f9ed-46e1-be9f-7803b4b3927a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:06.946582 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-078f4410-b687-45d9-ba1b-684b03b1ab3f tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:20:06.948704 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4ba97909-f9ed-46e1-be9f-7803b4b3927a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:06.949197 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4ba97909-f9ed-46e1-be9f-7803b4b3927a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:06.950507 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4ba97909-f9ed-46e1-be9f-7803b4b3927a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:06.950929 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4ba97909-f9ed-46e1-be9f-7803b4b3927a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:06.955687 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-078f4410-b687-45d9-ba1b-684b03b1ab3f tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.099324 Jun 17 15:20:06.956301 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 490/1193] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:20:06 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:20:06.980804 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-4ba97909-f9ed-46e1-be9f-7803b4b3927a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044094 Jun 17 15:20:06.981374 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 704/1194] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:20:06 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:20:06.999747 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-efcc90af-8da1-465d-8e11-8fdc87415f21 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:07.000676 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-efcc90af-8da1-465d-8e11-8fdc87415f21 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:07.006776 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-efcc90af-8da1-465d-8e11-8fdc87415f21 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:07.007231 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-efcc90af-8da1-465d-8e11-8fdc87415f21 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:07.007997 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-efcc90af-8da1-465d-8e11-8fdc87415f21 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:07.008460 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-efcc90af-8da1-465d-8e11-8fdc87415f21 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:07.037980 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-efcc90af-8da1-465d-8e11-8fdc87415f21 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042773 Jun 17 15:20:07.038545 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 491/1195] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:20:06 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:20:07.427204 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-b4450948-c285-4208-945f-48015924e1ce tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:07.427814 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-b4450948-c285-4208-945f-48015924e1ce tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:07.434360 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b4450948-c285-4208-945f-48015924e1ce tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:07.434808 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b4450948-c285-4208-945f-48015924e1ce tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:07.435569 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b4450948-c285-4208-945f-48015924e1ce tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:07.436041 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b4450948-c285-4208-945f-48015924e1ce tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:07.563588 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-b4450948-c285-4208-945f-48015924e1ce tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:20:07.571061 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-b4450948-c285-4208-945f-48015924e1ce tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.147782 Jun 17 15:20:07.571609 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 705/1196] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:20:07 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:20:07.973043 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-c3ec10bf-8aa3-4db4-8977-de7d511c96a3 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:07.973653 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-c3ec10bf-8aa3-4db4-8977-de7d511c96a3 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:07.980505 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c3ec10bf-8aa3-4db4-8977-de7d511c96a3 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:07.981582 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c3ec10bf-8aa3-4db4-8977-de7d511c96a3 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:07.982401 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c3ec10bf-8aa3-4db4-8977-de7d511c96a3 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:07.982839 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c3ec10bf-8aa3-4db4-8977-de7d511c96a3 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:07.992075 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-44a6f0cd-7258-4c2f-9ba4-d7206bec924f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:07.993314 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-44a6f0cd-7258-4c2f-9ba4-d7206bec924f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:08.000180 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-44a6f0cd-7258-4c2f-9ba4-d7206bec924f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:08.000745 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-44a6f0cd-7258-4c2f-9ba4-d7206bec924f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:08.001465 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-44a6f0cd-7258-4c2f-9ba4-d7206bec924f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:08.002106 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-44a6f0cd-7258-4c2f-9ba4-d7206bec924f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:08.033981 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-44a6f0cd-7258-4c2f-9ba4-d7206bec924f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045851 Jun 17 15:20:08.034565 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 706/1197] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:20:07 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:20:08.049498 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-f80819dd-9c9a-4fbe-9072-b6607f8ca03d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:08.050508 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-f80819dd-9c9a-4fbe-9072-b6607f8ca03d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:08.057046 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f80819dd-9c9a-4fbe-9072-b6607f8ca03d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:08.057226 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-c3ec10bf-8aa3-4db4-8977-de7d511c96a3 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:20:08.057580 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f80819dd-9c9a-4fbe-9072-b6607f8ca03d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:08.058468 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f80819dd-9c9a-4fbe-9072-b6607f8ca03d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:08.059145 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f80819dd-9c9a-4fbe-9072-b6607f8ca03d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:08.066467 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-c3ec10bf-8aa3-4db4-8977-de7d511c96a3 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.097596 Jun 17 15:20:08.072763 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 492/1198] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:20:07 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:20:08.092987 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-f80819dd-9c9a-4fbe-9072-b6607f8ca03d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047521 Jun 17 15:20:08.093560 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 707/1199] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:20:08 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 15:20:08.590025 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-27b54ce2-c173-41de-befc-33f4d88caf37 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:08.590669 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-27b54ce2-c173-41de-befc-33f4d88caf37 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:08.596989 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-27b54ce2-c173-41de-befc-33f4d88caf37 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:08.597429 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-27b54ce2-c173-41de-befc-33f4d88caf37 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:08.598175 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-27b54ce2-c173-41de-befc-33f4d88caf37 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:08.598606 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-27b54ce2-c173-41de-befc-33f4d88caf37 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:08.615606 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell1:SELECT=100 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:20:08.734132 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-27b54ce2-c173-41de-befc-33f4d88caf37 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:20:08.741810 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-27b54ce2-c173-41de-befc-33f4d88caf37 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.156300 Jun 17 15:20:08.742379 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 493/1200] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:20:08 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:20:09.046530 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-29d566f4-f88f-42c8-8178-79d3b48d05be tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:09.047493 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-29d566f4-f88f-42c8-8178-79d3b48d05be tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:09.054270 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-29d566f4-f88f-42c8-8178-79d3b48d05be tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:09.054724 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-29d566f4-f88f-42c8-8178-79d3b48d05be tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:09.055500 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-29d566f4-f88f-42c8-8178-79d3b48d05be tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:09.055934 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-29d566f4-f88f-42c8-8178-79d3b48d05be tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:09.083224 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-19838e78-564e-41f1-8ff6-52d6f66bf491 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:09.083852 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-19838e78-564e-41f1-8ff6-52d6f66bf491 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:09.085483 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-29d566f4-f88f-42c8-8178-79d3b48d05be tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043508 Jun 17 15:20:09.085948 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 708/1201] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:20:09 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:20:09.090925 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-19838e78-564e-41f1-8ff6-52d6f66bf491 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:09.091658 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-19838e78-564e-41f1-8ff6-52d6f66bf491 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:09.092431 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-19838e78-564e-41f1-8ff6-52d6f66bf491 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:09.092860 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-19838e78-564e-41f1-8ff6-52d6f66bf491 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:09.106236 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-179c113d-04df-4349-b8b2-33ad960587c3 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:09.107156 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-179c113d-04df-4349-b8b2-33ad960587c3 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:09.113557 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-179c113d-04df-4349-b8b2-33ad960587c3 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:09.114014 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-179c113d-04df-4349-b8b2-33ad960587c3 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:09.114824 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-179c113d-04df-4349-b8b2-33ad960587c3 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:09.115255 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-179c113d-04df-4349-b8b2-33ad960587c3 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:09.145304 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-179c113d-04df-4349-b8b2-33ad960587c3 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043628 Jun 17 15:20:09.145868 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 709/1202] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:20:09 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:20:09.156885 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-19838e78-564e-41f1-8ff6-52d6f66bf491 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:20:09.164188 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-19838e78-564e-41f1-8ff6-52d6f66bf491 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.084987 Jun 17 15:20:09.164769 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 494/1203] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:20:09 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:20:09.759540 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-1b1a7296-bbb3-4c44-b68f-5563c8e0db48 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:09.760067 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-1b1a7296-bbb3-4c44-b68f-5563c8e0db48 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:09.766684 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1b1a7296-bbb3-4c44-b68f-5563c8e0db48 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:09.767129 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1b1a7296-bbb3-4c44-b68f-5563c8e0db48 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:09.767918 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1b1a7296-bbb3-4c44-b68f-5563c8e0db48 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:09.768362 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1b1a7296-bbb3-4c44-b68f-5563c8e0db48 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:09.911384 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-1b1a7296-bbb3-4c44-b68f-5563c8e0db48 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:20:09.919116 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-1b1a7296-bbb3-4c44-b68f-5563c8e0db48 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.163814 Jun 17 15:20:09.919694 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 710/1204] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:20:09 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:20:10.098303 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-15efd65f-09dc-49b3-9e78-ca6c1634d921 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:10.099255 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-15efd65f-09dc-49b3-9e78-ca6c1634d921 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:10.105924 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-15efd65f-09dc-49b3-9e78-ca6c1634d921 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:10.106366 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-15efd65f-09dc-49b3-9e78-ca6c1634d921 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:10.107126 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-15efd65f-09dc-49b3-9e78-ca6c1634d921 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:10.107550 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-15efd65f-09dc-49b3-9e78-ca6c1634d921 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:10.137660 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-15efd65f-09dc-49b3-9e78-ca6c1634d921 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043313 Jun 17 15:20:10.138222 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 495/1205] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:20:10 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:20:10.157049 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-6d6ef310-859f-4c12-ad50-6c395964b8d0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:10.157961 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-6d6ef310-859f-4c12-ad50-6c395964b8d0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:10.164882 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6d6ef310-859f-4c12-ad50-6c395964b8d0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:10.165365 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6d6ef310-859f-4c12-ad50-6c395964b8d0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:10.166207 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6d6ef310-859f-4c12-ad50-6c395964b8d0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:10.166649 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6d6ef310-859f-4c12-ad50-6c395964b8d0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:10.183069 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-ebe81f86-9608-4b25-a7a7-15409533b881 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:10.184319 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-ebe81f86-9608-4b25-a7a7-15409533b881 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:10.190353 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ebe81f86-9608-4b25-a7a7-15409533b881 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:10.190797 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ebe81f86-9608-4b25-a7a7-15409533b881 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:10.191563 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ebe81f86-9608-4b25-a7a7-15409533b881 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:10.191989 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ebe81f86-9608-4b25-a7a7-15409533b881 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:10.198213 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-6d6ef310-859f-4c12-ad50-6c395964b8d0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045040 Jun 17 15:20:10.198791 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 711/1206] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:20:10 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:20:10.255178 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-ebe81f86-9608-4b25-a7a7-15409533b881 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:20:10.263169 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-ebe81f86-9608-4b25-a7a7-15409533b881 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.083899 Jun 17 15:20:10.263747 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 496/1207] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:20:10 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:20:10.936096 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-a34ba0c4-1529-459d-9385-71d79c60a31c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:10.936741 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-a34ba0c4-1529-459d-9385-71d79c60a31c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:10.942800 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a34ba0c4-1529-459d-9385-71d79c60a31c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:10.943253 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a34ba0c4-1529-459d-9385-71d79c60a31c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:10.944020 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a34ba0c4-1529-459d-9385-71d79c60a31c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:10.944492 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a34ba0c4-1529-459d-9385-71d79c60a31c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:11.102161 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-a34ba0c4-1529-459d-9385-71d79c60a31c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:20:11.109702 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-a34ba0c4-1529-459d-9385-71d79c60a31c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.177579 Jun 17 15:20:11.110489 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 712/1208] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:20:10 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:20:11.149166 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-09cc7e34-c469-4c2e-8307-bda3e4c1e97c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:11.150083 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-09cc7e34-c469-4c2e-8307-bda3e4c1e97c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:11.157465 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-09cc7e34-c469-4c2e-8307-bda3e4c1e97c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:11.157911 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-09cc7e34-c469-4c2e-8307-bda3e4c1e97c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:11.158655 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-09cc7e34-c469-4c2e-8307-bda3e4c1e97c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:11.159086 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-09cc7e34-c469-4c2e-8307-bda3e4c1e97c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:11.186290 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-09cc7e34-c469-4c2e-8307-bda3e4c1e97c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040994 Jun 17 15:20:11.186765 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 497/1209] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:20:11 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:20:11.209194 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-7e734594-2362-4d33-8ef0-8ba1a197a6b6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:11.210102 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-7e734594-2362-4d33-8ef0-8ba1a197a6b6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:11.217282 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7e734594-2362-4d33-8ef0-8ba1a197a6b6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:11.217723 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7e734594-2362-4d33-8ef0-8ba1a197a6b6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:11.218472 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7e734594-2362-4d33-8ef0-8ba1a197a6b6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:11.218896 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7e734594-2362-4d33-8ef0-8ba1a197a6b6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:11.247220 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-7e734594-2362-4d33-8ef0-8ba1a197a6b6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041965 Jun 17 15:20:11.247758 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 713/1210] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:20:11 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:20:11.278789 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-b3825a55-889b-4511-a5b8-35556410f081 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:11.279470 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-b3825a55-889b-4511-a5b8-35556410f081 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:11.285619 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b3825a55-889b-4511-a5b8-35556410f081 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:11.286070 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b3825a55-889b-4511-a5b8-35556410f081 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:11.286824 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b3825a55-889b-4511-a5b8-35556410f081 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:11.287288 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b3825a55-889b-4511-a5b8-35556410f081 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:11.348462 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-b3825a55-889b-4511-a5b8-35556410f081 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:20:11.356427 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-b3825a55-889b-4511-a5b8-35556410f081 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.081408 Jun 17 15:20:11.357009 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 498/1211] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:20:11 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:20:12.126912 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-38f1d87d-c0e0-4f68-8a1f-17cd7ea237a9 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:12.127525 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-38f1d87d-c0e0-4f68-8a1f-17cd7ea237a9 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:12.133584 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-38f1d87d-c0e0-4f68-8a1f-17cd7ea237a9 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:12.134030 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-38f1d87d-c0e0-4f68-8a1f-17cd7ea237a9 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:12.134818 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-38f1d87d-c0e0-4f68-8a1f-17cd7ea237a9 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:12.135247 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-38f1d87d-c0e0-4f68-8a1f-17cd7ea237a9 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:12.197853 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-aa63ebb4-6b72-4edb-94b7-64f5b602fad6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:12.198785 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-aa63ebb4-6b72-4edb-94b7-64f5b602fad6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:12.205537 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-aa63ebb4-6b72-4edb-94b7-64f5b602fad6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:12.205989 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-aa63ebb4-6b72-4edb-94b7-64f5b602fad6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:12.206758 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-aa63ebb4-6b72-4edb-94b7-64f5b602fad6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:12.207209 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-aa63ebb4-6b72-4edb-94b7-64f5b602fad6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:12.237719 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-aa63ebb4-6b72-4edb-94b7-64f5b602fad6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043808 Jun 17 15:20:12.238292 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 499/1212] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:20:12 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:20:12.258862 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-7a874422-2d05-4d8d-9b16-88e2839f0716 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:12.259813 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-7a874422-2d05-4d8d-9b16-88e2839f0716 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:12.265821 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7a874422-2d05-4d8d-9b16-88e2839f0716 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:12.266274 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7a874422-2d05-4d8d-9b16-88e2839f0716 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:12.267038 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7a874422-2d05-4d8d-9b16-88e2839f0716 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:12.267472 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7a874422-2d05-4d8d-9b16-88e2839f0716 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:12.269229 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-38f1d87d-c0e0-4f68-8a1f-17cd7ea237a9 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:20:12.276974 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-38f1d87d-c0e0-4f68-8a1f-17cd7ea237a9 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.154217 Jun 17 15:20:12.278028 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 714/1213] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:20:12 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:20:12.297715 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-7a874422-2d05-4d8d-9b16-88e2839f0716 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042756 Jun 17 15:20:12.298287 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 500/1214] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:20:12 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 15:20:12.373100 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-3741ce07-f3fb-4107-a6f2-9ebb2cb03a2d tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:12.373706 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-3741ce07-f3fb-4107-a6f2-9ebb2cb03a2d tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:12.376601 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_api:SELECT=100 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:20:12.380310 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3741ce07-f3fb-4107-a6f2-9ebb2cb03a2d tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:12.380766 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3741ce07-f3fb-4107-a6f2-9ebb2cb03a2d tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:12.381526 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3741ce07-f3fb-4107-a6f2-9ebb2cb03a2d tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:12.381953 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3741ce07-f3fb-4107-a6f2-9ebb2cb03a2d tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:12.442978 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-3741ce07-f3fb-4107-a6f2-9ebb2cb03a2d tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:20:12.446386 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=100 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:20:12.451759 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-3741ce07-f3fb-4107-a6f2-9ebb2cb03a2d tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.082584 Jun 17 15:20:12.452312 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 715/1215] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:20:12 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:20:13.250847 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-be2fe64a-b9cb-4a18-a8d0-34f05d79798f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:13.251696 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-be2fe64a-b9cb-4a18-a8d0-34f05d79798f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:13.258765 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-be2fe64a-b9cb-4a18-a8d0-34f05d79798f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:13.259223 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-be2fe64a-b9cb-4a18-a8d0-34f05d79798f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:13.260014 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-be2fe64a-b9cb-4a18-a8d0-34f05d79798f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:13.260480 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-be2fe64a-b9cb-4a18-a8d0-34f05d79798f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:13.291510 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-be2fe64a-b9cb-4a18-a8d0-34f05d79798f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046076 Jun 17 15:20:13.292103 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 501/1216] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:20:13 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:20:13.296210 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-7d5ae2b6-253d-4697-a4ac-70bbec85cc20 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:13.296876 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-7d5ae2b6-253d-4697-a4ac-70bbec85cc20 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:13.303916 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7d5ae2b6-253d-4697-a4ac-70bbec85cc20 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:13.304776 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7d5ae2b6-253d-4697-a4ac-70bbec85cc20 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:13.305566 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7d5ae2b6-253d-4697-a4ac-70bbec85cc20 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:13.306004 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7d5ae2b6-253d-4697-a4ac-70bbec85cc20 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:13.310581 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-837fd7bf-ca6c-4427-b3f1-32f7c46e2d57 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:13.312252 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-837fd7bf-ca6c-4427-b3f1-32f7c46e2d57 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:13.317707 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-837fd7bf-ca6c-4427-b3f1-32f7c46e2d57 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:13.318156 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-837fd7bf-ca6c-4427-b3f1-32f7c46e2d57 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:13.318922 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-837fd7bf-ca6c-4427-b3f1-32f7c46e2d57 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:13.319358 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-837fd7bf-ca6c-4427-b3f1-32f7c46e2d57 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:13.349954 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-837fd7bf-ca6c-4427-b3f1-32f7c46e2d57 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043959 Jun 17 15:20:13.351095 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 502/1217] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:20:13 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:20:13.438214 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-7d5ae2b6-253d-4697-a4ac-70bbec85cc20 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:20:13.445880 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-7d5ae2b6-253d-4697-a4ac-70bbec85cc20 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.155079 Jun 17 15:20:13.446450 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 716/1218] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:20:13 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:20:13.468685 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-2ff6b02e-0ea2-423e-b73c-c60de7d9f954 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:13.469297 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-2ff6b02e-0ea2-423e-b73c-c60de7d9f954 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:13.475284 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2ff6b02e-0ea2-423e-b73c-c60de7d9f954 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:13.475712 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2ff6b02e-0ea2-423e-b73c-c60de7d9f954 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:13.476488 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2ff6b02e-0ea2-423e-b73c-c60de7d9f954 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:13.476923 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2ff6b02e-0ea2-423e-b73c-c60de7d9f954 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:13.544496 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-2ff6b02e-0ea2-423e-b73c-c60de7d9f954 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:20:13.552654 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-2ff6b02e-0ea2-423e-b73c-c60de7d9f954 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.088293 Jun 17 15:20:13.553213 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 503/1219] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:20:13 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:20:14.304532 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-f05aebaa-c40c-4a50-8c16-1e2d6711175f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:14.305444 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-f05aebaa-c40c-4a50-8c16-1e2d6711175f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:14.312377 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f05aebaa-c40c-4a50-8c16-1e2d6711175f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:14.312824 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f05aebaa-c40c-4a50-8c16-1e2d6711175f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:14.313574 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f05aebaa-c40c-4a50-8c16-1e2d6711175f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:14.314005 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f05aebaa-c40c-4a50-8c16-1e2d6711175f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:14.342649 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-f05aebaa-c40c-4a50-8c16-1e2d6711175f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042430 Jun 17 15:20:14.343237 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 717/1220] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:20:14 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:20:14.361806 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-cd6ddf51-b8e5-463a-a5d3-130cc2803483 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:14.362726 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-cd6ddf51-b8e5-463a-a5d3-130cc2803483 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:14.368960 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cd6ddf51-b8e5-463a-a5d3-130cc2803483 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:14.369411 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cd6ddf51-b8e5-463a-a5d3-130cc2803483 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:14.370166 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cd6ddf51-b8e5-463a-a5d3-130cc2803483 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:14.370598 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cd6ddf51-b8e5-463a-a5d3-130cc2803483 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:14.400419 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-cd6ddf51-b8e5-463a-a5d3-130cc2803483 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042487 Jun 17 15:20:14.400994 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 504/1221] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:20:14 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:20:14.461995 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-c87fc779-a764-4fcd-a0a7-51ae118cc861 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:14.462610 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-c87fc779-a764-4fcd-a0a7-51ae118cc861 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:14.469359 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c87fc779-a764-4fcd-a0a7-51ae118cc861 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:14.469802 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c87fc779-a764-4fcd-a0a7-51ae118cc861 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:14.470574 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c87fc779-a764-4fcd-a0a7-51ae118cc861 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:14.471004 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c87fc779-a764-4fcd-a0a7-51ae118cc861 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:14.569336 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-91e491e5-6dca-43b6-b2d7-bca4505347e0 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:14.569951 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-91e491e5-6dca-43b6-b2d7-bca4505347e0 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:14.576913 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-91e491e5-6dca-43b6-b2d7-bca4505347e0 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:14.577359 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-91e491e5-6dca-43b6-b2d7-bca4505347e0 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:14.578143 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-91e491e5-6dca-43b6-b2d7-bca4505347e0 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:14.578576 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-91e491e5-6dca-43b6-b2d7-bca4505347e0 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:14.610888 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-c87fc779-a764-4fcd-a0a7-51ae118cc861 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:20:14.618677 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-c87fc779-a764-4fcd-a0a7-51ae118cc861 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.160623 Jun 17 15:20:14.619264 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 718/1222] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:20:14 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:20:14.640262 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-91e491e5-6dca-43b6-b2d7-bca4505347e0 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:20:14.647840 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-91e491e5-6dca-43b6-b2d7-bca4505347e0 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.082314 Jun 17 15:20:14.648410 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 505/1223] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:20:14 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:20:15.354466 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-fd80e4ba-fa1a-4038-a7ba-301ea249acd7 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:15.356219 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-fd80e4ba-fa1a-4038-a7ba-301ea249acd7 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:15.362776 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fd80e4ba-fa1a-4038-a7ba-301ea249acd7 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:15.363221 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fd80e4ba-fa1a-4038-a7ba-301ea249acd7 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:15.363983 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fd80e4ba-fa1a-4038-a7ba-301ea249acd7 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:15.364442 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fd80e4ba-fa1a-4038-a7ba-301ea249acd7 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:15.393706 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-fd80e4ba-fa1a-4038-a7ba-301ea249acd7 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043201 Jun 17 15:20:15.394273 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 719/1224] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:20:15 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:20:15.411040 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-42dcf2f8-b74d-4487-8ec2-d9148dd6516e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:15.411994 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-42dcf2f8-b74d-4487-8ec2-d9148dd6516e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:15.419036 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-42dcf2f8-b74d-4487-8ec2-d9148dd6516e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:15.419495 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-42dcf2f8-b74d-4487-8ec2-d9148dd6516e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:15.420232 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-42dcf2f8-b74d-4487-8ec2-d9148dd6516e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:15.420693 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-42dcf2f8-b74d-4487-8ec2-d9148dd6516e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:15.449713 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-42dcf2f8-b74d-4487-8ec2-d9148dd6516e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042530 Jun 17 15:20:15.450269 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 506/1225] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:20:15 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:20:15.636188 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-ca70b23a-fa01-4516-ab0e-c9482438d590 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:15.636735 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-ca70b23a-fa01-4516-ab0e-c9482438d590 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:15.642865 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ca70b23a-fa01-4516-ab0e-c9482438d590 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:15.643304 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ca70b23a-fa01-4516-ab0e-c9482438d590 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:15.644065 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ca70b23a-fa01-4516-ab0e-c9482438d590 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:15.644523 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ca70b23a-fa01-4516-ab0e-c9482438d590 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:15.664252 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-981f8d50-e790-402b-9265-dbbf93f85682 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:15.664885 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-981f8d50-e790-402b-9265-dbbf93f85682 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:15.671511 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-981f8d50-e790-402b-9265-dbbf93f85682 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:15.671985 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-981f8d50-e790-402b-9265-dbbf93f85682 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:15.672771 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-981f8d50-e790-402b-9265-dbbf93f85682 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:15.673198 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-981f8d50-e790-402b-9265-dbbf93f85682 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:15.734954 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-981f8d50-e790-402b-9265-dbbf93f85682 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:20:15.742853 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-981f8d50-e790-402b-9265-dbbf93f85682 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.082233 Jun 17 15:20:15.743443 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 507/1226] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:20:15 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:20:15.783834 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-ca70b23a-fa01-4516-ab0e-c9482438d590 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:20:15.791778 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-ca70b23a-fa01-4516-ab0e-c9482438d590 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.159437 Jun 17 15:20:15.792376 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 720/1227] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:20:15 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:20:16.405807 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-0876132e-74a2-4b64-97c1-ecd49f954f85 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:16.406724 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-0876132e-74a2-4b64-97c1-ecd49f954f85 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:16.412763 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0876132e-74a2-4b64-97c1-ecd49f954f85 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:16.413315 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0876132e-74a2-4b64-97c1-ecd49f954f85 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:16.413943 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0876132e-74a2-4b64-97c1-ecd49f954f85 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:16.414376 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0876132e-74a2-4b64-97c1-ecd49f954f85 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:16.443427 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-0876132e-74a2-4b64-97c1-ecd49f954f85 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042086 Jun 17 15:20:16.443976 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 508/1228] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:20:16 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:20:16.461469 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-d0c82c4d-7209-4004-a46b-d2920abc779c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:16.462295 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-d0c82c4d-7209-4004-a46b-d2920abc779c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:16.469838 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d0c82c4d-7209-4004-a46b-d2920abc779c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:16.470210 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d0c82c4d-7209-4004-a46b-d2920abc779c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:16.470968 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d0c82c4d-7209-4004-a46b-d2920abc779c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:16.471390 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d0c82c4d-7209-4004-a46b-d2920abc779c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:16.502657 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-d0c82c4d-7209-4004-a46b-d2920abc779c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044868 Jun 17 15:20:16.503237 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 721/1229] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:20:16 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:20:16.760388 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-272400c0-64c0-4e45-819d-bcc1457fbe34 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:16.760948 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-272400c0-64c0-4e45-819d-bcc1457fbe34 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:16.767708 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-272400c0-64c0-4e45-819d-bcc1457fbe34 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:16.768146 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-272400c0-64c0-4e45-819d-bcc1457fbe34 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:16.768938 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-272400c0-64c0-4e45-819d-bcc1457fbe34 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:16.769360 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-272400c0-64c0-4e45-819d-bcc1457fbe34 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:16.810426 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-55534552-de0b-4553-a451-ccdc1dd15575 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:16.811041 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-55534552-de0b-4553-a451-ccdc1dd15575 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:16.817017 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-55534552-de0b-4553-a451-ccdc1dd15575 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:16.817458 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-55534552-de0b-4553-a451-ccdc1dd15575 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:16.818220 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-55534552-de0b-4553-a451-ccdc1dd15575 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:16.818646 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-55534552-de0b-4553-a451-ccdc1dd15575 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:16.830421 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-272400c0-64c0-4e45-819d-bcc1457fbe34 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:20:16.838672 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-272400c0-64c0-4e45-819d-bcc1457fbe34 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.082073 Jun 17 15:20:16.839264 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 509/1230] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:20:16 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:20:16.988674 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-55534552-de0b-4553-a451-ccdc1dd15575 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:20:16.997032 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-55534552-de0b-4553-a451-ccdc1dd15575 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.190942 Jun 17 15:20:16.997605 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 722/1231] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:20:16 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:20:17.454679 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-7a23768e-1889-4fc8-b5bc-bc4c94067dd3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:17.455609 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-7a23768e-1889-4fc8-b5bc-bc4c94067dd3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:17.462288 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7a23768e-1889-4fc8-b5bc-bc4c94067dd3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:17.462735 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7a23768e-1889-4fc8-b5bc-bc4c94067dd3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:17.463505 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7a23768e-1889-4fc8-b5bc-bc4c94067dd3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:17.463938 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7a23768e-1889-4fc8-b5bc-bc4c94067dd3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:17.468664 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell1:SELECT=100 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:20:17.494390 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-7a23768e-1889-4fc8-b5bc-bc4c94067dd3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043681 Jun 17 15:20:17.494952 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 510/1232] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:20:17 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:20:17.515538 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-a62a40c0-89a8-45a1-a446-daa51487fb17 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:17.516483 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-a62a40c0-89a8-45a1-a446-daa51487fb17 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:17.523307 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a62a40c0-89a8-45a1-a446-daa51487fb17 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:17.523755 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a62a40c0-89a8-45a1-a446-daa51487fb17 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:17.524548 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a62a40c0-89a8-45a1-a446-daa51487fb17 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:17.524977 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a62a40c0-89a8-45a1-a446-daa51487fb17 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:17.555637 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-a62a40c0-89a8-45a1-a446-daa51487fb17 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044039 Jun 17 15:20:17.556193 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 723/1233] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:20:17 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:20:17.856984 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-8b6a9bc0-5f8a-42a4-94ad-35a576611257 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:17.857593 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-8b6a9bc0-5f8a-42a4-94ad-35a576611257 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:17.863826 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8b6a9bc0-5f8a-42a4-94ad-35a576611257 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:17.864277 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8b6a9bc0-5f8a-42a4-94ad-35a576611257 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:17.865168 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8b6a9bc0-5f8a-42a4-94ad-35a576611257 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:17.865633 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8b6a9bc0-5f8a-42a4-94ad-35a576611257 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:17.929736 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-8b6a9bc0-5f8a-42a4-94ad-35a576611257 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:20:17.937251 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-8b6a9bc0-5f8a-42a4-94ad-35a576611257 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.084094 Jun 17 15:20:17.937802 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 511/1234] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:20:17 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:20:18.018074 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-78c91aab-1cc5-4018-b987-157097ac9d0e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:18.018713 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-78c91aab-1cc5-4018-b987-157097ac9d0e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:18.026660 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-78c91aab-1cc5-4018-b987-157097ac9d0e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:18.027346 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-78c91aab-1cc5-4018-b987-157097ac9d0e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:18.028601 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-78c91aab-1cc5-4018-b987-157097ac9d0e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:18.029228 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-78c91aab-1cc5-4018-b987-157097ac9d0e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:18.164464 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-78c91aab-1cc5-4018-b987-157097ac9d0e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:20:18.173886 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-78c91aab-1cc5-4018-b987-157097ac9d0e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.162050 Jun 17 15:20:18.174646 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 724/1235] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:20:18 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:20:18.506081 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-c55b295f-bfce-4847-9d0f-b990a5d58a37 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:18.507020 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-c55b295f-bfce-4847-9d0f-b990a5d58a37 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:18.513538 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c55b295f-bfce-4847-9d0f-b990a5d58a37 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:18.513977 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c55b295f-bfce-4847-9d0f-b990a5d58a37 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:18.514726 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c55b295f-bfce-4847-9d0f-b990a5d58a37 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:18.515155 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c55b295f-bfce-4847-9d0f-b990a5d58a37 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:18.542222 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-c55b295f-bfce-4847-9d0f-b990a5d58a37 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040169 Jun 17 15:20:18.543273 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 512/1236] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:20:18 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:20:18.567192 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-993e7fdc-9471-4275-a3db-cc54caf5f011 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:18.568135 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-993e7fdc-9471-4275-a3db-cc54caf5f011 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:18.574582 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-993e7fdc-9471-4275-a3db-cc54caf5f011 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:18.575028 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-993e7fdc-9471-4275-a3db-cc54caf5f011 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:18.575784 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-993e7fdc-9471-4275-a3db-cc54caf5f011 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:18.576215 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-993e7fdc-9471-4275-a3db-cc54caf5f011 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:18.604433 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-993e7fdc-9471-4275-a3db-cc54caf5f011 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041251 Jun 17 15:20:18.605464 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 725/1237] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:20:18 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:20:18.953179 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-6ca0b698-9c19-4829-8a34-3600075cec95 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:18.953725 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-6ca0b698-9c19-4829-8a34-3600075cec95 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:18.959689 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6ca0b698-9c19-4829-8a34-3600075cec95 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:18.960126 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6ca0b698-9c19-4829-8a34-3600075cec95 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:18.960904 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6ca0b698-9c19-4829-8a34-3600075cec95 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:18.961341 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6ca0b698-9c19-4829-8a34-3600075cec95 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:19.030270 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-6ca0b698-9c19-4829-8a34-3600075cec95 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:20:19.037894 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-6ca0b698-9c19-4829-8a34-3600075cec95 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.088584 Jun 17 15:20:19.038457 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 513/1238] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:20:18 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:20:19.191656 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-30b42e69-c5a4-4f43-811e-4a4c88a78892 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:19.192262 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-30b42e69-c5a4-4f43-811e-4a4c88a78892 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:19.198322 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-30b42e69-c5a4-4f43-811e-4a4c88a78892 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:19.199256 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-30b42e69-c5a4-4f43-811e-4a4c88a78892 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:19.200007 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-30b42e69-c5a4-4f43-811e-4a4c88a78892 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:19.200462 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-30b42e69-c5a4-4f43-811e-4a4c88a78892 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:19.330325 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-30b42e69-c5a4-4f43-811e-4a4c88a78892 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:20:19.337841 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-30b42e69-c5a4-4f43-811e-4a4c88a78892 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.150090 Jun 17 15:20:19.338394 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 726/1239] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:20:19 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:20:19.554107 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-6938268a-9a49-4b06-9404-9a91244118f5 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:19.554952 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-6938268a-9a49-4b06-9404-9a91244118f5 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:19.561902 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6938268a-9a49-4b06-9404-9a91244118f5 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:19.562375 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6938268a-9a49-4b06-9404-9a91244118f5 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:19.563101 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6938268a-9a49-4b06-9404-9a91244118f5 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:19.563534 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6938268a-9a49-4b06-9404-9a91244118f5 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:19.592744 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-6938268a-9a49-4b06-9404-9a91244118f5 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042535 Jun 17 15:20:19.593308 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 514/1240] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:20:19 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:20:19.617904 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-cc6f21e0-7a3b-43d4-be68-4f7e3538fe5d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:19.618845 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-cc6f21e0-7a3b-43d4-be68-4f7e3538fe5d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:19.625907 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cc6f21e0-7a3b-43d4-be68-4f7e3538fe5d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:19.626349 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cc6f21e0-7a3b-43d4-be68-4f7e3538fe5d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:19.627111 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cc6f21e0-7a3b-43d4-be68-4f7e3538fe5d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:19.627537 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cc6f21e0-7a3b-43d4-be68-4f7e3538fe5d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:19.657833 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-cc6f21e0-7a3b-43d4-be68-4f7e3538fe5d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044863 Jun 17 15:20:19.658392 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 727/1241] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:20:19 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:20:20.055130 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-05762930-144c-4f64-bdf3-1873b9de5d16 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:20.055746 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-05762930-144c-4f64-bdf3-1873b9de5d16 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:20.062460 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-05762930-144c-4f64-bdf3-1873b9de5d16 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:20.062915 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-05762930-144c-4f64-bdf3-1873b9de5d16 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:20.063676 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-05762930-144c-4f64-bdf3-1873b9de5d16 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:20.064110 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-05762930-144c-4f64-bdf3-1873b9de5d16 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:20.125345 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-05762930-144c-4f64-bdf3-1873b9de5d16 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:20:20.133035 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-05762930-144c-4f64-bdf3-1873b9de5d16 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.081810 Jun 17 15:20:20.133842 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 515/1242] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:20:20 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:20:20.357311 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-f6790970-5b95-4399-b96c-295b6440530c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:20.358064 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-f6790970-5b95-4399-b96c-295b6440530c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:20.364073 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f6790970-5b95-4399-b96c-295b6440530c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:20.364560 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f6790970-5b95-4399-b96c-295b6440530c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:20.365329 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f6790970-5b95-4399-b96c-295b6440530c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:20.365764 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f6790970-5b95-4399-b96c-295b6440530c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:20.497885 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-f6790970-5b95-4399-b96c-295b6440530c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:20:20.505545 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-f6790970-5b95-4399-b96c-295b6440530c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.152790 Jun 17 15:20:20.506110 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 728/1243] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:20:20 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:20:20.604557 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-33295159-0b4d-4d48-9fa5-c51af15a192f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:20.606099 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-33295159-0b4d-4d48-9fa5-c51af15a192f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:20.612526 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-33295159-0b4d-4d48-9fa5-c51af15a192f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:20.612912 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-33295159-0b4d-4d48-9fa5-c51af15a192f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:20.613683 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-33295159-0b4d-4d48-9fa5-c51af15a192f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:20.614114 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-33295159-0b4d-4d48-9fa5-c51af15a192f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:20.642038 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-33295159-0b4d-4d48-9fa5-c51af15a192f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041460 Jun 17 15:20:20.642577 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 516/1244] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:20:20 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:20:20.669611 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-38f24d1b-cd4b-4790-af7e-217548ed10ab tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:20.670525 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-38f24d1b-cd4b-4790-af7e-217548ed10ab tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:20.677029 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-38f24d1b-cd4b-4790-af7e-217548ed10ab tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:20.677477 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-38f24d1b-cd4b-4790-af7e-217548ed10ab tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:20.678235 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-38f24d1b-cd4b-4790-af7e-217548ed10ab tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:20.678666 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-38f24d1b-cd4b-4790-af7e-217548ed10ab tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:20.707859 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-38f24d1b-cd4b-4790-af7e-217548ed10ab tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042251 Jun 17 15:20:20.708432 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 729/1245] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:20:20 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:20:21.150585 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-5a2e3867-726e-44f9-af53-2d1afe8fa473 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:21.151297 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-5a2e3867-726e-44f9-af53-2d1afe8fa473 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:21.157471 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5a2e3867-726e-44f9-af53-2d1afe8fa473 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:21.157919 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5a2e3867-726e-44f9-af53-2d1afe8fa473 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:21.158691 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5a2e3867-726e-44f9-af53-2d1afe8fa473 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:21.159161 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5a2e3867-726e-44f9-af53-2d1afe8fa473 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:21.220882 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-5a2e3867-726e-44f9-af53-2d1afe8fa473 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:20:21.228250 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-5a2e3867-726e-44f9-af53-2d1afe8fa473 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.081562 Jun 17 15:20:21.228834 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 517/1246] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:20:21 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:20:21.522753 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-d493ab4d-cd67-44ce-b6bf-4858d6aeb430 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:21.523366 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-d493ab4d-cd67-44ce-b6bf-4858d6aeb430 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:21.529758 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d493ab4d-cd67-44ce-b6bf-4858d6aeb430 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:21.530197 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d493ab4d-cd67-44ce-b6bf-4858d6aeb430 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:21.530952 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d493ab4d-cd67-44ce-b6bf-4858d6aeb430 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:21.531377 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d493ab4d-cd67-44ce-b6bf-4858d6aeb430 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:21.653864 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-4eae3c89-6864-48f1-a2e7-692c0e68da4a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:21.654849 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-4eae3c89-6864-48f1-a2e7-692c0e68da4a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:21.661614 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4eae3c89-6864-48f1-a2e7-692c0e68da4a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:21.662154 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4eae3c89-6864-48f1-a2e7-692c0e68da4a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:21.663002 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4eae3c89-6864-48f1-a2e7-692c0e68da4a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:21.663443 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4eae3c89-6864-48f1-a2e7-692c0e68da4a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:21.665988 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-d493ab4d-cd67-44ce-b6bf-4858d6aeb430 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:20:21.674135 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-d493ab4d-cd67-44ce-b6bf-4858d6aeb430 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.155377 Jun 17 15:20:21.674811 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 730/1247] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:20:21 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:20:21.699598 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-4eae3c89-6864-48f1-a2e7-692c0e68da4a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049866 Jun 17 15:20:21.700182 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 518/1248] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:20:21 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:20:21.719730 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-97c19a1a-22ca-4cc8-b6fe-2191264f207a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:21.720666 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-97c19a1a-22ca-4cc8-b6fe-2191264f207a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:21.727276 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-97c19a1a-22ca-4cc8-b6fe-2191264f207a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:21.727717 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-97c19a1a-22ca-4cc8-b6fe-2191264f207a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:21.728519 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-97c19a1a-22ca-4cc8-b6fe-2191264f207a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:21.728945 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-97c19a1a-22ca-4cc8-b6fe-2191264f207a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:21.759629 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-97c19a1a-22ca-4cc8-b6fe-2191264f207a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044105 Jun 17 15:20:21.760429 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 731/1249] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:20:21 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:20:22.244927 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-a13df5ea-7ace-4156-8ff9-e362fddb5eaf tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:22.245486 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-a13df5ea-7ace-4156-8ff9-e362fddb5eaf tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:22.252268 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a13df5ea-7ace-4156-8ff9-e362fddb5eaf tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:22.252738 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a13df5ea-7ace-4156-8ff9-e362fddb5eaf tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:22.253508 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a13df5ea-7ace-4156-8ff9-e362fddb5eaf tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:22.253943 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a13df5ea-7ace-4156-8ff9-e362fddb5eaf tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:22.317556 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-a13df5ea-7ace-4156-8ff9-e362fddb5eaf tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:20:22.325815 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-a13df5ea-7ace-4156-8ff9-e362fddb5eaf tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.085335 Jun 17 15:20:22.326374 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 519/1250] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:20:22 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:20:22.691044 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-4a911346-3d10-4930-9f46-1507726a7969 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:22.691659 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-4a911346-3d10-4930-9f46-1507726a7969 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:22.697841 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4a911346-3d10-4930-9f46-1507726a7969 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:22.698293 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4a911346-3d10-4930-9f46-1507726a7969 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:22.699707 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4a911346-3d10-4930-9f46-1507726a7969 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:22.700140 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4a911346-3d10-4930-9f46-1507726a7969 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:22.711082 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-d8d99ebe-1f41-4dc5-a66f-9aa0fe304a20 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:22.712014 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-d8d99ebe-1f41-4dc5-a66f-9aa0fe304a20 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:22.718777 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=100 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:20:22.718984 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d8d99ebe-1f41-4dc5-a66f-9aa0fe304a20 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:22.719366 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d8d99ebe-1f41-4dc5-a66f-9aa0fe304a20 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:22.720222 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d8d99ebe-1f41-4dc5-a66f-9aa0fe304a20 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:22.720763 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d8d99ebe-1f41-4dc5-a66f-9aa0fe304a20 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:22.750375 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-d8d99ebe-1f41-4dc5-a66f-9aa0fe304a20 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043172 Jun 17 15:20:22.750971 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 520/1251] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:20:22 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:20:22.775398 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-55bdc9ae-2101-47e5-8c4b-f9202bf3a0c9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:22.777125 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-55bdc9ae-2101-47e5-8c4b-f9202bf3a0c9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:22.785921 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-55bdc9ae-2101-47e5-8c4b-f9202bf3a0c9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:22.786370 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-55bdc9ae-2101-47e5-8c4b-f9202bf3a0c9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:22.787138 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-55bdc9ae-2101-47e5-8c4b-f9202bf3a0c9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:22.787577 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-55bdc9ae-2101-47e5-8c4b-f9202bf3a0c9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:22.816996 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-55bdc9ae-2101-47e5-8c4b-f9202bf3a0c9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046703 Jun 17 15:20:22.817874 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 521/1252] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:20:22 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 15:20:22.839177 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-4a911346-3d10-4930-9f46-1507726a7969 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:20:22.846866 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-4a911346-3d10-4930-9f46-1507726a7969 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.159717 Jun 17 15:20:22.847419 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 732/1253] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:20:22 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:20:23.343221 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-a00c074a-6779-4a63-ac46-1b88a0f52f84 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:23.343825 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-a00c074a-6779-4a63-ac46-1b88a0f52f84 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:23.350372 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a00c074a-6779-4a63-ac46-1b88a0f52f84 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:23.350826 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a00c074a-6779-4a63-ac46-1b88a0f52f84 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:23.351605 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a00c074a-6779-4a63-ac46-1b88a0f52f84 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:23.352046 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a00c074a-6779-4a63-ac46-1b88a0f52f84 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:23.415421 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-a00c074a-6779-4a63-ac46-1b88a0f52f84 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:20:23.424380 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-a00c074a-6779-4a63-ac46-1b88a0f52f84 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.085688 Jun 17 15:20:23.424963 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 522/1254] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:20:23 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:20:23.762623 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-95a5178c-fac4-4500-9908-fa2ea1f4b80c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:23.763454 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-95a5178c-fac4-4500-9908-fa2ea1f4b80c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:23.770158 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-95a5178c-fac4-4500-9908-fa2ea1f4b80c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:23.770604 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-95a5178c-fac4-4500-9908-fa2ea1f4b80c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:23.771373 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-95a5178c-fac4-4500-9908-fa2ea1f4b80c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:23.771805 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-95a5178c-fac4-4500-9908-fa2ea1f4b80c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:23.801420 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-95a5178c-fac4-4500-9908-fa2ea1f4b80c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043352 Jun 17 15:20:23.801974 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 733/1255] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:20:23 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:20:23.829028 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-67c25c3f-3633-46ae-a2d2-724c4f16d570 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:23.829959 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-67c25c3f-3633-46ae-a2d2-724c4f16d570 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:23.836497 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-67c25c3f-3633-46ae-a2d2-724c4f16d570 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:23.836978 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-67c25c3f-3633-46ae-a2d2-724c4f16d570 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:23.837746 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-67c25c3f-3633-46ae-a2d2-724c4f16d570 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:23.838183 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-67c25c3f-3633-46ae-a2d2-724c4f16d570 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:23.863683 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-75c49a62-5e38-4165-b5fb-c69096f44ecc tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:23.864290 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-75c49a62-5e38-4165-b5fb-c69096f44ecc tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:23.868350 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-67c25c3f-3633-46ae-a2d2-724c4f16d570 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043221 Jun 17 15:20:23.868942 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 523/1256] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:20:23 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:20:23.870478 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-75c49a62-5e38-4165-b5fb-c69096f44ecc tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:23.870932 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-75c49a62-5e38-4165-b5fb-c69096f44ecc tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:23.871698 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-75c49a62-5e38-4165-b5fb-c69096f44ecc tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:23.872129 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-75c49a62-5e38-4165-b5fb-c69096f44ecc tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:24.003405 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-75c49a62-5e38-4165-b5fb-c69096f44ecc tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:20:24.012894 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-75c49a62-5e38-4165-b5fb-c69096f44ecc tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.152806 Jun 17 15:20:24.013470 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 734/1257] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:20:23 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:20:24.441367 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-edcc6c61-402c-44bf-b13b-31c919223804 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:24.441979 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-edcc6c61-402c-44bf-b13b-31c919223804 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:24.448273 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-edcc6c61-402c-44bf-b13b-31c919223804 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:24.449259 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-edcc6c61-402c-44bf-b13b-31c919223804 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:24.450103 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-edcc6c61-402c-44bf-b13b-31c919223804 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:24.450532 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-edcc6c61-402c-44bf-b13b-31c919223804 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:24.519104 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-edcc6c61-402c-44bf-b13b-31c919223804 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:20:24.528417 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-edcc6c61-402c-44bf-b13b-31c919223804 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.090927 Jun 17 15:20:24.529257 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 524/1258] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:20:24 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:20:24.813849 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-07a95dbb-17e4-41c6-b154-f486c1ac1c7b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:24.814688 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-07a95dbb-17e4-41c6-b154-f486c1ac1c7b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:24.821453 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-07a95dbb-17e4-41c6-b154-f486c1ac1c7b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:24.821896 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-07a95dbb-17e4-41c6-b154-f486c1ac1c7b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:24.822666 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-07a95dbb-17e4-41c6-b154-f486c1ac1c7b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:24.823099 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-07a95dbb-17e4-41c6-b154-f486c1ac1c7b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:24.854223 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-07a95dbb-17e4-41c6-b154-f486c1ac1c7b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044413 Jun 17 15:20:24.854852 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 735/1259] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:20:24 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:20:24.879438 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-df57e64d-bb2f-48c3-a9fc-3da4acb6fa83 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:24.880446 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-df57e64d-bb2f-48c3-a9fc-3da4acb6fa83 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:24.887692 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-df57e64d-bb2f-48c3-a9fc-3da4acb6fa83 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:24.888130 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-df57e64d-bb2f-48c3-a9fc-3da4acb6fa83 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:24.888929 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-df57e64d-bb2f-48c3-a9fc-3da4acb6fa83 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:24.889350 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-df57e64d-bb2f-48c3-a9fc-3da4acb6fa83 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:24.920451 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-df57e64d-bb2f-48c3-a9fc-3da4acb6fa83 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044971 Jun 17 15:20:24.921016 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 525/1260] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:20:24 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:20:25.030261 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-8420ec0c-ec1b-4500-aaf6-7c6c59633e36 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:25.030888 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-8420ec0c-ec1b-4500-aaf6-7c6c59633e36 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:25.037196 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8420ec0c-ec1b-4500-aaf6-7c6c59633e36 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:25.037647 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8420ec0c-ec1b-4500-aaf6-7c6c59633e36 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:25.038425 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8420ec0c-ec1b-4500-aaf6-7c6c59633e36 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:25.038861 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8420ec0c-ec1b-4500-aaf6-7c6c59633e36 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:25.186521 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-8420ec0c-ec1b-4500-aaf6-7c6c59633e36 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:20:25.194740 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-8420ec0c-ec1b-4500-aaf6-7c6c59633e36 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.168437 Jun 17 15:20:25.195319 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 736/1261] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:20:25 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:20:25.546169 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-64a89e15-e07b-4722-ac88-913b5d2cb8fe tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:25.546786 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-64a89e15-e07b-4722-ac88-913b5d2cb8fe tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:25.549811 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_api:SELECT=100 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:20:25.553960 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-64a89e15-e07b-4722-ac88-913b5d2cb8fe tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:25.554407 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-64a89e15-e07b-4722-ac88-913b5d2cb8fe tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:25.555175 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-64a89e15-e07b-4722-ac88-913b5d2cb8fe tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:25.555606 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-64a89e15-e07b-4722-ac88-913b5d2cb8fe tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:25.617335 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-64a89e15-e07b-4722-ac88-913b5d2cb8fe tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:20:25.620791 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell1:SELECT=100 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:20:25.625942 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-64a89e15-e07b-4722-ac88-913b5d2cb8fe tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.084198 Jun 17 15:20:25.626523 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 526/1262] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:20:25 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:20:25.866153 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-c2e88351-ba65-45d1-9fb9-6a221f0b1894 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:25.867079 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-c2e88351-ba65-45d1-9fb9-6a221f0b1894 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:25.873342 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c2e88351-ba65-45d1-9fb9-6a221f0b1894 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:25.873796 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c2e88351-ba65-45d1-9fb9-6a221f0b1894 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:25.874573 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c2e88351-ba65-45d1-9fb9-6a221f0b1894 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:25.875004 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c2e88351-ba65-45d1-9fb9-6a221f0b1894 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:25.905081 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-c2e88351-ba65-45d1-9fb9-6a221f0b1894 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043064 Jun 17 15:20:25.905658 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 737/1263] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:20:25 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:20:25.931083 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-60acfaa5-28a5-45f5-bd58-6a5ddcc3fb85 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:25.931997 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-60acfaa5-28a5-45f5-bd58-6a5ddcc3fb85 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:25.939290 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-60acfaa5-28a5-45f5-bd58-6a5ddcc3fb85 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:25.939930 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-60acfaa5-28a5-45f5-bd58-6a5ddcc3fb85 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:25.941168 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-60acfaa5-28a5-45f5-bd58-6a5ddcc3fb85 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:25.941691 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-60acfaa5-28a5-45f5-bd58-6a5ddcc3fb85 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:25.975870 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-60acfaa5-28a5-45f5-bd58-6a5ddcc3fb85 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048650 Jun 17 15:20:25.976555 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 527/1264] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:20:25 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:20:26.215820 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-ebb6aa2f-171d-4828-9249-70f982a9e728 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:26.217194 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-ebb6aa2f-171d-4828-9249-70f982a9e728 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:26.227313 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ebb6aa2f-171d-4828-9249-70f982a9e728 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:26.228076 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ebb6aa2f-171d-4828-9249-70f982a9e728 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:26.229416 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ebb6aa2f-171d-4828-9249-70f982a9e728 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:26.230353 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ebb6aa2f-171d-4828-9249-70f982a9e728 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:26.375514 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-ebb6aa2f-171d-4828-9249-70f982a9e728 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:20:26.387420 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-ebb6aa2f-171d-4828-9249-70f982a9e728 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.178940 Jun 17 15:20:26.388083 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 738/1265] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:20:26 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:20:26.649299 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-20e985c6-3d9c-4db8-b2dc-b3aaec985e75 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:26.649914 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-20e985c6-3d9c-4db8-b2dc-b3aaec985e75 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:26.656543 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-20e985c6-3d9c-4db8-b2dc-b3aaec985e75 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:26.656987 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-20e985c6-3d9c-4db8-b2dc-b3aaec985e75 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:26.657760 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-20e985c6-3d9c-4db8-b2dc-b3aaec985e75 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:26.658189 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-20e985c6-3d9c-4db8-b2dc-b3aaec985e75 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:26.725926 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-20e985c6-3d9c-4db8-b2dc-b3aaec985e75 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:20:26.734347 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-20e985c6-3d9c-4db8-b2dc-b3aaec985e75 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.088912 Jun 17 15:20:26.734928 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 528/1266] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:20:26 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:20:26.918301 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-900c127a-a59e-4547-a2ba-8483541dcc7e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:26.919127 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-900c127a-a59e-4547-a2ba-8483541dcc7e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:26.925967 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-900c127a-a59e-4547-a2ba-8483541dcc7e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:26.926465 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-900c127a-a59e-4547-a2ba-8483541dcc7e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:26.927426 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-900c127a-a59e-4547-a2ba-8483541dcc7e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:26.927948 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-900c127a-a59e-4547-a2ba-8483541dcc7e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:26.975449 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-900c127a-a59e-4547-a2ba-8483541dcc7e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061354 Jun 17 15:20:26.976424 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 739/1267] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:20:26 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:20:26.987633 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-0fe684f5-5cdf-4d00-bfdd-e291228e2371 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:26.988613 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-0fe684f5-5cdf-4d00-bfdd-e291228e2371 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:26.995281 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0fe684f5-5cdf-4d00-bfdd-e291228e2371 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:26.996295 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0fe684f5-5cdf-4d00-bfdd-e291228e2371 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:26.997093 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0fe684f5-5cdf-4d00-bfdd-e291228e2371 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:26.997528 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0fe684f5-5cdf-4d00-bfdd-e291228e2371 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:27.028143 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-0fe684f5-5cdf-4d00-bfdd-e291228e2371 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044526 Jun 17 15:20:27.028760 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 529/1268] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:20:26 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:20:27.406083 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-a98d8b01-9ce8-4f3c-bc1f-3a881f19a50b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:27.406707 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-a98d8b01-9ce8-4f3c-bc1f-3a881f19a50b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:27.412808 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a98d8b01-9ce8-4f3c-bc1f-3a881f19a50b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:27.413262 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a98d8b01-9ce8-4f3c-bc1f-3a881f19a50b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:27.414042 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a98d8b01-9ce8-4f3c-bc1f-3a881f19a50b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:27.414478 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a98d8b01-9ce8-4f3c-bc1f-3a881f19a50b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:27.577060 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-a98d8b01-9ce8-4f3c-bc1f-3a881f19a50b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:20:27.584743 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-a98d8b01-9ce8-4f3c-bc1f-3a881f19a50b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.183298 Jun 17 15:20:27.585316 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 740/1269] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:20:27 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:20:27.752146 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-4de6e65e-3d5b-4586-bedb-c0df7796e6b9 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:27.752711 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-4de6e65e-3d5b-4586-bedb-c0df7796e6b9 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:27.759089 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4de6e65e-3d5b-4586-bedb-c0df7796e6b9 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:27.759539 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4de6e65e-3d5b-4586-bedb-c0df7796e6b9 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:27.760309 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4de6e65e-3d5b-4586-bedb-c0df7796e6b9 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:27.760782 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4de6e65e-3d5b-4586-bedb-c0df7796e6b9 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:27.828924 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-4de6e65e-3d5b-4586-bedb-c0df7796e6b9 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:20:27.837321 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-4de6e65e-3d5b-4586-bedb-c0df7796e6b9 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.089068 Jun 17 15:20:27.837919 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 530/1270] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:20:27 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:20:27.989442 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-1866dc40-8930-4e8c-92a8-d833525eee5b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:27.990381 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-1866dc40-8930-4e8c-92a8-d833525eee5b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:27.997700 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1866dc40-8930-4e8c-92a8-d833525eee5b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:27.998153 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1866dc40-8930-4e8c-92a8-d833525eee5b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:27.998935 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1866dc40-8930-4e8c-92a8-d833525eee5b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:27.999369 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1866dc40-8930-4e8c-92a8-d833525eee5b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:28.031682 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-1866dc40-8930-4e8c-92a8-d833525eee5b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046270 Jun 17 15:20:28.032170 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 741/1271] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:20:27 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:20:28.040094 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-2d8a0e0c-e397-4b5f-9a21-69a15100d375 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:28.041049 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-2d8a0e0c-e397-4b5f-9a21-69a15100d375 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:28.048497 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2d8a0e0c-e397-4b5f-9a21-69a15100d375 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:28.048935 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2d8a0e0c-e397-4b5f-9a21-69a15100d375 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:28.049700 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2d8a0e0c-e397-4b5f-9a21-69a15100d375 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:28.050127 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2d8a0e0c-e397-4b5f-9a21-69a15100d375 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:28.082795 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-2d8a0e0c-e397-4b5f-9a21-69a15100d375 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046925 Jun 17 15:20:28.083429 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 531/1272] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:20:28 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 15:20:28.602756 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-6471fa03-1ebc-4e6c-a045-57c07796c8bf tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:28.603364 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-6471fa03-1ebc-4e6c-a045-57c07796c8bf tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:28.610443 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6471fa03-1ebc-4e6c-a045-57c07796c8bf tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:28.610894 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6471fa03-1ebc-4e6c-a045-57c07796c8bf tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:28.611670 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6471fa03-1ebc-4e6c-a045-57c07796c8bf tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:28.612103 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6471fa03-1ebc-4e6c-a045-57c07796c8bf tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:28.753422 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-6471fa03-1ebc-4e6c-a045-57c07796c8bf tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:20:28.761293 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-6471fa03-1ebc-4e6c-a045-57c07796c8bf tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.162359 Jun 17 15:20:28.761877 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 742/1273] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:20:28 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:20:28.854720 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-54343281-7cfd-482b-805a-2604a1802196 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:28.855889 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-54343281-7cfd-482b-805a-2604a1802196 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:28.861928 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-54343281-7cfd-482b-805a-2604a1802196 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:28.862372 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-54343281-7cfd-482b-805a-2604a1802196 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:28.863122 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-54343281-7cfd-482b-805a-2604a1802196 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:28.863552 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-54343281-7cfd-482b-805a-2604a1802196 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:28.926358 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-54343281-7cfd-482b-805a-2604a1802196 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:20:28.934017 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-54343281-7cfd-482b-805a-2604a1802196 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.083161 Jun 17 15:20:28.934573 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 532/1274] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:20:28 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:20:29.043814 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-6d862300-6273-4bb9-a96a-10d04f6bfddb tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:29.044775 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-6d862300-6273-4bb9-a96a-10d04f6bfddb tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:29.051514 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6d862300-6273-4bb9-a96a-10d04f6bfddb tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:29.051956 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6d862300-6273-4bb9-a96a-10d04f6bfddb tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:29.052807 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6d862300-6273-4bb9-a96a-10d04f6bfddb tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:29.053248 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6d862300-6273-4bb9-a96a-10d04f6bfddb tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:29.084252 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-6d862300-6273-4bb9-a96a-10d04f6bfddb tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044413 Jun 17 15:20:29.084877 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 743/1275] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:20:29 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:20:29.096491 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-5a72a734-146b-4364-a8c6-add96973d204 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:29.097795 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-5a72a734-146b-4364-a8c6-add96973d204 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:29.104948 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5a72a734-146b-4364-a8c6-add96973d204 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:29.105523 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5a72a734-146b-4364-a8c6-add96973d204 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:29.106386 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5a72a734-146b-4364-a8c6-add96973d204 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:29.106861 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5a72a734-146b-4364-a8c6-add96973d204 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:29.137968 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-5a72a734-146b-4364-a8c6-add96973d204 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045597 Jun 17 15:20:29.138530 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 533/1276] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:20:29 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 15:20:29.778697 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-b7475147-218f-4c92-8aa3-2e1341582df7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:29.779225 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-b7475147-218f-4c92-8aa3-2e1341582df7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:29.785607 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b7475147-218f-4c92-8aa3-2e1341582df7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:29.786042 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b7475147-218f-4c92-8aa3-2e1341582df7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:29.786880 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b7475147-218f-4c92-8aa3-2e1341582df7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:29.787318 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b7475147-218f-4c92-8aa3-2e1341582df7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:29.936293 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-b7475147-218f-4c92-8aa3-2e1341582df7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:20:29.949134 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-b7475147-218f-4c92-8aa3-2e1341582df7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.174048 Jun 17 15:20:29.950046 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 744/1277] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:20:29 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:20:29.950827 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-ea6db7b5-8f4c-43a1-b995-ffee6f4d6b63 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:29.951458 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-ea6db7b5-8f4c-43a1-b995-ffee6f4d6b63 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:29.958458 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ea6db7b5-8f4c-43a1-b995-ffee6f4d6b63 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:29.958915 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ea6db7b5-8f4c-43a1-b995-ffee6f4d6b63 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:29.959714 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ea6db7b5-8f4c-43a1-b995-ffee6f4d6b63 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:29.960145 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ea6db7b5-8f4c-43a1-b995-ffee6f4d6b63 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:30.035044 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-ea6db7b5-8f4c-43a1-b995-ffee6f4d6b63 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:20:30.043557 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-ea6db7b5-8f4c-43a1-b995-ffee6f4d6b63 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.096686 Jun 17 15:20:30.044146 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 534/1278] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:20:29 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:20:30.096303 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-c07dc686-763a-46ca-b008-e75a8af3269e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:30.097273 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-c07dc686-763a-46ca-b008-e75a8af3269e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:30.104311 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c07dc686-763a-46ca-b008-e75a8af3269e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:30.105750 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c07dc686-763a-46ca-b008-e75a8af3269e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:30.106545 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c07dc686-763a-46ca-b008-e75a8af3269e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:30.106982 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c07dc686-763a-46ca-b008-e75a8af3269e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:30.141832 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-c07dc686-763a-46ca-b008-e75a8af3269e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049523 Jun 17 15:20:30.142404 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 745/1279] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:20:30 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:20:30.154695 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-58323c4a-78a0-4726-b076-d1a8f037a7f0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:30.156379 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-58323c4a-78a0-4726-b076-d1a8f037a7f0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:30.168232 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-58323c4a-78a0-4726-b076-d1a8f037a7f0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:30.169040 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-58323c4a-78a0-4726-b076-d1a8f037a7f0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:30.170397 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-58323c4a-78a0-4726-b076-d1a8f037a7f0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:30.171165 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-58323c4a-78a0-4726-b076-d1a8f037a7f0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:30.226833 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-58323c4a-78a0-4726-b076-d1a8f037a7f0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.079707 Jun 17 15:20:30.227828 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 535/1280] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:20:30 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 15:20:30.973751 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-2b1be94e-eb97-491a-8fb8-e8a481c48f94 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:30.974366 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-2b1be94e-eb97-491a-8fb8-e8a481c48f94 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:30.980560 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2b1be94e-eb97-491a-8fb8-e8a481c48f94 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:30.981006 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2b1be94e-eb97-491a-8fb8-e8a481c48f94 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:30.981776 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2b1be94e-eb97-491a-8fb8-e8a481c48f94 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:30.982204 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2b1be94e-eb97-491a-8fb8-e8a481c48f94 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:31.061878 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-ac311a24-a8f7-4584-a70b-6ddd4548db40 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:31.062887 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-ac311a24-a8f7-4584-a70b-6ddd4548db40 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:31.071732 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ac311a24-a8f7-4584-a70b-6ddd4548db40 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:31.072473 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ac311a24-a8f7-4584-a70b-6ddd4548db40 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:31.075541 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ac311a24-a8f7-4584-a70b-6ddd4548db40 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:31.075541 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ac311a24-a8f7-4584-a70b-6ddd4548db40 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:31.148510 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-ac311a24-a8f7-4584-a70b-6ddd4548db40 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:20:31.157960 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-ac311a24-a8f7-4584-a70b-6ddd4548db40 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.101326 Jun 17 15:20:31.158796 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 536/1281] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:20:31 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:20:31.163612 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-14764cfa-9b0e-4fc5-8d9c-a47fd33fd13f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:31.164691 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-14764cfa-9b0e-4fc5-8d9c-a47fd33fd13f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:31.175427 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-14764cfa-9b0e-4fc5-8d9c-a47fd33fd13f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:31.175936 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-14764cfa-9b0e-4fc5-8d9c-a47fd33fd13f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:31.177073 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-14764cfa-9b0e-4fc5-8d9c-a47fd33fd13f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:31.177699 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-14764cfa-9b0e-4fc5-8d9c-a47fd33fd13f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:31.214875 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-14764cfa-9b0e-4fc5-8d9c-a47fd33fd13f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055068 Jun 17 15:20:31.215778 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 537/1282] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:20:31 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:20:31.243766 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-5d58ca99-03c1-427e-842d-c0de5a18dc2c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:31.245155 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-5d58ca99-03c1-427e-842d-c0de5a18dc2c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:31.255783 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5d58ca99-03c1-427e-842d-c0de5a18dc2c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:31.256563 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5d58ca99-03c1-427e-842d-c0de5a18dc2c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:31.257865 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5d58ca99-03c1-427e-842d-c0de5a18dc2c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:31.258574 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5d58ca99-03c1-427e-842d-c0de5a18dc2c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:31.311917 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-5d58ca99-03c1-427e-842d-c0de5a18dc2c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.074759 Jun 17 15:20:31.312830 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 538/1283] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:20:31 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 15:20:31.363357 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-2b1be94e-eb97-491a-8fb8-e8a481c48f94 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:20:31.372049 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-2b1be94e-eb97-491a-8fb8-e8a481c48f94 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.406996 Jun 17 15:20:31.372671 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 746/1284] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:20:30 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:20:32.177876 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-f77d84d7-4380-4fd1-b201-b033569b99a9 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:32.178477 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-f77d84d7-4380-4fd1-b201-b033569b99a9 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:32.185600 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f77d84d7-4380-4fd1-b201-b033569b99a9 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:32.186039 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f77d84d7-4380-4fd1-b201-b033569b99a9 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:32.186800 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f77d84d7-4380-4fd1-b201-b033569b99a9 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:32.187233 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f77d84d7-4380-4fd1-b201-b033569b99a9 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:32.227592 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-424ff6c5-5555-4b89-a265-b7615f638b96 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:32.228556 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-424ff6c5-5555-4b89-a265-b7615f638b96 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:32.235772 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-424ff6c5-5555-4b89-a265-b7615f638b96 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:32.236296 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-424ff6c5-5555-4b89-a265-b7615f638b96 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:32.237040 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-424ff6c5-5555-4b89-a265-b7615f638b96 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:32.237468 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-424ff6c5-5555-4b89-a265-b7615f638b96 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:32.251573 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-f77d84d7-4380-4fd1-b201-b033569b99a9 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:20:32.264639 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-f77d84d7-4380-4fd1-b201-b033569b99a9 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.090187 Jun 17 15:20:32.265735 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 539/1285] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:20:32 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:20:32.269384 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-424ff6c5-5555-4b89-a265-b7615f638b96 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045749 Jun 17 15:20:32.269950 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 747/1286] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:20:32 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:20:32.325247 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-e43219eb-876f-4749-bc2f-0ccffa4947e7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:32.326171 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-e43219eb-876f-4749-bc2f-0ccffa4947e7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:32.332338 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e43219eb-876f-4749-bc2f-0ccffa4947e7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:32.332800 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e43219eb-876f-4749-bc2f-0ccffa4947e7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:32.333556 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e43219eb-876f-4749-bc2f-0ccffa4947e7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:32.333986 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e43219eb-876f-4749-bc2f-0ccffa4947e7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:32.364797 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-e43219eb-876f-4749-bc2f-0ccffa4947e7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044123 Jun 17 15:20:32.365363 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 540/1287] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:20:32 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:20:32.390528 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-1a3708ac-3058-4da5-9633-448130b6914c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:32.391273 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-1a3708ac-3058-4da5-9633-448130b6914c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:32.397652 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1a3708ac-3058-4da5-9633-448130b6914c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:32.398094 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1a3708ac-3058-4da5-9633-448130b6914c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:32.398856 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1a3708ac-3058-4da5-9633-448130b6914c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:32.399287 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1a3708ac-3058-4da5-9633-448130b6914c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:32.535289 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-1a3708ac-3058-4da5-9633-448130b6914c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:20:32.543259 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-1a3708ac-3058-4da5-9633-448130b6914c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.157162 Jun 17 15:20:32.543837 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 748/1288] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:20:32 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:20:33.282236 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-fedeb231-6e1a-496f-aefb-bf9b61764068 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:33.285103 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-fedeb231-6e1a-496f-aefb-bf9b61764068 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:33.291499 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fedeb231-6e1a-496f-aefb-bf9b61764068 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:33.291893 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-a0dce5c7-e4f1-4e6e-bb07-5e1882bbea24 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:33.292956 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fedeb231-6e1a-496f-aefb-bf9b61764068 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:33.293429 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-a0dce5c7-e4f1-4e6e-bb07-5e1882bbea24 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:33.294405 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fedeb231-6e1a-496f-aefb-bf9b61764068 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:33.295190 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fedeb231-6e1a-496f-aefb-bf9b61764068 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:33.300619 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a0dce5c7-e4f1-4e6e-bb07-5e1882bbea24 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:33.301052 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a0dce5c7-e4f1-4e6e-bb07-5e1882bbea24 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:33.301815 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a0dce5c7-e4f1-4e6e-bb07-5e1882bbea24 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:33.302252 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a0dce5c7-e4f1-4e6e-bb07-5e1882bbea24 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:33.307816 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=100 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:20:33.347752 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-fedeb231-6e1a-496f-aefb-bf9b61764068 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069097 Jun 17 15:20:33.349021 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 541/1289] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:20:33 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:20:33.369208 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-a0dce5c7-e4f1-4e6e-bb07-5e1882bbea24 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:20:33.376917 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-7da30637-10f0-4e83-bf7d-18c48efa2f3b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:33.378499 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-7da30637-10f0-4e83-bf7d-18c48efa2f3b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:33.384950 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-a0dce5c7-e4f1-4e6e-bb07-5e1882bbea24 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.097159 Jun 17 15:20:33.385683 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 749/1290] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:20:33 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:20:33.387405 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7da30637-10f0-4e83-bf7d-18c48efa2f3b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:33.387857 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7da30637-10f0-4e83-bf7d-18c48efa2f3b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:33.388675 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7da30637-10f0-4e83-bf7d-18c48efa2f3b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:33.389111 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7da30637-10f0-4e83-bf7d-18c48efa2f3b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:33.421362 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-7da30637-10f0-4e83-bf7d-18c48efa2f3b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048546 Jun 17 15:20:33.421963 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 542/1291] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:20:33 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 15:20:33.560290 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-1f382fad-9c2b-4d81-bb98-2151cda980e0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:33.561044 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-1f382fad-9c2b-4d81-bb98-2151cda980e0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:33.571263 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1f382fad-9c2b-4d81-bb98-2151cda980e0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:33.571745 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1f382fad-9c2b-4d81-bb98-2151cda980e0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:33.572562 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1f382fad-9c2b-4d81-bb98-2151cda980e0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:33.572993 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1f382fad-9c2b-4d81-bb98-2151cda980e0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:33.708460 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-1f382fad-9c2b-4d81-bb98-2151cda980e0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:20:33.716910 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-1f382fad-9c2b-4d81-bb98-2151cda980e0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.160684 Jun 17 15:20:33.717476 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 750/1292] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:20:33 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:20:34.362821 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-c444db98-1c43-499d-8403-01d291f86c68 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:34.363766 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-c444db98-1c43-499d-8403-01d291f86c68 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:34.370936 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c444db98-1c43-499d-8403-01d291f86c68 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:34.371374 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c444db98-1c43-499d-8403-01d291f86c68 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:34.372141 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c444db98-1c43-499d-8403-01d291f86c68 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:34.372604 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c444db98-1c43-499d-8403-01d291f86c68 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:34.391003 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell1:SELECT=100 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:20:34.403500 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-203cdc15-0ff8-449a-9e31-82139640e704 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:34.404292 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-203cdc15-0ff8-449a-9e31-82139640e704 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:34.404558 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-c444db98-1c43-499d-8403-01d291f86c68 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046457 Jun 17 15:20:34.405627 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 543/1293] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:20:34 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:20:34.411815 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-203cdc15-0ff8-449a-9e31-82139640e704 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:34.412256 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-203cdc15-0ff8-449a-9e31-82139640e704 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:34.413056 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-203cdc15-0ff8-449a-9e31-82139640e704 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:34.413481 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-203cdc15-0ff8-449a-9e31-82139640e704 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:34.436403 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-02ba13c5-4bc9-4a7f-a2bb-51aae3338b97 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:34.437482 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-02ba13c5-4bc9-4a7f-a2bb-51aae3338b97 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:34.444253 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-02ba13c5-4bc9-4a7f-a2bb-51aae3338b97 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:34.444737 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-02ba13c5-4bc9-4a7f-a2bb-51aae3338b97 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:34.445510 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-02ba13c5-4bc9-4a7f-a2bb-51aae3338b97 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:34.445947 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-02ba13c5-4bc9-4a7f-a2bb-51aae3338b97 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:34.478418 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-203cdc15-0ff8-449a-9e31-82139640e704 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:20:34.478665 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-02ba13c5-4bc9-4a7f-a2bb-51aae3338b97 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047184 Jun 17 15:20:34.480070 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 544/1294] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:20:34 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 15:20:34.490320 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-203cdc15-0ff8-449a-9e31-82139640e704 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.090569 Jun 17 15:20:34.491314 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 751/1295] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:20:34 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:20:34.735015 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-1c04d701-63bf-4817-8859-1ddc93c9f3b7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:34.735510 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-1c04d701-63bf-4817-8859-1ddc93c9f3b7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:34.741582 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1c04d701-63bf-4817-8859-1ddc93c9f3b7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:34.742022 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1c04d701-63bf-4817-8859-1ddc93c9f3b7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:34.742770 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1c04d701-63bf-4817-8859-1ddc93c9f3b7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:34.743194 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1c04d701-63bf-4817-8859-1ddc93c9f3b7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:34.881404 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-1c04d701-63bf-4817-8859-1ddc93c9f3b7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:20:34.889810 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-1c04d701-63bf-4817-8859-1ddc93c9f3b7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.158768 Jun 17 15:20:34.890377 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 545/1296] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:20:34 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:20:35.415610 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-53582a8a-6006-46d9-801f-1cb267f65328 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:35.416584 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-53582a8a-6006-46d9-801f-1cb267f65328 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:35.423328 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-53582a8a-6006-46d9-801f-1cb267f65328 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:35.423778 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-53582a8a-6006-46d9-801f-1cb267f65328 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:35.424579 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-53582a8a-6006-46d9-801f-1cb267f65328 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:35.425013 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-53582a8a-6006-46d9-801f-1cb267f65328 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:35.456055 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-53582a8a-6006-46d9-801f-1cb267f65328 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044491 Jun 17 15:20:35.456666 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 752/1297] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:20:35 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:20:35.491676 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-8115458d-956d-4635-b0b9-fc3f959e7fd5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:35.492628 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-8115458d-956d-4635-b0b9-fc3f959e7fd5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:35.499597 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8115458d-956d-4635-b0b9-fc3f959e7fd5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:35.500031 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8115458d-956d-4635-b0b9-fc3f959e7fd5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:35.500818 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8115458d-956d-4635-b0b9-fc3f959e7fd5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:35.501249 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8115458d-956d-4635-b0b9-fc3f959e7fd5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:35.515696 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-ddd2ea60-f197-46d9-8e05-c19af8ba5ba8 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:35.516670 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-ddd2ea60-f197-46d9-8e05-c19af8ba5ba8 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:35.522826 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ddd2ea60-f197-46d9-8e05-c19af8ba5ba8 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:35.523282 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ddd2ea60-f197-46d9-8e05-c19af8ba5ba8 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:35.524049 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ddd2ea60-f197-46d9-8e05-c19af8ba5ba8 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:35.524513 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ddd2ea60-f197-46d9-8e05-c19af8ba5ba8 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:35.533436 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-8115458d-956d-4635-b0b9-fc3f959e7fd5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045802 Jun 17 15:20:35.534074 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 546/1298] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:20:35 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:20:35.587433 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-ddd2ea60-f197-46d9-8e05-c19af8ba5ba8 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:20:35.595520 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-ddd2ea60-f197-46d9-8e05-c19af8ba5ba8 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.084273 Jun 17 15:20:35.596093 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 753/1299] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:20:35 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:20:35.907328 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-1fd5869a-e431-4f31-b5f4-69e4c99d1af2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:35.907976 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-1fd5869a-e431-4f31-b5f4-69e4c99d1af2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:35.914121 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1fd5869a-e431-4f31-b5f4-69e4c99d1af2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:35.914571 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1fd5869a-e431-4f31-b5f4-69e4c99d1af2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:35.915338 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1fd5869a-e431-4f31-b5f4-69e4c99d1af2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:35.915780 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1fd5869a-e431-4f31-b5f4-69e4c99d1af2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:36.059683 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-1fd5869a-e431-4f31-b5f4-69e4c99d1af2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:20:36.067543 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-1fd5869a-e431-4f31-b5f4-69e4c99d1af2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.164326 Jun 17 15:20:36.068126 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 547/1300] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:20:35 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:20:36.468649 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-39942aab-6464-43da-a3c8-b9bf016d727c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:36.469622 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-39942aab-6464-43da-a3c8-b9bf016d727c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:36.476401 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-39942aab-6464-43da-a3c8-b9bf016d727c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:36.476851 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-39942aab-6464-43da-a3c8-b9bf016d727c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:36.477625 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-39942aab-6464-43da-a3c8-b9bf016d727c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:36.478052 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-39942aab-6464-43da-a3c8-b9bf016d727c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:36.506552 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-39942aab-6464-43da-a3c8-b9bf016d727c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042831 Jun 17 15:20:36.507102 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 754/1301] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:20:36 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:20:36.546473 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-9440a8f0-22f2-4051-8f07-fd26162f7a08 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:36.547384 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-9440a8f0-22f2-4051-8f07-fd26162f7a08 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:36.553767 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9440a8f0-22f2-4051-8f07-fd26162f7a08 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:36.554209 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9440a8f0-22f2-4051-8f07-fd26162f7a08 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:36.554954 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9440a8f0-22f2-4051-8f07-fd26162f7a08 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:36.555382 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9440a8f0-22f2-4051-8f07-fd26162f7a08 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:36.583842 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-9440a8f0-22f2-4051-8f07-fd26162f7a08 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041274 Jun 17 15:20:36.584403 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 548/1302] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:20:36 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:20:36.670328 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-416748d2-93a4-4e99-8ce5-883484408ef3 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:36.670857 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-416748d2-93a4-4e99-8ce5-883484408ef3 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:36.676901 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-416748d2-93a4-4e99-8ce5-883484408ef3 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:36.677348 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-416748d2-93a4-4e99-8ce5-883484408ef3 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:36.678107 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-416748d2-93a4-4e99-8ce5-883484408ef3 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:36.678542 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-416748d2-93a4-4e99-8ce5-883484408ef3 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:36.739282 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-416748d2-93a4-4e99-8ce5-883484408ef3 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:20:36.747275 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-416748d2-93a4-4e99-8ce5-883484408ef3 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.080979 Jun 17 15:20:36.747832 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 755/1303] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:20:36 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:20:37.084932 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-e556720f-7691-4e4d-ae48-8388231c54a8 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:37.085583 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-e556720f-7691-4e4d-ae48-8388231c54a8 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:37.091992 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e556720f-7691-4e4d-ae48-8388231c54a8 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:37.092481 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e556720f-7691-4e4d-ae48-8388231c54a8 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:37.093246 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e556720f-7691-4e4d-ae48-8388231c54a8 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:37.093679 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e556720f-7691-4e4d-ae48-8388231c54a8 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:37.224795 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-e556720f-7691-4e4d-ae48-8388231c54a8 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:20:37.232737 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-e556720f-7691-4e4d-ae48-8388231c54a8 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.151726 Jun 17 15:20:37.233297 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 549/1304] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:20:37 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:20:37.518188 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-181877f3-7766-48e2-b34b-16e3a585d1a9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:37.519103 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-181877f3-7766-48e2-b34b-16e3a585d1a9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:37.525574 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-181877f3-7766-48e2-b34b-16e3a585d1a9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:37.526013 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-181877f3-7766-48e2-b34b-16e3a585d1a9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:37.527263 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-181877f3-7766-48e2-b34b-16e3a585d1a9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:37.527685 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-181877f3-7766-48e2-b34b-16e3a585d1a9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:37.556427 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-181877f3-7766-48e2-b34b-16e3a585d1a9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042175 Jun 17 15:20:37.556975 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 756/1305] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:20:37 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:20:37.596356 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-855e36cf-d965-431c-99d7-007988e7678b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:37.597279 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-855e36cf-d965-431c-99d7-007988e7678b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:37.603715 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-855e36cf-d965-431c-99d7-007988e7678b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:37.604270 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-855e36cf-d965-431c-99d7-007988e7678b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:37.605634 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-855e36cf-d965-431c-99d7-007988e7678b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:37.606067 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-855e36cf-d965-431c-99d7-007988e7678b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:37.634943 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-855e36cf-d965-431c-99d7-007988e7678b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042456 Jun 17 15:20:37.635417 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 550/1306] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:20:37 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:20:37.763663 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-b96e0117-1516-4d7d-b211-232de462a6b3 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:37.764269 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-b96e0117-1516-4d7d-b211-232de462a6b3 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:37.770316 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b96e0117-1516-4d7d-b211-232de462a6b3 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:37.770758 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b96e0117-1516-4d7d-b211-232de462a6b3 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:37.771512 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b96e0117-1516-4d7d-b211-232de462a6b3 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:37.771941 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b96e0117-1516-4d7d-b211-232de462a6b3 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:37.835258 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-b96e0117-1516-4d7d-b211-232de462a6b3 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:20:37.843831 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-b96e0117-1516-4d7d-b211-232de462a6b3 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.083975 Jun 17 15:20:37.844426 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 757/1307] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:20:37 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:20:38.250332 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-0c058545-316a-4518-acd2-231c2363200f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:38.250945 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-0c058545-316a-4518-acd2-231c2363200f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:38.257055 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0c058545-316a-4518-acd2-231c2363200f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:38.257505 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0c058545-316a-4518-acd2-231c2363200f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:38.258267 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0c058545-316a-4518-acd2-231c2363200f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:38.258705 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0c058545-316a-4518-acd2-231c2363200f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:38.389965 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-0c058545-316a-4518-acd2-231c2363200f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:20:38.397479 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-0c058545-316a-4518-acd2-231c2363200f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.150964 Jun 17 15:20:38.398059 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 551/1308] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:20:38 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:20:38.567991 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-4978dd60-826c-4ddc-a025-ab98ec3266f4 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:38.568873 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-4978dd60-826c-4ddc-a025-ab98ec3266f4 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:38.575946 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4978dd60-826c-4ddc-a025-ab98ec3266f4 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:38.576423 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4978dd60-826c-4ddc-a025-ab98ec3266f4 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:38.577182 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4978dd60-826c-4ddc-a025-ab98ec3266f4 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:38.577607 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4978dd60-826c-4ddc-a025-ab98ec3266f4 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:38.606812 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-4978dd60-826c-4ddc-a025-ab98ec3266f4 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042848 Jun 17 15:20:38.607364 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 758/1309] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:20:38 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:20:38.645845 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-d7354858-7926-4696-8b04-8db3f91d21c0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:38.646771 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-d7354858-7926-4696-8b04-8db3f91d21c0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:38.653451 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d7354858-7926-4696-8b04-8db3f91d21c0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:38.653893 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d7354858-7926-4696-8b04-8db3f91d21c0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:38.654653 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d7354858-7926-4696-8b04-8db3f91d21c0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:38.655078 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d7354858-7926-4696-8b04-8db3f91d21c0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:38.685156 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-d7354858-7926-4696-8b04-8db3f91d21c0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043202 Jun 17 15:20:38.685723 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 552/1310] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:20:38 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:20:38.861138 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-a0e68889-a4da-45ef-baea-521378783ad3 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:38.861757 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-a0e68889-a4da-45ef-baea-521378783ad3 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:38.868058 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a0e68889-a4da-45ef-baea-521378783ad3 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:38.868560 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a0e68889-a4da-45ef-baea-521378783ad3 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:38.869333 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a0e68889-a4da-45ef-baea-521378783ad3 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:38.869769 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a0e68889-a4da-45ef-baea-521378783ad3 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:38.933389 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-a0e68889-a4da-45ef-baea-521378783ad3 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:20:38.941056 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-a0e68889-a4da-45ef-baea-521378783ad3 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.083834 Jun 17 15:20:38.941624 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 759/1311] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:20:38 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:20:39.414368 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-71166192-ddc4-4e1d-a38f-9279ca88187e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:39.414982 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-71166192-ddc4-4e1d-a38f-9279ca88187e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:39.421150 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-71166192-ddc4-4e1d-a38f-9279ca88187e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:39.421605 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-71166192-ddc4-4e1d-a38f-9279ca88187e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:39.422384 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-71166192-ddc4-4e1d-a38f-9279ca88187e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:39.422822 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-71166192-ddc4-4e1d-a38f-9279ca88187e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:39.554944 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-71166192-ddc4-4e1d-a38f-9279ca88187e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:20:39.562485 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-71166192-ddc4-4e1d-a38f-9279ca88187e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.152123 Jun 17 15:20:39.563043 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 553/1312] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:20:39 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:20:39.617599 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-ae86b856-7564-4909-b843-c13617034123 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:39.618511 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-ae86b856-7564-4909-b843-c13617034123 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:39.624950 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ae86b856-7564-4909-b843-c13617034123 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:39.625392 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ae86b856-7564-4909-b843-c13617034123 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:39.626171 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ae86b856-7564-4909-b843-c13617034123 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:39.626596 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ae86b856-7564-4909-b843-c13617034123 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:39.657716 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-ae86b856-7564-4909-b843-c13617034123 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043706 Jun 17 15:20:39.658181 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 760/1313] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:20:39 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:20:39.697461 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-208466fa-04c4-4418-82d9-1bc5959ffd02 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:39.698907 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-208466fa-04c4-4418-82d9-1bc5959ffd02 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:39.705390 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-208466fa-04c4-4418-82d9-1bc5959ffd02 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:39.705834 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-208466fa-04c4-4418-82d9-1bc5959ffd02 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:39.706622 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-208466fa-04c4-4418-82d9-1bc5959ffd02 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:39.707058 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-208466fa-04c4-4418-82d9-1bc5959ffd02 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:39.736306 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-208466fa-04c4-4418-82d9-1bc5959ffd02 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043133 Jun 17 15:20:39.736948 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 554/1314] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:20:39 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:20:39.958228 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-7df47336-6706-43c9-96ad-2cbf8b0ce56f tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:39.958745 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-7df47336-6706-43c9-96ad-2cbf8b0ce56f tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:39.964990 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7df47336-6706-43c9-96ad-2cbf8b0ce56f tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:39.965430 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7df47336-6706-43c9-96ad-2cbf8b0ce56f tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:39.966443 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7df47336-6706-43c9-96ad-2cbf8b0ce56f tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:39.966871 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7df47336-6706-43c9-96ad-2cbf8b0ce56f tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:40.027205 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-7df47336-6706-43c9-96ad-2cbf8b0ce56f tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:20:40.034663 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-7df47336-6706-43c9-96ad-2cbf8b0ce56f tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.080537 Jun 17 15:20:40.035212 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 761/1315] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:20:39 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:20:40.579098 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-9e124ce3-3a2c-4201-aa6a-b1305ba332fb tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:40.579719 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-9e124ce3-3a2c-4201-aa6a-b1305ba332fb tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:40.585789 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9e124ce3-3a2c-4201-aa6a-b1305ba332fb tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:40.586237 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9e124ce3-3a2c-4201-aa6a-b1305ba332fb tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:40.586997 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9e124ce3-3a2c-4201-aa6a-b1305ba332fb tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:40.587429 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9e124ce3-3a2c-4201-aa6a-b1305ba332fb tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:40.670395 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-ec99dc7b-4893-4442-aa9b-28e341030ab6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:40.671356 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-ec99dc7b-4893-4442-aa9b-28e341030ab6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:40.677986 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ec99dc7b-4893-4442-aa9b-28e341030ab6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:40.678438 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ec99dc7b-4893-4442-aa9b-28e341030ab6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:40.679207 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ec99dc7b-4893-4442-aa9b-28e341030ab6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:40.679649 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ec99dc7b-4893-4442-aa9b-28e341030ab6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:40.711903 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-ec99dc7b-4893-4442-aa9b-28e341030ab6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046222 Jun 17 15:20:40.712517 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 762/1316] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:20:40 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:20:40.718094 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-9e124ce3-3a2c-4201-aa6a-b1305ba332fb tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:20:40.725651 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-9e124ce3-3a2c-4201-aa6a-b1305ba332fb tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.150481 Jun 17 15:20:40.726207 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 555/1317] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:20:40 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:20:40.748881 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-c78c4639-bbb2-41d1-aeee-882d693c53ab tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:40.749928 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-c78c4639-bbb2-41d1-aeee-882d693c53ab tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:40.756088 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c78c4639-bbb2-41d1-aeee-882d693c53ab tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:40.756580 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c78c4639-bbb2-41d1-aeee-882d693c53ab tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:40.757347 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c78c4639-bbb2-41d1-aeee-882d693c53ab tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:40.757782 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c78c4639-bbb2-41d1-aeee-882d693c53ab tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:40.787264 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-c78c4639-bbb2-41d1-aeee-882d693c53ab tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043920 Jun 17 15:20:40.787826 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 763/1318] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:20:40 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:20:41.052056 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-d97934c9-c188-45e5-a2d8-d5a757b1f652 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:41.052728 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-d97934c9-c188-45e5-a2d8-d5a757b1f652 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:41.058869 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d97934c9-c188-45e5-a2d8-d5a757b1f652 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:41.059314 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d97934c9-c188-45e5-a2d8-d5a757b1f652 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:41.060077 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d97934c9-c188-45e5-a2d8-d5a757b1f652 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:41.060543 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d97934c9-c188-45e5-a2d8-d5a757b1f652 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:41.126603 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-d97934c9-c188-45e5-a2d8-d5a757b1f652 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:20:41.133978 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-d97934c9-c188-45e5-a2d8-d5a757b1f652 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.086554 Jun 17 15:20:41.134533 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 556/1319] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:20:41 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:20:41.724436 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-f9bd6bdf-5e68-4677-ad33-ca335dd10545 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:41.725306 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-f9bd6bdf-5e68-4677-ad33-ca335dd10545 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:41.732709 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f9bd6bdf-5e68-4677-ad33-ca335dd10545 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:41.733150 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f9bd6bdf-5e68-4677-ad33-ca335dd10545 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:41.733909 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f9bd6bdf-5e68-4677-ad33-ca335dd10545 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:41.734336 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f9bd6bdf-5e68-4677-ad33-ca335dd10545 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:41.743353 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-13a8c92e-bc77-4940-b954-b20e3a270f7e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:41.743964 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-13a8c92e-bc77-4940-b954-b20e3a270f7e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:41.751446 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-13a8c92e-bc77-4940-b954-b20e3a270f7e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:41.751886 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-13a8c92e-bc77-4940-b954-b20e3a270f7e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:41.752673 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-13a8c92e-bc77-4940-b954-b20e3a270f7e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:41.753099 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-13a8c92e-bc77-4940-b954-b20e3a270f7e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:41.764400 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-f9bd6bdf-5e68-4677-ad33-ca335dd10545 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043971 Jun 17 15:20:41.764978 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 764/1320] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:20:41 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:20:41.802796 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-04ab0f51-a379-46ed-ba1d-b2c8d95d6f73 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:41.804139 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-04ab0f51-a379-46ed-ba1d-b2c8d95d6f73 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:41.807524 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_api:SELECT=100 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:20:41.812339 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-04ab0f51-a379-46ed-ba1d-b2c8d95d6f73 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:41.812796 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-04ab0f51-a379-46ed-ba1d-b2c8d95d6f73 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:41.813574 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-04ab0f51-a379-46ed-ba1d-b2c8d95d6f73 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:41.814004 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-04ab0f51-a379-46ed-ba1d-b2c8d95d6f73 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:41.840048 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=100 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:20:41.845876 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-04ab0f51-a379-46ed-ba1d-b2c8d95d6f73 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050140 Jun 17 15:20:41.846734 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 765/1321] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:20:41 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 15:20:41.896427 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-13a8c92e-bc77-4940-b954-b20e3a270f7e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:20:41.904103 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-13a8c92e-bc77-4940-b954-b20e3a270f7e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.164467 Jun 17 15:20:41.904698 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 557/1322] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:20:41 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:20:42.151862 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-30a306f2-42f2-4dbc-828a-d3e327e35dc1 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:42.152526 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-30a306f2-42f2-4dbc-828a-d3e327e35dc1 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:42.158881 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-30a306f2-42f2-4dbc-828a-d3e327e35dc1 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:42.159334 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-30a306f2-42f2-4dbc-828a-d3e327e35dc1 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:42.160110 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-30a306f2-42f2-4dbc-828a-d3e327e35dc1 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:42.160580 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-30a306f2-42f2-4dbc-828a-d3e327e35dc1 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:42.223780 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-30a306f2-42f2-4dbc-828a-d3e327e35dc1 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:20:42.232203 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-30a306f2-42f2-4dbc-828a-d3e327e35dc1 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.084973 Jun 17 15:20:42.232794 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 766/1323] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:20:42 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:20:42.775990 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-4ef6ea8e-3e43-4f15-b716-d123c815c83a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:42.776932 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-4ef6ea8e-3e43-4f15-b716-d123c815c83a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:42.783481 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4ef6ea8e-3e43-4f15-b716-d123c815c83a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:42.783922 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4ef6ea8e-3e43-4f15-b716-d123c815c83a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:42.784708 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4ef6ea8e-3e43-4f15-b716-d123c815c83a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:42.785135 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4ef6ea8e-3e43-4f15-b716-d123c815c83a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:42.814607 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-4ef6ea8e-3e43-4f15-b716-d123c815c83a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042578 Jun 17 15:20:42.815170 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 558/1324] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:20:42 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:20:42.858026 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-4f32115c-2973-4814-8ea8-0ceb6e812c98 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:42.858949 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-4f32115c-2973-4814-8ea8-0ceb6e812c98 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:42.865664 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4f32115c-2973-4814-8ea8-0ceb6e812c98 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:42.866108 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4f32115c-2973-4814-8ea8-0ceb6e812c98 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:42.866928 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4f32115c-2973-4814-8ea8-0ceb6e812c98 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:42.867364 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4f32115c-2973-4814-8ea8-0ceb6e812c98 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:42.898812 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-4f32115c-2973-4814-8ea8-0ceb6e812c98 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044816 Jun 17 15:20:42.899389 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 767/1325] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:20:42 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:20:42.921241 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-c550e60c-c84d-4f9d-af11-0ac5de334a76 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:42.921846 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-c550e60c-c84d-4f9d-af11-0ac5de334a76 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:42.927864 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c550e60c-c84d-4f9d-af11-0ac5de334a76 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:42.928305 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c550e60c-c84d-4f9d-af11-0ac5de334a76 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:42.929089 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c550e60c-c84d-4f9d-af11-0ac5de334a76 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:42.929518 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c550e60c-c84d-4f9d-af11-0ac5de334a76 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:43.064431 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-c550e60c-c84d-4f9d-af11-0ac5de334a76 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:20:43.072258 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-c550e60c-c84d-4f9d-af11-0ac5de334a76 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.154930 Jun 17 15:20:43.072876 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 559/1326] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:20:42 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:20:43.249659 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-1a248c5b-08b3-4749-91df-7d3d258b7f76 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:43.250297 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-1a248c5b-08b3-4749-91df-7d3d258b7f76 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:43.256423 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1a248c5b-08b3-4749-91df-7d3d258b7f76 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:43.256874 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1a248c5b-08b3-4749-91df-7d3d258b7f76 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:43.257645 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1a248c5b-08b3-4749-91df-7d3d258b7f76 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:43.258140 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1a248c5b-08b3-4749-91df-7d3d258b7f76 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:43.323692 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-1a248c5b-08b3-4749-91df-7d3d258b7f76 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:20:43.331359 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-1a248c5b-08b3-4749-91df-7d3d258b7f76 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.086220 Jun 17 15:20:43.331925 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 768/1327] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:20:43 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:20:43.826211 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-2b0fce3e-6693-4b66-ae83-6d2c7288dabe tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:43.827134 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-2b0fce3e-6693-4b66-ae83-6d2c7288dabe tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:43.833623 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2b0fce3e-6693-4b66-ae83-6d2c7288dabe tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:43.834069 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2b0fce3e-6693-4b66-ae83-6d2c7288dabe tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:43.834826 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2b0fce3e-6693-4b66-ae83-6d2c7288dabe tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:43.835255 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2b0fce3e-6693-4b66-ae83-6d2c7288dabe tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:43.839491 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell1:SELECT=100 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:20:43.865140 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-2b0fce3e-6693-4b66-ae83-6d2c7288dabe tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042833 Jun 17 15:20:43.865691 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 560/1328] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:20:43 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:20:43.910546 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-50ec24fd-fdca-4f4c-99ac-5db51e984881 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:43.911464 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-50ec24fd-fdca-4f4c-99ac-5db51e984881 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:43.918044 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-50ec24fd-fdca-4f4c-99ac-5db51e984881 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:43.918479 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-50ec24fd-fdca-4f4c-99ac-5db51e984881 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:43.919256 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-50ec24fd-fdca-4f4c-99ac-5db51e984881 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:43.919679 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-50ec24fd-fdca-4f4c-99ac-5db51e984881 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:43.949786 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-50ec24fd-fdca-4f4c-99ac-5db51e984881 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043180 Jun 17 15:20:43.950339 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 769/1329] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:20:43 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:20:44.090651 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-37841f8e-a9b0-4ae9-87bc-b58fbc8883d4 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:44.091510 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-37841f8e-a9b0-4ae9-87bc-b58fbc8883d4 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:44.097746 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-37841f8e-a9b0-4ae9-87bc-b58fbc8883d4 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:44.098189 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-37841f8e-a9b0-4ae9-87bc-b58fbc8883d4 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:44.098951 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-37841f8e-a9b0-4ae9-87bc-b58fbc8883d4 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:44.099379 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-37841f8e-a9b0-4ae9-87bc-b58fbc8883d4 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:44.236758 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-37841f8e-a9b0-4ae9-87bc-b58fbc8883d4 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:20:44.244373 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-37841f8e-a9b0-4ae9-87bc-b58fbc8883d4 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.158294 Jun 17 15:20:44.245431 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 561/1330] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:20:44 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:20:44.349566 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-925cc550-4898-4012-bdf9-2582c4b13b36 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:44.350228 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-925cc550-4898-4012-bdf9-2582c4b13b36 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:44.356420 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-925cc550-4898-4012-bdf9-2582c4b13b36 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:44.356864 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-925cc550-4898-4012-bdf9-2582c4b13b36 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:44.357623 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-925cc550-4898-4012-bdf9-2582c4b13b36 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:44.358052 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-925cc550-4898-4012-bdf9-2582c4b13b36 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:44.420401 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-925cc550-4898-4012-bdf9-2582c4b13b36 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:20:44.428002 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-925cc550-4898-4012-bdf9-2582c4b13b36 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.083454 Jun 17 15:20:44.428604 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 770/1331] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:20:44 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:20:44.877687 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-5ed4491b-5841-4c7c-bcee-290be382415b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:44.878639 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-5ed4491b-5841-4c7c-bcee-290be382415b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:44.885297 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5ed4491b-5841-4c7c-bcee-290be382415b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:44.885747 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5ed4491b-5841-4c7c-bcee-290be382415b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:44.886522 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5ed4491b-5841-4c7c-bcee-290be382415b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:44.886974 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5ed4491b-5841-4c7c-bcee-290be382415b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:44.918783 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-5ed4491b-5841-4c7c-bcee-290be382415b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045215 Jun 17 15:20:44.919350 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 562/1332] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:20:44 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:20:44.961056 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-3fc57048-e9db-46ab-b047-ff1636a1e5e9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:44.961890 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-3fc57048-e9db-46ab-b047-ff1636a1e5e9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:44.971811 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3fc57048-e9db-46ab-b047-ff1636a1e5e9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:44.972244 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3fc57048-e9db-46ab-b047-ff1636a1e5e9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:44.973075 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3fc57048-e9db-46ab-b047-ff1636a1e5e9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:44.973501 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3fc57048-e9db-46ab-b047-ff1636a1e5e9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:45.006646 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-3fc57048-e9db-46ab-b047-ff1636a1e5e9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049601 Jun 17 15:20:45.007864 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 771/1333] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:20:44 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:20:45.262130 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-90537935-5b16-46ac-8bbe-9ddb92392a98 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:45.262655 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-90537935-5b16-46ac-8bbe-9ddb92392a98 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:45.268640 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-90537935-5b16-46ac-8bbe-9ddb92392a98 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:45.269083 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-90537935-5b16-46ac-8bbe-9ddb92392a98 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:45.269829 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-90537935-5b16-46ac-8bbe-9ddb92392a98 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:45.270256 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-90537935-5b16-46ac-8bbe-9ddb92392a98 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:45.421612 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-90537935-5b16-46ac-8bbe-9ddb92392a98 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:20:45.429552 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-90537935-5b16-46ac-8bbe-9ddb92392a98 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.171250 Jun 17 15:20:45.430115 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 563/1334] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:20:45 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:20:45.446000 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-90450553-73ca-4ddd-8654-5205f3a15dd4 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:45.446614 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-90450553-73ca-4ddd-8654-5205f3a15dd4 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:45.453571 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-90450553-73ca-4ddd-8654-5205f3a15dd4 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:45.454012 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-90450553-73ca-4ddd-8654-5205f3a15dd4 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:45.454772 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-90450553-73ca-4ddd-8654-5205f3a15dd4 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:45.455193 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-90450553-73ca-4ddd-8654-5205f3a15dd4 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:45.517811 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-90450553-73ca-4ddd-8654-5205f3a15dd4 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:20:45.525394 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-90450553-73ca-4ddd-8654-5205f3a15dd4 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.083303 Jun 17 15:20:45.525956 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 772/1335] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:20:45 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:20:45.930490 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-64d1c848-d2d7-47e9-b6d9-03c4a0b09fdf tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:45.931448 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-64d1c848-d2d7-47e9-b6d9-03c4a0b09fdf tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:45.938468 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-64d1c848-d2d7-47e9-b6d9-03c4a0b09fdf tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:45.938913 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-64d1c848-d2d7-47e9-b6d9-03c4a0b09fdf tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:45.939673 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-64d1c848-d2d7-47e9-b6d9-03c4a0b09fdf tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:45.940105 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-64d1c848-d2d7-47e9-b6d9-03c4a0b09fdf tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:45.970440 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-64d1c848-d2d7-47e9-b6d9-03c4a0b09fdf tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043835 Jun 17 15:20:45.971001 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 564/1336] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:20:45 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:20:46.018712 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-94ef6e62-3c5f-4937-adb1-8c7332d7fefe tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:46.019662 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-94ef6e62-3c5f-4937-adb1-8c7332d7fefe tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:46.026589 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-94ef6e62-3c5f-4937-adb1-8c7332d7fefe tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:46.027049 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-94ef6e62-3c5f-4937-adb1-8c7332d7fefe tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:46.027796 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-94ef6e62-3c5f-4937-adb1-8c7332d7fefe tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:46.028222 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-94ef6e62-3c5f-4937-adb1-8c7332d7fefe tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:46.058373 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-94ef6e62-3c5f-4937-adb1-8c7332d7fefe tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043128 Jun 17 15:20:46.058851 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 773/1337] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:20:46 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:20:46.446207 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-c31b3ad8-7989-4f8f-90c0-f7915eb77e60 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:46.446829 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-c31b3ad8-7989-4f8f-90c0-f7915eb77e60 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:46.452907 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c31b3ad8-7989-4f8f-90c0-f7915eb77e60 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:46.453358 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c31b3ad8-7989-4f8f-90c0-f7915eb77e60 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:46.454120 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c31b3ad8-7989-4f8f-90c0-f7915eb77e60 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:46.454584 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c31b3ad8-7989-4f8f-90c0-f7915eb77e60 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:46.543580 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-3d1d39b6-72d8-494f-b691-5c3ec6432d9a tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:46.544376 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-3d1d39b6-72d8-494f-b691-5c3ec6432d9a tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:46.550631 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3d1d39b6-72d8-494f-b691-5c3ec6432d9a tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:46.551151 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3d1d39b6-72d8-494f-b691-5c3ec6432d9a tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:46.551984 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3d1d39b6-72d8-494f-b691-5c3ec6432d9a tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:46.552544 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3d1d39b6-72d8-494f-b691-5c3ec6432d9a tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:46.591305 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-c31b3ad8-7989-4f8f-90c0-f7915eb77e60 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:20:46.599052 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-c31b3ad8-7989-4f8f-90c0-f7915eb77e60 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.156643 Jun 17 15:20:46.599620 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 565/1338] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:20:46 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:20:46.615196 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-3d1d39b6-72d8-494f-b691-5c3ec6432d9a tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:20:46.622856 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-3d1d39b6-72d8-494f-b691-5c3ec6432d9a tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.083795 Jun 17 15:20:46.623549 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 774/1339] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:20:46 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:20:46.982497 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-80f3c645-4499-4be6-9f7f-0f1455b88ffd tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:46.983397 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-80f3c645-4499-4be6-9f7f-0f1455b88ffd tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:46.990309 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-80f3c645-4499-4be6-9f7f-0f1455b88ffd tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:46.990764 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-80f3c645-4499-4be6-9f7f-0f1455b88ffd tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:46.991550 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-80f3c645-4499-4be6-9f7f-0f1455b88ffd tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:46.991990 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-80f3c645-4499-4be6-9f7f-0f1455b88ffd tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:47.024675 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-80f3c645-4499-4be6-9f7f-0f1455b88ffd tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046338 Jun 17 15:20:47.025262 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 566/1340] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:20:46 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:20:47.069919 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-04a2eb88-2d4f-4a96-a94d-1fdf68b1b019 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:47.070859 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-04a2eb88-2d4f-4a96-a94d-1fdf68b1b019 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:47.078275 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-04a2eb88-2d4f-4a96-a94d-1fdf68b1b019 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:47.078722 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-04a2eb88-2d4f-4a96-a94d-1fdf68b1b019 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:47.079496 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-04a2eb88-2d4f-4a96-a94d-1fdf68b1b019 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:47.079933 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-04a2eb88-2d4f-4a96-a94d-1fdf68b1b019 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:47.111885 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-04a2eb88-2d4f-4a96-a94d-1fdf68b1b019 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045990 Jun 17 15:20:47.112506 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 775/1341] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:20:47 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:20:47.617088 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-a158bc46-4462-4a8c-8b54-67ad45184318 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:47.617735 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-a158bc46-4462-4a8c-8b54-67ad45184318 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:47.624379 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a158bc46-4462-4a8c-8b54-67ad45184318 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:47.624830 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a158bc46-4462-4a8c-8b54-67ad45184318 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:47.625591 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a158bc46-4462-4a8c-8b54-67ad45184318 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:47.626023 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a158bc46-4462-4a8c-8b54-67ad45184318 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:47.640097 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-d748803c-3b55-4437-b294-679d56779f12 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:47.640650 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-d748803c-3b55-4437-b294-679d56779f12 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:47.647495 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d748803c-3b55-4437-b294-679d56779f12 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:47.647946 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d748803c-3b55-4437-b294-679d56779f12 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:47.648768 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d748803c-3b55-4437-b294-679d56779f12 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:47.649202 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d748803c-3b55-4437-b294-679d56779f12 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:47.715029 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-d748803c-3b55-4437-b294-679d56779f12 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:20:47.724038 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-d748803c-3b55-4437-b294-679d56779f12 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.088817 Jun 17 15:20:47.724662 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 776/1342] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:20:47 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:20:47.765737 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-a158bc46-4462-4a8c-8b54-67ad45184318 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:20:47.773994 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-a158bc46-4462-4a8c-8b54-67ad45184318 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.160817 Jun 17 15:20:47.774582 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 567/1343] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:20:47 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:20:48.037280 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-54ca7718-2e8e-4db4-af88-fa0e50559793 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:48.038129 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-54ca7718-2e8e-4db4-af88-fa0e50559793 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:48.045075 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-54ca7718-2e8e-4db4-af88-fa0e50559793 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:48.045518 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-54ca7718-2e8e-4db4-af88-fa0e50559793 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:48.046295 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-54ca7718-2e8e-4db4-af88-fa0e50559793 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:48.046725 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-54ca7718-2e8e-4db4-af88-fa0e50559793 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:48.077108 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-54ca7718-2e8e-4db4-af88-fa0e50559793 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043892 Jun 17 15:20:48.077774 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 777/1344] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:20:48 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:20:48.123338 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-1292abea-0696-4f6c-8878-948d8215bf6a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:48.124277 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-1292abea-0696-4f6c-8878-948d8215bf6a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:48.131196 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1292abea-0696-4f6c-8878-948d8215bf6a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:48.131647 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1292abea-0696-4f6c-8878-948d8215bf6a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:48.132453 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1292abea-0696-4f6c-8878-948d8215bf6a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:48.132892 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1292abea-0696-4f6c-8878-948d8215bf6a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:48.168477 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-1292abea-0696-4f6c-8878-948d8215bf6a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049102 Jun 17 15:20:48.169063 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 568/1345] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:20:48 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:20:48.741577 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-dc917fc8-3c91-41ac-b294-f77877347f1b tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:48.742180 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-dc917fc8-3c91-41ac-b294-f77877347f1b tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:48.748747 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-dc917fc8-3c91-41ac-b294-f77877347f1b tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:48.749185 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-dc917fc8-3c91-41ac-b294-f77877347f1b tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:48.749940 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-dc917fc8-3c91-41ac-b294-f77877347f1b tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:48.750371 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-dc917fc8-3c91-41ac-b294-f77877347f1b tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:48.791154 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-49c1e324-abe7-4317-9c8b-bd888f9b84f2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:48.791959 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-49c1e324-abe7-4317-9c8b-bd888f9b84f2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:48.798378 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-49c1e324-abe7-4317-9c8b-bd888f9b84f2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:48.798918 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-49c1e324-abe7-4317-9c8b-bd888f9b84f2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:48.799749 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-49c1e324-abe7-4317-9c8b-bd888f9b84f2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:48.800255 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-49c1e324-abe7-4317-9c8b-bd888f9b84f2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:48.812705 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-dc917fc8-3c91-41ac-b294-f77877347f1b tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:20:48.820232 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-dc917fc8-3c91-41ac-b294-f77877347f1b tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.082626 Jun 17 15:20:48.820860 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 778/1346] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:20:48 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:20:48.937515 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-49c1e324-abe7-4317-9c8b-bd888f9b84f2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:20:48.945051 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-49c1e324-abe7-4317-9c8b-bd888f9b84f2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.157911 Jun 17 15:20:48.945613 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 569/1347] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:20:48 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:20:49.089659 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-5fc9622e-0767-435d-8b80-9200862a4cb8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:49.090599 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-5fc9622e-0767-435d-8b80-9200862a4cb8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:49.097961 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5fc9622e-0767-435d-8b80-9200862a4cb8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:49.098404 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5fc9622e-0767-435d-8b80-9200862a4cb8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:49.099190 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5fc9622e-0767-435d-8b80-9200862a4cb8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:49.099621 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5fc9622e-0767-435d-8b80-9200862a4cb8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:49.130960 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-5fc9622e-0767-435d-8b80-9200862a4cb8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045383 Jun 17 15:20:49.131552 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 779/1348] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:20:49 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:20:49.180799 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-2773a861-74d2-43cd-b8d7-b223edeeff27 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:49.181760 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-2773a861-74d2-43cd-b8d7-b223edeeff27 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:49.189301 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2773a861-74d2-43cd-b8d7-b223edeeff27 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:49.189671 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2773a861-74d2-43cd-b8d7-b223edeeff27 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:49.190447 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2773a861-74d2-43cd-b8d7-b223edeeff27 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:49.190877 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2773a861-74d2-43cd-b8d7-b223edeeff27 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:49.222686 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-2773a861-74d2-43cd-b8d7-b223edeeff27 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046128 Jun 17 15:20:49.223266 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 570/1349] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:20:49 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:20:49.837350 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-a2f88c4b-c42b-48e3-a376-031f222cb9eb tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:49.837962 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-a2f88c4b-c42b-48e3-a376-031f222cb9eb tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:49.844769 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a2f88c4b-c42b-48e3-a376-031f222cb9eb tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:49.845220 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a2f88c4b-c42b-48e3-a376-031f222cb9eb tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:49.845984 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a2f88c4b-c42b-48e3-a376-031f222cb9eb tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:49.846417 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a2f88c4b-c42b-48e3-a376-031f222cb9eb tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:49.914793 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-a2f88c4b-c42b-48e3-a376-031f222cb9eb tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:20:49.924727 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-a2f88c4b-c42b-48e3-a376-031f222cb9eb tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.091156 Jun 17 15:20:49.925347 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 780/1350] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:20:49 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:20:49.962609 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-f815f8ee-8070-4fab-94d8-8a7c121bbe29 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:49.963228 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-f815f8ee-8070-4fab-94d8-8a7c121bbe29 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:49.969577 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f815f8ee-8070-4fab-94d8-8a7c121bbe29 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:49.970033 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f815f8ee-8070-4fab-94d8-8a7c121bbe29 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:49.970794 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f815f8ee-8070-4fab-94d8-8a7c121bbe29 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:49.971231 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f815f8ee-8070-4fab-94d8-8a7c121bbe29 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:50.109731 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-f815f8ee-8070-4fab-94d8-8a7c121bbe29 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:20:50.117517 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-f815f8ee-8070-4fab-94d8-8a7c121bbe29 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.158733 Jun 17 15:20:50.118082 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 571/1351] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:20:49 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:20:50.142836 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-dae741f2-7f80-4933-b9e4-4d8275acced0 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:50.143760 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-dae741f2-7f80-4933-b9e4-4d8275acced0 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:50.150386 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-dae741f2-7f80-4933-b9e4-4d8275acced0 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:50.150836 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-dae741f2-7f80-4933-b9e4-4d8275acced0 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:50.151617 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-dae741f2-7f80-4933-b9e4-4d8275acced0 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:50.152034 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-dae741f2-7f80-4933-b9e4-4d8275acced0 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:50.181051 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-dae741f2-7f80-4933-b9e4-4d8275acced0 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042283 Jun 17 15:20:50.181610 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 781/1352] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:20:50 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:20:50.236114 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-e96785f0-b64c-4718-9e88-a61a7000fb10 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:50.237081 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-e96785f0-b64c-4718-9e88-a61a7000fb10 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:50.243559 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e96785f0-b64c-4718-9e88-a61a7000fb10 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:50.243999 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e96785f0-b64c-4718-9e88-a61a7000fb10 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:50.245396 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e96785f0-b64c-4718-9e88-a61a7000fb10 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:50.245822 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e96785f0-b64c-4718-9e88-a61a7000fb10 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:50.275032 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-e96785f0-b64c-4718-9e88-a61a7000fb10 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043109 Jun 17 15:20:50.275589 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 572/1353] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:20:50 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:20:50.941767 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-9e9823f9-3e3a-4072-84c5-04c8fbec7c08 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:50.942773 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-9e9823f9-3e3a-4072-84c5-04c8fbec7c08 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:50.949577 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9e9823f9-3e3a-4072-84c5-04c8fbec7c08 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:50.950026 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9e9823f9-3e3a-4072-84c5-04c8fbec7c08 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:50.950803 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9e9823f9-3e3a-4072-84c5-04c8fbec7c08 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:50.951235 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9e9823f9-3e3a-4072-84c5-04c8fbec7c08 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:50.970550 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=100 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:20:51.016879 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-9e9823f9-3e3a-4072-84c5-04c8fbec7c08 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:20:51.024949 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-9e9823f9-3e3a-4072-84c5-04c8fbec7c08 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.086974 Jun 17 15:20:51.025532 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 782/1354] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:20:50 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:20:51.135549 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-5f215095-1fe2-4719-bcf9-36006361e37e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:51.136169 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-5f215095-1fe2-4719-bcf9-36006361e37e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:51.142541 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5f215095-1fe2-4719-bcf9-36006361e37e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:51.142990 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5f215095-1fe2-4719-bcf9-36006361e37e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:51.143759 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5f215095-1fe2-4719-bcf9-36006361e37e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:51.144197 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5f215095-1fe2-4719-bcf9-36006361e37e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:51.193650 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-c5e1b586-7989-44df-9362-43074612d721 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:51.194528 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-c5e1b586-7989-44df-9362-43074612d721 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:51.201933 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c5e1b586-7989-44df-9362-43074612d721 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:51.202388 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c5e1b586-7989-44df-9362-43074612d721 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:51.203475 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c5e1b586-7989-44df-9362-43074612d721 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:51.203975 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c5e1b586-7989-44df-9362-43074612d721 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:51.239733 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-c5e1b586-7989-44df-9362-43074612d721 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050661 Jun 17 15:20:51.244081 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 783/1355] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:20:51 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:20:51.288291 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-5994d4b5-c1e8-4c64-bc7a-8bd081e5562f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:51.291027 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-5994d4b5-c1e8-4c64-bc7a-8bd081e5562f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:51.296386 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5994d4b5-c1e8-4c64-bc7a-8bd081e5562f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:51.300372 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5994d4b5-c1e8-4c64-bc7a-8bd081e5562f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:51.300372 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5994d4b5-c1e8-4c64-bc7a-8bd081e5562f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:51.300372 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5994d4b5-c1e8-4c64-bc7a-8bd081e5562f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:51.316360 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-5f215095-1fe2-4719-bcf9-36006361e37e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:20:51.324950 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-5f215095-1fe2-4719-bcf9-36006361e37e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.193238 Jun 17 15:20:51.325773 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 573/1356] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:20:51 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:20:51.330601 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-5994d4b5-c1e8-4c64-bc7a-8bd081e5562f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046207 Jun 17 15:20:51.331512 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 784/1357] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:20:51 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:20:52.042525 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-0e9f9d68-9496-4bc4-a2b7-4c25cc0fecd6 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:52.043043 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-0e9f9d68-9496-4bc4-a2b7-4c25cc0fecd6 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:52.049976 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0e9f9d68-9496-4bc4-a2b7-4c25cc0fecd6 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:52.050422 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0e9f9d68-9496-4bc4-a2b7-4c25cc0fecd6 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:52.051194 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0e9f9d68-9496-4bc4-a2b7-4c25cc0fecd6 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:52.051622 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0e9f9d68-9496-4bc4-a2b7-4c25cc0fecd6 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:52.118492 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-0e9f9d68-9496-4bc4-a2b7-4c25cc0fecd6 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:20:52.126776 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-0e9f9d68-9496-4bc4-a2b7-4c25cc0fecd6 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.088244 Jun 17 15:20:52.127350 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 574/1358] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:20:52 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:20:52.251999 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-8663fadb-ff30-469a-82fe-1ed1d47b6de3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:52.252955 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-8663fadb-ff30-469a-82fe-1ed1d47b6de3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:52.259670 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8663fadb-ff30-469a-82fe-1ed1d47b6de3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:52.260116 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8663fadb-ff30-469a-82fe-1ed1d47b6de3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:52.260966 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8663fadb-ff30-469a-82fe-1ed1d47b6de3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:52.261396 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8663fadb-ff30-469a-82fe-1ed1d47b6de3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:52.291286 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-8663fadb-ff30-469a-82fe-1ed1d47b6de3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043294 Jun 17 15:20:52.292387 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 785/1359] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:20:52 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:20:52.342824 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-39fc192c-1407-4a78-a907-da81c4e36d86 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:52.343095 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-7b15d807-eefe-415b-bed3-993bd80fc9de tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:52.343560 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-39fc192c-1407-4a78-a907-da81c4e36d86 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:52.343962 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-7b15d807-eefe-415b-bed3-993bd80fc9de tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:52.350151 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-39fc192c-1407-4a78-a907-da81c4e36d86 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:52.350610 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-39fc192c-1407-4a78-a907-da81c4e36d86 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:52.350743 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7b15d807-eefe-415b-bed3-993bd80fc9de tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:52.351070 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7b15d807-eefe-415b-bed3-993bd80fc9de tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:52.351413 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-39fc192c-1407-4a78-a907-da81c4e36d86 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:52.351829 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-39fc192c-1407-4a78-a907-da81c4e36d86 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:52.351943 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7b15d807-eefe-415b-bed3-993bd80fc9de tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:52.352261 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7b15d807-eefe-415b-bed3-993bd80fc9de tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:52.384346 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-7b15d807-eefe-415b-bed3-993bd80fc9de tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045563 Jun 17 15:20:52.384934 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 575/1360] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:20:52 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:20:52.496375 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-39fc192c-1407-4a78-a907-da81c4e36d86 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:20:52.503839 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-39fc192c-1407-4a78-a907-da81c4e36d86 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.165139 Jun 17 15:20:52.504418 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 786/1361] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:20:52 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:20:53.144174 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-87805eaf-3c1d-482c-bb24-88cf6396365d tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:53.144811 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-87805eaf-3c1d-482c-bb24-88cf6396365d tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:53.147700 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_api:SELECT=100 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:20:53.152015 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-87805eaf-3c1d-482c-bb24-88cf6396365d tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:53.152494 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-87805eaf-3c1d-482c-bb24-88cf6396365d tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:53.153249 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-87805eaf-3c1d-482c-bb24-88cf6396365d tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:53.153680 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-87805eaf-3c1d-482c-bb24-88cf6396365d tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:53.215932 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-87805eaf-3c1d-482c-bb24-88cf6396365d tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:20:53.219608 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell1:SELECT=100 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:20:53.224402 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-87805eaf-3c1d-482c-bb24-88cf6396365d tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.084024 Jun 17 15:20:53.224963 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 576/1362] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:20:53 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:20:53.303813 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-8127184f-b36e-4f0a-a16b-daded9511f26 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:53.304708 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-8127184f-b36e-4f0a-a16b-daded9511f26 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:53.311733 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8127184f-b36e-4f0a-a16b-daded9511f26 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:53.312181 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8127184f-b36e-4f0a-a16b-daded9511f26 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:53.312982 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8127184f-b36e-4f0a-a16b-daded9511f26 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:53.313421 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8127184f-b36e-4f0a-a16b-daded9511f26 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:53.342694 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-8127184f-b36e-4f0a-a16b-daded9511f26 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043036 Jun 17 15:20:53.343252 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 787/1363] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:20:53 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:20:53.395232 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-c6a86def-e737-4fb0-b10d-1268a66eac6f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:53.396157 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-c6a86def-e737-4fb0-b10d-1268a66eac6f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:53.403063 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c6a86def-e737-4fb0-b10d-1268a66eac6f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:53.403514 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c6a86def-e737-4fb0-b10d-1268a66eac6f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:53.404313 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c6a86def-e737-4fb0-b10d-1268a66eac6f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:53.404773 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c6a86def-e737-4fb0-b10d-1268a66eac6f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:53.434310 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-c6a86def-e737-4fb0-b10d-1268a66eac6f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042988 Jun 17 15:20:53.434883 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 577/1364] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:20:53 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:20:53.520562 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-09834d66-e3dc-4654-8c91-acc63915fd54 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:53.521166 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-09834d66-e3dc-4654-8c91-acc63915fd54 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:53.527111 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-09834d66-e3dc-4654-8c91-acc63915fd54 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:53.527554 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-09834d66-e3dc-4654-8c91-acc63915fd54 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:53.528306 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-09834d66-e3dc-4654-8c91-acc63915fd54 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:53.528759 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-09834d66-e3dc-4654-8c91-acc63915fd54 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:53.658325 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-09834d66-e3dc-4654-8c91-acc63915fd54 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:20:53.666099 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-09834d66-e3dc-4654-8c91-acc63915fd54 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.149361 Jun 17 15:20:53.667169 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 788/1365] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:20:53 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:20:54.241402 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-3138db72-1111-4bbe-b4e4-2c394ced1d51 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:54.242011 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-3138db72-1111-4bbe-b4e4-2c394ced1d51 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:54.248055 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3138db72-1111-4bbe-b4e4-2c394ced1d51 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:54.248551 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3138db72-1111-4bbe-b4e4-2c394ced1d51 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:54.249314 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3138db72-1111-4bbe-b4e4-2c394ced1d51 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:54.249740 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3138db72-1111-4bbe-b4e4-2c394ced1d51 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:54.310003 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-3138db72-1111-4bbe-b4e4-2c394ced1d51 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:20:54.317509 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-3138db72-1111-4bbe-b4e4-2c394ced1d51 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.079994 Jun 17 15:20:54.318074 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 578/1366] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:20:54 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:20:54.355522 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-6ff7d761-130d-4ce1-ae98-191f44c726cf tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:54.356483 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-6ff7d761-130d-4ce1-ae98-191f44c726cf tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:54.363082 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6ff7d761-130d-4ce1-ae98-191f44c726cf tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:54.363525 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6ff7d761-130d-4ce1-ae98-191f44c726cf tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:54.364454 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6ff7d761-130d-4ce1-ae98-191f44c726cf tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:54.364889 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6ff7d761-130d-4ce1-ae98-191f44c726cf tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:54.394961 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-6ff7d761-130d-4ce1-ae98-191f44c726cf tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044082 Jun 17 15:20:54.395515 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 789/1367] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:20:54 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:20:54.446373 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-9cbeaeea-0b87-4368-99cc-4968cb202061 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:54.447311 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-9cbeaeea-0b87-4368-99cc-4968cb202061 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:54.455127 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9cbeaeea-0b87-4368-99cc-4968cb202061 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:54.455569 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9cbeaeea-0b87-4368-99cc-4968cb202061 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:54.456385 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9cbeaeea-0b87-4368-99cc-4968cb202061 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:54.456818 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9cbeaeea-0b87-4368-99cc-4968cb202061 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:54.489914 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-9cbeaeea-0b87-4368-99cc-4968cb202061 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047553 Jun 17 15:20:54.490491 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 579/1368] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:20:54 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:20:54.683547 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-54a0cdf5-ca33-4740-9bc1-27811a13c01c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:54.684171 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-54a0cdf5-ca33-4740-9bc1-27811a13c01c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:54.690475 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-54a0cdf5-ca33-4740-9bc1-27811a13c01c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:54.690924 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-54a0cdf5-ca33-4740-9bc1-27811a13c01c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:54.691696 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-54a0cdf5-ca33-4740-9bc1-27811a13c01c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:54.692134 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-54a0cdf5-ca33-4740-9bc1-27811a13c01c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:54.827012 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-54a0cdf5-ca33-4740-9bc1-27811a13c01c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:20:54.834628 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-54a0cdf5-ca33-4740-9bc1-27811a13c01c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.154944 Jun 17 15:20:54.835197 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 790/1369] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:20:54 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:20:55.334181 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-3c178154-7af9-427b-9f12-73db34ee0f34 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:55.334799 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-3c178154-7af9-427b-9f12-73db34ee0f34 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:55.340841 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3c178154-7af9-427b-9f12-73db34ee0f34 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:55.341537 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3c178154-7af9-427b-9f12-73db34ee0f34 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:55.342341 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3c178154-7af9-427b-9f12-73db34ee0f34 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:55.342772 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3c178154-7af9-427b-9f12-73db34ee0f34 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:55.405740 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-8a0736b2-c62c-4b76-bd1f-d2a5bd30305c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:55.407013 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-8a0736b2-c62c-4b76-bd1f-d2a5bd30305c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:55.410761 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-3c178154-7af9-427b-9f12-73db34ee0f34 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:20:55.413739 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8a0736b2-c62c-4b76-bd1f-d2a5bd30305c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:55.414185 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8a0736b2-c62c-4b76-bd1f-d2a5bd30305c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:55.414946 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8a0736b2-c62c-4b76-bd1f-d2a5bd30305c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:55.415372 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8a0736b2-c62c-4b76-bd1f-d2a5bd30305c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:55.419025 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-3c178154-7af9-427b-9f12-73db34ee0f34 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.088628 Jun 17 15:20:55.419736 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 580/1370] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:20:55 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:20:55.446364 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-8a0736b2-c62c-4b76-bd1f-d2a5bd30305c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044639 Jun 17 15:20:55.446908 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 791/1371] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:20:55 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:20:55.502169 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-bbc2e993-0856-45be-a27c-8ce28c9a5e1b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:55.503138 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-bbc2e993-0856-45be-a27c-8ce28c9a5e1b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:55.510016 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bbc2e993-0856-45be-a27c-8ce28c9a5e1b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:55.510464 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bbc2e993-0856-45be-a27c-8ce28c9a5e1b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:55.511236 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bbc2e993-0856-45be-a27c-8ce28c9a5e1b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:55.511665 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bbc2e993-0856-45be-a27c-8ce28c9a5e1b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:55.541052 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-bbc2e993-0856-45be-a27c-8ce28c9a5e1b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042877 Jun 17 15:20:55.542280 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 581/1372] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:20:55 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:20:55.852229 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-ae50138c-a192-4c08-89b2-3def88fc5ff0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:55.852926 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-ae50138c-a192-4c08-89b2-3def88fc5ff0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:55.860378 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ae50138c-a192-4c08-89b2-3def88fc5ff0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:55.860838 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ae50138c-a192-4c08-89b2-3def88fc5ff0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:55.861609 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ae50138c-a192-4c08-89b2-3def88fc5ff0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:55.862046 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ae50138c-a192-4c08-89b2-3def88fc5ff0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:56.000032 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-ae50138c-a192-4c08-89b2-3def88fc5ff0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:20:56.008139 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-ae50138c-a192-4c08-89b2-3def88fc5ff0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.161153 Jun 17 15:20:56.008810 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 792/1373] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:20:55 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:20:56.077037 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-edc611a6-9e02-4f68-8fdb-b8098a423678 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:56.077555 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-edc611a6-9e02-4f68-8fdb-b8098a423678 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:56.083569 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-edc611a6-9e02-4f68-8fdb-b8098a423678 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:56.084017 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-edc611a6-9e02-4f68-8fdb-b8098a423678 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:56.084798 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-edc611a6-9e02-4f68-8fdb-b8098a423678 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:56.085231 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-edc611a6-9e02-4f68-8fdb-b8098a423678 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:56.436339 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-328719e3-ae2c-4c49-8eaf-71b083dfacc9 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:56.437196 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-328719e3-ae2c-4c49-8eaf-71b083dfacc9 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:56.443330 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-328719e3-ae2c-4c49-8eaf-71b083dfacc9 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:56.443780 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-328719e3-ae2c-4c49-8eaf-71b083dfacc9 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:56.444637 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-328719e3-ae2c-4c49-8eaf-71b083dfacc9 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:56.445079 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-328719e3-ae2c-4c49-8eaf-71b083dfacc9 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:56.508841 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-328719e3-ae2c-4c49-8eaf-71b083dfacc9 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:20:56.517294 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-328719e3-ae2c-4c49-8eaf-71b083dfacc9 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.085287 Jun 17 15:20:56.517862 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 793/1374] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:20:56 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:20:56.522546 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-e07bdc11-fb58-43d1-8103-06401c9bc85f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:56.523460 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-e07bdc11-fb58-43d1-8103-06401c9bc85f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:56.529348 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e07bdc11-fb58-43d1-8103-06401c9bc85f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:56.529794 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e07bdc11-fb58-43d1-8103-06401c9bc85f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:56.530562 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e07bdc11-fb58-43d1-8103-06401c9bc85f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:56.530998 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e07bdc11-fb58-43d1-8103-06401c9bc85f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:56.561544 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-e07bdc11-fb58-43d1-8103-06401c9bc85f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042354 Jun 17 15:20:56.562391 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 794/1375] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:20:56 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:20:56.569858 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-750fe352-928e-4fcb-9b1f-2593bf29f7d0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:56.571253 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-750fe352-928e-4fcb-9b1f-2593bf29f7d0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:56.580856 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-750fe352-928e-4fcb-9b1f-2593bf29f7d0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:56.581314 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-750fe352-928e-4fcb-9b1f-2593bf29f7d0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:56.582097 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-750fe352-928e-4fcb-9b1f-2593bf29f7d0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:56.582536 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-750fe352-928e-4fcb-9b1f-2593bf29f7d0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:56.615487 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-750fe352-928e-4fcb-9b1f-2593bf29f7d0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051574 Jun 17 15:20:56.616052 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 795/1376] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:20:56 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:20:57.025197 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-bc6ba127-f848-4fc2-bc1c-49f961b9948d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:57.026416 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-bc6ba127-f848-4fc2-bc1c-49f961b9948d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:57.033035 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bc6ba127-f848-4fc2-bc1c-49f961b9948d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:57.033486 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bc6ba127-f848-4fc2-bc1c-49f961b9948d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:57.034252 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bc6ba127-f848-4fc2-bc1c-49f961b9948d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:57.034685 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bc6ba127-f848-4fc2-bc1c-49f961b9948d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:57.172957 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-bc6ba127-f848-4fc2-bc1c-49f961b9948d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:20:57.182964 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-bc6ba127-f848-4fc2-bc1c-49f961b9948d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.161653 Jun 17 15:20:57.183453 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 796/1377] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:20:57 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:20:57.534233 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-d5af5c64-9121-4db7-ba50-d69106d8d5d3 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:57.534938 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-d5af5c64-9121-4db7-ba50-d69106d8d5d3 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:57.541135 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d5af5c64-9121-4db7-ba50-d69106d8d5d3 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:57.541579 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d5af5c64-9121-4db7-ba50-d69106d8d5d3 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:57.542377 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d5af5c64-9121-4db7-ba50-d69106d8d5d3 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:57.542806 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d5af5c64-9121-4db7-ba50-d69106d8d5d3 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:57.605019 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-d5af5c64-9121-4db7-ba50-d69106d8d5d3 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:20:57.612492 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-d5af5c64-9121-4db7-ba50-d69106d8d5d3 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.082113 Jun 17 15:20:57.613057 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 797/1378] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:20:57 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:20:57.617759 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-c2267376-b31a-48b1-bfdd-2b7dc68f5c84 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:57.618660 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-c2267376-b31a-48b1-bfdd-2b7dc68f5c84 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:57.625455 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c2267376-b31a-48b1-bfdd-2b7dc68f5c84 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:57.625899 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c2267376-b31a-48b1-bfdd-2b7dc68f5c84 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:57.626659 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c2267376-b31a-48b1-bfdd-2b7dc68f5c84 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:57.627087 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c2267376-b31a-48b1-bfdd-2b7dc68f5c84 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:57.656524 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-c2267376-b31a-48b1-bfdd-2b7dc68f5c84 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042323 Jun 17 15:20:57.656994 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 798/1379] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:20:57 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:20:57.661530 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-f93d4101-a411-440d-a6ec-fa27ba019b20 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:57.662415 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-f93d4101-a411-440d-a6ec-fa27ba019b20 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:57.668246 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f93d4101-a411-440d-a6ec-fa27ba019b20 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:57.668719 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f93d4101-a411-440d-a6ec-fa27ba019b20 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:57.669469 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f93d4101-a411-440d-a6ec-fa27ba019b20 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:57.669896 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f93d4101-a411-440d-a6ec-fa27ba019b20 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:57.673451 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=100 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:20:57.699511 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-f93d4101-a411-440d-a6ec-fa27ba019b20 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041474 Jun 17 15:20:57.700071 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 799/1380] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:20:57 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:20:58.200188 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-045078a0-deac-40aa-b1fd-06fb27fb87ed tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:58.200839 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-045078a0-deac-40aa-b1fd-06fb27fb87ed tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:58.207351 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-045078a0-deac-40aa-b1fd-06fb27fb87ed tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:58.207805 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-045078a0-deac-40aa-b1fd-06fb27fb87ed tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:58.208595 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-045078a0-deac-40aa-b1fd-06fb27fb87ed tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:58.209029 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-045078a0-deac-40aa-b1fd-06fb27fb87ed tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:58.339463 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-045078a0-deac-40aa-b1fd-06fb27fb87ed tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:20:58.347201 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-045078a0-deac-40aa-b1fd-06fb27fb87ed tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.150994 Jun 17 15:20:58.347758 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 800/1381] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:20:58 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:20:58.629998 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-c6f1fe89-aba9-4a89-81bc-32c3317e580f tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:58.630682 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-c6f1fe89-aba9-4a89-81bc-32c3317e580f tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:58.636617 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c6f1fe89-aba9-4a89-81bc-32c3317e580f tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:58.637068 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c6f1fe89-aba9-4a89-81bc-32c3317e580f tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:58.637829 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c6f1fe89-aba9-4a89-81bc-32c3317e580f tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:58.638258 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c6f1fe89-aba9-4a89-81bc-32c3317e580f tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:58.700009 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-c6f1fe89-aba9-4a89-81bc-32c3317e580f tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:20:58.707548 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-c6f1fe89-aba9-4a89-81bc-32c3317e580f tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.081545 Jun 17 15:20:58.708107 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 801/1382] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:20:58 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:20:58.712684 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-fa975a91-95c6-44fa-ba53-65abd1330408 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:58.714081 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-fa975a91-95c6-44fa-ba53-65abd1330408 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:58.720015 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fa975a91-95c6-44fa-ba53-65abd1330408 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:58.720503 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fa975a91-95c6-44fa-ba53-65abd1330408 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:58.721256 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fa975a91-95c6-44fa-ba53-65abd1330408 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:58.721695 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fa975a91-95c6-44fa-ba53-65abd1330408 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:58.749957 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-fa975a91-95c6-44fa-ba53-65abd1330408 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040798 Jun 17 15:20:58.750510 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 802/1383] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:20:58 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:20:58.755000 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-aff52a1a-ed5c-4a5d-a386-d49777dbf474 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:58.755887 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-aff52a1a-ed5c-4a5d-a386-d49777dbf474 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:58.761473 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-aff52a1a-ed5c-4a5d-a386-d49777dbf474 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:58.761922 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-aff52a1a-ed5c-4a5d-a386-d49777dbf474 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:58.762678 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-aff52a1a-ed5c-4a5d-a386-d49777dbf474 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:58.763107 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-aff52a1a-ed5c-4a5d-a386-d49777dbf474 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:58.791326 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-aff52a1a-ed5c-4a5d-a386-d49777dbf474 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039795 Jun 17 15:20:58.792430 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 803/1384] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:20:58 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:20:59.364818 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-c456cbe8-9765-447a-bac3-6055fd9e0fe5 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:59.365447 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-c456cbe8-9765-447a-bac3-6055fd9e0fe5 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:59.372531 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c456cbe8-9765-447a-bac3-6055fd9e0fe5 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:59.372987 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c456cbe8-9765-447a-bac3-6055fd9e0fe5 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:59.373760 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c456cbe8-9765-447a-bac3-6055fd9e0fe5 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:59.374188 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c456cbe8-9765-447a-bac3-6055fd9e0fe5 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:59.509665 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-c456cbe8-9765-447a-bac3-6055fd9e0fe5 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:20:59.518425 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-c456cbe8-9765-447a-bac3-6055fd9e0fe5 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.157359 Jun 17 15:20:59.519026 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 804/1385] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:20:59 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:20:59.725244 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-53eb4b06-1eef-446f-ab74-976e44bb8f32 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:59.725891 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-53eb4b06-1eef-446f-ab74-976e44bb8f32 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:59.732242 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-53eb4b06-1eef-446f-ab74-976e44bb8f32 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:59.732718 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-53eb4b06-1eef-446f-ab74-976e44bb8f32 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:59.733493 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-53eb4b06-1eef-446f-ab74-976e44bb8f32 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:59.733926 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-53eb4b06-1eef-446f-ab74-976e44bb8f32 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:59.795421 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-53eb4b06-1eef-446f-ab74-976e44bb8f32 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:20:59.803227 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-53eb4b06-1eef-446f-ab74-976e44bb8f32 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.081998 Jun 17 15:20:59.803789 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 805/1386] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:20:59 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:20:59.809117 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-ed7c2005-7e17-4a0f-ad50-f0aa6b8c43b3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:59.810020 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-ed7c2005-7e17-4a0f-ad50-f0aa6b8c43b3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:59.816226 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ed7c2005-7e17-4a0f-ad50-f0aa6b8c43b3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:59.816716 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ed7c2005-7e17-4a0f-ad50-f0aa6b8c43b3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:59.817510 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ed7c2005-7e17-4a0f-ad50-f0aa6b8c43b3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:59.817947 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ed7c2005-7e17-4a0f-ad50-f0aa6b8c43b3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:59.847498 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-ed7c2005-7e17-4a0f-ad50-f0aa6b8c43b3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042656 Jun 17 15:20:59.848076 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 806/1387] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:20:59 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:20:59.852871 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-7050b437-ee0b-42b3-834f-488d6b0462de tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:20:59.853776 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-7050b437-ee0b-42b3-834f-488d6b0462de tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:20:59.860203 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7050b437-ee0b-42b3-834f-488d6b0462de tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:59.860688 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7050b437-ee0b-42b3-834f-488d6b0462de tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:59.861449 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7050b437-ee0b-42b3-834f-488d6b0462de tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:20:59.861874 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7050b437-ee0b-42b3-834f-488d6b0462de tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:20:59.891717 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-7050b437-ee0b-42b3-834f-488d6b0462de tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042495 Jun 17 15:20:59.892276 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 807/1388] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:20:59 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:21:00.535110 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-69bc5f5e-eb55-4c7e-8409-68652498183a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:00.535717 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-69bc5f5e-eb55-4c7e-8409-68652498183a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:00.542752 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-69bc5f5e-eb55-4c7e-8409-68652498183a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:00.543186 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-69bc5f5e-eb55-4c7e-8409-68652498183a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:00.543923 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-69bc5f5e-eb55-4c7e-8409-68652498183a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:00.544381 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-69bc5f5e-eb55-4c7e-8409-68652498183a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:00.678597 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-69bc5f5e-eb55-4c7e-8409-68652498183a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:21:00.686528 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-69bc5f5e-eb55-4c7e-8409-68652498183a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.155267 Jun 17 15:21:00.687103 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 808/1389] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:21:00 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:21:00.821085 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-f3534213-645b-4dce-abd8-9b08b8f02923 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:00.821946 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-f3534213-645b-4dce-abd8-9b08b8f02923 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:00.828230 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f3534213-645b-4dce-abd8-9b08b8f02923 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:00.828702 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f3534213-645b-4dce-abd8-9b08b8f02923 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:00.829460 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f3534213-645b-4dce-abd8-9b08b8f02923 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:00.829883 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f3534213-645b-4dce-abd8-9b08b8f02923 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:00.892701 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-f3534213-645b-4dce-abd8-9b08b8f02923 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:21:00.900485 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-f3534213-645b-4dce-abd8-9b08b8f02923 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.083241 Jun 17 15:21:00.901086 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 809/1390] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:21:00 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:21:00.905712 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-780a03d0-e04d-49b1-bb70-f8d40ff90ded tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:00.906620 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-780a03d0-e04d-49b1-bb70-f8d40ff90ded tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:00.912841 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-780a03d0-e04d-49b1-bb70-f8d40ff90ded tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:00.913281 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-780a03d0-e04d-49b1-bb70-f8d40ff90ded tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:00.914035 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-780a03d0-e04d-49b1-bb70-f8d40ff90ded tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:00.914462 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-780a03d0-e04d-49b1-bb70-f8d40ff90ded tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:00.944264 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-780a03d0-e04d-49b1-bb70-f8d40ff90ded tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042038 Jun 17 15:21:00.944782 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 810/1391] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:21:00 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:21:00.951147 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-a0763920-fcd2-411a-be9b-b1736bd2f952 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:00.952072 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-a0763920-fcd2-411a-be9b-b1736bd2f952 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:00.958483 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a0763920-fcd2-411a-be9b-b1736bd2f952 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:00.958971 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a0763920-fcd2-411a-be9b-b1736bd2f952 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:00.959749 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a0763920-fcd2-411a-be9b-b1736bd2f952 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:00.960179 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a0763920-fcd2-411a-be9b-b1736bd2f952 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:00.991054 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-a0763920-fcd2-411a-be9b-b1736bd2f952 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045178 Jun 17 15:21:00.991640 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 811/1392] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:21:00 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:21:01.703124 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-bf0ce264-1005-42d6-a16f-c296df0c2150 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:01.703741 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-bf0ce264-1005-42d6-a16f-c296df0c2150 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:01.710361 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bf0ce264-1005-42d6-a16f-c296df0c2150 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:01.710816 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bf0ce264-1005-42d6-a16f-c296df0c2150 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:01.711584 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bf0ce264-1005-42d6-a16f-c296df0c2150 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:01.712024 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bf0ce264-1005-42d6-a16f-c296df0c2150 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:01.858514 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-bf0ce264-1005-42d6-a16f-c296df0c2150 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:21:01.866525 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-bf0ce264-1005-42d6-a16f-c296df0c2150 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.167282 Jun 17 15:21:01.867136 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 812/1393] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:21:01 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:21:01.917783 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-01e1ded0-82f4-4a11-869a-9fc3533d0f23 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:01.918394 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-01e1ded0-82f4-4a11-869a-9fc3533d0f23 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:01.924696 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-01e1ded0-82f4-4a11-869a-9fc3533d0f23 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:01.925151 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-01e1ded0-82f4-4a11-869a-9fc3533d0f23 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:01.925938 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-01e1ded0-82f4-4a11-869a-9fc3533d0f23 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:01.926507 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-01e1ded0-82f4-4a11-869a-9fc3533d0f23 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:01.990319 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-01e1ded0-82f4-4a11-869a-9fc3533d0f23 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:21:01.999675 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-01e1ded0-82f4-4a11-869a-9fc3533d0f23 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.085730 Jun 17 15:21:02.000267 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 813/1394] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:21:01 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:21:02.005366 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-2025bda6-520f-4bcd-8c75-624ca5bb7c81 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:02.006398 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-2025bda6-520f-4bcd-8c75-624ca5bb7c81 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:02.015011 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2025bda6-520f-4bcd-8c75-624ca5bb7c81 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:02.015455 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2025bda6-520f-4bcd-8c75-624ca5bb7c81 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:02.016228 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2025bda6-520f-4bcd-8c75-624ca5bb7c81 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:02.016676 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2025bda6-520f-4bcd-8c75-624ca5bb7c81 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:02.051736 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-2025bda6-520f-4bcd-8c75-624ca5bb7c81 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050205 Jun 17 15:21:02.052377 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 814/1395] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:21:02 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:21:02.057846 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-867c22f9-e854-4a03-81ad-a3c8a905d52d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:02.058789 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-867c22f9-e854-4a03-81ad-a3c8a905d52d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:02.061956 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_api:SELECT=100 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:21:02.066259 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-867c22f9-e854-4a03-81ad-a3c8a905d52d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:02.066696 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-867c22f9-e854-4a03-81ad-a3c8a905d52d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:02.067494 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-867c22f9-e854-4a03-81ad-a3c8a905d52d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:02.067936 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-867c22f9-e854-4a03-81ad-a3c8a905d52d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:02.098678 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=100 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:21:02.103886 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-867c22f9-e854-4a03-81ad-a3c8a905d52d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050348 Jun 17 15:21:02.104528 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 815/1396] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:21:02 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:21:02.883021 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-34f8d8a5-86d6-4c94-9628-fb790411670d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:02.883684 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-34f8d8a5-86d6-4c94-9628-fb790411670d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:02.890668 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-34f8d8a5-86d6-4c94-9628-fb790411670d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:02.891117 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-34f8d8a5-86d6-4c94-9628-fb790411670d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:02.891895 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-34f8d8a5-86d6-4c94-9628-fb790411670d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:02.892361 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-34f8d8a5-86d6-4c94-9628-fb790411670d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:03.027773 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-34f8d8a5-86d6-4c94-9628-fb790411670d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:21:03.037186 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-34f8d8a5-86d6-4c94-9628-fb790411670d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.157897 Jun 17 15:21:03.037767 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 816/1397] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:21:02 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:21:03.042918 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-ae5946d2-c807-4e99-b7aa-06c7e4ed8763 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:03.043523 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-ae5946d2-c807-4e99-b7aa-06c7e4ed8763 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:03.049722 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ae5946d2-c807-4e99-b7aa-06c7e4ed8763 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:03.050171 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ae5946d2-c807-4e99-b7aa-06c7e4ed8763 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:03.050945 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ae5946d2-c807-4e99-b7aa-06c7e4ed8763 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:03.051376 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ae5946d2-c807-4e99-b7aa-06c7e4ed8763 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:03.113992 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-ae5946d2-c807-4e99-b7aa-06c7e4ed8763 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:21:03.122067 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-ae5946d2-c807-4e99-b7aa-06c7e4ed8763 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.083216 Jun 17 15:21:03.122664 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 817/1398] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:21:03 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:21:03.127772 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-c007b8bb-bb2e-49fb-acd4-c70f55b17418 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:03.128740 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-c007b8bb-bb2e-49fb-acd4-c70f55b17418 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:03.135063 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c007b8bb-bb2e-49fb-acd4-c70f55b17418 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:03.135420 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c007b8bb-bb2e-49fb-acd4-c70f55b17418 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:03.136187 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c007b8bb-bb2e-49fb-acd4-c70f55b17418 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:03.136645 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c007b8bb-bb2e-49fb-acd4-c70f55b17418 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:03.167035 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-c007b8bb-bb2e-49fb-acd4-c70f55b17418 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042658 Jun 17 15:21:03.167614 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 818/1399] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:21:03 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:21:03.172652 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-ccb39081-5778-4781-8e73-1c104766d027 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:03.173581 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-ccb39081-5778-4781-8e73-1c104766d027 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:03.179860 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ccb39081-5778-4781-8e73-1c104766d027 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:03.180280 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ccb39081-5778-4781-8e73-1c104766d027 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:03.181079 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ccb39081-5778-4781-8e73-1c104766d027 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:03.181506 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ccb39081-5778-4781-8e73-1c104766d027 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:03.210831 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-ccb39081-5778-4781-8e73-1c104766d027 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042083 Jun 17 15:21:03.211403 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 819/1400] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:21:03 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:21:04.056782 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-6e83a5cb-2742-4d35-9048-3d39ceebddf3 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:04.058136 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-6e83a5cb-2742-4d35-9048-3d39ceebddf3 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:04.066445 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6e83a5cb-2742-4d35-9048-3d39ceebddf3 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:04.066886 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6e83a5cb-2742-4d35-9048-3d39ceebddf3 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:04.067655 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6e83a5cb-2742-4d35-9048-3d39ceebddf3 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:04.068086 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6e83a5cb-2742-4d35-9048-3d39ceebddf3 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:04.212175 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-6e83a5cb-2742-4d35-9048-3d39ceebddf3 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:21:04.220704 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-6e83a5cb-2742-4d35-9048-3d39ceebddf3 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.169081 Jun 17 15:21:04.221270 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 820/1401] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:21:04 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:21:04.225911 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-34fe3674-0026-4a13-8d19-e0d8c50a39dc tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:04.226519 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-34fe3674-0026-4a13-8d19-e0d8c50a39dc tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:04.233235 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-34fe3674-0026-4a13-8d19-e0d8c50a39dc tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:04.233682 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-34fe3674-0026-4a13-8d19-e0d8c50a39dc tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:04.234447 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-34fe3674-0026-4a13-8d19-e0d8c50a39dc tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:04.234879 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-34fe3674-0026-4a13-8d19-e0d8c50a39dc tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:04.297566 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-34fe3674-0026-4a13-8d19-e0d8c50a39dc tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:21:04.305364 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-34fe3674-0026-4a13-8d19-e0d8c50a39dc tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.083098 Jun 17 15:21:04.305930 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 821/1402] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:21:04 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:21:04.310580 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-bd200aba-2c34-4cc2-a0c4-c6e51d7c34d1 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:04.311430 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-bd200aba-2c34-4cc2-a0c4-c6e51d7c34d1 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:04.318732 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bd200aba-2c34-4cc2-a0c4-c6e51d7c34d1 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:04.319181 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bd200aba-2c34-4cc2-a0c4-c6e51d7c34d1 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:04.319939 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bd200aba-2c34-4cc2-a0c4-c6e51d7c34d1 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:04.320394 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bd200aba-2c34-4cc2-a0c4-c6e51d7c34d1 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:04.350421 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-bd200aba-2c34-4cc2-a0c4-c6e51d7c34d1 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043416 Jun 17 15:21:04.351000 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 822/1403] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:21:04 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:21:04.356379 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-8a01c8a2-eb2f-4575-926d-2c3816355a9d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:04.357295 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-8a01c8a2-eb2f-4575-926d-2c3816355a9d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:04.363430 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8a01c8a2-eb2f-4575-926d-2c3816355a9d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:04.363878 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8a01c8a2-eb2f-4575-926d-2c3816355a9d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:04.364669 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8a01c8a2-eb2f-4575-926d-2c3816355a9d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:04.365101 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8a01c8a2-eb2f-4575-926d-2c3816355a9d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:04.396143 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-8a01c8a2-eb2f-4575-926d-2c3816355a9d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044036 Jun 17 15:21:04.396770 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 823/1404] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:21:04 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:21:05.239300 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-9005d0de-f9eb-4c35-814b-cc35af3f0f4f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:05.240131 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-9005d0de-f9eb-4c35-814b-cc35af3f0f4f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:05.247760 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9005d0de-f9eb-4c35-814b-cc35af3f0f4f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:05.248210 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9005d0de-f9eb-4c35-814b-cc35af3f0f4f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:05.249030 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9005d0de-f9eb-4c35-814b-cc35af3f0f4f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:05.249468 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9005d0de-f9eb-4c35-814b-cc35af3f0f4f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:05.418630 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-9005d0de-f9eb-4c35-814b-cc35af3f0f4f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:21:05.426806 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-9005d0de-f9eb-4c35-814b-cc35af3f0f4f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.191866 Jun 17 15:21:05.427394 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 824/1405] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:21:05 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:21:05.432808 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-77251843-8c76-492e-acfa-96ef1acb3ab1 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:05.433423 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-77251843-8c76-492e-acfa-96ef1acb3ab1 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:05.439958 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-77251843-8c76-492e-acfa-96ef1acb3ab1 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:05.440440 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-77251843-8c76-492e-acfa-96ef1acb3ab1 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:05.441218 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-77251843-8c76-492e-acfa-96ef1acb3ab1 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:05.441644 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-77251843-8c76-492e-acfa-96ef1acb3ab1 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:05.514561 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-77251843-8c76-492e-acfa-96ef1acb3ab1 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:21:05.522720 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-77251843-8c76-492e-acfa-96ef1acb3ab1 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.094252 Jun 17 15:21:05.523299 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 825/1406] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:21:05 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:21:05.528564 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-ff9b46ef-a752-4b13-8bfd-39cc700cb90d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:05.529489 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-ff9b46ef-a752-4b13-8bfd-39cc700cb90d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:05.535820 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ff9b46ef-a752-4b13-8bfd-39cc700cb90d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:05.536267 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ff9b46ef-a752-4b13-8bfd-39cc700cb90d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:05.537067 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ff9b46ef-a752-4b13-8bfd-39cc700cb90d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:05.537493 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ff9b46ef-a752-4b13-8bfd-39cc700cb90d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:05.573774 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-ff9b46ef-a752-4b13-8bfd-39cc700cb90d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049390 Jun 17 15:21:05.574360 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 826/1407] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:21:05 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:21:05.579026 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-035ad978-579a-4cc8-9789-9774c5afb075 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:05.579932 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-035ad978-579a-4cc8-9789-9774c5afb075 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:05.585998 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-035ad978-579a-4cc8-9789-9774c5afb075 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:05.586445 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-035ad978-579a-4cc8-9789-9774c5afb075 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:05.587213 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-035ad978-579a-4cc8-9789-9774c5afb075 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:05.587645 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-035ad978-579a-4cc8-9789-9774c5afb075 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:05.622225 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-035ad978-579a-4cc8-9789-9774c5afb075 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046685 Jun 17 15:21:05.622702 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 827/1408] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:21:05 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:21:06.081229 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_api:SELECT=12 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:21:06.105009 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell1:SELECT=34 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:21:06.443757 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-a4cfcb09-7c73-4a12-8199-983a97e7e844 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:06.444394 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-a4cfcb09-7c73-4a12-8199-983a97e7e844 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:06.450943 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a4cfcb09-7c73-4a12-8199-983a97e7e844 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:06.451383 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a4cfcb09-7c73-4a12-8199-983a97e7e844 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:06.452181 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a4cfcb09-7c73-4a12-8199-983a97e7e844 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:06.452637 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a4cfcb09-7c73-4a12-8199-983a97e7e844 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:06.586735 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-a4cfcb09-7c73-4a12-8199-983a97e7e844 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:21:06.594663 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-a4cfcb09-7c73-4a12-8199-983a97e7e844 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.154776 Jun 17 15:21:06.595192 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 828/1409] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:21:06 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:21:06.599752 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-bfc3535f-423f-4fb5-8377-f19ff09b35c4 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:06.600368 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-bfc3535f-423f-4fb5-8377-f19ff09b35c4 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:06.606998 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bfc3535f-423f-4fb5-8377-f19ff09b35c4 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:06.607442 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bfc3535f-423f-4fb5-8377-f19ff09b35c4 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:06.608231 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bfc3535f-423f-4fb5-8377-f19ff09b35c4 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:06.608703 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bfc3535f-423f-4fb5-8377-f19ff09b35c4 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:06.670322 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-bfc3535f-423f-4fb5-8377-f19ff09b35c4 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:21:06.678058 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-bfc3535f-423f-4fb5-8377-f19ff09b35c4 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.081817 Jun 17 15:21:06.678628 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 829/1410] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:21:06 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:21:06.683830 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-7fa1ce5b-1e86-448f-ac0e-4b420ec5dd24 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:06.684804 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-7fa1ce5b-1e86-448f-ac0e-4b420ec5dd24 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:06.691174 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7fa1ce5b-1e86-448f-ac0e-4b420ec5dd24 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:06.691626 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7fa1ce5b-1e86-448f-ac0e-4b420ec5dd24 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:06.692470 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7fa1ce5b-1e86-448f-ac0e-4b420ec5dd24 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:06.692904 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7fa1ce5b-1e86-448f-ac0e-4b420ec5dd24 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:06.721817 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-7fa1ce5b-1e86-448f-ac0e-4b420ec5dd24 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042138 Jun 17 15:21:06.722384 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 830/1411] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:21:06 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:21:06.727128 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-8b478e3e-4329-4306-b07f-d182ea9e5d37 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:06.728021 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-8b478e3e-4329-4306-b07f-d182ea9e5d37 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:06.734342 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8b478e3e-4329-4306-b07f-d182ea9e5d37 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:06.734786 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8b478e3e-4329-4306-b07f-d182ea9e5d37 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:06.735542 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8b478e3e-4329-4306-b07f-d182ea9e5d37 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:06.735971 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8b478e3e-4329-4306-b07f-d182ea9e5d37 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:06.764612 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-8b478e3e-4329-4306-b07f-d182ea9e5d37 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041166 Jun 17 15:21:06.765166 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 831/1412] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:21:06 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:21:07.612376 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-a3237387-a65f-4e84-9034-d4a992447a98 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:07.613103 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-a3237387-a65f-4e84-9034-d4a992447a98 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:07.619621 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a3237387-a65f-4e84-9034-d4a992447a98 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:07.620068 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a3237387-a65f-4e84-9034-d4a992447a98 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:07.620892 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a3237387-a65f-4e84-9034-d4a992447a98 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:07.621332 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a3237387-a65f-4e84-9034-d4a992447a98 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:07.641210 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=100 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:21:07.762774 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-a3237387-a65f-4e84-9034-d4a992447a98 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:21:07.770851 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-a3237387-a65f-4e84-9034-d4a992447a98 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.162112 Jun 17 15:21:07.771133 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 832/1413] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:21:07 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:21:07.776276 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-9107856e-4d2f-4740-ae46-6859597c4341 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:07.776910 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-9107856e-4d2f-4740-ae46-6859597c4341 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:07.783116 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9107856e-4d2f-4740-ae46-6859597c4341 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:07.783560 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9107856e-4d2f-4740-ae46-6859597c4341 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:07.784360 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9107856e-4d2f-4740-ae46-6859597c4341 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:07.784797 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9107856e-4d2f-4740-ae46-6859597c4341 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:07.847647 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-9107856e-4d2f-4740-ae46-6859597c4341 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:21:07.855397 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-9107856e-4d2f-4740-ae46-6859597c4341 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.083268 Jun 17 15:21:07.856480 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 833/1414] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:21:07 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:21:07.861301 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-fc1e66a5-1fe8-4fef-a61c-377f9e6e9e9d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:07.862230 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-fc1e66a5-1fe8-4fef-a61c-377f9e6e9e9d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:07.868488 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fc1e66a5-1fe8-4fef-a61c-377f9e6e9e9d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:07.868951 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fc1e66a5-1fe8-4fef-a61c-377f9e6e9e9d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:07.869734 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fc1e66a5-1fe8-4fef-a61c-377f9e6e9e9d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:07.870173 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fc1e66a5-1fe8-4fef-a61c-377f9e6e9e9d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:07.901540 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-fc1e66a5-1fe8-4fef-a61c-377f9e6e9e9d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043211 Jun 17 15:21:07.902036 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 834/1415] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:21:07 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:21:07.906842 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-97fb1fb8-4db7-499f-bf19-a06d4918976e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:07.907756 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-97fb1fb8-4db7-499f-bf19-a06d4918976e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:07.913880 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-97fb1fb8-4db7-499f-bf19-a06d4918976e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:07.914333 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-97fb1fb8-4db7-499f-bf19-a06d4918976e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:07.915108 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-97fb1fb8-4db7-499f-bf19-a06d4918976e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:07.915545 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-97fb1fb8-4db7-499f-bf19-a06d4918976e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:07.945999 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-97fb1fb8-4db7-499f-bf19-a06d4918976e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042870 Jun 17 15:21:07.946588 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 835/1416] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:21:07 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:21:08.787266 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-8b09beeb-9dfa-4f47-a96f-27cafe257c34 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:08.787950 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-8b09beeb-9dfa-4f47-a96f-27cafe257c34 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:08.796710 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8b09beeb-9dfa-4f47-a96f-27cafe257c34 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:08.797217 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8b09beeb-9dfa-4f47-a96f-27cafe257c34 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:08.798156 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8b09beeb-9dfa-4f47-a96f-27cafe257c34 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:08.798648 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8b09beeb-9dfa-4f47-a96f-27cafe257c34 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:08.939245 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-8b09beeb-9dfa-4f47-a96f-27cafe257c34 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:21:08.947378 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-8b09beeb-9dfa-4f47-a96f-27cafe257c34 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.164007 Jun 17 15:21:08.947983 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 836/1417] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:21:08 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:21:08.952999 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-ffcf3ea0-ed2c-4211-b393-27f8ade9b60f tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:08.953731 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-ffcf3ea0-ed2c-4211-b393-27f8ade9b60f tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:08.960306 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ffcf3ea0-ed2c-4211-b393-27f8ade9b60f tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:08.960780 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ffcf3ea0-ed2c-4211-b393-27f8ade9b60f tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:08.961557 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ffcf3ea0-ed2c-4211-b393-27f8ade9b60f tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:08.961992 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ffcf3ea0-ed2c-4211-b393-27f8ade9b60f tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:09.028415 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-ffcf3ea0-ed2c-4211-b393-27f8ade9b60f tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:21:09.036589 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-ffcf3ea0-ed2c-4211-b393-27f8ade9b60f tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.087407 Jun 17 15:21:09.037221 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 837/1418] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:21:08 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:21:09.042931 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-f0597446-cb64-4fd8-99c0-e1b620752e62 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:09.043780 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-f0597446-cb64-4fd8-99c0-e1b620752e62 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:09.051313 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f0597446-cb64-4fd8-99c0-e1b620752e62 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:09.051755 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f0597446-cb64-4fd8-99c0-e1b620752e62 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:09.052596 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f0597446-cb64-4fd8-99c0-e1b620752e62 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:09.053027 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f0597446-cb64-4fd8-99c0-e1b620752e62 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:09.084405 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-f0597446-cb64-4fd8-99c0-e1b620752e62 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046070 Jun 17 15:21:09.084987 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 838/1419] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:21:09 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:21:09.090852 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-0789e25b-8972-49ac-bffe-f0e4afbbffa1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:09.092020 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-0789e25b-8972-49ac-bffe-f0e4afbbffa1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:09.098448 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0789e25b-8972-49ac-bffe-f0e4afbbffa1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:09.098894 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0789e25b-8972-49ac-bffe-f0e4afbbffa1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:09.099679 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0789e25b-8972-49ac-bffe-f0e4afbbffa1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:09.100138 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0789e25b-8972-49ac-bffe-f0e4afbbffa1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:09.134475 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-0789e25b-8972-49ac-bffe-f0e4afbbffa1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048401 Jun 17 15:21:09.135096 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 839/1420] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:21:09 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:21:09.967287 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-1ec81012-36a5-4fee-89f1-c7b044833c00 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:09.967955 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-1ec81012-36a5-4fee-89f1-c7b044833c00 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:09.974661 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1ec81012-36a5-4fee-89f1-c7b044833c00 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:09.975113 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1ec81012-36a5-4fee-89f1-c7b044833c00 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:09.975894 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1ec81012-36a5-4fee-89f1-c7b044833c00 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:09.976467 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1ec81012-36a5-4fee-89f1-c7b044833c00 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:10.153741 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-1ec81012-36a5-4fee-89f1-c7b044833c00 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:21:10.163705 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-1ec81012-36a5-4fee-89f1-c7b044833c00 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.200594 Jun 17 15:21:10.164305 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 840/1421] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:21:09 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:21:10.169699 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-c418cf81-d62a-4369-acc3-5faff3e83137 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:10.170575 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-c418cf81-d62a-4369-acc3-5faff3e83137 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:10.177585 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c418cf81-d62a-4369-acc3-5faff3e83137 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:10.178050 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c418cf81-d62a-4369-acc3-5faff3e83137 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:10.178975 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c418cf81-d62a-4369-acc3-5faff3e83137 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:10.179379 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c418cf81-d62a-4369-acc3-5faff3e83137 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:10.246257 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-c418cf81-d62a-4369-acc3-5faff3e83137 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:21:10.254171 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-c418cf81-d62a-4369-acc3-5faff3e83137 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.088787 Jun 17 15:21:10.254758 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 841/1422] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:21:10 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:21:10.259559 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-e4466f8c-1df7-4089-95f0-82de71435e06 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:10.260527 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-e4466f8c-1df7-4089-95f0-82de71435e06 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:10.266891 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e4466f8c-1df7-4089-95f0-82de71435e06 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:10.267343 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e4466f8c-1df7-4089-95f0-82de71435e06 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:10.268124 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e4466f8c-1df7-4089-95f0-82de71435e06 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:10.268589 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e4466f8c-1df7-4089-95f0-82de71435e06 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:10.304821 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-e4466f8c-1df7-4089-95f0-82de71435e06 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048958 Jun 17 15:21:10.306084 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 842/1423] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:21:10 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:21:10.361836 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-bc9711a3-9b46-4a6c-930e-9466e4e1b311 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:10.362807 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-bc9711a3-9b46-4a6c-930e-9466e4e1b311 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:10.369116 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bc9711a3-9b46-4a6c-930e-9466e4e1b311 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:10.370122 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bc9711a3-9b46-4a6c-930e-9466e4e1b311 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:10.370908 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bc9711a3-9b46-4a6c-930e-9466e4e1b311 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:10.371318 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bc9711a3-9b46-4a6c-930e-9466e4e1b311 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:10.401655 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-bc9711a3-9b46-4a6c-930e-9466e4e1b311 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.095160 Jun 17 15:21:10.402233 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 843/1424] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:21:10 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:21:11.182113 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-02f2718e-ea5a-4898-9b23-0404e2a9ae61 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:11.182842 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-02f2718e-ea5a-4898-9b23-0404e2a9ae61 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:11.189727 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-02f2718e-ea5a-4898-9b23-0404e2a9ae61 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:11.190198 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-02f2718e-ea5a-4898-9b23-0404e2a9ae61 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:11.190972 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-02f2718e-ea5a-4898-9b23-0404e2a9ae61 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:11.191403 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-02f2718e-ea5a-4898-9b23-0404e2a9ae61 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:11.330756 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-02f2718e-ea5a-4898-9b23-0404e2a9ae61 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:21:11.338346 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-02f2718e-ea5a-4898-9b23-0404e2a9ae61 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.160208 Jun 17 15:21:11.338913 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 844/1425] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:21:11 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:21:11.343726 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-876f3f7d-d8e8-4ac5-a266-f4e227ccefff tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:11.344269 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-876f3f7d-d8e8-4ac5-a266-f4e227ccefff tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:11.350277 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-876f3f7d-d8e8-4ac5-a266-f4e227ccefff tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:11.350725 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-876f3f7d-d8e8-4ac5-a266-f4e227ccefff tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:11.351493 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-876f3f7d-d8e8-4ac5-a266-f4e227ccefff tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:11.351926 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-876f3f7d-d8e8-4ac5-a266-f4e227ccefff tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:11.414284 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-876f3f7d-d8e8-4ac5-a266-f4e227ccefff tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:21:11.421948 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-876f3f7d-d8e8-4ac5-a266-f4e227ccefff tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.082025 Jun 17 15:21:11.422519 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 845/1426] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:21:11 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:21:11.427206 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-5f24c178-d7ab-4f34-9b93-80b6a7551115 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:11.428117 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-5f24c178-d7ab-4f34-9b93-80b6a7551115 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:11.434768 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5f24c178-d7ab-4f34-9b93-80b6a7551115 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:11.435216 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5f24c178-d7ab-4f34-9b93-80b6a7551115 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:11.436022 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5f24c178-d7ab-4f34-9b93-80b6a7551115 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:11.436490 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5f24c178-d7ab-4f34-9b93-80b6a7551115 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:11.466680 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-5f24c178-d7ab-4f34-9b93-80b6a7551115 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042838 Jun 17 15:21:11.467250 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 846/1427] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:21:11 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:21:11.471855 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-68ac54ad-3172-4716-bc25-b784e91a12cb tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:11.472786 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-68ac54ad-3172-4716-bc25-b784e91a12cb tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:11.478608 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-68ac54ad-3172-4716-bc25-b784e91a12cb tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:11.479101 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-68ac54ad-3172-4716-bc25-b784e91a12cb tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:11.479857 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-68ac54ad-3172-4716-bc25-b784e91a12cb tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:11.480291 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-68ac54ad-3172-4716-bc25-b784e91a12cb tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:11.511200 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-68ac54ad-3172-4716-bc25-b784e91a12cb tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042853 Jun 17 15:21:11.511802 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 847/1428] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:21:11 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:21:12.355763 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-a54407a6-d9a0-434b-ba49-1f645f0a56d6 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:12.356488 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-a54407a6-d9a0-434b-ba49-1f645f0a56d6 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:12.363316 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a54407a6-d9a0-434b-ba49-1f645f0a56d6 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:12.363834 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a54407a6-d9a0-434b-ba49-1f645f0a56d6 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:12.364836 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a54407a6-d9a0-434b-ba49-1f645f0a56d6 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:12.365093 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a54407a6-d9a0-434b-ba49-1f645f0a56d6 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:12.516933 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-a54407a6-d9a0-434b-ba49-1f645f0a56d6 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:21:12.524923 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-a54407a6-d9a0-434b-ba49-1f645f0a56d6 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.173579 Jun 17 15:21:12.525504 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 848/1429] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:21:12 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:21:12.530908 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-0484a430-0788-4848-9df8-6b17d3ea7ba9 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:12.531529 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-0484a430-0788-4848-9df8-6b17d3ea7ba9 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:12.537938 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0484a430-0788-4848-9df8-6b17d3ea7ba9 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:12.538378 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0484a430-0788-4848-9df8-6b17d3ea7ba9 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:12.539147 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0484a430-0788-4848-9df8-6b17d3ea7ba9 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:12.539581 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0484a430-0788-4848-9df8-6b17d3ea7ba9 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:12.544020 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=100 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:21:12.604145 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-0484a430-0788-4848-9df8-6b17d3ea7ba9 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:21:12.612085 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-0484a430-0788-4848-9df8-6b17d3ea7ba9 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.084827 Jun 17 15:21:12.612619 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 849/1430] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:21:12 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:21:12.617488 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-0941d9ec-0f9d-42d5-b909-41eb86efb73b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:12.618456 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-0941d9ec-0f9d-42d5-b909-41eb86efb73b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:12.625082 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0941d9ec-0f9d-42d5-b909-41eb86efb73b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:12.625520 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0941d9ec-0f9d-42d5-b909-41eb86efb73b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:12.626718 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0941d9ec-0f9d-42d5-b909-41eb86efb73b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:12.626718 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0941d9ec-0f9d-42d5-b909-41eb86efb73b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:12.658245 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-0941d9ec-0f9d-42d5-b909-41eb86efb73b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044540 Jun 17 15:21:12.658823 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 850/1431] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:21:12 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:21:12.663655 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-e6fd3ae9-80fd-4f82-b803-a939f7582046 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:12.664608 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-e6fd3ae9-80fd-4f82-b803-a939f7582046 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:12.670878 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e6fd3ae9-80fd-4f82-b803-a939f7582046 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:12.671320 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e6fd3ae9-80fd-4f82-b803-a939f7582046 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:12.672096 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e6fd3ae9-80fd-4f82-b803-a939f7582046 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:12.672558 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e6fd3ae9-80fd-4f82-b803-a939f7582046 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:12.704058 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-e6fd3ae9-80fd-4f82-b803-a939f7582046 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044143 Jun 17 15:21:12.704672 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 851/1432] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:21:12 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:21:13.543514 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-80edb295-e821-482f-9ac9-abf7559386f8 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:13.544187 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-80edb295-e821-482f-9ac9-abf7559386f8 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:13.550817 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-80edb295-e821-482f-9ac9-abf7559386f8 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:13.551289 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-80edb295-e821-482f-9ac9-abf7559386f8 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:13.552065 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-80edb295-e821-482f-9ac9-abf7559386f8 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:13.552540 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-80edb295-e821-482f-9ac9-abf7559386f8 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:13.695370 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-80edb295-e821-482f-9ac9-abf7559386f8 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:21:13.703525 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-80edb295-e821-482f-9ac9-abf7559386f8 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.164418 Jun 17 15:21:13.704121 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 852/1433] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:21:13 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:21:13.708873 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-9e5545ef-ed5d-4e6b-b9f4-a4557ef4fcb3 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:13.709486 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-9e5545ef-ed5d-4e6b-b9f4-a4557ef4fcb3 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:13.716628 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9e5545ef-ed5d-4e6b-b9f4-a4557ef4fcb3 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:13.717106 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9e5545ef-ed5d-4e6b-b9f4-a4557ef4fcb3 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:13.717884 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9e5545ef-ed5d-4e6b-b9f4-a4557ef4fcb3 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:13.718315 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9e5545ef-ed5d-4e6b-b9f4-a4557ef4fcb3 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:13.780897 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-9e5545ef-ed5d-4e6b-b9f4-a4557ef4fcb3 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:21:13.788577 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-9e5545ef-ed5d-4e6b-b9f4-a4557ef4fcb3 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.083417 Jun 17 15:21:13.789144 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 853/1434] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:21:13 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:21:13.794438 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-c33220b5-c880-44a4-ad0d-ebf4292a6e99 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:13.795362 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-c33220b5-c880-44a4-ad0d-ebf4292a6e99 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:13.801823 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c33220b5-c880-44a4-ad0d-ebf4292a6e99 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:13.802268 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c33220b5-c880-44a4-ad0d-ebf4292a6e99 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:13.803043 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c33220b5-c880-44a4-ad0d-ebf4292a6e99 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:13.803476 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c33220b5-c880-44a4-ad0d-ebf4292a6e99 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:13.832755 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-c33220b5-c880-44a4-ad0d-ebf4292a6e99 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042484 Jun 17 15:21:13.833316 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 854/1435] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:21:13 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:21:13.838467 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-3334af5a-14c1-4ba4-9032-3ebdf3f7ba9f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:13.839382 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-3334af5a-14c1-4ba4-9032-3ebdf3f7ba9f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:13.846002 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3334af5a-14c1-4ba4-9032-3ebdf3f7ba9f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:13.846451 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3334af5a-14c1-4ba4-9032-3ebdf3f7ba9f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:13.847222 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3334af5a-14c1-4ba4-9032-3ebdf3f7ba9f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:13.847661 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3334af5a-14c1-4ba4-9032-3ebdf3f7ba9f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:13.878770 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-3334af5a-14c1-4ba4-9032-3ebdf3f7ba9f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044369 Jun 17 15:21:13.879355 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 855/1436] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:21:13 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:21:14.727310 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-7ebbb99c-5f5f-47fd-aa26-bd5d57cc2f5b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:14.728485 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-7ebbb99c-5f5f-47fd-aa26-bd5d57cc2f5b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:14.737573 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7ebbb99c-5f5f-47fd-aa26-bd5d57cc2f5b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:14.738023 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7ebbb99c-5f5f-47fd-aa26-bd5d57cc2f5b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:14.738801 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7ebbb99c-5f5f-47fd-aa26-bd5d57cc2f5b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:14.739236 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7ebbb99c-5f5f-47fd-aa26-bd5d57cc2f5b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:14.884971 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-7ebbb99c-5f5f-47fd-aa26-bd5d57cc2f5b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:21:14.893741 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-7ebbb99c-5f5f-47fd-aa26-bd5d57cc2f5b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.174037 Jun 17 15:21:14.894327 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 856/1437] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:21:14 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:21:14.898888 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-7b1e50e0-8e17-4d7c-9b9e-2d590c395db5 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:14.899495 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-7b1e50e0-8e17-4d7c-9b9e-2d590c395db5 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:14.905932 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7b1e50e0-8e17-4d7c-9b9e-2d590c395db5 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:14.906381 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7b1e50e0-8e17-4d7c-9b9e-2d590c395db5 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:14.907189 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7b1e50e0-8e17-4d7c-9b9e-2d590c395db5 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:14.907625 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7b1e50e0-8e17-4d7c-9b9e-2d590c395db5 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:14.972470 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-7b1e50e0-8e17-4d7c-9b9e-2d590c395db5 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:21:14.981280 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-7b1e50e0-8e17-4d7c-9b9e-2d590c395db5 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.085882 Jun 17 15:21:14.981870 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 857/1438] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:21:14 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:21:14.986821 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-4a99c7ff-d299-4e97-9c02-45d3a3f7751e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:14.987831 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-4a99c7ff-d299-4e97-9c02-45d3a3f7751e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:14.995085 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4a99c7ff-d299-4e97-9c02-45d3a3f7751e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:14.995607 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4a99c7ff-d299-4e97-9c02-45d3a3f7751e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:14.996991 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4a99c7ff-d299-4e97-9c02-45d3a3f7751e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:14.997973 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4a99c7ff-d299-4e97-9c02-45d3a3f7751e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:15.029316 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-4a99c7ff-d299-4e97-9c02-45d3a3f7751e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046370 Jun 17 15:21:15.029877 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 858/1439] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:21:14 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:21:15.034584 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-097798a6-893d-4e67-8a6f-b73a8ffa6102 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:15.035499 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-097798a6-893d-4e67-8a6f-b73a8ffa6102 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:15.042110 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-097798a6-893d-4e67-8a6f-b73a8ffa6102 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:15.042563 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-097798a6-893d-4e67-8a6f-b73a8ffa6102 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:15.043335 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-097798a6-893d-4e67-8a6f-b73a8ffa6102 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:15.043774 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-097798a6-893d-4e67-8a6f-b73a8ffa6102 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:15.073421 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-097798a6-893d-4e67-8a6f-b73a8ffa6102 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042466 Jun 17 15:21:15.073997 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 859/1440] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:21:15 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:21:15.911410 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-9ceaeb8e-8334-435e-a451-0d965a49540f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:15.912119 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-9ceaeb8e-8334-435e-a451-0d965a49540f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:15.919222 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9ceaeb8e-8334-435e-a451-0d965a49540f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:15.919674 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9ceaeb8e-8334-435e-a451-0d965a49540f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:15.920488 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9ceaeb8e-8334-435e-a451-0d965a49540f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:15.920923 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9ceaeb8e-8334-435e-a451-0d965a49540f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:16.070333 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-9ceaeb8e-8334-435e-a451-0d965a49540f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:21:16.079056 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-9ceaeb8e-8334-435e-a451-0d965a49540f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.171663 Jun 17 15:21:16.079757 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 860/1441] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:21:15 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:21:16.084837 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-bfabc8e3-694b-4765-aa7d-611c9da752b7 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:16.085481 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-bfabc8e3-694b-4765-aa7d-611c9da752b7 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:16.091839 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bfabc8e3-694b-4765-aa7d-611c9da752b7 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:16.092291 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bfabc8e3-694b-4765-aa7d-611c9da752b7 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:16.093086 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bfabc8e3-694b-4765-aa7d-611c9da752b7 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:16.093519 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bfabc8e3-694b-4765-aa7d-611c9da752b7 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:16.157939 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-bfabc8e3-694b-4765-aa7d-611c9da752b7 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:21:16.166687 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-bfabc8e3-694b-4765-aa7d-611c9da752b7 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.085227 Jun 17 15:21:16.167176 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 861/1442] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:21:16 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:21:16.172146 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-e41d4e3a-6bbb-4fef-a966-8b83e8bdc867 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:16.173151 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-e41d4e3a-6bbb-4fef-a966-8b83e8bdc867 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:16.179859 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e41d4e3a-6bbb-4fef-a966-8b83e8bdc867 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:16.180307 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e41d4e3a-6bbb-4fef-a966-8b83e8bdc867 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:16.181214 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e41d4e3a-6bbb-4fef-a966-8b83e8bdc867 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:16.181647 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e41d4e3a-6bbb-4fef-a966-8b83e8bdc867 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:16.214764 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-e41d4e3a-6bbb-4fef-a966-8b83e8bdc867 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046391 Jun 17 15:21:16.215887 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 862/1443] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:21:16 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:21:16.223720 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-dc9cbc80-e116-4e78-b3c6-ea4cd37a4338 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:16.224684 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-dc9cbc80-e116-4e78-b3c6-ea4cd37a4338 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:16.231769 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-dc9cbc80-e116-4e78-b3c6-ea4cd37a4338 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:16.232219 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-dc9cbc80-e116-4e78-b3c6-ea4cd37a4338 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:16.233026 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-dc9cbc80-e116-4e78-b3c6-ea4cd37a4338 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:16.233461 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-dc9cbc80-e116-4e78-b3c6-ea4cd37a4338 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:16.265148 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-dc9cbc80-e116-4e78-b3c6-ea4cd37a4338 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047755 Jun 17 15:21:16.265733 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 863/1444] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:21:16 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:21:17.104961 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-0e8ab81a-f792-4e28-a39a-f333ba4d25b8 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:17.105700 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-0e8ab81a-f792-4e28-a39a-f333ba4d25b8 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:17.112570 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0e8ab81a-f792-4e28-a39a-f333ba4d25b8 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:17.113145 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0e8ab81a-f792-4e28-a39a-f333ba4d25b8 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:17.114018 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0e8ab81a-f792-4e28-a39a-f333ba4d25b8 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:17.114619 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0e8ab81a-f792-4e28-a39a-f333ba4d25b8 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:17.254069 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-0e8ab81a-f792-4e28-a39a-f333ba4d25b8 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:21:17.262509 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-0e8ab81a-f792-4e28-a39a-f333ba4d25b8 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.161797 Jun 17 15:21:17.263076 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 864/1445] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:21:17 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:21:17.267539 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-42f13fda-21d2-4278-bb53-7d8751d2e177 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:17.268144 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-42f13fda-21d2-4278-bb53-7d8751d2e177 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:17.272727 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_api:SELECT=100 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:21:17.274906 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-42f13fda-21d2-4278-bb53-7d8751d2e177 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:17.275418 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-42f13fda-21d2-4278-bb53-7d8751d2e177 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:17.276238 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-42f13fda-21d2-4278-bb53-7d8751d2e177 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:17.276744 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-42f13fda-21d2-4278-bb53-7d8751d2e177 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:17.346384 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-42f13fda-21d2-4278-bb53-7d8751d2e177 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:21:17.351492 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=100 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:21:17.359146 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-42f13fda-21d2-4278-bb53-7d8751d2e177 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.095026 Jun 17 15:21:17.359808 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 865/1446] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:21:17 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:21:17.367958 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-5b0a9911-32d6-4c1c-b12b-e5045a2293af tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:17.369083 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-5b0a9911-32d6-4c1c-b12b-e5045a2293af tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:17.375977 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5b0a9911-32d6-4c1c-b12b-e5045a2293af tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:17.376452 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5b0a9911-32d6-4c1c-b12b-e5045a2293af tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:17.377226 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5b0a9911-32d6-4c1c-b12b-e5045a2293af tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:17.377652 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5b0a9911-32d6-4c1c-b12b-e5045a2293af tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:17.409521 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-5b0a9911-32d6-4c1c-b12b-e5045a2293af tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048275 Jun 17 15:21:17.410092 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 866/1447] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:21:17 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:21:17.414788 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-30f7a16f-061d-41c1-8263-e67cab37f4a6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:17.415724 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-30f7a16f-061d-41c1-8263-e67cab37f4a6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:17.421955 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-30f7a16f-061d-41c1-8263-e67cab37f4a6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:17.422391 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-30f7a16f-061d-41c1-8263-e67cab37f4a6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:17.423154 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-30f7a16f-061d-41c1-8263-e67cab37f4a6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:17.423578 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-30f7a16f-061d-41c1-8263-e67cab37f4a6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:17.456620 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-30f7a16f-061d-41c1-8263-e67cab37f4a6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045405 Jun 17 15:21:17.457400 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 867/1448] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:21:17 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:21:18.281682 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-fc306db0-2bc4-43ab-bebf-bc4a3f78fd20 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:18.282417 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-fc306db0-2bc4-43ab-bebf-bc4a3f78fd20 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:18.289105 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fc306db0-2bc4-43ab-bebf-bc4a3f78fd20 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:18.289550 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fc306db0-2bc4-43ab-bebf-bc4a3f78fd20 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:18.290324 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fc306db0-2bc4-43ab-bebf-bc4a3f78fd20 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:18.290757 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fc306db0-2bc4-43ab-bebf-bc4a3f78fd20 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:18.445356 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-fc306db0-2bc4-43ab-bebf-bc4a3f78fd20 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:21:18.454194 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-fc306db0-2bc4-43ab-bebf-bc4a3f78fd20 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.176329 Jun 17 15:21:18.454783 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 868/1449] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:21:18 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:21:18.459451 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-24658825-a4ac-41ed-a7b2-c73159e3746a tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:18.460065 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-24658825-a4ac-41ed-a7b2-c73159e3746a tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:18.468067 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-24658825-a4ac-41ed-a7b2-c73159e3746a tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:18.468601 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-24658825-a4ac-41ed-a7b2-c73159e3746a tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:18.469446 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-24658825-a4ac-41ed-a7b2-c73159e3746a tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:18.469917 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-24658825-a4ac-41ed-a7b2-c73159e3746a tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:18.535534 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-24658825-a4ac-41ed-a7b2-c73159e3746a tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:21:18.543510 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-24658825-a4ac-41ed-a7b2-c73159e3746a tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.087693 Jun 17 15:21:18.544093 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 869/1450] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:21:18 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:21:18.549300 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-e649f3ee-da63-4319-ab90-45bd66f527a6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:18.550229 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-e649f3ee-da63-4319-ab90-45bd66f527a6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:18.556795 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e649f3ee-da63-4319-ab90-45bd66f527a6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:18.557238 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e649f3ee-da63-4319-ab90-45bd66f527a6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:18.558012 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e649f3ee-da63-4319-ab90-45bd66f527a6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:18.558445 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e649f3ee-da63-4319-ab90-45bd66f527a6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:18.590044 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-e649f3ee-da63-4319-ab90-45bd66f527a6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044828 Jun 17 15:21:18.590622 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 870/1451] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:21:18 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:21:18.595593 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-d960e6c4-ad09-4f6d-9743-b038871fc097 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:18.596527 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-d960e6c4-ad09-4f6d-9743-b038871fc097 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:18.602679 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d960e6c4-ad09-4f6d-9743-b038871fc097 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:18.603116 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d960e6c4-ad09-4f6d-9743-b038871fc097 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:18.603882 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d960e6c4-ad09-4f6d-9743-b038871fc097 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:18.604312 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d960e6c4-ad09-4f6d-9743-b038871fc097 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:18.641775 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-d960e6c4-ad09-4f6d-9743-b038871fc097 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049659 Jun 17 15:21:18.642882 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 871/1452] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:21:18 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:21:19.474967 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-fb85a105-c6ff-45a1-bd7c-6a19062bbf50 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:19.475768 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-fb85a105-c6ff-45a1-bd7c-6a19062bbf50 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:19.483067 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fb85a105-c6ff-45a1-bd7c-6a19062bbf50 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:19.483530 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fb85a105-c6ff-45a1-bd7c-6a19062bbf50 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:19.484311 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fb85a105-c6ff-45a1-bd7c-6a19062bbf50 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:19.484784 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fb85a105-c6ff-45a1-bd7c-6a19062bbf50 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:19.671631 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-fb85a105-c6ff-45a1-bd7c-6a19062bbf50 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:21:19.680436 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-fb85a105-c6ff-45a1-bd7c-6a19062bbf50 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.209427 Jun 17 15:21:19.681200 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 872/1453] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:21:19 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:21:19.687010 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-2439b252-e892-410d-aa6d-72a7ccc2c6cc tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:19.687801 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-2439b252-e892-410d-aa6d-72a7ccc2c6cc tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:19.694667 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2439b252-e892-410d-aa6d-72a7ccc2c6cc tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:19.695135 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2439b252-e892-410d-aa6d-72a7ccc2c6cc tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:19.695898 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2439b252-e892-410d-aa6d-72a7ccc2c6cc tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:19.696348 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2439b252-e892-410d-aa6d-72a7ccc2c6cc tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:19.761656 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-2439b252-e892-410d-aa6d-72a7ccc2c6cc tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:21:19.769635 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-2439b252-e892-410d-aa6d-72a7ccc2c6cc tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.087298 Jun 17 15:21:19.770216 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 873/1454] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:21:19 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:21:19.774947 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-b8836b8f-f93f-4363-b8f7-822ec572b08b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:19.776390 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-b8836b8f-f93f-4363-b8f7-822ec572b08b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:19.783335 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b8836b8f-f93f-4363-b8f7-822ec572b08b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:19.783787 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b8836b8f-f93f-4363-b8f7-822ec572b08b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:19.784601 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b8836b8f-f93f-4363-b8f7-822ec572b08b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:19.785038 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b8836b8f-f93f-4363-b8f7-822ec572b08b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:19.817866 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-b8836b8f-f93f-4363-b8f7-822ec572b08b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046457 Jun 17 15:21:19.818630 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 874/1455] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:21:19 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:21:19.823878 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-06f87509-f558-42e3-af2c-0cff8c8c8093 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:19.824855 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-06f87509-f558-42e3-af2c-0cff8c8c8093 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:19.831262 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-06f87509-f558-42e3-af2c-0cff8c8c8093 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:19.831713 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-06f87509-f558-42e3-af2c-0cff8c8c8093 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:19.832556 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-06f87509-f558-42e3-af2c-0cff8c8c8093 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:19.832995 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-06f87509-f558-42e3-af2c-0cff8c8c8093 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:19.865857 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-06f87509-f558-42e3-af2c-0cff8c8c8093 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046059 Jun 17 15:21:19.866426 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 875/1456] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:21:19 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:21:20.701309 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-a203f070-c990-4a61-9a0d-913645cf9118 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:20.701986 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-a203f070-c990-4a61-9a0d-913645cf9118 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:20.708966 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a203f070-c990-4a61-9a0d-913645cf9118 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:20.709411 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a203f070-c990-4a61-9a0d-913645cf9118 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:20.710178 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a203f070-c990-4a61-9a0d-913645cf9118 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:20.710646 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a203f070-c990-4a61-9a0d-913645cf9118 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:20.859128 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-a203f070-c990-4a61-9a0d-913645cf9118 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:21:20.867343 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-a203f070-c990-4a61-9a0d-913645cf9118 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.170931 Jun 17 15:21:20.867940 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 876/1457] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:21:20 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:21:20.874662 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-e41ba79e-85a7-4491-8468-14a47fe0954b tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:20.874662 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-e41ba79e-85a7-4491-8468-14a47fe0954b tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:20.880658 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e41ba79e-85a7-4491-8468-14a47fe0954b tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:20.881103 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e41ba79e-85a7-4491-8468-14a47fe0954b tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:20.881891 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e41ba79e-85a7-4491-8468-14a47fe0954b tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:20.882353 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e41ba79e-85a7-4491-8468-14a47fe0954b tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:20.953987 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-e41ba79e-85a7-4491-8468-14a47fe0954b tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:21:20.969546 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-e41ba79e-85a7-4491-8468-14a47fe0954b tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.100060 Jun 17 15:21:20.970630 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 877/1458] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:21:20 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:21:20.979788 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-6df2caea-e560-4bc0-a157-75eba9fe435e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:20.981588 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-6df2caea-e560-4bc0-a157-75eba9fe435e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:20.993203 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6df2caea-e560-4bc0-a157-75eba9fe435e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:20.993940 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6df2caea-e560-4bc0-a157-75eba9fe435e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:20.995894 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6df2caea-e560-4bc0-a157-75eba9fe435e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:20.996747 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6df2caea-e560-4bc0-a157-75eba9fe435e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:21.046835 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-6df2caea-e560-4bc0-a157-75eba9fe435e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074634 Jun 17 15:21:21.047438 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 878/1459] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:21:20 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:21:21.052478 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-9d7a72ca-2585-4053-8e29-8e742c0ed077 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:21.053436 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-9d7a72ca-2585-4053-8e29-8e742c0ed077 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:21.060597 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9d7a72ca-2585-4053-8e29-8e742c0ed077 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:21.061041 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9d7a72ca-2585-4053-8e29-8e742c0ed077 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:21.061835 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9d7a72ca-2585-4053-8e29-8e742c0ed077 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:21.062266 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9d7a72ca-2585-4053-8e29-8e742c0ed077 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:21.096309 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-9d7a72ca-2585-4053-8e29-8e742c0ed077 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047747 Jun 17 15:21:21.096903 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 879/1460] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:21:21 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:21:21.887425 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-b7985058-ade5-4dba-98ef-62013bbd8974 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:21.888118 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-b7985058-ade5-4dba-98ef-62013bbd8974 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:21.895145 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b7985058-ade5-4dba-98ef-62013bbd8974 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:21.895597 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b7985058-ade5-4dba-98ef-62013bbd8974 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:21.896393 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b7985058-ade5-4dba-98ef-62013bbd8974 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:21.896860 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b7985058-ade5-4dba-98ef-62013bbd8974 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:22.045990 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-b7985058-ade5-4dba-98ef-62013bbd8974 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:21:22.054170 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-b7985058-ade5-4dba-98ef-62013bbd8974 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.170689 Jun 17 15:21:22.054762 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 880/1461] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:21:21 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:21:22.059344 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-deb6322f-32ac-4928-8511-f19a0f8b4bc8 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:22.059949 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-deb6322f-32ac-4928-8511-f19a0f8b4bc8 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:22.066196 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-deb6322f-32ac-4928-8511-f19a0f8b4bc8 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:22.066641 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-deb6322f-32ac-4928-8511-f19a0f8b4bc8 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:22.067431 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-deb6322f-32ac-4928-8511-f19a0f8b4bc8 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:22.067864 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-deb6322f-32ac-4928-8511-f19a0f8b4bc8 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:22.131932 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-deb6322f-32ac-4928-8511-f19a0f8b4bc8 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:21:22.140354 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-deb6322f-32ac-4928-8511-f19a0f8b4bc8 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.084577 Jun 17 15:21:22.140928 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 881/1462] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:21:22 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:21:22.145527 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-ec199e61-b67c-4220-bacd-06fffb8451d1 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:22.146434 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-ec199e61-b67c-4220-bacd-06fffb8451d1 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:22.153107 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ec199e61-b67c-4220-bacd-06fffb8451d1 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:22.153562 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ec199e61-b67c-4220-bacd-06fffb8451d1 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:22.154328 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ec199e61-b67c-4220-bacd-06fffb8451d1 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:22.154762 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ec199e61-b67c-4220-bacd-06fffb8451d1 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:22.171663 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=100 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:21:22.185243 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-ec199e61-b67c-4220-bacd-06fffb8451d1 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043232 Jun 17 15:21:22.187599 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 882/1463] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:21:22 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:21:22.191166 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-52c28d49-6604-43e9-a32b-df2e01b8937c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:22.192662 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-52c28d49-6604-43e9-a32b-df2e01b8937c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:22.199353 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-52c28d49-6604-43e9-a32b-df2e01b8937c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:22.199812 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-52c28d49-6604-43e9-a32b-df2e01b8937c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:22.200640 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-52c28d49-6604-43e9-a32b-df2e01b8937c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:22.201076 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-52c28d49-6604-43e9-a32b-df2e01b8937c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:22.234784 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-52c28d49-6604-43e9-a32b-df2e01b8937c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047717 Jun 17 15:21:22.235283 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 883/1464] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:21:22 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:21:23.071794 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-3611520c-12ed-4bed-82e5-d3886e2764c7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:23.072446 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-3611520c-12ed-4bed-82e5-d3886e2764c7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:23.078902 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3611520c-12ed-4bed-82e5-d3886e2764c7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:23.079341 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3611520c-12ed-4bed-82e5-d3886e2764c7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:23.080095 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3611520c-12ed-4bed-82e5-d3886e2764c7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:23.080554 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3611520c-12ed-4bed-82e5-d3886e2764c7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:23.266740 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-3611520c-12ed-4bed-82e5-d3886e2764c7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:21:23.274458 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-3611520c-12ed-4bed-82e5-d3886e2764c7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.206574 Jun 17 15:21:23.275035 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 884/1465] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:21:23 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:21:23.280032 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-e5f23f83-1537-4520-b363-e04948990985 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:23.280661 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-e5f23f83-1537-4520-b363-e04948990985 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:23.286711 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e5f23f83-1537-4520-b363-e04948990985 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:23.287160 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e5f23f83-1537-4520-b363-e04948990985 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:23.287935 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e5f23f83-1537-4520-b363-e04948990985 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:23.288470 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e5f23f83-1537-4520-b363-e04948990985 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:23.350505 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-e5f23f83-1537-4520-b363-e04948990985 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:21:23.358915 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-e5f23f83-1537-4520-b363-e04948990985 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.082368 Jun 17 15:21:23.359614 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 885/1466] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:21:23 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:21:23.364168 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-23349718-c1aa-4142-9645-10e0d05205ca tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:23.365183 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-23349718-c1aa-4142-9645-10e0d05205ca tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:23.371273 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-23349718-c1aa-4142-9645-10e0d05205ca tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:23.371728 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-23349718-c1aa-4142-9645-10e0d05205ca tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:23.372608 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-23349718-c1aa-4142-9645-10e0d05205ca tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:23.373035 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-23349718-c1aa-4142-9645-10e0d05205ca tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:23.402885 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-23349718-c1aa-4142-9645-10e0d05205ca tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042332 Jun 17 15:21:23.403461 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 886/1467] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:21:23 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:21:23.408114 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-fb5608a2-c835-41b6-997e-dc245a3a7556 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:23.409053 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-fb5608a2-c835-41b6-997e-dc245a3a7556 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:23.414860 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fb5608a2-c835-41b6-997e-dc245a3a7556 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:23.415320 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fb5608a2-c835-41b6-997e-dc245a3a7556 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:23.416696 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fb5608a2-c835-41b6-997e-dc245a3a7556 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:23.417140 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fb5608a2-c835-41b6-997e-dc245a3a7556 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:23.447513 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-fb5608a2-c835-41b6-997e-dc245a3a7556 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042943 Jun 17 15:21:23.448083 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 887/1468] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:21:23 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:21:24.291102 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-bc578d65-0a8b-4d89-8847-ff53e11e87c5 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:24.291791 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-bc578d65-0a8b-4d89-8847-ff53e11e87c5 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:24.298345 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bc578d65-0a8b-4d89-8847-ff53e11e87c5 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:24.298795 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bc578d65-0a8b-4d89-8847-ff53e11e87c5 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:24.299559 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bc578d65-0a8b-4d89-8847-ff53e11e87c5 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:24.299991 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bc578d65-0a8b-4d89-8847-ff53e11e87c5 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:24.432871 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-bc578d65-0a8b-4d89-8847-ff53e11e87c5 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:21:24.440604 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-bc578d65-0a8b-4d89-8847-ff53e11e87c5 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.153378 Jun 17 15:21:24.441167 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 888/1469] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:21:24 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:21:24.445689 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-1a237da9-21b7-4542-8045-a9c715e21604 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:24.446297 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-1a237da9-21b7-4542-8045-a9c715e21604 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:24.452958 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1a237da9-21b7-4542-8045-a9c715e21604 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:24.453409 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1a237da9-21b7-4542-8045-a9c715e21604 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:24.454198 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1a237da9-21b7-4542-8045-a9c715e21604 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:24.454628 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1a237da9-21b7-4542-8045-a9c715e21604 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:24.520359 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-1a237da9-21b7-4542-8045-a9c715e21604 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:21:24.528184 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-1a237da9-21b7-4542-8045-a9c715e21604 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.085969 Jun 17 15:21:24.528801 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 889/1470] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:21:24 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:21:24.533610 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-155a0ffd-dfb3-43f7-9cc8-a5ab8c80f8bf tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:24.534531 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-155a0ffd-dfb3-43f7-9cc8-a5ab8c80f8bf tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:24.540754 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-155a0ffd-dfb3-43f7-9cc8-a5ab8c80f8bf tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:24.541742 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-155a0ffd-dfb3-43f7-9cc8-a5ab8c80f8bf tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:24.542464 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-155a0ffd-dfb3-43f7-9cc8-a5ab8c80f8bf tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:24.542894 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-155a0ffd-dfb3-43f7-9cc8-a5ab8c80f8bf tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:24.571599 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-155a0ffd-dfb3-43f7-9cc8-a5ab8c80f8bf tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041741 Jun 17 15:21:24.572158 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 890/1471] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:21:24 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:21:24.576735 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-8bdcaf43-3d4d-4651-9afa-c43726b7839b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:24.577631 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-8bdcaf43-3d4d-4651-9afa-c43726b7839b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:24.583387 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8bdcaf43-3d4d-4651-9afa-c43726b7839b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:24.583836 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8bdcaf43-3d4d-4651-9afa-c43726b7839b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:24.584629 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8bdcaf43-3d4d-4651-9afa-c43726b7839b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:24.585069 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8bdcaf43-3d4d-4651-9afa-c43726b7839b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:24.613921 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-8bdcaf43-3d4d-4651-9afa-c43726b7839b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040707 Jun 17 15:21:24.614484 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 891/1472] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:21:24 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:21:25.458423 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-58daa5ee-c789-4e2a-bde3-6833f5e86c72 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:25.459146 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-58daa5ee-c789-4e2a-bde3-6833f5e86c72 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:25.466379 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-58daa5ee-c789-4e2a-bde3-6833f5e86c72 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:25.467090 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-58daa5ee-c789-4e2a-bde3-6833f5e86c72 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:25.467857 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-58daa5ee-c789-4e2a-bde3-6833f5e86c72 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:25.468289 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-58daa5ee-c789-4e2a-bde3-6833f5e86c72 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:25.604416 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-58daa5ee-c789-4e2a-bde3-6833f5e86c72 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:21:25.612287 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-58daa5ee-c789-4e2a-bde3-6833f5e86c72 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.157743 Jun 17 15:21:25.612895 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 892/1473] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:21:25 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:21:25.617538 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-abec4fc1-4d72-482c-9971-ef0318c31180 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:25.618185 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-abec4fc1-4d72-482c-9971-ef0318c31180 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:25.625317 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-abec4fc1-4d72-482c-9971-ef0318c31180 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:25.625782 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-abec4fc1-4d72-482c-9971-ef0318c31180 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:25.626560 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-abec4fc1-4d72-482c-9971-ef0318c31180 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:25.627001 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-abec4fc1-4d72-482c-9971-ef0318c31180 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:25.690547 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-abec4fc1-4d72-482c-9971-ef0318c31180 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:21:25.699936 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-abec4fc1-4d72-482c-9971-ef0318c31180 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.085984 Jun 17 15:21:25.700574 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 893/1474] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:21:25 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:21:25.705647 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-c1eb3c6d-ba60-4862-ac96-13a18c29329f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:25.706576 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-c1eb3c6d-ba60-4862-ac96-13a18c29329f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:25.713042 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c1eb3c6d-ba60-4862-ac96-13a18c29329f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:25.713520 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c1eb3c6d-ba60-4862-ac96-13a18c29329f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:25.714301 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c1eb3c6d-ba60-4862-ac96-13a18c29329f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:25.714733 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c1eb3c6d-ba60-4862-ac96-13a18c29329f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:25.746513 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-c1eb3c6d-ba60-4862-ac96-13a18c29329f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044859 Jun 17 15:21:25.747095 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 894/1475] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:21:25 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:21:25.751976 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-b42c14d4-f3b9-4d2f-ba9d-5d3f77d336e3 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:25.752918 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-b42c14d4-f3b9-4d2f-ba9d-5d3f77d336e3 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:25.759077 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b42c14d4-f3b9-4d2f-ba9d-5d3f77d336e3 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:25.759524 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b42c14d4-f3b9-4d2f-ba9d-5d3f77d336e3 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:25.760969 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b42c14d4-f3b9-4d2f-ba9d-5d3f77d336e3 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:25.761402 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b42c14d4-f3b9-4d2f-ba9d-5d3f77d336e3 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:25.791244 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-b42c14d4-f3b9-4d2f-ba9d-5d3f77d336e3 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042958 Jun 17 15:21:25.791828 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 895/1476] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:21:25 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:21:26.629974 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-8aa57c32-5f1e-4803-9855-1ae2f498612f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:26.630619 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-8aa57c32-5f1e-4803-9855-1ae2f498612f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:26.637244 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8aa57c32-5f1e-4803-9855-1ae2f498612f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:26.637717 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8aa57c32-5f1e-4803-9855-1ae2f498612f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:26.638463 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8aa57c32-5f1e-4803-9855-1ae2f498612f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:26.638895 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8aa57c32-5f1e-4803-9855-1ae2f498612f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:26.782717 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-8aa57c32-5f1e-4803-9855-1ae2f498612f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:21:26.791075 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-8aa57c32-5f1e-4803-9855-1ae2f498612f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.164994 Jun 17 15:21:26.791979 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 896/1477] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:21:26 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:21:26.796355 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-cf43c368-8eb6-4420-a1cc-23ade16f6cd4 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:26.796980 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-cf43c368-8eb6-4420-a1cc-23ade16f6cd4 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:26.803949 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cf43c368-8eb6-4420-a1cc-23ade16f6cd4 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:26.804424 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cf43c368-8eb6-4420-a1cc-23ade16f6cd4 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:26.805207 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cf43c368-8eb6-4420-a1cc-23ade16f6cd4 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:26.805638 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cf43c368-8eb6-4420-a1cc-23ade16f6cd4 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:26.868460 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-cf43c368-8eb6-4420-a1cc-23ade16f6cd4 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:21:26.876080 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-cf43c368-8eb6-4420-a1cc-23ade16f6cd4 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.083423 Jun 17 15:21:26.876682 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 897/1478] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:21:26 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:21:26.881344 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-878fe1b5-c8fa-42e0-b718-27e460da5b90 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:26.882192 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-878fe1b5-c8fa-42e0-b718-27e460da5b90 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:26.888790 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-878fe1b5-c8fa-42e0-b718-27e460da5b90 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:26.889238 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-878fe1b5-c8fa-42e0-b718-27e460da5b90 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:26.890008 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-878fe1b5-c8fa-42e0-b718-27e460da5b90 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:26.890443 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-878fe1b5-c8fa-42e0-b718-27e460da5b90 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:26.919780 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-878fe1b5-c8fa-42e0-b718-27e460da5b90 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042050 Jun 17 15:21:26.920358 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 898/1479] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:21:26 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:21:26.924946 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-6b2573c1-0bd7-47f1-9b41-66d99e074e3b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:26.925880 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-6b2573c1-0bd7-47f1-9b41-66d99e074e3b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:26.931741 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6b2573c1-0bd7-47f1-9b41-66d99e074e3b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:26.932184 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6b2573c1-0bd7-47f1-9b41-66d99e074e3b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:26.932990 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6b2573c1-0bd7-47f1-9b41-66d99e074e3b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:26.933422 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6b2573c1-0bd7-47f1-9b41-66d99e074e3b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:26.937076 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=100 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:21:26.964177 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-6b2573c1-0bd7-47f1-9b41-66d99e074e3b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042755 Jun 17 15:21:26.964888 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 899/1480] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:21:26 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:21:27.811568 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-66745182-a405-4107-b2b1-f7a999559bc1 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:27.812255 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-66745182-a405-4107-b2b1-f7a999559bc1 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:27.818915 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-66745182-a405-4107-b2b1-f7a999559bc1 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:27.819414 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-66745182-a405-4107-b2b1-f7a999559bc1 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:27.820234 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-66745182-a405-4107-b2b1-f7a999559bc1 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:27.820864 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-66745182-a405-4107-b2b1-f7a999559bc1 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:27.967864 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-66745182-a405-4107-b2b1-f7a999559bc1 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:21:27.976408 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-66745182-a405-4107-b2b1-f7a999559bc1 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.169000 Jun 17 15:21:27.977009 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 900/1481] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:21:27 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:21:27.982455 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-61d98d3e-a1b7-45b6-b1ea-33c84c3e5541 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:27.983078 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-61d98d3e-a1b7-45b6-b1ea-33c84c3e5541 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:27.989609 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-61d98d3e-a1b7-45b6-b1ea-33c84c3e5541 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:27.990060 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-61d98d3e-a1b7-45b6-b1ea-33c84c3e5541 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:27.990854 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-61d98d3e-a1b7-45b6-b1ea-33c84c3e5541 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:27.991296 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-61d98d3e-a1b7-45b6-b1ea-33c84c3e5541 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:28.057235 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-61d98d3e-a1b7-45b6-b1ea-33c84c3e5541 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:21:28.065466 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-61d98d3e-a1b7-45b6-b1ea-33c84c3e5541 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.087310 Jun 17 15:21:28.066011 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 901/1482] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:21:27 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:21:28.070716 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-ab057e36-0da6-424d-8f45-7b5b40a0e635 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:28.071642 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-ab057e36-0da6-424d-8f45-7b5b40a0e635 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:28.078194 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ab057e36-0da6-424d-8f45-7b5b40a0e635 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:28.078641 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ab057e36-0da6-424d-8f45-7b5b40a0e635 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:28.079422 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ab057e36-0da6-424d-8f45-7b5b40a0e635 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:28.079861 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ab057e36-0da6-424d-8f45-7b5b40a0e635 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:28.112514 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-ab057e36-0da6-424d-8f45-7b5b40a0e635 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045424 Jun 17 15:21:28.113104 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 902/1483] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:21:28 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:21:28.117879 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-cac731a6-6211-4c7c-9af8-2b5eb07164d0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:28.118784 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-cac731a6-6211-4c7c-9af8-2b5eb07164d0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:28.125099 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cac731a6-6211-4c7c-9af8-2b5eb07164d0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:28.125551 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cac731a6-6211-4c7c-9af8-2b5eb07164d0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:28.126334 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cac731a6-6211-4c7c-9af8-2b5eb07164d0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:28.126770 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cac731a6-6211-4c7c-9af8-2b5eb07164d0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:28.158418 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-cac731a6-6211-4c7c-9af8-2b5eb07164d0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044242 Jun 17 15:21:28.158999 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 903/1484] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:21:28 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:21:28.995705 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-b446d616-d871-4059-a031-396212837779 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:28.996872 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-b446d616-d871-4059-a031-396212837779 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:29.003277 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b446d616-d871-4059-a031-396212837779 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:29.003718 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b446d616-d871-4059-a031-396212837779 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:29.004530 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b446d616-d871-4059-a031-396212837779 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:29.004975 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b446d616-d871-4059-a031-396212837779 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:29.149849 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-b446d616-d871-4059-a031-396212837779 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:21:29.157683 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-b446d616-d871-4059-a031-396212837779 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.166885 Jun 17 15:21:29.158259 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 904/1485] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:21:28 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:21:29.162826 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-0c9b9fee-f47c-4c9b-a5c5-fcb2e8196459 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:29.163470 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-0c9b9fee-f47c-4c9b-a5c5-fcb2e8196459 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:29.171027 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0c9b9fee-f47c-4c9b-a5c5-fcb2e8196459 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:29.171479 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0c9b9fee-f47c-4c9b-a5c5-fcb2e8196459 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:29.172257 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0c9b9fee-f47c-4c9b-a5c5-fcb2e8196459 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:29.172732 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0c9b9fee-f47c-4c9b-a5c5-fcb2e8196459 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:29.239140 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-0c9b9fee-f47c-4c9b-a5c5-fcb2e8196459 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:21:29.247534 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-0c9b9fee-f47c-4c9b-a5c5-fcb2e8196459 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.088208 Jun 17 15:21:29.248022 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 905/1486] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:21:29 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:21:29.252773 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-bb144653-c383-452b-99bd-ce8006f9c3ad tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:29.253689 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-bb144653-c383-452b-99bd-ce8006f9c3ad tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:29.259870 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bb144653-c383-452b-99bd-ce8006f9c3ad tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:29.260318 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bb144653-c383-452b-99bd-ce8006f9c3ad tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:29.261118 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bb144653-c383-452b-99bd-ce8006f9c3ad tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:29.261559 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bb144653-c383-452b-99bd-ce8006f9c3ad tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:29.291804 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-bb144653-c383-452b-99bd-ce8006f9c3ad tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042111 Jun 17 15:21:29.292393 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 906/1487] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:21:29 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:21:29.297242 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-b29fdd5e-a381-4de4-966a-bff27798ec42 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:29.298149 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-b29fdd5e-a381-4de4-966a-bff27798ec42 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:29.303983 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b29fdd5e-a381-4de4-966a-bff27798ec42 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:29.304471 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b29fdd5e-a381-4de4-966a-bff27798ec42 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:29.305242 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b29fdd5e-a381-4de4-966a-bff27798ec42 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:29.305681 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b29fdd5e-a381-4de4-966a-bff27798ec42 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:29.334713 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-b29fdd5e-a381-4de4-966a-bff27798ec42 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041173 Jun 17 15:21:29.335285 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 907/1488] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:21:29 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:21:30.175781 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-afbfdc23-bf24-4e05-a232-4bffd1ef7d26 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:30.176574 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-afbfdc23-bf24-4e05-a232-4bffd1ef7d26 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:30.184439 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-afbfdc23-bf24-4e05-a232-4bffd1ef7d26 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:30.184889 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-afbfdc23-bf24-4e05-a232-4bffd1ef7d26 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:30.185672 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-afbfdc23-bf24-4e05-a232-4bffd1ef7d26 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:30.186107 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-afbfdc23-bf24-4e05-a232-4bffd1ef7d26 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:30.334020 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-afbfdc23-bf24-4e05-a232-4bffd1ef7d26 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:21:30.342412 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-afbfdc23-bf24-4e05-a232-4bffd1ef7d26 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.170084 Jun 17 15:21:30.343014 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 908/1489] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:21:30 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:21:30.347652 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-65f47ca6-adc2-4c68-ab3f-49b8d1480391 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:30.348264 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-65f47ca6-adc2-4c68-ab3f-49b8d1480391 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:30.354786 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-65f47ca6-adc2-4c68-ab3f-49b8d1480391 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:30.355238 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-65f47ca6-adc2-4c68-ab3f-49b8d1480391 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:30.356069 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-65f47ca6-adc2-4c68-ab3f-49b8d1480391 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:30.356539 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-65f47ca6-adc2-4c68-ab3f-49b8d1480391 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:30.418587 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-65f47ca6-adc2-4c68-ab3f-49b8d1480391 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:21:30.426203 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-65f47ca6-adc2-4c68-ab3f-49b8d1480391 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.082148 Jun 17 15:21:30.426706 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 909/1490] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:21:30 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:21:30.431454 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-6a7fe5ba-113c-4f49-93be-9b399e9f777d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:30.432955 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-6a7fe5ba-113c-4f49-93be-9b399e9f777d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:30.439291 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6a7fe5ba-113c-4f49-93be-9b399e9f777d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:30.439736 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6a7fe5ba-113c-4f49-93be-9b399e9f777d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:30.440552 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6a7fe5ba-113c-4f49-93be-9b399e9f777d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:30.440983 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6a7fe5ba-113c-4f49-93be-9b399e9f777d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:30.471970 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-6a7fe5ba-113c-4f49-93be-9b399e9f777d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044171 Jun 17 15:21:30.472588 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 910/1491] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:21:30 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:21:30.477229 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-53cf9fc4-ad22-4b04-aefe-569b3b327f17 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:30.478149 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-53cf9fc4-ad22-4b04-aefe-569b3b327f17 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:30.484886 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-53cf9fc4-ad22-4b04-aefe-569b3b327f17 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:30.485336 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-53cf9fc4-ad22-4b04-aefe-569b3b327f17 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:30.486095 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-53cf9fc4-ad22-4b04-aefe-569b3b327f17 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:30.486520 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-53cf9fc4-ad22-4b04-aefe-569b3b327f17 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:30.517720 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-53cf9fc4-ad22-4b04-aefe-569b3b327f17 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044062 Jun 17 15:21:30.518298 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 911/1492] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:21:30 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:21:31.360982 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-d0c7e73c-c76b-42ca-a8fb-075c698f7d85 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:31.361939 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-d0c7e73c-c76b-42ca-a8fb-075c698f7d85 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:31.368494 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d0c7e73c-c76b-42ca-a8fb-075c698f7d85 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:31.368986 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d0c7e73c-c76b-42ca-a8fb-075c698f7d85 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:31.369734 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d0c7e73c-c76b-42ca-a8fb-075c698f7d85 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:31.370167 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d0c7e73c-c76b-42ca-a8fb-075c698f7d85 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:31.516516 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-d0c7e73c-c76b-42ca-a8fb-075c698f7d85 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:21:31.525375 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-d0c7e73c-c76b-42ca-a8fb-075c698f7d85 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.168191 Jun 17 15:21:31.525984 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 912/1493] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:21:31 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:21:31.531025 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-a8e7252d-2c3e-4244-9018-b171b2457783 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:31.531653 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-a8e7252d-2c3e-4244-9018-b171b2457783 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:31.539451 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a8e7252d-2c3e-4244-9018-b171b2457783 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:31.539899 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a8e7252d-2c3e-4244-9018-b171b2457783 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:31.540743 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a8e7252d-2c3e-4244-9018-b171b2457783 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:31.541425 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a8e7252d-2c3e-4244-9018-b171b2457783 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:31.609507 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-a8e7252d-2c3e-4244-9018-b171b2457783 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:21:31.617418 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-a8e7252d-2c3e-4244-9018-b171b2457783 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.090290 Jun 17 15:21:31.617913 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 913/1494] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:21:31 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:21:31.623355 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-bf90f224-8990-4047-bd18-391197789310 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:31.624377 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-bf90f224-8990-4047-bd18-391197789310 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:31.630396 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bf90f224-8990-4047-bd18-391197789310 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:31.630840 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bf90f224-8990-4047-bd18-391197789310 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:31.631597 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bf90f224-8990-4047-bd18-391197789310 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:31.632019 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bf90f224-8990-4047-bd18-391197789310 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:31.662343 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-bf90f224-8990-4047-bd18-391197789310 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043365 Jun 17 15:21:31.662918 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 914/1495] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:21:31 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:21:31.667652 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-eedefde6-e0c1-4794-9985-7d591a86fdbe tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:31.668581 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-eedefde6-e0c1-4794-9985-7d591a86fdbe tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:31.671357 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_api:SELECT=100 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:21:31.675233 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-eedefde6-e0c1-4794-9985-7d591a86fdbe tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:31.675677 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-eedefde6-e0c1-4794-9985-7d591a86fdbe tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:31.676472 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-eedefde6-e0c1-4794-9985-7d591a86fdbe tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:31.676921 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-eedefde6-e0c1-4794-9985-7d591a86fdbe tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:31.705799 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=100 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:21:31.711033 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-eedefde6-e0c1-4794-9985-7d591a86fdbe tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047093 Jun 17 15:21:31.711607 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 915/1496] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:21:31 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:21:32.543686 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-e8174c44-d19c-460a-a5c5-b46d4a6a0a58 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:32.544409 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-e8174c44-d19c-460a-a5c5-b46d4a6a0a58 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:32.551663 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e8174c44-d19c-460a-a5c5-b46d4a6a0a58 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:32.552113 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e8174c44-d19c-460a-a5c5-b46d4a6a0a58 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:32.552914 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e8174c44-d19c-460a-a5c5-b46d4a6a0a58 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:32.553353 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e8174c44-d19c-460a-a5c5-b46d4a6a0a58 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:32.690950 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-e8174c44-d19c-460a-a5c5-b46d4a6a0a58 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:21:32.699437 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-e8174c44-d19c-460a-a5c5-b46d4a6a0a58 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.160157 Jun 17 15:21:32.700055 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 916/1497] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:21:32 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:21:32.704770 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-f2da3609-1899-4bf7-8fc5-e74483276172 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:32.705378 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-f2da3609-1899-4bf7-8fc5-e74483276172 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:32.711453 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f2da3609-1899-4bf7-8fc5-e74483276172 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:32.711905 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f2da3609-1899-4bf7-8fc5-e74483276172 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:32.713309 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f2da3609-1899-4bf7-8fc5-e74483276172 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:32.713762 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f2da3609-1899-4bf7-8fc5-e74483276172 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:32.776723 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-f2da3609-1899-4bf7-8fc5-e74483276172 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:21:32.784833 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-f2da3609-1899-4bf7-8fc5-e74483276172 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.083583 Jun 17 15:21:32.785646 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 917/1498] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:21:32 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:21:32.790713 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-cfb6da34-89e4-46ae-8085-72ebe61bba8f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:32.791854 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-cfb6da34-89e4-46ae-8085-72ebe61bba8f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:32.798939 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cfb6da34-89e4-46ae-8085-72ebe61bba8f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:32.799382 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cfb6da34-89e4-46ae-8085-72ebe61bba8f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:32.800148 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cfb6da34-89e4-46ae-8085-72ebe61bba8f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:32.800657 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cfb6da34-89e4-46ae-8085-72ebe61bba8f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:32.830843 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-cfb6da34-89e4-46ae-8085-72ebe61bba8f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043987 Jun 17 15:21:32.831414 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 918/1499] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:21:32 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:21:32.836059 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-970110f2-62c9-42db-b035-a51c59e25299 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:32.836989 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-970110f2-62c9-42db-b035-a51c59e25299 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:32.844263 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-970110f2-62c9-42db-b035-a51c59e25299 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:32.844739 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-970110f2-62c9-42db-b035-a51c59e25299 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:32.845516 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-970110f2-62c9-42db-b035-a51c59e25299 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:32.845948 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-970110f2-62c9-42db-b035-a51c59e25299 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:32.877513 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-970110f2-62c9-42db-b035-a51c59e25299 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045038 Jun 17 15:21:32.878071 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 919/1500] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:21:32 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:21:33.717329 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-04b53099-d032-42d2-a3f3-7dccdbb59810 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:33.718220 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-04b53099-d032-42d2-a3f3-7dccdbb59810 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:33.725487 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-04b53099-d032-42d2-a3f3-7dccdbb59810 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:33.725944 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-04b53099-d032-42d2-a3f3-7dccdbb59810 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:33.726764 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-04b53099-d032-42d2-a3f3-7dccdbb59810 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:33.727202 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-04b53099-d032-42d2-a3f3-7dccdbb59810 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:33.871480 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-04b53099-d032-42d2-a3f3-7dccdbb59810 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:21:33.879871 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-04b53099-d032-42d2-a3f3-7dccdbb59810 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.166879 Jun 17 15:21:33.880482 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 920/1501] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:21:33 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:21:33.885075 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-6d486e28-8c46-4da6-82b2-a9fd3be67d09 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:33.885693 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-6d486e28-8c46-4da6-82b2-a9fd3be67d09 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:33.892047 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6d486e28-8c46-4da6-82b2-a9fd3be67d09 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:33.892532 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6d486e28-8c46-4da6-82b2-a9fd3be67d09 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:33.893316 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6d486e28-8c46-4da6-82b2-a9fd3be67d09 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:33.893756 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6d486e28-8c46-4da6-82b2-a9fd3be67d09 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:33.958508 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-6d486e28-8c46-4da6-82b2-a9fd3be67d09 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:21:33.967164 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-6d486e28-8c46-4da6-82b2-a9fd3be67d09 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.085393 Jun 17 15:21:33.967812 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 921/1502] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:21:33 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:21:33.972612 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-5e493faa-6b3f-43e5-a5a2-2e41f989a452 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:33.973537 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-5e493faa-6b3f-43e5-a5a2-2e41f989a452 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:33.980485 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5e493faa-6b3f-43e5-a5a2-2e41f989a452 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:33.980934 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5e493faa-6b3f-43e5-a5a2-2e41f989a452 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:33.981715 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5e493faa-6b3f-43e5-a5a2-2e41f989a452 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:33.982155 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5e493faa-6b3f-43e5-a5a2-2e41f989a452 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:34.011354 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-5e493faa-6b3f-43e5-a5a2-2e41f989a452 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042535 Jun 17 15:21:34.011919 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 922/1503] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:21:33 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:21:34.016584 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-b0908b41-bb3a-44cb-a320-c1c78df5f047 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:34.017484 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-b0908b41-bb3a-44cb-a320-c1c78df5f047 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:34.023372 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b0908b41-bb3a-44cb-a320-c1c78df5f047 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:34.023822 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b0908b41-bb3a-44cb-a320-c1c78df5f047 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:34.024626 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b0908b41-bb3a-44cb-a320-c1c78df5f047 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:34.025064 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b0908b41-bb3a-44cb-a320-c1c78df5f047 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:34.056668 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-b0908b41-bb3a-44cb-a320-c1c78df5f047 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043518 Jun 17 15:21:34.057259 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 923/1504] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:21:34 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:21:34.903403 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-8c0e3735-c719-45da-a020-5ff8f0840271 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:34.904179 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-8c0e3735-c719-45da-a020-5ff8f0840271 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:34.911232 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8c0e3735-c719-45da-a020-5ff8f0840271 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:34.911662 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8c0e3735-c719-45da-a020-5ff8f0840271 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:34.912477 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8c0e3735-c719-45da-a020-5ff8f0840271 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:34.912905 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8c0e3735-c719-45da-a020-5ff8f0840271 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:35.066790 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-8c0e3735-c719-45da-a020-5ff8f0840271 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:21:35.075186 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-8c0e3735-c719-45da-a020-5ff8f0840271 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.175864 Jun 17 15:21:35.075920 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 924/1505] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:21:34 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:21:35.081274 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-cf789eb8-0f28-4232-8511-e2c8cab39c42 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:35.081975 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-cf789eb8-0f28-4232-8511-e2c8cab39c42 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:35.089646 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cf789eb8-0f28-4232-8511-e2c8cab39c42 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:35.090107 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cf789eb8-0f28-4232-8511-e2c8cab39c42 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:35.090908 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cf789eb8-0f28-4232-8511-e2c8cab39c42 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:35.091344 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cf789eb8-0f28-4232-8511-e2c8cab39c42 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:35.160364 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-cf789eb8-0f28-4232-8511-e2c8cab39c42 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:21:35.173636 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-cf789eb8-0f28-4232-8511-e2c8cab39c42 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.096230 Jun 17 15:21:35.174619 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 925/1506] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:21:35 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:21:35.185315 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-6ba90b79-df96-4328-8678-5ef704a25588 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:35.186739 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-6ba90b79-df96-4328-8678-5ef704a25588 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:35.196433 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6ba90b79-df96-4328-8678-5ef704a25588 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:35.196994 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6ba90b79-df96-4328-8678-5ef704a25588 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:35.197792 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6ba90b79-df96-4328-8678-5ef704a25588 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:35.198229 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6ba90b79-df96-4328-8678-5ef704a25588 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:35.229367 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-6ba90b79-df96-4328-8678-5ef704a25588 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052831 Jun 17 15:21:35.229953 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 926/1507] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:21:35 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:21:35.234821 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-ac25b81b-5e04-4da0-87df-87cb2ad9025a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:35.235731 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-ac25b81b-5e04-4da0-87df-87cb2ad9025a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:35.241857 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ac25b81b-5e04-4da0-87df-87cb2ad9025a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:35.242302 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ac25b81b-5e04-4da0-87df-87cb2ad9025a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:35.243076 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ac25b81b-5e04-4da0-87df-87cb2ad9025a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:35.243512 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ac25b81b-5e04-4da0-87df-87cb2ad9025a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:35.274360 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-ac25b81b-5e04-4da0-87df-87cb2ad9025a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043318 Jun 17 15:21:35.274958 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 927/1508] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:21:35 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:21:36.094551 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-418849ba-84ac-4fec-a626-52f542c1a40d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:36.095310 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-418849ba-84ac-4fec-a626-52f542c1a40d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:36.102265 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-418849ba-84ac-4fec-a626-52f542c1a40d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:36.102776 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-418849ba-84ac-4fec-a626-52f542c1a40d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:36.103719 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-418849ba-84ac-4fec-a626-52f542c1a40d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:36.104201 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-418849ba-84ac-4fec-a626-52f542c1a40d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:36.259307 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-418849ba-84ac-4fec-a626-52f542c1a40d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:21:36.267751 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-418849ba-84ac-4fec-a626-52f542c1a40d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.177859 Jun 17 15:21:36.268345 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 928/1509] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:21:36 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:21:36.273129 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-18256b07-cf6a-4433-af68-602a9aeb4b44 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:36.273747 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-18256b07-cf6a-4433-af68-602a9aeb4b44 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:36.280063 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-18256b07-cf6a-4433-af68-602a9aeb4b44 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:36.280560 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-18256b07-cf6a-4433-af68-602a9aeb4b44 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:36.281352 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-18256b07-cf6a-4433-af68-602a9aeb4b44 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:36.281923 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-18256b07-cf6a-4433-af68-602a9aeb4b44 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:36.345308 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-18256b07-cf6a-4433-af68-602a9aeb4b44 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:21:36.353054 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-18256b07-cf6a-4433-af68-602a9aeb4b44 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.083582 Jun 17 15:21:36.353766 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 929/1510] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:21:36 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:21:36.358704 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-4e06a7d7-8b22-4ecd-8615-36664ecc8e95 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:36.359636 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-4e06a7d7-8b22-4ecd-8615-36664ecc8e95 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:36.366107 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4e06a7d7-8b22-4ecd-8615-36664ecc8e95 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:36.366559 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4e06a7d7-8b22-4ecd-8615-36664ecc8e95 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:36.367342 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4e06a7d7-8b22-4ecd-8615-36664ecc8e95 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:36.367782 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4e06a7d7-8b22-4ecd-8615-36664ecc8e95 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:36.401928 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-4e06a7d7-8b22-4ecd-8615-36664ecc8e95 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046972 Jun 17 15:21:36.402520 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 930/1511] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:21:36 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:21:36.407349 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-5433cf3d-e496-4114-b981-8ce088ed244c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:36.408266 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-5433cf3d-e496-4114-b981-8ce088ed244c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:36.414808 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5433cf3d-e496-4114-b981-8ce088ed244c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:36.415251 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5433cf3d-e496-4114-b981-8ce088ed244c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:36.416573 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5433cf3d-e496-4114-b981-8ce088ed244c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:36.417001 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5433cf3d-e496-4114-b981-8ce088ed244c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:36.448834 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-5433cf3d-e496-4114-b981-8ce088ed244c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045206 Jun 17 15:21:36.449412 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 931/1512] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:21:36 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:21:37.286053 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-7cb89623-02a7-485e-a92f-55a71bc16876 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:37.286785 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-7cb89623-02a7-485e-a92f-55a71bc16876 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:37.294383 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7cb89623-02a7-485e-a92f-55a71bc16876 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:37.294902 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7cb89623-02a7-485e-a92f-55a71bc16876 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:37.295781 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7cb89623-02a7-485e-a92f-55a71bc16876 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:37.296311 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7cb89623-02a7-485e-a92f-55a71bc16876 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:37.320964 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=100 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:21:37.469066 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-7cb89623-02a7-485e-a92f-55a71bc16876 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:21:37.476846 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-7cb89623-02a7-485e-a92f-55a71bc16876 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.194566 Jun 17 15:21:37.477424 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 932/1513] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:21:37 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:21:37.481991 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-a9abe567-a080-4522-be6b-2a813e93aaa4 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:37.482602 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-a9abe567-a080-4522-be6b-2a813e93aaa4 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:37.488671 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a9abe567-a080-4522-be6b-2a813e93aaa4 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:37.489124 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a9abe567-a080-4522-be6b-2a813e93aaa4 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:37.489904 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a9abe567-a080-4522-be6b-2a813e93aaa4 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:37.490342 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a9abe567-a080-4522-be6b-2a813e93aaa4 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:37.558467 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-a9abe567-a080-4522-be6b-2a813e93aaa4 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:21:37.567019 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-a9abe567-a080-4522-be6b-2a813e93aaa4 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.088533 Jun 17 15:21:37.567612 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 933/1514] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:21:37 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:21:37.572998 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-67a7bf5f-701e-42da-8e40-8182a81b9df4 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:37.573946 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-67a7bf5f-701e-42da-8e40-8182a81b9df4 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:37.580416 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-67a7bf5f-701e-42da-8e40-8182a81b9df4 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:37.580870 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-67a7bf5f-701e-42da-8e40-8182a81b9df4 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:37.581658 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-67a7bf5f-701e-42da-8e40-8182a81b9df4 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:37.582095 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-67a7bf5f-701e-42da-8e40-8182a81b9df4 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:37.613442 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-67a7bf5f-701e-42da-8e40-8182a81b9df4 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044712 Jun 17 15:21:37.614155 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 934/1515] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:21:37 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:21:37.622469 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-525609d2-17c7-4337-8ffd-806221c122ee tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:37.623524 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-525609d2-17c7-4337-8ffd-806221c122ee tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:37.630708 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-525609d2-17c7-4337-8ffd-806221c122ee tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:37.631220 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-525609d2-17c7-4337-8ffd-806221c122ee tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:37.632070 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-525609d2-17c7-4337-8ffd-806221c122ee tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:37.632611 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-525609d2-17c7-4337-8ffd-806221c122ee tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:37.666078 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-525609d2-17c7-4337-8ffd-806221c122ee tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050377 Jun 17 15:21:37.666682 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 935/1516] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:21:37 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:21:38.498996 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-dff02ef6-79a4-4236-a535-9f3f206aa1b2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:38.499704 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-dff02ef6-79a4-4236-a535-9f3f206aa1b2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:38.507171 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-dff02ef6-79a4-4236-a535-9f3f206aa1b2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:38.507637 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-dff02ef6-79a4-4236-a535-9f3f206aa1b2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:38.508471 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-dff02ef6-79a4-4236-a535-9f3f206aa1b2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:38.508918 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-dff02ef6-79a4-4236-a535-9f3f206aa1b2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:38.660831 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-dff02ef6-79a4-4236-a535-9f3f206aa1b2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:21:38.668663 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-dff02ef6-79a4-4236-a535-9f3f206aa1b2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.173532 Jun 17 15:21:38.669245 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 936/1517] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:21:38 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:21:38.674005 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-c08d9389-c5db-4591-9761-96752cd6ac02 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:38.674625 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-c08d9389-c5db-4591-9761-96752cd6ac02 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:38.680768 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c08d9389-c5db-4591-9761-96752cd6ac02 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:38.681226 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c08d9389-c5db-4591-9761-96752cd6ac02 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:38.681997 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c08d9389-c5db-4591-9761-96752cd6ac02 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:38.682432 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c08d9389-c5db-4591-9761-96752cd6ac02 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:38.746783 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 15:21:38.747581 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Fri Jun 17 15:21:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments/713822dc-11e8-4f5c-ae7c-bcf41e01b06d (ip 10.222.0.48) !!! Jun 17 15:21:38.750323 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-c08d9389-c5db-4591-9761-96752cd6ac02 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:21:38.760667 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-c08d9389-c5db-4591-9761-96752cd6ac02 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.090327 Jun 17 15:21:38.761398 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 937/1518] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:21:38 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:21:38.770358 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-becc30e9-a5b6-4933-aee5-3e1e53c974dc tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:38.772010 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-becc30e9-a5b6-4933-aee5-3e1e53c974dc tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:38.781447 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-becc30e9-a5b6-4933-aee5-3e1e53c974dc tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:38.781917 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-becc30e9-a5b6-4933-aee5-3e1e53c974dc tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:38.782692 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-becc30e9-a5b6-4933-aee5-3e1e53c974dc tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:38.783132 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-becc30e9-a5b6-4933-aee5-3e1e53c974dc tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:38.813004 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-becc30e9-a5b6-4933-aee5-3e1e53c974dc tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050171 Jun 17 15:21:38.813594 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 938/1519] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:21:38 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:21:38.818347 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-35064f42-d297-4055-85cc-ca7c82d206c7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:38.819267 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-35064f42-d297-4055-85cc-ca7c82d206c7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:38.826305 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-35064f42-d297-4055-85cc-ca7c82d206c7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:38.826758 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-35064f42-d297-4055-85cc-ca7c82d206c7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:38.827567 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-35064f42-d297-4055-85cc-ca7c82d206c7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:38.828009 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-35064f42-d297-4055-85cc-ca7c82d206c7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:38.859507 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-35064f42-d297-4055-85cc-ca7c82d206c7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044834 Jun 17 15:21:38.860089 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 939/1520] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:21:38 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:21:39.693541 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-aee95c88-a728-4689-9d5b-ab9262d43ed1 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:39.694272 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-aee95c88-a728-4689-9d5b-ab9262d43ed1 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:39.701286 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-aee95c88-a728-4689-9d5b-ab9262d43ed1 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:39.701739 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-aee95c88-a728-4689-9d5b-ab9262d43ed1 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:39.702527 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-aee95c88-a728-4689-9d5b-ab9262d43ed1 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:39.702962 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-aee95c88-a728-4689-9d5b-ab9262d43ed1 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:39.851041 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-aee95c88-a728-4689-9d5b-ab9262d43ed1 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:21:39.859333 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-aee95c88-a728-4689-9d5b-ab9262d43ed1 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.169766 Jun 17 15:21:39.859914 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 940/1521] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:21:39 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:21:39.864721 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-eb18139c-25f4-4af8-aa1d-9592bd03e767 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:39.865326 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-eb18139c-25f4-4af8-aa1d-9592bd03e767 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:39.871747 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-eb18139c-25f4-4af8-aa1d-9592bd03e767 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:39.872192 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-eb18139c-25f4-4af8-aa1d-9592bd03e767 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:39.872999 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-eb18139c-25f4-4af8-aa1d-9592bd03e767 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:39.873425 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-eb18139c-25f4-4af8-aa1d-9592bd03e767 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:39.937592 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-eb18139c-25f4-4af8-aa1d-9592bd03e767 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:21:39.945580 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-eb18139c-25f4-4af8-aa1d-9592bd03e767 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.084422 Jun 17 15:21:39.946080 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 941/1522] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:21:39 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:21:39.951102 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-ca0b1923-dca6-4af6-9d6a-beb525615ce2 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:39.952027 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-ca0b1923-dca6-4af6-9d6a-beb525615ce2 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:39.958239 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ca0b1923-dca6-4af6-9d6a-beb525615ce2 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:39.958688 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ca0b1923-dca6-4af6-9d6a-beb525615ce2 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:39.959466 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ca0b1923-dca6-4af6-9d6a-beb525615ce2 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:39.959903 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ca0b1923-dca6-4af6-9d6a-beb525615ce2 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:39.991486 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-ca0b1923-dca6-4af6-9d6a-beb525615ce2 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044230 Jun 17 15:21:39.992080 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 942/1523] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:21:39 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:21:39.997209 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-5d475794-c5d3-4d99-91d2-7186f78a339f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:39.998133 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-5d475794-c5d3-4d99-91d2-7186f78a339f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:40.004536 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5d475794-c5d3-4d99-91d2-7186f78a339f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:40.004988 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5d475794-c5d3-4d99-91d2-7186f78a339f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:40.005766 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5d475794-c5d3-4d99-91d2-7186f78a339f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:40.006202 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5d475794-c5d3-4d99-91d2-7186f78a339f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:40.037128 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-5d475794-c5d3-4d99-91d2-7186f78a339f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043797 Jun 17 15:21:40.037712 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 943/1524] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:21:39 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:21:40.876356 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-b3d134a0-ac88-4cd7-a96b-8b412578f0c2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:40.877374 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-b3d134a0-ac88-4cd7-a96b-8b412578f0c2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:40.883923 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b3d134a0-ac88-4cd7-a96b-8b412578f0c2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:40.885080 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b3d134a0-ac88-4cd7-a96b-8b412578f0c2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:40.885965 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b3d134a0-ac88-4cd7-a96b-8b412578f0c2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:40.886579 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b3d134a0-ac88-4cd7-a96b-8b412578f0c2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:41.030734 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-b3d134a0-ac88-4cd7-a96b-8b412578f0c2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:21:41.038776 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-b3d134a0-ac88-4cd7-a96b-8b412578f0c2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.166335 Jun 17 15:21:41.039348 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 944/1525] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:21:40 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:21:41.045431 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-88505bed-6381-40b6-9080-74f5e4513235 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:41.045729 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-88505bed-6381-40b6-9080-74f5e4513235 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:41.055570 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-88505bed-6381-40b6-9080-74f5e4513235 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:41.056157 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-88505bed-6381-40b6-9080-74f5e4513235 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:41.057621 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-88505bed-6381-40b6-9080-74f5e4513235 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:41.058259 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-88505bed-6381-40b6-9080-74f5e4513235 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:41.134838 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-88505bed-6381-40b6-9080-74f5e4513235 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:21:41.142771 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-88505bed-6381-40b6-9080-74f5e4513235 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.102343 Jun 17 15:21:41.143357 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 945/1526] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:21:41 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:21:41.147992 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-da94b6f9-4a9b-4903-9068-8a29195110f7 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:41.149001 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-da94b6f9-4a9b-4903-9068-8a29195110f7 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:41.155315 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-da94b6f9-4a9b-4903-9068-8a29195110f7 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:41.155758 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-da94b6f9-4a9b-4903-9068-8a29195110f7 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:41.156560 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-da94b6f9-4a9b-4903-9068-8a29195110f7 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:41.156992 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-da94b6f9-4a9b-4903-9068-8a29195110f7 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:41.188641 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-da94b6f9-4a9b-4903-9068-8a29195110f7 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044180 Jun 17 15:21:41.189218 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 946/1527] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:21:41 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:21:41.193914 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-6d424d21-3da4-4f98-91bd-feda45c27c17 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:41.194817 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-6d424d21-3da4-4f98-91bd-feda45c27c17 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:41.200912 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6d424d21-3da4-4f98-91bd-feda45c27c17 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:41.201358 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6d424d21-3da4-4f98-91bd-feda45c27c17 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:41.202120 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6d424d21-3da4-4f98-91bd-feda45c27c17 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:41.202565 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6d424d21-3da4-4f98-91bd-feda45c27c17 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:41.232807 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-6d424d21-3da4-4f98-91bd-feda45c27c17 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042493 Jun 17 15:21:41.233380 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 947/1528] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:21:41 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:21:42.061951 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-274e9354-0a31-4f0b-b835-b5d13993e52a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:42.062686 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-274e9354-0a31-4f0b-b835-b5d13993e52a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:42.071656 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-274e9354-0a31-4f0b-b835-b5d13993e52a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:42.073004 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-274e9354-0a31-4f0b-b835-b5d13993e52a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:42.074222 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-274e9354-0a31-4f0b-b835-b5d13993e52a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:42.074899 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-274e9354-0a31-4f0b-b835-b5d13993e52a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:42.219705 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-274e9354-0a31-4f0b-b835-b5d13993e52a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:21:42.227682 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-274e9354-0a31-4f0b-b835-b5d13993e52a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.169623 Jun 17 15:21:42.228312 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 948/1529] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:21:42 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:21:42.232888 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-95e00a38-7ba4-4200-bba1-aa474057374e tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:42.233493 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-95e00a38-7ba4-4200-bba1-aa474057374e tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:42.239823 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-95e00a38-7ba4-4200-bba1-aa474057374e tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:42.240567 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-95e00a38-7ba4-4200-bba1-aa474057374e tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:42.241343 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-95e00a38-7ba4-4200-bba1-aa474057374e tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:42.241769 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-95e00a38-7ba4-4200-bba1-aa474057374e tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:42.246619 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=100 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:21:42.307858 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-95e00a38-7ba4-4200-bba1-aa474057374e tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:21:42.316219 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-95e00a38-7ba4-4200-bba1-aa474057374e tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.086716 Jun 17 15:21:42.316786 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 949/1530] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:21:42 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:21:42.321729 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-b526a304-794f-42cc-98e1-b0108a4e7ca7 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:42.323356 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-b526a304-794f-42cc-98e1-b0108a4e7ca7 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:42.329992 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b526a304-794f-42cc-98e1-b0108a4e7ca7 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:42.330448 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b526a304-794f-42cc-98e1-b0108a4e7ca7 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:42.331226 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b526a304-794f-42cc-98e1-b0108a4e7ca7 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:42.331650 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b526a304-794f-42cc-98e1-b0108a4e7ca7 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:42.364967 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-b526a304-794f-42cc-98e1-b0108a4e7ca7 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046960 Jun 17 15:21:42.365618 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 950/1531] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:21:42 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:21:42.374492 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-850053e8-9cc6-47d9-914b-a9acb23118c2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:42.375447 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-850053e8-9cc6-47d9-914b-a9acb23118c2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:42.381816 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-850053e8-9cc6-47d9-914b-a9acb23118c2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:42.382260 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-850053e8-9cc6-47d9-914b-a9acb23118c2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:42.383031 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-850053e8-9cc6-47d9-914b-a9acb23118c2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:42.383455 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-850053e8-9cc6-47d9-914b-a9acb23118c2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:42.418584 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-850053e8-9cc6-47d9-914b-a9acb23118c2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051505 Jun 17 15:21:42.419181 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 951/1532] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:21:42 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:21:43.245126 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-bf7bf5fe-4c8e-4301-ba72-f0f28a1e556a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:43.245895 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-bf7bf5fe-4c8e-4301-ba72-f0f28a1e556a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:43.252510 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bf7bf5fe-4c8e-4301-ba72-f0f28a1e556a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:43.252967 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bf7bf5fe-4c8e-4301-ba72-f0f28a1e556a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:43.253737 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bf7bf5fe-4c8e-4301-ba72-f0f28a1e556a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:43.254175 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bf7bf5fe-4c8e-4301-ba72-f0f28a1e556a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:43.398234 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-bf7bf5fe-4c8e-4301-ba72-f0f28a1e556a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:21:43.406510 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-bf7bf5fe-4c8e-4301-ba72-f0f28a1e556a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.165314 Jun 17 15:21:43.407091 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 952/1533] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:21:43 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:21:43.411760 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-31717da1-ec2d-499d-9e32-5fca40862373 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:43.412430 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-31717da1-ec2d-499d-9e32-5fca40862373 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:43.418857 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-31717da1-ec2d-499d-9e32-5fca40862373 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:43.419306 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-31717da1-ec2d-499d-9e32-5fca40862373 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:43.420284 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-31717da1-ec2d-499d-9e32-5fca40862373 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:43.421467 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-31717da1-ec2d-499d-9e32-5fca40862373 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:43.486324 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-31717da1-ec2d-499d-9e32-5fca40862373 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:21:43.494503 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-31717da1-ec2d-499d-9e32-5fca40862373 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.085901 Jun 17 15:21:43.495329 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 953/1534] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:21:43 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:21:43.499951 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-da3711de-1fbe-455c-8449-9e49dbe7c128 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:43.500881 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-da3711de-1fbe-455c-8449-9e49dbe7c128 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:43.507252 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-da3711de-1fbe-455c-8449-9e49dbe7c128 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:43.507704 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-da3711de-1fbe-455c-8449-9e49dbe7c128 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:43.508549 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-da3711de-1fbe-455c-8449-9e49dbe7c128 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:43.508991 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-da3711de-1fbe-455c-8449-9e49dbe7c128 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:43.538892 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-da3711de-1fbe-455c-8449-9e49dbe7c128 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042507 Jun 17 15:21:43.539484 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 954/1535] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:21:43 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:21:43.544107 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-3318dce6-6611-4e0d-9896-06481a4a82b7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:43.545036 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-3318dce6-6611-4e0d-9896-06481a4a82b7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:43.550893 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3318dce6-6611-4e0d-9896-06481a4a82b7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:43.551344 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3318dce6-6611-4e0d-9896-06481a4a82b7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:43.552108 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3318dce6-6611-4e0d-9896-06481a4a82b7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:43.552577 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3318dce6-6611-4e0d-9896-06481a4a82b7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:43.582691 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-3318dce6-6611-4e0d-9896-06481a4a82b7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042163 Jun 17 15:21:43.583257 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 955/1536] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:21:43 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:21:44.423879 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-ad69bd97-bd0b-4779-80c0-2d9611f41fbb tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:44.424613 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-ad69bd97-bd0b-4779-80c0-2d9611f41fbb tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:44.431631 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ad69bd97-bd0b-4779-80c0-2d9611f41fbb tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:44.432092 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ad69bd97-bd0b-4779-80c0-2d9611f41fbb tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:44.432903 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ad69bd97-bd0b-4779-80c0-2d9611f41fbb tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:44.433333 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ad69bd97-bd0b-4779-80c0-2d9611f41fbb tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:44.583299 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-ad69bd97-bd0b-4779-80c0-2d9611f41fbb tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:21:44.597886 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-ad69bd97-bd0b-4779-80c0-2d9611f41fbb tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.177712 Jun 17 15:21:44.598926 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 956/1537] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:21:44 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:21:44.607666 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-c2dbb706-2740-4c29-aaac-b593618ef0d1 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:44.608761 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-c2dbb706-2740-4c29-aaac-b593618ef0d1 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:44.619035 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c2dbb706-2740-4c29-aaac-b593618ef0d1 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:44.619797 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c2dbb706-2740-4c29-aaac-b593618ef0d1 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:44.621167 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c2dbb706-2740-4c29-aaac-b593618ef0d1 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:44.621931 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c2dbb706-2740-4c29-aaac-b593618ef0d1 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:44.690088 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-c2dbb706-2740-4c29-aaac-b593618ef0d1 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:21:44.698543 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-c2dbb706-2740-4c29-aaac-b593618ef0d1 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.098269 Jun 17 15:21:44.699124 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 957/1538] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:21:44 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:21:44.707544 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-0e75c4ed-6d0e-4a82-98b4-a25d518dac5d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:44.707544 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-0e75c4ed-6d0e-4a82-98b4-a25d518dac5d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:44.711264 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0e75c4ed-6d0e-4a82-98b4-a25d518dac5d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:44.711706 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0e75c4ed-6d0e-4a82-98b4-a25d518dac5d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:44.712547 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0e75c4ed-6d0e-4a82-98b4-a25d518dac5d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:44.713484 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0e75c4ed-6d0e-4a82-98b4-a25d518dac5d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:44.749793 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-0e75c4ed-6d0e-4a82-98b4-a25d518dac5d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049589 Jun 17 15:21:44.750378 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 958/1539] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:21:44 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:21:44.755124 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-51c76503-5e92-4fb6-ba92-6a9d9cdb61e7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:44.756034 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-51c76503-5e92-4fb6-ba92-6a9d9cdb61e7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:44.762879 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-51c76503-5e92-4fb6-ba92-6a9d9cdb61e7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:44.763326 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-51c76503-5e92-4fb6-ba92-6a9d9cdb61e7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:44.764109 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-51c76503-5e92-4fb6-ba92-6a9d9cdb61e7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:44.764570 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-51c76503-5e92-4fb6-ba92-6a9d9cdb61e7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:44.795448 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-51c76503-5e92-4fb6-ba92-6a9d9cdb61e7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044009 Jun 17 15:21:44.796016 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 959/1540] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:21:44 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:21:45.616801 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-41dcbaaa-dc2a-4928-859b-511d4475132b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:45.617509 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-41dcbaaa-dc2a-4928-859b-511d4475132b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:45.625108 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-41dcbaaa-dc2a-4928-859b-511d4475132b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:45.625605 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-41dcbaaa-dc2a-4928-859b-511d4475132b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:45.626431 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-41dcbaaa-dc2a-4928-859b-511d4475132b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:45.626913 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-41dcbaaa-dc2a-4928-859b-511d4475132b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:45.763519 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-41dcbaaa-dc2a-4928-859b-511d4475132b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:21:45.771767 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-41dcbaaa-dc2a-4928-859b-511d4475132b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.158844 Jun 17 15:21:45.772387 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 960/1541] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:21:45 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:21:45.777651 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-fe26583b-3b83-4acd-85d5-9d7353f62dcd tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:45.778274 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-fe26583b-3b83-4acd-85d5-9d7353f62dcd tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:45.784818 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fe26583b-3b83-4acd-85d5-9d7353f62dcd tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:45.785272 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fe26583b-3b83-4acd-85d5-9d7353f62dcd tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:45.786060 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fe26583b-3b83-4acd-85d5-9d7353f62dcd tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:45.786496 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fe26583b-3b83-4acd-85d5-9d7353f62dcd tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:45.852509 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-fe26583b-3b83-4acd-85d5-9d7353f62dcd tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:21:45.860910 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-fe26583b-3b83-4acd-85d5-9d7353f62dcd tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.087468 Jun 17 15:21:45.861493 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 961/1542] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:21:45 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:21:45.866159 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-60d2a226-99e8-444f-bcc6-1872023d81f1 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:45.867070 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-60d2a226-99e8-444f-bcc6-1872023d81f1 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:45.873400 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-60d2a226-99e8-444f-bcc6-1872023d81f1 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:45.873844 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-60d2a226-99e8-444f-bcc6-1872023d81f1 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:45.874614 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-60d2a226-99e8-444f-bcc6-1872023d81f1 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:45.875036 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-60d2a226-99e8-444f-bcc6-1872023d81f1 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:45.907918 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-60d2a226-99e8-444f-bcc6-1872023d81f1 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045313 Jun 17 15:21:45.908661 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 962/1543] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:21:45 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:21:45.913671 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-b4ddb25a-34b7-47e9-87a3-7a6f55fbb5c9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:45.914595 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-b4ddb25a-34b7-47e9-87a3-7a6f55fbb5c9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:45.922212 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b4ddb25a-34b7-47e9-87a3-7a6f55fbb5c9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:45.922654 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b4ddb25a-34b7-47e9-87a3-7a6f55fbb5c9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:45.923456 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b4ddb25a-34b7-47e9-87a3-7a6f55fbb5c9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:45.923886 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b4ddb25a-34b7-47e9-87a3-7a6f55fbb5c9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:45.958647 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-b4ddb25a-34b7-47e9-87a3-7a6f55fbb5c9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048699 Jun 17 15:21:45.959284 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 963/1544] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:21:45 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:21:46.791237 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-73af88ac-ac44-46c9-8b2b-48f8b45d7b57 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:46.791937 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-73af88ac-ac44-46c9-8b2b-48f8b45d7b57 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:46.799502 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-73af88ac-ac44-46c9-8b2b-48f8b45d7b57 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:46.800044 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-73af88ac-ac44-46c9-8b2b-48f8b45d7b57 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:46.800926 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-73af88ac-ac44-46c9-8b2b-48f8b45d7b57 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:46.801485 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-73af88ac-ac44-46c9-8b2b-48f8b45d7b57 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:46.959034 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-73af88ac-ac44-46c9-8b2b-48f8b45d7b57 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:21:46.967567 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-73af88ac-ac44-46c9-8b2b-48f8b45d7b57 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.180170 Jun 17 15:21:46.968154 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 964/1545] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:21:46 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:21:46.972914 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-916246ca-3242-436d-8018-1bee77e16c79 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:46.973532 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-916246ca-3242-436d-8018-1bee77e16c79 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:46.976509 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_api:SELECT=100 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:21:46.981292 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-916246ca-3242-436d-8018-1bee77e16c79 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:46.981745 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-916246ca-3242-436d-8018-1bee77e16c79 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:46.982529 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-916246ca-3242-436d-8018-1bee77e16c79 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:46.982978 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-916246ca-3242-436d-8018-1bee77e16c79 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:47.062928 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-916246ca-3242-436d-8018-1bee77e16c79 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:21:47.066677 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=100 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:21:47.072674 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-916246ca-3242-436d-8018-1bee77e16c79 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.103414 Jun 17 15:21:47.073409 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 965/1546] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:21:46 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:21:47.078726 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-c17b7c07-8e2c-4e1f-8ea8-3dc1ece7f09a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:47.079863 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-c17b7c07-8e2c-4e1f-8ea8-3dc1ece7f09a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:47.087096 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c17b7c07-8e2c-4e1f-8ea8-3dc1ece7f09a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:47.087549 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c17b7c07-8e2c-4e1f-8ea8-3dc1ece7f09a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:47.088358 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c17b7c07-8e2c-4e1f-8ea8-3dc1ece7f09a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:47.088803 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c17b7c07-8e2c-4e1f-8ea8-3dc1ece7f09a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:47.135120 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-c17b7c07-8e2c-4e1f-8ea8-3dc1ece7f09a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060508 Jun 17 15:21:47.135787 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 966/1547] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:21:47 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:21:47.141314 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-b2767b80-240d-4037-9931-c6ec1b2241dd tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:47.142297 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-b2767b80-240d-4037-9931-c6ec1b2241dd tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:47.151544 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b2767b80-240d-4037-9931-c6ec1b2241dd tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:47.152387 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b2767b80-240d-4037-9931-c6ec1b2241dd tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:47.153803 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b2767b80-240d-4037-9931-c6ec1b2241dd tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:47.154600 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b2767b80-240d-4037-9931-c6ec1b2241dd tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:47.212236 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-b2767b80-240d-4037-9931-c6ec1b2241dd tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.074660 Jun 17 15:21:47.213379 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 967/1548] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:21:47 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:21:47.985535 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-78a89adf-ea7e-43ac-b50a-d09a68ce806e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:47.986355 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-78a89adf-ea7e-43ac-b50a-d09a68ce806e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:47.992867 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-78a89adf-ea7e-43ac-b50a-d09a68ce806e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:47.993305 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-78a89adf-ea7e-43ac-b50a-d09a68ce806e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:47.994769 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-78a89adf-ea7e-43ac-b50a-d09a68ce806e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:47.995196 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-78a89adf-ea7e-43ac-b50a-d09a68ce806e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:48.140672 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-78a89adf-ea7e-43ac-b50a-d09a68ce806e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:21:48.147962 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-78a89adf-ea7e-43ac-b50a-d09a68ce806e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.166273 Jun 17 15:21:48.148577 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 968/1549] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:21:47 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:21:48.153304 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-ccc29b1f-6f4e-4695-a5e7-68fdffeae0de tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:48.153922 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-ccc29b1f-6f4e-4695-a5e7-68fdffeae0de tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:48.160167 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ccc29b1f-6f4e-4695-a5e7-68fdffeae0de tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:48.160646 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ccc29b1f-6f4e-4695-a5e7-68fdffeae0de tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:48.161474 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ccc29b1f-6f4e-4695-a5e7-68fdffeae0de tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:48.161903 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ccc29b1f-6f4e-4695-a5e7-68fdffeae0de tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:48.225720 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-ccc29b1f-6f4e-4695-a5e7-68fdffeae0de tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:21:48.233349 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-ccc29b1f-6f4e-4695-a5e7-68fdffeae0de tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.083757 Jun 17 15:21:48.233922 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 969/1550] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:21:48 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:21:48.238763 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-9d4a9ea9-c471-4e35-9f36-9c3c52388970 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:48.239608 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-9d4a9ea9-c471-4e35-9f36-9c3c52388970 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:48.246219 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9d4a9ea9-c471-4e35-9f36-9c3c52388970 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:48.246661 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9d4a9ea9-c471-4e35-9f36-9c3c52388970 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:48.247432 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9d4a9ea9-c471-4e35-9f36-9c3c52388970 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:48.247862 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9d4a9ea9-c471-4e35-9f36-9c3c52388970 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:48.277041 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-9d4a9ea9-c471-4e35-9f36-9c3c52388970 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042063 Jun 17 15:21:48.277606 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 970/1551] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:21:48 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:21:48.282366 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-b03ec2d9-ac7c-468e-b779-b5f2721d1b58 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:48.283264 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-b03ec2d9-ac7c-468e-b779-b5f2721d1b58 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:48.289176 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b03ec2d9-ac7c-468e-b779-b5f2721d1b58 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:48.289627 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b03ec2d9-ac7c-468e-b779-b5f2721d1b58 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:48.290387 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b03ec2d9-ac7c-468e-b779-b5f2721d1b58 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:48.290903 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b03ec2d9-ac7c-468e-b779-b5f2721d1b58 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:48.321329 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-b03ec2d9-ac7c-468e-b779-b5f2721d1b58 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042677 Jun 17 15:21:48.322417 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 971/1552] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:21:48 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:21:49.169108 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-e5a58457-b772-4700-9657-4f017466ca00 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:49.169821 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-e5a58457-b772-4700-9657-4f017466ca00 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:49.177815 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e5a58457-b772-4700-9657-4f017466ca00 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:49.178580 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e5a58457-b772-4700-9657-4f017466ca00 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:49.179755 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e5a58457-b772-4700-9657-4f017466ca00 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:49.180282 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e5a58457-b772-4700-9657-4f017466ca00 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:49.332162 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-e5a58457-b772-4700-9657-4f017466ca00 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:21:49.341716 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-e5a58457-b772-4700-9657-4f017466ca00 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.176547 Jun 17 15:21:49.342597 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 972/1553] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:21:49 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:21:49.347624 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-b137f53a-fec2-420e-af54-9af83c3206eb tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:49.348578 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-b137f53a-fec2-420e-af54-9af83c3206eb tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:49.355230 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b137f53a-fec2-420e-af54-9af83c3206eb tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:49.355674 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b137f53a-fec2-420e-af54-9af83c3206eb tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:49.356471 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b137f53a-fec2-420e-af54-9af83c3206eb tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:49.356903 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b137f53a-fec2-420e-af54-9af83c3206eb tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:49.425417 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-b137f53a-fec2-420e-af54-9af83c3206eb tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:21:49.434081 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-b137f53a-fec2-420e-af54-9af83c3206eb tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.090435 Jun 17 15:21:49.434661 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 973/1554] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:21:49 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:21:49.439499 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-af440ad7-b8ec-40d3-9bc1-ab351df57b19 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:49.440438 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-af440ad7-b8ec-40d3-9bc1-ab351df57b19 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:49.446572 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-af440ad7-b8ec-40d3-9bc1-ab351df57b19 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:49.447506 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-af440ad7-b8ec-40d3-9bc1-ab351df57b19 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:49.448271 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-af440ad7-b8ec-40d3-9bc1-ab351df57b19 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:49.448734 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-af440ad7-b8ec-40d3-9bc1-ab351df57b19 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:49.480768 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-af440ad7-b8ec-40d3-9bc1-ab351df57b19 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044899 Jun 17 15:21:49.481539 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 974/1555] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:21:49 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:21:49.489059 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-e78ba1ae-7767-4735-b601-bb4a9dd09b6d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:49.490210 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-e78ba1ae-7767-4735-b601-bb4a9dd09b6d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:49.498696 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e78ba1ae-7767-4735-b601-bb4a9dd09b6d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:49.499481 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e78ba1ae-7767-4735-b601-bb4a9dd09b6d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:49.500899 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e78ba1ae-7767-4735-b601-bb4a9dd09b6d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:49.501620 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e78ba1ae-7767-4735-b601-bb4a9dd09b6d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:49.553702 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-e78ba1ae-7767-4735-b601-bb4a9dd09b6d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.070358 Jun 17 15:21:49.554681 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 975/1556] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:21:49 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:21:50.361515 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-5a568242-09d1-4115-ab50-6972d69f3905 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:50.362307 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-5a568242-09d1-4115-ab50-6972d69f3905 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:50.369527 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5a568242-09d1-4115-ab50-6972d69f3905 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:50.369969 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5a568242-09d1-4115-ab50-6972d69f3905 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:50.370732 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5a568242-09d1-4115-ab50-6972d69f3905 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:50.371180 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5a568242-09d1-4115-ab50-6972d69f3905 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:50.510483 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-5a568242-09d1-4115-ab50-6972d69f3905 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:21:50.518157 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-5a568242-09d1-4115-ab50-6972d69f3905 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.160434 Jun 17 15:21:50.518739 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 976/1557] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:21:50 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:21:50.523357 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-bc179bc3-8ed8-49b1-bedc-357d8fcc68be tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:50.523954 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-bc179bc3-8ed8-49b1-bedc-357d8fcc68be tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:50.530327 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bc179bc3-8ed8-49b1-bedc-357d8fcc68be tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:50.530657 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bc179bc3-8ed8-49b1-bedc-357d8fcc68be tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:50.531433 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bc179bc3-8ed8-49b1-bedc-357d8fcc68be tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:50.531860 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bc179bc3-8ed8-49b1-bedc-357d8fcc68be tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:50.601656 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-bc179bc3-8ed8-49b1-bedc-357d8fcc68be tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:21:50.609336 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-bc179bc3-8ed8-49b1-bedc-357d8fcc68be tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.089627 Jun 17 15:21:50.609908 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 977/1558] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:21:50 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:21:50.614732 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-d3c12750-df2e-455e-871f-04ccc463fbb6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:50.615593 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-d3c12750-df2e-455e-871f-04ccc463fbb6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:50.622139 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d3c12750-df2e-455e-871f-04ccc463fbb6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:50.622592 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d3c12750-df2e-455e-871f-04ccc463fbb6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:50.623366 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d3c12750-df2e-455e-871f-04ccc463fbb6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:50.623805 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d3c12750-df2e-455e-871f-04ccc463fbb6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:50.654292 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-d3c12750-df2e-455e-871f-04ccc463fbb6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043318 Jun 17 15:21:50.654864 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 978/1559] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:21:50 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:21:50.659686 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-0d4a206d-d63e-401f-bf71-89fd9ea7b610 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:50.660631 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-0d4a206d-d63e-401f-bf71-89fd9ea7b610 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:50.667329 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0d4a206d-d63e-401f-bf71-89fd9ea7b610 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:50.667798 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0d4a206d-d63e-401f-bf71-89fd9ea7b610 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:50.668600 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0d4a206d-d63e-401f-bf71-89fd9ea7b610 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:50.669045 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0d4a206d-d63e-401f-bf71-89fd9ea7b610 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:50.699050 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-0d4a206d-d63e-401f-bf71-89fd9ea7b610 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043122 Jun 17 15:21:50.699643 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 979/1560] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:21:50 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:21:51.539138 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-8d6ebf06-88e7-4997-8a22-04499b4aa68e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:51.540189 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-8d6ebf06-88e7-4997-8a22-04499b4aa68e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:51.546994 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8d6ebf06-88e7-4997-8a22-04499b4aa68e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:51.547453 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8d6ebf06-88e7-4997-8a22-04499b4aa68e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:51.548355 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8d6ebf06-88e7-4997-8a22-04499b4aa68e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:51.548931 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8d6ebf06-88e7-4997-8a22-04499b4aa68e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:51.700078 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-8d6ebf06-88e7-4997-8a22-04499b4aa68e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:21:51.711135 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-8d6ebf06-88e7-4997-8a22-04499b4aa68e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.176244 Jun 17 15:21:51.711810 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 980/1561] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:21:51 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:21:51.717947 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-126c7da0-ec83-4501-8d66-791af33d45e3 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:51.718139 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-126c7da0-ec83-4501-8d66-791af33d45e3 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:51.724818 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-126c7da0-ec83-4501-8d66-791af33d45e3 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:51.725279 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-126c7da0-ec83-4501-8d66-791af33d45e3 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:51.726107 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-126c7da0-ec83-4501-8d66-791af33d45e3 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:51.726596 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-126c7da0-ec83-4501-8d66-791af33d45e3 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:51.794258 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-126c7da0-ec83-4501-8d66-791af33d45e3 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:21:51.801984 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-126c7da0-ec83-4501-8d66-791af33d45e3 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.089199 Jun 17 15:21:51.802555 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 981/1562] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:21:51 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:21:51.808088 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-c43b0bd0-611e-4427-976c-e65726017c7d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:51.809036 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-c43b0bd0-611e-4427-976c-e65726017c7d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:51.815433 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c43b0bd0-611e-4427-976c-e65726017c7d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:51.816024 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c43b0bd0-611e-4427-976c-e65726017c7d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:51.816949 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c43b0bd0-611e-4427-976c-e65726017c7d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:51.817435 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c43b0bd0-611e-4427-976c-e65726017c7d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:51.835494 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=100 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:21:51.849341 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-c43b0bd0-611e-4427-976c-e65726017c7d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045745 Jun 17 15:21:51.849912 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 982/1563] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:21:51 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:21:51.854553 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-4da9d7cb-f341-4bc7-a685-9e4e191fbecc tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:51.855450 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-4da9d7cb-f341-4bc7-a685-9e4e191fbecc tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:51.861285 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4da9d7cb-f341-4bc7-a685-9e4e191fbecc tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:51.861738 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4da9d7cb-f341-4bc7-a685-9e4e191fbecc tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:51.862499 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4da9d7cb-f341-4bc7-a685-9e4e191fbecc tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:51.862933 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4da9d7cb-f341-4bc7-a685-9e4e191fbecc tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:51.893512 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-4da9d7cb-f341-4bc7-a685-9e4e191fbecc tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042437 Jun 17 15:21:51.893998 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 983/1564] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:21:51 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:21:52.729343 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-e97b2d13-2003-4faa-84fc-ae6ca0f5ed30 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:52.730046 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-e97b2d13-2003-4faa-84fc-ae6ca0f5ed30 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:52.736971 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e97b2d13-2003-4faa-84fc-ae6ca0f5ed30 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:52.737458 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e97b2d13-2003-4faa-84fc-ae6ca0f5ed30 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:52.738268 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e97b2d13-2003-4faa-84fc-ae6ca0f5ed30 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:52.738735 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e97b2d13-2003-4faa-84fc-ae6ca0f5ed30 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:52.878796 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-e97b2d13-2003-4faa-84fc-ae6ca0f5ed30 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:21:52.893306 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-e97b2d13-2003-4faa-84fc-ae6ca0f5ed30 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.167885 Jun 17 15:21:52.894442 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 984/1565] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:21:52 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:21:52.899007 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-17a7cb99-f55f-4e58-920e-0e1d5e8443ef tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:52.901247 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-17a7cb99-f55f-4e58-920e-0e1d5e8443ef tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:52.906309 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-17a7cb99-f55f-4e58-920e-0e1d5e8443ef tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:52.906758 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-17a7cb99-f55f-4e58-920e-0e1d5e8443ef tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:52.907522 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-17a7cb99-f55f-4e58-920e-0e1d5e8443ef tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:52.907956 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-17a7cb99-f55f-4e58-920e-0e1d5e8443ef tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:52.972151 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-17a7cb99-f55f-4e58-920e-0e1d5e8443ef tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:21:52.979959 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-17a7cb99-f55f-4e58-920e-0e1d5e8443ef tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.084662 Jun 17 15:21:52.980496 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 985/1566] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:21:52 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:21:52.985501 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-396edb5f-cd9c-44c1-9de6-7fa07b1a65ab tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:52.986372 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-396edb5f-cd9c-44c1-9de6-7fa07b1a65ab tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:52.992461 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-396edb5f-cd9c-44c1-9de6-7fa07b1a65ab tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:52.992913 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-396edb5f-cd9c-44c1-9de6-7fa07b1a65ab tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:52.993682 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-396edb5f-cd9c-44c1-9de6-7fa07b1a65ab tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:52.994119 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-396edb5f-cd9c-44c1-9de6-7fa07b1a65ab tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:53.023505 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-396edb5f-cd9c-44c1-9de6-7fa07b1a65ab tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041944 Jun 17 15:21:53.024082 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 986/1567] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:21:52 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:21:53.029526 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-dc2160d6-3aa4-4c42-8e29-5a4529914e1e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:53.030469 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-dc2160d6-3aa4-4c42-8e29-5a4529914e1e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:53.036504 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-dc2160d6-3aa4-4c42-8e29-5a4529914e1e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:53.036964 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-dc2160d6-3aa4-4c42-8e29-5a4529914e1e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:53.037739 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-dc2160d6-3aa4-4c42-8e29-5a4529914e1e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:53.038186 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-dc2160d6-3aa4-4c42-8e29-5a4529914e1e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:53.068215 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-dc2160d6-3aa4-4c42-8e29-5a4529914e1e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042973 Jun 17 15:21:53.068832 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 987/1568] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:21:53 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:21:53.912949 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-0eb12c79-b7e1-46c4-ab08-2451826eca4f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:53.913645 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-0eb12c79-b7e1-46c4-ab08-2451826eca4f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:53.920228 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0eb12c79-b7e1-46c4-ab08-2451826eca4f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:53.920710 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0eb12c79-b7e1-46c4-ab08-2451826eca4f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:53.921488 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0eb12c79-b7e1-46c4-ab08-2451826eca4f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:53.921921 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0eb12c79-b7e1-46c4-ab08-2451826eca4f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:54.065478 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-0eb12c79-b7e1-46c4-ab08-2451826eca4f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:21:54.073904 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-0eb12c79-b7e1-46c4-ab08-2451826eca4f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.164845 Jun 17 15:21:54.074484 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 988/1569] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:21:53 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:21:54.079161 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-412bc603-6e5c-4b50-9b4e-ca77799d942f tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:54.079844 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-412bc603-6e5c-4b50-9b4e-ca77799d942f tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:54.086053 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-412bc603-6e5c-4b50-9b4e-ca77799d942f tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:54.086508 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-412bc603-6e5c-4b50-9b4e-ca77799d942f tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:54.087290 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-412bc603-6e5c-4b50-9b4e-ca77799d942f tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:54.087727 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-412bc603-6e5c-4b50-9b4e-ca77799d942f tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:54.150990 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-412bc603-6e5c-4b50-9b4e-ca77799d942f tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:21:54.158796 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-412bc603-6e5c-4b50-9b4e-ca77799d942f tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.083320 Jun 17 15:21:54.159372 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 989/1570] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:21:54 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:21:54.164092 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-c1040bf9-fca3-4655-8f9f-e15c6fc92587 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:54.164979 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-c1040bf9-fca3-4655-8f9f-e15c6fc92587 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:54.171115 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c1040bf9-fca3-4655-8f9f-e15c6fc92587 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:54.171564 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c1040bf9-fca3-4655-8f9f-e15c6fc92587 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:54.172350 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c1040bf9-fca3-4655-8f9f-e15c6fc92587 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:54.172803 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c1040bf9-fca3-4655-8f9f-e15c6fc92587 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:54.205637 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-c1040bf9-fca3-4655-8f9f-e15c6fc92587 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045205 Jun 17 15:21:54.206209 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 990/1571] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:21:54 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:21:54.210766 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-10741cc1-7a6b-4456-8cb3-665f886d32bb tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:21:54.211677 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-10741cc1-7a6b-4456-8cb3-665f886d32bb tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:54.217869 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-10741cc1-7a6b-4456-8cb3-665f886d32bb tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:54.218320 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-10741cc1-7a6b-4456-8cb3-665f886d32bb tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:54.219092 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-10741cc1-7a6b-4456-8cb3-665f886d32bb tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:54.219527 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-10741cc1-7a6b-4456-8cb3-665f886d32bb tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:54.315132 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-10741cc1-7a6b-4456-8cb3-665f886d32bb tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "POST /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/action" status: 200 len: 38044 microversion: 2.20 time: 0.107650 Jun 17 15:21:54.316043 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 991/1572] 10.222.0.48 () {62 vars in 1318 bytes} [Fri Jun 17 15:21:54 2022] POST /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869/action => generated 38044 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jun 17 15:21:55.092205 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-0d409bbd-6b3d-4316-82de-85ac21219d1e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:55.092924 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-0d409bbd-6b3d-4316-82de-85ac21219d1e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:55.100123 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0d409bbd-6b3d-4316-82de-85ac21219d1e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:55.100594 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0d409bbd-6b3d-4316-82de-85ac21219d1e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:55.101354 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0d409bbd-6b3d-4316-82de-85ac21219d1e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:55.101786 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0d409bbd-6b3d-4316-82de-85ac21219d1e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:55.236112 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-0d409bbd-6b3d-4316-82de-85ac21219d1e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:21:55.243806 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-0d409bbd-6b3d-4316-82de-85ac21219d1e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.156595 Jun 17 15:21:55.244650 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 992/1573] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:21:55 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:21:55.250757 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-241c0764-e868-4d8f-8852-3b367e6009ef tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:55.251362 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-241c0764-e868-4d8f-8852-3b367e6009ef tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:55.257328 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-241c0764-e868-4d8f-8852-3b367e6009ef tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:55.257778 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-241c0764-e868-4d8f-8852-3b367e6009ef tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:55.258559 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-241c0764-e868-4d8f-8852-3b367e6009ef tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:55.259000 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-241c0764-e868-4d8f-8852-3b367e6009ef tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:55.323061 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-241c0764-e868-4d8f-8852-3b367e6009ef tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:21:55.330651 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-241c0764-e868-4d8f-8852-3b367e6009ef tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.084854 Jun 17 15:21:55.331209 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 993/1574] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:21:55 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:21:55.335819 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-a2543f43-a66d-42fb-98b1-b00d892faef6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:55.336763 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-a2543f43-a66d-42fb-98b1-b00d892faef6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:55.343645 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a2543f43-a66d-42fb-98b1-b00d892faef6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:55.344086 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a2543f43-a66d-42fb-98b1-b00d892faef6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:55.344872 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a2543f43-a66d-42fb-98b1-b00d892faef6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:55.345296 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a2543f43-a66d-42fb-98b1-b00d892faef6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:55.374952 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-a2543f43-a66d-42fb-98b1-b00d892faef6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042691 Jun 17 15:21:55.375525 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 994/1575] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:21:55 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:21:56.206242 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-095e5565-0adc-4ccf-8e6f-45d363cb1714 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:21:56.206938 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-095e5565-0adc-4ccf-8e6f-45d363cb1714 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:21:56.214047 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-095e5565-0adc-4ccf-8e6f-45d363cb1714 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:56.214590 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-095e5565-0adc-4ccf-8e6f-45d363cb1714 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:21:56.215440 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-095e5565-0adc-4ccf-8e6f-45d363cb1714 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:21:56.215969 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-095e5565-0adc-4ccf-8e6f-45d363cb1714 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:22:06.211005 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_api:SELECT=60 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:22:06.236309 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=76 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:22:51.546717 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 15:22:51.547330 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Fri Jun 17 15:22:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments/713822dc-11e8-4f5c-ae7c-bcf41e01b06d (ip 10.222.0.48) !!! Jun 17 15:22:55.369648 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 15:22:55.370706 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Fri Jun 17 15:22:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments/713822dc-11e8-4f5c-ae7c-bcf41e01b06d (ip 10.222.0.48) !!! Jun 17 15:22:56.188820 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.objects.instance [None req-edc611a6-9e02-4f68-8fdb-b8098a423678 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lazy-loading 'services' on Instance uuid ba5d3180-d42a-4678-af13-c99282e054bf {{(pid=117649) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 15:22:56.294596 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.objects.instance [None req-095e5565-0adc-4ccf-8e6f-45d363cb1714 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lazy-loading 'services' on Instance uuid ba5d3180-d42a-4678-af13-c99282e054bf {{(pid=117650) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 15:22:56.742412 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 15:22:56.743067 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Fri Jun 17 15:22:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments/713822dc-11e8-4f5c-ae7c-bcf41e01b06d (ip 10.222.0.48) !!! Jun 17 15:22:58.839622 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 15:22:58.840196 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Fri Jun 17 15:22:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments/713822dc-11e8-4f5c-ae7c-bcf41e01b06d (ip 10.222.0.48) !!! Jun 17 15:23:06.193563 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell1:SELECT=4 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:23:06.299101 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=4 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:24:55.289959 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 15:24:55.290551 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Fri Jun 17 15:24:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments/713822dc-11e8-4f5c-ae7c-bcf41e01b06d (ip 10.222.0.48) !!! Jun 17 15:24:56.387385 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR oslo.messaging._drivers.impl_rabbit [None req-edc611a6-9e02-4f68-8fdb-b8098a423678 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [8095c0d0-2d89-477b-a02a-56a49bd45986] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 17 15:24:56.414409 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.wsgi [None req-095e5565-0adc-4ccf-8e6f-45d363cb1714 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c5a84499-ba7c-48d6-aef5-8d76f659b5e4) Jun 17 15:24:56.416818 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-095e5565-0adc-4ccf-8e6f-45d363cb1714 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Request method failure captured: Jun 17 15:24:56.416818 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: request: DELETE /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments/713822dc-11e8-4f5c-ae7c-bcf41e01b06d HTTP/1.1 Jun 17 15:24:56.416818 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Accept: application/json Jun 17 15:24:56.416818 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Accept-Encoding: identity Jun 17 15:24:56.416818 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Connection: close Jun 17 15:24:56.416818 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Content-Length: 0 Jun 17 15:24:56.416818 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Content-Type: application/json Jun 17 15:24:56.416818 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Host: 10.222.0.48 Jun 17 15:24:56.416818 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Openstack-System-Scope: None Jun 17 15:24:56.416818 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: User-Agent: python-urllib3/1.26.9 Jun 17 15:24:56.416818 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Auth-Token: gAAAAABirJmQC7m757v9yyJD0BsI2MhqMNm1yc2WpkBWgAGOwCYW524pgy_6_7F6gBQez89A-LSNviRE5zDFwqgj2BZoXTsMX0NmzFHDYuHo31ibepKT71785ic3IrIvGY4IglQk81nqgsevYUUWYR-s69vMdAmv9JQXTwFMOwaCzN_3w4dwj6k Jun 17 15:24:56.416818 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Domain-Id: None Jun 17 15:24:56.416818 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Domain-Name: None Jun 17 15:24:56.416818 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Identity-Status: Confirmed Jun 17 15:24:56.416818 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Is-Admin-Project: True Jun 17 15:24:56.416818 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Domain-Id: default Jun 17 15:24:56.416818 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Domain-Name: Default Jun 17 15:24:56.416818 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Id: 50408ec18fa04036a0abb6236343e258 Jun 17 15:24:56.416818 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1478734135 Jun 17 15:24:56.416818 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Role: reader,member Jun 17 15:24:56.416818 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Roles: reader,member Jun 17 15:24:56.418425 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_50408ec18fa04036a0abb6236343e258", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/50408ec18fa04036a0abb6236343e258"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/50408ec18fa04036a0abb6236343e258"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/50408ec18fa04036a0abb6236343e258"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Jun 17 15:24:56.418425 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1478734135 Jun 17 15:24:56.418425 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant-Id: 50408ec18fa04036a0abb6236343e258 Jun 17 15:24:56.418425 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1478734135 Jun 17 15:24:56.418425 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User: tempest-ServerRescueNegativeTestJSON-1478734135-project Jun 17 15:24:56.418425 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Domain-Id: default Jun 17 15:24:56.418425 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Domain-Name: Default Jun 17 15:24:56.418425 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Id: 562485deaf214fa29eac132464ef93e3 Jun 17 15:24:56.418425 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1478734135-project Jun 17 15:24:56.418425 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: method: > Jun 17 15:24:56.419329 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c5a84499-ba7c-48d6-aef5-8d76f659b5e4) Jun 17 15:24:56.419329 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: action_args: {'server_id': 'ba5d3180-d42a-4678-af13-c99282e054bf', 'id': '713822dc-11e8-4f5c-ae7c-bcf41e01b06d'} Jun 17 15:24:56.419329 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 15:24:56.419329 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:24:56.419329 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 15:24:56.419329 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 15:24:56.419329 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 15:24:56.419329 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 15:24:56.419329 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 15:24:56.419329 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 15:24:56.419329 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 15:24:56.419329 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 15:24:56.419329 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 15:24:56.419329 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 15:24:56.419329 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 15:24:56.419329 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 15:24:56.419329 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 15:24:56.420697 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 15:24:56.420697 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 15:24:56.420697 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 15:24:56.420697 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c5a84499-ba7c-48d6-aef5-8d76f659b5e4) Jun 17 15:24:56.420697 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:24:56.420697 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:24:56.420697 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:24:56.420697 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:24:56.420697 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 17 15:24:56.420697 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 17 15:24:56.420697 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 17 15:24:56.420697 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 17 15:24:56.420697 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 15:24:56.420697 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 15:24:56.420697 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 15:24:56.420697 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 15:24:56.420697 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 15:24:56.420697 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 15:24:56.420697 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 15:24:56.422205 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 15:24:56.422205 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 15:24:56.422205 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 15:24:56.422205 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 15:24:56.422205 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 15:24:56.422205 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 15:24:56.422205 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 15:24:56.422205 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 15:24:56.422205 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 15:24:56.422205 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 15:24:56.422205 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 15:24:56.422205 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c5a84499-ba7c-48d6-aef5-8d76f659b5e4) Jun 17 15:24:56.422205 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:24:56.422205 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:24:56.422205 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:24:56.422205 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:24:56.422205 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 17 15:24:56.423472 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 17 15:24:56.423472 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 17 15:24:56.423472 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 15:24:56.423472 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 17 15:24:56.423472 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 17 15:24:56.423472 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 17 15:24:56.423472 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 17 15:24:56.423472 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 17 15:24:56.423472 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 15:24:56.423472 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 17 15:24:56.423472 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 17 15:24:56.423472 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c5a84499-ba7c-48d6-aef5-8d76f659b5e4) Jun 17 15:24:56.423472 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:24:56.423472 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:24:56.423472 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:24:56.423472 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:24:56.423472 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:24:56.423472 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:24:56.424860 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 15:24:56.424860 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 15:24:56.424860 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 15:24:56.424860 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 15:24:56.424860 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 17 15:24:56.424860 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 17 15:24:56.424860 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c5a84499-ba7c-48d6-aef5-8d76f659b5e4) Jun 17 15:24:56.424860 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:24:56.424860 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:24:56.424860 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:24:56.424860 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:24:56.424860 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:24:56.424860 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:24:56.424860 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 15:24:56.424860 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 15:24:56.424860 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c5a84499-ba7c-48d6-aef5-8d76f659b5e4) Jun 17 15:24:56.424860 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:24:56.426423 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-095e5565-0adc-4ccf-8e6f-45d363cb1714 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c5a84499-ba7c-48d6-aef5-8d76f659b5e4) {{(pid=117650) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 15:24:56.426423 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-095e5565-0adc-4ccf-8e6f-45d363cb1714 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "DELETE /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments/713822dc-11e8-4f5c-ae7c-bcf41e01b06d" status: 400 len: 269 microversion: 2.1 time: 180.287740 Jun 17 15:24:56.426423 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 995/1576] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Jun 17 15:21:56 2022] DELETE /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments/713822dc-11e8-4f5c-ae7c-bcf41e01b06d => generated 269 bytes in 180289 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 17 15:24:56.539772 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-2967877b-0412-4e75-aa0a-71fcb19fecac tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:24:56.540425 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-2967877b-0412-4e75-aa0a-71fcb19fecac tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:24:56.546535 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2967877b-0412-4e75-aa0a-71fcb19fecac tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:24:56.546987 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2967877b-0412-4e75-aa0a-71fcb19fecac tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:24:56.547757 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2967877b-0412-4e75-aa0a-71fcb19fecac tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:24:56.548196 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2967877b-0412-4e75-aa0a-71fcb19fecac tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:24:56.683130 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-2967877b-0412-4e75-aa0a-71fcb19fecac tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:24:56.691279 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-2967877b-0412-4e75-aa0a-71fcb19fecac tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.271018 Jun 17 15:24:56.691848 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 996/1577] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:24:56 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:24:56.696297 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-8d88cb44-456a-41a9-9360-055590a42994 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:24:56.696914 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-8d88cb44-456a-41a9-9360-055590a42994 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:24:56.703324 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8d88cb44-456a-41a9-9360-055590a42994 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:24:56.703763 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8d88cb44-456a-41a9-9360-055590a42994 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:24:56.704559 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8d88cb44-456a-41a9-9360-055590a42994 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:24:56.704988 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8d88cb44-456a-41a9-9360-055590a42994 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:24:56.773375 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-8d88cb44-456a-41a9-9360-055590a42994 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:24:56.782353 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-8d88cb44-456a-41a9-9360-055590a42994 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.089437 Jun 17 15:24:56.782920 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 997/1578] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:24:56 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:24:56.854994 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-86226707-7fa8-4858-a92f-faaeee75a3ef tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:24:56.855976 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-86226707-7fa8-4858-a92f-faaeee75a3ef tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:24:56.862197 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-86226707-7fa8-4858-a92f-faaeee75a3ef tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:24:56.862636 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-86226707-7fa8-4858-a92f-faaeee75a3ef tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:24:56.863408 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-86226707-7fa8-4858-a92f-faaeee75a3ef tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:24:56.863848 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-86226707-7fa8-4858-a92f-faaeee75a3ef tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:24:56.894306 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-86226707-7fa8-4858-a92f-faaeee75a3ef tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.110319 Jun 17 15:24:56.894890 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 998/1579] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:24:56 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:24:56.899525 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-0e307505-11b3-4c8a-b4b1-3126685fb396 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:24:56.900016 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-0e307505-11b3-4c8a-b4b1-3126685fb396 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:24:56.906519 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0e307505-11b3-4c8a-b4b1-3126685fb396 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:24:56.906971 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0e307505-11b3-4c8a-b4b1-3126685fb396 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:24:56.907776 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0e307505-11b3-4c8a-b4b1-3126685fb396 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:24:56.908214 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0e307505-11b3-4c8a-b4b1-3126685fb396 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:24:57.394762 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO oslo.messaging._drivers.impl_rabbit [None req-edc611a6-9e02-4f68-8fdb-b8098a423678 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [8095c0d0-2d89-477b-a02a-56a49bd45986] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 44980. Jun 17 15:24:57.398369 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-edc611a6-9e02-4f68-8fdb-b8098a423678 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "DELETE /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments/713822dc-11e8-4f5c-ae7c-bcf41e01b06d" status: 202 len: 0 microversion: 2.1 time: 241.325880 Jun 17 15:24:57.398962 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 582/1580] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Jun 17 15:20:56 2022] DELETE /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments/713822dc-11e8-4f5c-ae7c-bcf41e01b06d => generated 0 bytes in 241327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 17 15:24:57.405280 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-3d15bbbc-cafa-4cd2-ac81-35ab5c520e17 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:24:57.405929 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-3d15bbbc-cafa-4cd2-ac81-35ab5c520e17 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:24:57.413922 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3d15bbbc-cafa-4cd2-ac81-35ab5c520e17 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:24:57.414376 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3d15bbbc-cafa-4cd2-ac81-35ab5c520e17 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:24:57.415200 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3d15bbbc-cafa-4cd2-ac81-35ab5c520e17 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:24:57.415677 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3d15bbbc-cafa-4cd2-ac81-35ab5c520e17 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:24:57.550246 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-3d15bbbc-cafa-4cd2-ac81-35ab5c520e17 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:24:57.557708 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-3d15bbbc-cafa-4cd2-ac81-35ab5c520e17 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.157637 Jun 17 15:24:57.558338 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 583/1581] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:24:57 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:24:57.562780 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-0b51dde8-bede-4721-ad44-8f59edc8be63 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:24:57.563261 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-0b51dde8-bede-4721-ad44-8f59edc8be63 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:24:57.568773 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0b51dde8-bede-4721-ad44-8f59edc8be63 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:24:57.569208 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0b51dde8-bede-4721-ad44-8f59edc8be63 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:24:57.570072 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0b51dde8-bede-4721-ad44-8f59edc8be63 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:24:57.570377 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0b51dde8-bede-4721-ad44-8f59edc8be63 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:25:06.904010 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_api:SELECT=8 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:25:06.926408 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=22 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:25:07.567248 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_api:SELECT=4 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:25:07.588352 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell1:SELECT=11,nova_cell1:INSERT=1 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:26:11.555521 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 15:26:11.556200 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Fri Jun 17 15:26:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924/os-volume_attachments/4e6d668f-6234-4ba9-913a-11f57866e984 (ip 10.222.0.48) !!! Jun 17 15:26:15.380086 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 15:26:15.380577 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Fri Jun 17 15:26:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments/713822dc-11e8-4f5c-ae7c-bcf41e01b06d (ip 10.222.0.48) !!! Jun 17 15:26:16.750961 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 15:26:16.751610 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Fri Jun 17 15:26:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments/713822dc-11e8-4f5c-ae7c-bcf41e01b06d (ip 10.222.0.48) !!! Jun 17 15:26:18.848528 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 15:26:18.849014 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Fri Jun 17 15:26:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924/os-volume_attachments/4e6d668f-6234-4ba9-913a-11f57866e984 (ip 10.222.0.48) !!! Jun 17 15:26:56.761209 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.objects.instance [None req-0e307505-11b3-4c8a-b4b1-3126685fb396 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lazy-loading 'services' on Instance uuid ba5d3180-d42a-4678-af13-c99282e054bf {{(pid=117650) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 15:26:56.866298 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.objects.instance [None req-0b51dde8-bede-4721-ad44-8f59edc8be63 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lazy-loading 'services' on Instance uuid 808f28e6-03bc-4b67-ab1f-f1ef13838924 {{(pid=117649) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 15:27:06.774256 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=4 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:27:06.870398 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell1:SELECT=4 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:28:15.298766 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 15:28:15.299684 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Fri Jun 17 15:28:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments/713822dc-11e8-4f5c-ae7c-bcf41e01b06d (ip 10.222.0.48) !!! Jun 17 15:28:57.038799 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.wsgi [None req-0e307505-11b3-4c8a-b4b1-3126685fb396 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4d6ae05e-8a95-4e29-8884-64296bc9b9b5) Jun 17 15:28:57.042913 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-0e307505-11b3-4c8a-b4b1-3126685fb396 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Request method failure captured: Jun 17 15:28:57.042913 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: request: DELETE /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments/713822dc-11e8-4f5c-ae7c-bcf41e01b06d HTTP/1.1 Jun 17 15:28:57.042913 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Accept: application/json Jun 17 15:28:57.042913 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Accept-Encoding: identity Jun 17 15:28:57.042913 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Connection: close Jun 17 15:28:57.042913 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Content-Length: 0 Jun 17 15:28:57.042913 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Content-Type: application/json Jun 17 15:28:57.042913 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Host: 10.222.0.48 Jun 17 15:28:57.042913 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Openstack-System-Scope: None Jun 17 15:28:57.042913 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: User-Agent: python-urllib3/1.26.9 Jun 17 15:28:57.042913 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Auth-Token: gAAAAABirJmQC7m757v9yyJD0BsI2MhqMNm1yc2WpkBWgAGOwCYW524pgy_6_7F6gBQez89A-LSNviRE5zDFwqgj2BZoXTsMX0NmzFHDYuHo31ibepKT71785ic3IrIvGY4IglQk81nqgsevYUUWYR-s69vMdAmv9JQXTwFMOwaCzN_3w4dwj6k Jun 17 15:28:57.042913 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Domain-Id: None Jun 17 15:28:57.042913 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Domain-Name: None Jun 17 15:28:57.042913 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Identity-Status: Confirmed Jun 17 15:28:57.042913 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Is-Admin-Project: True Jun 17 15:28:57.042913 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Domain-Id: default Jun 17 15:28:57.042913 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Domain-Name: Default Jun 17 15:28:57.042913 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Id: 50408ec18fa04036a0abb6236343e258 Jun 17 15:28:57.042913 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1478734135 Jun 17 15:28:57.042913 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Role: reader,member Jun 17 15:28:57.042913 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Roles: reader,member Jun 17 15:28:57.044760 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_50408ec18fa04036a0abb6236343e258", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/50408ec18fa04036a0abb6236343e258"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/50408ec18fa04036a0abb6236343e258"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/50408ec18fa04036a0abb6236343e258"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Jun 17 15:28:57.044760 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1478734135 Jun 17 15:28:57.044760 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant-Id: 50408ec18fa04036a0abb6236343e258 Jun 17 15:28:57.044760 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1478734135 Jun 17 15:28:57.044760 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User: tempest-ServerRescueNegativeTestJSON-1478734135-project Jun 17 15:28:57.044760 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Domain-Id: default Jun 17 15:28:57.044760 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Domain-Name: Default Jun 17 15:28:57.044760 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Id: 562485deaf214fa29eac132464ef93e3 Jun 17 15:28:57.044760 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1478734135-project Jun 17 15:28:57.044760 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: method: > Jun 17 15:28:57.045424 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4d6ae05e-8a95-4e29-8884-64296bc9b9b5) Jun 17 15:28:57.045424 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: action_args: {'server_id': 'ba5d3180-d42a-4678-af13-c99282e054bf', 'id': '713822dc-11e8-4f5c-ae7c-bcf41e01b06d'} Jun 17 15:28:57.045424 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 15:28:57.045424 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:28:57.045424 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 15:28:57.045424 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 15:28:57.045424 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 15:28:57.045424 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 15:28:57.045424 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 15:28:57.045424 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 15:28:57.045424 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 15:28:57.045424 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 15:28:57.045424 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 15:28:57.045424 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 15:28:57.045424 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 15:28:57.045424 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 15:28:57.045424 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 15:28:57.046531 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 15:28:57.046531 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 15:28:57.046531 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 15:28:57.046531 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4d6ae05e-8a95-4e29-8884-64296bc9b9b5) Jun 17 15:28:57.046531 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:28:57.046531 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:28:57.046531 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:28:57.046531 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:28:57.046531 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 17 15:28:57.046531 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 17 15:28:57.046531 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 17 15:28:57.046531 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 17 15:28:57.046531 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 15:28:57.046531 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 15:28:57.046531 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 15:28:57.046531 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 15:28:57.046531 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 15:28:57.046531 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 15:28:57.046531 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 15:28:57.047956 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 15:28:57.047956 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 15:28:57.047956 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 15:28:57.047956 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 15:28:57.047956 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 15:28:57.047956 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 15:28:57.047956 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 15:28:57.047956 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 15:28:57.047956 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 15:28:57.047956 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 15:28:57.047956 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 15:28:57.047956 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4d6ae05e-8a95-4e29-8884-64296bc9b9b5) Jun 17 15:28:57.047956 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:28:57.047956 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:28:57.047956 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:28:57.047956 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:28:57.047956 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 17 15:28:57.049342 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 17 15:28:57.049342 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 17 15:28:57.049342 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 15:28:57.049342 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 17 15:28:57.049342 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 17 15:28:57.049342 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 17 15:28:57.049342 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 17 15:28:57.049342 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 17 15:28:57.049342 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 15:28:57.049342 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 17 15:28:57.049342 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 17 15:28:57.049342 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4d6ae05e-8a95-4e29-8884-64296bc9b9b5) Jun 17 15:28:57.049342 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:28:57.049342 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:28:57.049342 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:28:57.049342 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:28:57.049342 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:28:57.049342 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:28:57.051905 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 15:28:57.051905 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 15:28:57.051905 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 15:28:57.051905 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 15:28:57.051905 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 17 15:28:57.051905 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 17 15:28:57.051905 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4d6ae05e-8a95-4e29-8884-64296bc9b9b5) Jun 17 15:28:57.051905 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:28:57.051905 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:28:57.051905 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:28:57.051905 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:28:57.051905 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:28:57.051905 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:28:57.051905 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 15:28:57.051905 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 15:28:57.051905 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4d6ae05e-8a95-4e29-8884-64296bc9b9b5) Jun 17 15:28:57.051905 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:28:57.053404 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-0e307505-11b3-4c8a-b4b1-3126685fb396 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4d6ae05e-8a95-4e29-8884-64296bc9b9b5) {{(pid=117650) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 15:28:57.053404 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-0e307505-11b3-4c8a-b4b1-3126685fb396 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "DELETE /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments/713822dc-11e8-4f5c-ae7c-bcf41e01b06d" status: 400 len: 269 microversion: 2.1 time: 240.149155 Jun 17 15:28:57.053404 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Fri Jun 17 15:28:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments/713822dc-11e8-4f5c-ae7c-bcf41e01b06d (ip 10.222.0.48) !!! Jun 17 15:28:57.053404 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Fri Jun 17 15:28:57 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments/713822dc-11e8-4f5c-ae7c-bcf41e01b06d (10.222.0.48) Jun 17 15:28:57.053404 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: CRITICAL nova [None req-0e307505-11b3-4c8a-b4b1-3126685fb396 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Unhandled error: OSError: write error Jun 17 15:28:57.053404 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova OSError: write error Jun 17 15:28:57.053404 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova Jun 17 15:28:57.054528 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 999/1582] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Jun 17 15:24:56 2022] DELETE /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments/713822dc-11e8-4f5c-ae7c-bcf41e01b06d => generated 0 bytes in 240152 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Jun 17 15:28:57.059998 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-08d78675-bf53-4942-ac7a-8de441932649 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:28:57.061366 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-08d78675-bf53-4942-ac7a-8de441932649 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:28:57.072276 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-08d78675-bf53-4942-ac7a-8de441932649 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:28:57.072838 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-08d78675-bf53-4942-ac7a-8de441932649 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:28:57.073551 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-08d78675-bf53-4942-ac7a-8de441932649 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:28:57.074002 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-08d78675-bf53-4942-ac7a-8de441932649 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:28:57.159692 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-08d78675-bf53-4942-ac7a-8de441932649 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:28:57.165440 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-0b51dde8-bede-4721-ad44-8f59edc8be63 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "DELETE /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924/os-volume_attachments/4e6d668f-6234-4ba9-913a-11f57866e984" status: 202 len: 0 microversion: 2.1 time: 239.605872 Jun 17 15:28:57.166160 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Fri Jun 17 15:28:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924/os-volume_attachments/4e6d668f-6234-4ba9-913a-11f57866e984 (ip 10.222.0.48) !!! Jun 17 15:28:57.166160 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Fri Jun 17 15:28:57 2022 - uwsgi_response_write_headers_do(): Broken pipe [core/writer.c line 248] during DELETE /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924/os-volume_attachments/4e6d668f-6234-4ba9-913a-11f57866e984 (10.222.0.48) Jun 17 15:28:57.167203 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: CRITICAL nova [None req-0b51dde8-bede-4721-ad44-8f59edc8be63 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Unhandled error: OSError: write error Jun 17 15:28:57.167203 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova OSError: write error Jun 17 15:28:57.167203 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova Jun 17 15:28:57.167644 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 584/1583] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Jun 17 15:24:57 2022] DELETE /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924/os-volume_attachments/4e6d668f-6234-4ba9-913a-11f57866e984 => generated 0 bytes in 239609 msecs (HTTP/1.1 202) 9 headers in 0 bytes (0 switches on core 0) Jun 17 15:28:57.173558 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-08d78675-bf53-4942-ac7a-8de441932649 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1224 microversion: 2.1 time: 0.124081 Jun 17 15:28:57.174608 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Fri Jun 17 15:28:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a (ip 10.222.0.48) !!! Jun 17 15:28:57.174608 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Fri Jun 17 15:28:57 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a (10.222.0.48) Jun 17 15:28:57.175688 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-178f0799-f3fa-4ee9-8b86-22e854428a4d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:28:57.176109 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: CRITICAL nova [None req-08d78675-bf53-4942-ac7a-8de441932649 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Unhandled error: OSError: write error Jun 17 15:28:57.176109 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova OSError: write error Jun 17 15:28:57.176109 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova Jun 17 15:28:57.176612 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1000/1584] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:28:57 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 0 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Jun 17 15:28:57.177239 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-178f0799-f3fa-4ee9-8b86-22e854428a4d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:28:57.184626 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-178f0799-f3fa-4ee9-8b86-22e854428a4d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:28:57.185176 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-178f0799-f3fa-4ee9-8b86-22e854428a4d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:28:57.185320 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-fc829962-5e5c-49b8-a299-3ee4a850c47b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:28:57.186104 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-fc829962-5e5c-49b8-a299-3ee4a850c47b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:28:57.186255 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-178f0799-f3fa-4ee9-8b86-22e854428a4d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:28:57.186671 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-178f0799-f3fa-4ee9-8b86-22e854428a4d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:28:57.198212 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fc829962-5e5c-49b8-a299-3ee4a850c47b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:28:57.198986 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fc829962-5e5c-49b8-a299-3ee4a850c47b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:28:57.200794 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fc829962-5e5c-49b8-a299-3ee4a850c47b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:28:57.201579 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fc829962-5e5c-49b8-a299-3ee4a850c47b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:28:57.227020 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-178f0799-f3fa-4ee9-8b86-22e854428a4d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058198 Jun 17 15:28:57.227730 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Fri Jun 17 15:28:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments (ip 10.222.0.48) !!! Jun 17 15:28:57.227730 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Fri Jun 17 15:28:57 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments (10.222.0.48) Jun 17 15:28:57.228552 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: CRITICAL nova [None req-178f0799-f3fa-4ee9-8b86-22e854428a4d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Unhandled error: OSError: write error Jun 17 15:28:57.228552 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova OSError: write error Jun 17 15:28:57.228552 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova Jun 17 15:28:57.229019 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 585/1585] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:28:57 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 0 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Jun 17 15:28:57.233955 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-9edcc7dd-561a-4903-baf2-4baab5b7802c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:28:57.234863 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-9edcc7dd-561a-4903-baf2-4baab5b7802c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:28:57.246322 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9edcc7dd-561a-4903-baf2-4baab5b7802c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:28:57.248059 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9edcc7dd-561a-4903-baf2-4baab5b7802c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:28:57.250860 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9edcc7dd-561a-4903-baf2-4baab5b7802c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:28:57.252054 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9edcc7dd-561a-4903-baf2-4baab5b7802c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:28:57.563512 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-9edcc7dd-561a-4903-baf2-4baab5b7802c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:28:57.572068 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-9edcc7dd-561a-4903-baf2-4baab5b7802c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.342044 Jun 17 15:28:57.572757 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Fri Jun 17 15:28:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 (ip 10.222.0.48) !!! Jun 17 15:28:57.572757 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Fri Jun 17 15:28:57 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 (10.222.0.48) Jun 17 15:28:57.573357 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: CRITICAL nova [None req-9edcc7dd-561a-4903-baf2-4baab5b7802c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Unhandled error: OSError: write error Jun 17 15:28:57.573357 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova OSError: write error Jun 17 15:28:57.573357 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova Jun 17 15:28:57.573866 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 586/1586] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:28:57 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 0 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Jun 17 15:28:57.578386 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-21ba5fca-14c7-400d-a609-4bd23439bfd0 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:28:57.578882 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-21ba5fca-14c7-400d-a609-4bd23439bfd0 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:28:57.585242 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-21ba5fca-14c7-400d-a609-4bd23439bfd0 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:28:57.585724 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-21ba5fca-14c7-400d-a609-4bd23439bfd0 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:28:57.586516 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-21ba5fca-14c7-400d-a609-4bd23439bfd0 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:28:57.586927 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-21ba5fca-14c7-400d-a609-4bd23439bfd0 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:29:07.196387 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_api:SELECT=4 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:29:07.240629 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=10 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:29:07.582339 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_api:SELECT=6 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:29:07.608320 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell1:SELECT=17,nova_cell1:INSERT=1 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:29:31.563792 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 15:29:31.565061 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Fri Jun 17 15:29:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924/os-volume_attachments/4e6d668f-6234-4ba9-913a-11f57866e984 (ip 10.222.0.48) !!! Jun 17 15:29:35.388415 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 15:29:35.389278 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Fri Jun 17 15:29:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments/713822dc-11e8-4f5c-ae7c-bcf41e01b06d (ip 10.222.0.48) !!! Jun 17 15:29:36.759655 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 15:29:36.759655 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Fri Jun 17 15:29:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments/713822dc-11e8-4f5c-ae7c-bcf41e01b06d (ip 10.222.0.48) !!! Jun 17 15:29:38.856879 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 15:29:38.857546 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Fri Jun 17 15:29:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924/os-volume_attachments/4e6d668f-6234-4ba9-913a-11f57866e984 (ip 10.222.0.48) !!! Jun 17 15:30:57.401810 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.objects.instance [None req-fc829962-5e5c-49b8-a299-3ee4a850c47b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lazy-loading 'services' on Instance uuid ba5d3180-d42a-4678-af13-c99282e054bf {{(pid=117650) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 15:30:57.474276 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.objects.instance [None req-21ba5fca-14c7-400d-a609-4bd23439bfd0 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lazy-loading 'services' on Instance uuid 808f28e6-03bc-4b67-ab1f-f1ef13838924 {{(pid=117649) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 15:31:07.421263 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=4 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:31:07.494005 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell1:SELECT=4 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:31:35.311206 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 15:31:35.312143 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Fri Jun 17 15:31:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments/713822dc-11e8-4f5c-ae7c-bcf41e01b06d (ip 10.222.0.48) !!! Jun 17 15:31:38.764146 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 15:31:38.764866 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Fri Jun 17 15:31:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924/os-volume_attachments/4e6d668f-6234-4ba9-913a-11f57866e984 (ip 10.222.0.48) !!! Jun 17 15:32:46.282483 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.wsgi [None req-fc829962-5e5c-49b8-a299-3ee4a850c47b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3adf73bc-0a93-439b-ba9c-d455d074d292) Jun 17 15:32:46.284895 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-fc829962-5e5c-49b8-a299-3ee4a850c47b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Request method failure captured: Jun 17 15:32:46.284895 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: request: DELETE /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments/713822dc-11e8-4f5c-ae7c-bcf41e01b06d HTTP/1.1 Jun 17 15:32:46.284895 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Accept: application/json Jun 17 15:32:46.284895 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Accept-Encoding: identity Jun 17 15:32:46.284895 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Connection: close Jun 17 15:32:46.284895 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Content-Length: 0 Jun 17 15:32:46.284895 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Content-Type: application/json Jun 17 15:32:46.284895 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Host: 10.222.0.48 Jun 17 15:32:46.284895 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Openstack-System-Scope: None Jun 17 15:32:46.284895 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: User-Agent: python-urllib3/1.26.9 Jun 17 15:32:46.284895 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Auth-Token: gAAAAABirJmQC7m757v9yyJD0BsI2MhqMNm1yc2WpkBWgAGOwCYW524pgy_6_7F6gBQez89A-LSNviRE5zDFwqgj2BZoXTsMX0NmzFHDYuHo31ibepKT71785ic3IrIvGY4IglQk81nqgsevYUUWYR-s69vMdAmv9JQXTwFMOwaCzN_3w4dwj6k Jun 17 15:32:46.284895 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Domain-Id: None Jun 17 15:32:46.284895 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Domain-Name: None Jun 17 15:32:46.284895 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Identity-Status: Confirmed Jun 17 15:32:46.284895 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Is-Admin-Project: True Jun 17 15:32:46.284895 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Domain-Id: default Jun 17 15:32:46.284895 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Domain-Name: Default Jun 17 15:32:46.284895 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Id: 50408ec18fa04036a0abb6236343e258 Jun 17 15:32:46.284895 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1478734135 Jun 17 15:32:46.284895 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Role: reader,member Jun 17 15:32:46.284895 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Roles: reader,member Jun 17 15:32:46.286945 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_50408ec18fa04036a0abb6236343e258", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/50408ec18fa04036a0abb6236343e258"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/50408ec18fa04036a0abb6236343e258"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/50408ec18fa04036a0abb6236343e258"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Jun 17 15:32:46.286945 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1478734135 Jun 17 15:32:46.286945 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant-Id: 50408ec18fa04036a0abb6236343e258 Jun 17 15:32:46.286945 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1478734135 Jun 17 15:32:46.286945 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User: tempest-ServerRescueNegativeTestJSON-1478734135-project Jun 17 15:32:46.286945 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Domain-Id: default Jun 17 15:32:46.286945 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Domain-Name: Default Jun 17 15:32:46.286945 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Id: 562485deaf214fa29eac132464ef93e3 Jun 17 15:32:46.286945 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1478734135-project Jun 17 15:32:46.286945 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: method: > Jun 17 15:32:46.289121 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3adf73bc-0a93-439b-ba9c-d455d074d292) Jun 17 15:32:46.289121 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: action_args: {'server_id': 'ba5d3180-d42a-4678-af13-c99282e054bf', 'id': '713822dc-11e8-4f5c-ae7c-bcf41e01b06d'} Jun 17 15:32:46.289121 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 15:32:46.289121 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:46.289121 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 15:32:46.289121 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 15:32:46.289121 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 15:32:46.289121 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 15:32:46.289121 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 15:32:46.289121 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 15:32:46.289121 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 15:32:46.289121 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 15:32:46.289121 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 15:32:46.289121 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 15:32:46.289121 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 15:32:46.289121 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 15:32:46.289121 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 15:32:46.293282 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 15:32:46.293282 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 15:32:46.293282 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 15:32:46.293282 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3adf73bc-0a93-439b-ba9c-d455d074d292) Jun 17 15:32:46.293282 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:32:46.293282 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:32:46.293282 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:32:46.293282 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:46.293282 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 17 15:32:46.293282 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 17 15:32:46.293282 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 17 15:32:46.293282 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 17 15:32:46.293282 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 15:32:46.293282 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 15:32:46.293282 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 15:32:46.293282 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 15:32:46.293282 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 15:32:46.293282 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 15:32:46.293282 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 15:32:46.298287 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 15:32:46.298287 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 15:32:46.298287 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 15:32:46.298287 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 15:32:46.298287 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 15:32:46.298287 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 15:32:46.298287 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 15:32:46.298287 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 15:32:46.298287 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 15:32:46.298287 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 15:32:46.298287 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 15:32:46.298287 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3adf73bc-0a93-439b-ba9c-d455d074d292) Jun 17 15:32:46.298287 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:32:46.298287 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:32:46.298287 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:32:46.298287 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:46.298287 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 17 15:32:46.302322 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 17 15:32:46.302322 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 17 15:32:46.302322 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 15:32:46.302322 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 17 15:32:46.302322 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 17 15:32:46.302322 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 17 15:32:46.302322 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 17 15:32:46.302322 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 17 15:32:46.302322 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 15:32:46.302322 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 17 15:32:46.302322 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 17 15:32:46.302322 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3adf73bc-0a93-439b-ba9c-d455d074d292) Jun 17 15:32:46.302322 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:32:46.302322 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:32:46.302322 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:32:46.302322 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:46.302322 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:32:46.302322 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:32:46.305914 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 15:32:46.305914 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 15:32:46.305914 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 15:32:46.305914 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 15:32:46.305914 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 17 15:32:46.305914 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 17 15:32:46.305914 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3adf73bc-0a93-439b-ba9c-d455d074d292) Jun 17 15:32:46.305914 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:32:46.305914 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:32:46.305914 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:32:46.305914 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:46.305914 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:32:46.305914 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:32:46.305914 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 15:32:46.305914 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 15:32:46.305914 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3adf73bc-0a93-439b-ba9c-d455d074d292) Jun 17 15:32:46.305914 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:32:46.309405 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-fc829962-5e5c-49b8-a299-3ee4a850c47b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3adf73bc-0a93-439b-ba9c-d455d074d292) {{(pid=117650) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 15:32:46.309405 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-fc829962-5e5c-49b8-a299-3ee4a850c47b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "DELETE /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments/713822dc-11e8-4f5c-ae7c-bcf41e01b06d" status: 400 len: 269 microversion: 2.1 time: 229.108851 Jun 17 15:32:46.309405 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Fri Jun 17 15:32:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments/713822dc-11e8-4f5c-ae7c-bcf41e01b06d (ip 10.222.0.48) !!! Jun 17 15:32:46.309405 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Fri Jun 17 15:32:46 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments/713822dc-11e8-4f5c-ae7c-bcf41e01b06d (10.222.0.48) Jun 17 15:32:46.309405 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: CRITICAL nova [None req-fc829962-5e5c-49b8-a299-3ee4a850c47b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Unhandled error: OSError: write error Jun 17 15:32:46.309405 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova OSError: write error Jun 17 15:32:46.309405 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova Jun 17 15:32:46.311339 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1001/1587] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Jun 17 15:28:57 2022] DELETE /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments/713822dc-11e8-4f5c-ae7c-bcf41e01b06d => generated 0 bytes in 229111 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Jun 17 15:32:46.311339 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-75e9ecec-7cb4-47f7-a410-4056b8e1c213 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:32:46.311339 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-75e9ecec-7cb4-47f7-a410-4056b8e1c213 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:32:46.311339 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-75e9ecec-7cb4-47f7-a410-4056b8e1c213 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:46.311999 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-75e9ecec-7cb4-47f7-a410-4056b8e1c213 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:46.311999 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-75e9ecec-7cb4-47f7-a410-4056b8e1c213 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:46.311999 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-75e9ecec-7cb4-47f7-a410-4056b8e1c213 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:46.325349 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.wsgi [None req-21ba5fca-14c7-400d-a609-4bd23439bfd0 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1952be6b-e9bf-49db-87eb-ee14d1d6f7bc) Jun 17 15:32:46.332988 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-21ba5fca-14c7-400d-a609-4bd23439bfd0 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Request method failure captured: Jun 17 15:32:46.332988 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: request: DELETE /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924/os-volume_attachments/4e6d668f-6234-4ba9-913a-11f57866e984 HTTP/1.1 Jun 17 15:32:46.332988 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Accept: application/json Jun 17 15:32:46.332988 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Accept-Encoding: identity Jun 17 15:32:46.332988 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Connection: close Jun 17 15:32:46.332988 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Content-Length: 0 Jun 17 15:32:46.332988 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Content-Type: application/json Jun 17 15:32:46.332988 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Host: 10.222.0.48 Jun 17 15:32:46.332988 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Openstack-System-Scope: None Jun 17 15:32:46.332988 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: User-Agent: python-urllib3/1.26.9 Jun 17 15:32:46.332988 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Auth-Token: gAAAAABirJpPRELvo50oKxdbD2bQ6GGouzj8i1DebBt1zfB7fX0V-PDU7hlPCfVEJbYQ9PsMuU2ZA4JvqklZ9Y9hD2QbIWtBnNkd8fMsMcOzOLJcX5MT958XBAGaNkW3F9LEBjk4LnqtyEbVGNYjmbh2tqH5UI9WDRv0xJagRknfyHTSn0wpzG0 Jun 17 15:32:46.332988 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Domain-Id: None Jun 17 15:32:46.332988 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Domain-Name: None Jun 17 15:32:46.332988 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Identity-Status: Confirmed Jun 17 15:32:46.332988 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Is-Admin-Project: True Jun 17 15:32:46.332988 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Domain-Id: default Jun 17 15:32:46.332988 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Domain-Name: Default Jun 17 15:32:46.332988 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Id: 42b42320bc424a19b4ac5e35dae7afb3 Jun 17 15:32:46.332988 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1590813198 Jun 17 15:32:46.332988 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Role: reader,member Jun 17 15:32:46.332988 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Roles: reader,member Jun 17 15:32:46.336465 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_42b42320bc424a19b4ac5e35dae7afb3", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/42b42320bc424a19b4ac5e35dae7afb3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/42b42320bc424a19b4ac5e35dae7afb3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/42b42320bc424a19b4ac5e35dae7afb3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Jun 17 15:32:46.336465 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant: tempest-VolumesSnapshotTestJSON-1590813198 Jun 17 15:32:46.336465 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant-Id: 42b42320bc424a19b4ac5e35dae7afb3 Jun 17 15:32:46.336465 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1590813198 Jun 17 15:32:46.336465 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User: tempest-VolumesSnapshotTestJSON-1590813198-project Jun 17 15:32:46.336465 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Domain-Id: default Jun 17 15:32:46.336465 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Domain-Name: Default Jun 17 15:32:46.336465 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Id: b6ac8cbc7c6d4cce9d2b0a1289846a3d Jun 17 15:32:46.336465 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Name: tempest-VolumesSnapshotTestJSON-1590813198-project Jun 17 15:32:46.336465 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: method: > Jun 17 15:32:46.338269 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1952be6b-e9bf-49db-87eb-ee14d1d6f7bc) Jun 17 15:32:46.338269 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: action_args: {'server_id': '808f28e6-03bc-4b67-ab1f-f1ef13838924', 'id': '4e6d668f-6234-4ba9-913a-11f57866e984'} Jun 17 15:32:46.338269 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 15:32:46.338269 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:46.338269 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 15:32:46.338269 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 15:32:46.338269 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 15:32:46.338269 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 15:32:46.338269 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 15:32:46.338269 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 15:32:46.338269 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 15:32:46.338269 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 15:32:46.338269 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 15:32:46.338269 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 15:32:46.338269 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 15:32:46.338269 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 15:32:46.338269 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 15:32:46.342784 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 15:32:46.342784 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 15:32:46.342784 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 15:32:46.342784 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1952be6b-e9bf-49db-87eb-ee14d1d6f7bc) Jun 17 15:32:46.342784 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:32:46.342784 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:32:46.342784 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:32:46.342784 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:46.342784 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 17 15:32:46.342784 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 17 15:32:46.342784 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 17 15:32:46.342784 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 17 15:32:46.342784 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 15:32:46.342784 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 15:32:46.342784 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 15:32:46.342784 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 15:32:46.342784 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 15:32:46.342784 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 15:32:46.342784 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 15:32:46.345694 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 15:32:46.345694 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 15:32:46.345694 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 15:32:46.345694 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 15:32:46.345694 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 15:32:46.345694 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 15:32:46.345694 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 15:32:46.345694 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 15:32:46.345694 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 15:32:46.345694 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 15:32:46.345694 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 15:32:46.345694 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1952be6b-e9bf-49db-87eb-ee14d1d6f7bc) Jun 17 15:32:46.345694 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:32:46.345694 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:32:46.345694 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:32:46.345694 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:46.345694 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 17 15:32:46.349202 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 17 15:32:46.349202 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 17 15:32:46.349202 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 15:32:46.349202 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 17 15:32:46.349202 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 17 15:32:46.349202 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 17 15:32:46.349202 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 17 15:32:46.349202 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 17 15:32:46.349202 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 15:32:46.349202 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 17 15:32:46.349202 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 17 15:32:46.349202 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1952be6b-e9bf-49db-87eb-ee14d1d6f7bc) Jun 17 15:32:46.349202 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:32:46.349202 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:32:46.349202 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:32:46.349202 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:46.349202 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:32:46.349202 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:32:46.353422 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 15:32:46.353422 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 15:32:46.353422 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 15:32:46.353422 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 15:32:46.353422 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 17 15:32:46.353422 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 17 15:32:46.353422 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1952be6b-e9bf-49db-87eb-ee14d1d6f7bc) Jun 17 15:32:46.353422 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:32:46.353422 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:32:46.353422 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:32:46.353422 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:46.353422 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:32:46.353422 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:32:46.353422 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 15:32:46.353422 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 15:32:46.353422 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1952be6b-e9bf-49db-87eb-ee14d1d6f7bc) Jun 17 15:32:46.353422 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:32:46.356670 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-21ba5fca-14c7-400d-a609-4bd23439bfd0 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1952be6b-e9bf-49db-87eb-ee14d1d6f7bc) {{(pid=117649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 15:32:46.356670 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-21ba5fca-14c7-400d-a609-4bd23439bfd0 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "DELETE /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924/os-volume_attachments/4e6d668f-6234-4ba9-913a-11f57866e984" status: 400 len: 269 microversion: 2.1 time: 228.759212 Jun 17 15:32:46.357106 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-75e9ecec-7cb4-47f7-a410-4056b8e1c213 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:46.357106 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-75e9ecec-7cb4-47f7-a410-4056b8e1c213 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:46.357540 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Fri Jun 17 15:32:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924/os-volume_attachments/4e6d668f-6234-4ba9-913a-11f57866e984 (ip 10.222.0.48) !!! Jun 17 15:32:46.357540 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Fri Jun 17 15:32:46 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924/os-volume_attachments/4e6d668f-6234-4ba9-913a-11f57866e984 (10.222.0.48) Jun 17 15:32:46.357955 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.objects.instance [None req-75e9ecec-7cb4-47f7-a410-4056b8e1c213 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lazy-loading 'fault' on Instance uuid 8fee7bc0-cd0e-4c25-8475-b43e79cb933a {{(pid=117650) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 15:32:46.358179 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: CRITICAL nova [None req-21ba5fca-14c7-400d-a609-4bd23439bfd0 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Unhandled error: OSError: write error Jun 17 15:32:46.358179 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova OSError: write error Jun 17 15:32:46.358179 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova Jun 17 15:32:46.358179 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 587/1588] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Jun 17 15:28:57 2022] DELETE /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924/os-volume_attachments/4e6d668f-6234-4ba9-913a-11f57866e984 => generated 0 bytes in 228777 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Jun 17 15:32:46.387507 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-cb87ec92-a32e-474a-a3ae-4c2e4c33626b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:32:46.392388 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-cb87ec92-a32e-474a-a3ae-4c2e4c33626b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:32:46.403950 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cb87ec92-a32e-474a-a3ae-4c2e4c33626b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:46.404851 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-75e9ecec-7cb4-47f7-a410-4056b8e1c213 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e3e797edb9a453d9142c3196a4f21bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6298c1910e1a488983d5399d7952a5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:32:46.406765 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cb87ec92-a32e-474a-a3ae-4c2e4c33626b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:46.407734 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cb87ec92-a32e-474a-a3ae-4c2e4c33626b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:46.408181 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cb87ec92-a32e-474a-a3ae-4c2e4c33626b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:46.415280 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-75e9ecec-7cb4-47f7-a410-4056b8e1c213 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 200 len: 1229 microversion: 2.1 time: 0.126558 Jun 17 15:32:46.415860 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Fri Jun 17 15:32:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a (ip 10.222.0.48) !!! Jun 17 15:32:46.415860 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Fri Jun 17 15:32:46 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a (10.222.0.48) Jun 17 15:32:46.416520 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: CRITICAL nova [None req-75e9ecec-7cb4-47f7-a410-4056b8e1c213 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Unhandled error: OSError: write error Jun 17 15:32:46.416520 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova OSError: write error Jun 17 15:32:46.416520 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova Jun 17 15:32:46.416835 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1002/1589] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:32:46 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 0 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Jun 17 15:32:46.422401 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-f1d26613-5a05-4b4e-bf60-62a8d26aae22 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:32:46.422945 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-f1d26613-5a05-4b4e-bf60-62a8d26aae22 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:32:46.448765 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-cb87ec92-a32e-474a-a3ae-4c2e4c33626b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087907 Jun 17 15:32:46.448932 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f1d26613-5a05-4b4e-bf60-62a8d26aae22 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:46.449406 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f1d26613-5a05-4b4e-bf60-62a8d26aae22 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:46.449974 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Fri Jun 17 15:32:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments (ip 10.222.0.48) !!! Jun 17 15:32:46.450137 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Fri Jun 17 15:32:46 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments (10.222.0.48) Jun 17 15:32:46.450917 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f1d26613-5a05-4b4e-bf60-62a8d26aae22 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:46.451900 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: CRITICAL nova [None req-cb87ec92-a32e-474a-a3ae-4c2e4c33626b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Unhandled error: OSError: write error Jun 17 15:32:46.451900 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova OSError: write error Jun 17 15:32:46.451900 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova Jun 17 15:32:46.452395 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 588/1590] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:32:46 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 0 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Jun 17 15:32:46.452824 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f1d26613-5a05-4b4e-bf60-62a8d26aae22 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:46.571494 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.objects.instance [None req-f1d26613-5a05-4b4e-bf60-62a8d26aae22 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lazy-loading 'services' on Instance uuid ba5d3180-d42a-4678-af13-c99282e054bf {{(pid=117650) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 15:32:46.608964 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-8be43758-91fb-4d15-81df-d9ec524daf80 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:32:46.609596 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-8be43758-91fb-4d15-81df-d9ec524daf80 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:32:46.616423 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8be43758-91fb-4d15-81df-d9ec524daf80 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:46.617017 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8be43758-91fb-4d15-81df-d9ec524daf80 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:46.618335 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8be43758-91fb-4d15-81df-d9ec524daf80 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:46.620377 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8be43758-91fb-4d15-81df-d9ec524daf80 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:46.649774 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.wsgi [None req-f1d26613-5a05-4b4e-bf60-62a8d26aae22 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4ea349d8-8de0-428d-9162-e9d5cf65f47e) Jun 17 15:32:46.652018 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-f1d26613-5a05-4b4e-bf60-62a8d26aae22 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Request method failure captured: Jun 17 15:32:46.652018 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: request: DELETE /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments/713822dc-11e8-4f5c-ae7c-bcf41e01b06d HTTP/1.1 Jun 17 15:32:46.652018 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Accept: application/json Jun 17 15:32:46.652018 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Accept-Encoding: identity Jun 17 15:32:46.652018 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Connection: close Jun 17 15:32:46.652018 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Content-Length: 0 Jun 17 15:32:46.652018 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Content-Type: application/json Jun 17 15:32:46.652018 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Host: 10.222.0.48 Jun 17 15:32:46.652018 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Openstack-System-Scope: None Jun 17 15:32:46.652018 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: User-Agent: python-urllib3/1.26.9 Jun 17 15:32:46.652018 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Auth-Token: gAAAAABirJmQC7m757v9yyJD0BsI2MhqMNm1yc2WpkBWgAGOwCYW524pgy_6_7F6gBQez89A-LSNviRE5zDFwqgj2BZoXTsMX0NmzFHDYuHo31ibepKT71785ic3IrIvGY4IglQk81nqgsevYUUWYR-s69vMdAmv9JQXTwFMOwaCzN_3w4dwj6k Jun 17 15:32:46.652018 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Domain-Id: None Jun 17 15:32:46.652018 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Domain-Name: None Jun 17 15:32:46.652018 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Identity-Status: Confirmed Jun 17 15:32:46.652018 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Is-Admin-Project: True Jun 17 15:32:46.652018 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Domain-Id: default Jun 17 15:32:46.652018 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Domain-Name: Default Jun 17 15:32:46.652018 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Id: 50408ec18fa04036a0abb6236343e258 Jun 17 15:32:46.652018 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1478734135 Jun 17 15:32:46.652018 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Role: reader,member Jun 17 15:32:46.652018 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Roles: reader,member Jun 17 15:32:46.656004 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_50408ec18fa04036a0abb6236343e258", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/50408ec18fa04036a0abb6236343e258"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/50408ec18fa04036a0abb6236343e258"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/50408ec18fa04036a0abb6236343e258"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Jun 17 15:32:46.656004 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1478734135 Jun 17 15:32:46.656004 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant-Id: 50408ec18fa04036a0abb6236343e258 Jun 17 15:32:46.656004 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1478734135 Jun 17 15:32:46.656004 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User: tempest-ServerRescueNegativeTestJSON-1478734135-project Jun 17 15:32:46.656004 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Domain-Id: default Jun 17 15:32:46.656004 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Domain-Name: Default Jun 17 15:32:46.656004 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Id: 562485deaf214fa29eac132464ef93e3 Jun 17 15:32:46.656004 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1478734135-project Jun 17 15:32:46.656004 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: method: > Jun 17 15:32:46.657326 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4ea349d8-8de0-428d-9162-e9d5cf65f47e) Jun 17 15:32:46.657326 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: action_args: {'server_id': 'ba5d3180-d42a-4678-af13-c99282e054bf', 'id': '713822dc-11e8-4f5c-ae7c-bcf41e01b06d'} Jun 17 15:32:46.657326 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 15:32:46.657326 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:46.657326 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 15:32:46.657326 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 15:32:46.657326 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 15:32:46.657326 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 15:32:46.657326 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 15:32:46.657326 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 15:32:46.657326 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 15:32:46.657326 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 15:32:46.657326 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 15:32:46.657326 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 15:32:46.657326 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 15:32:46.657326 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 15:32:46.657326 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 15:32:46.659551 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 15:32:46.659551 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 15:32:46.659551 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 15:32:46.659551 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4ea349d8-8de0-428d-9162-e9d5cf65f47e) Jun 17 15:32:46.659551 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:32:46.659551 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:32:46.659551 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:32:46.659551 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:46.659551 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 17 15:32:46.659551 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 17 15:32:46.659551 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 17 15:32:46.659551 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 17 15:32:46.659551 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 15:32:46.659551 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 15:32:46.659551 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 15:32:46.659551 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 15:32:46.659551 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 15:32:46.659551 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 15:32:46.659551 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 15:32:46.662093 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 15:32:46.662093 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 15:32:46.662093 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 15:32:46.662093 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 15:32:46.662093 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 15:32:46.662093 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 15:32:46.662093 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 15:32:46.662093 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 15:32:46.662093 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 15:32:46.662093 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 15:32:46.662093 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 15:32:46.662093 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4ea349d8-8de0-428d-9162-e9d5cf65f47e) Jun 17 15:32:46.662093 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:32:46.662093 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:32:46.662093 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:32:46.662093 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:46.662093 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 17 15:32:46.668414 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 17 15:32:46.668414 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 17 15:32:46.668414 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 15:32:46.668414 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 17 15:32:46.668414 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 17 15:32:46.668414 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 17 15:32:46.668414 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 17 15:32:46.668414 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 17 15:32:46.668414 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 15:32:46.668414 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 17 15:32:46.668414 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 17 15:32:46.668414 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4ea349d8-8de0-428d-9162-e9d5cf65f47e) Jun 17 15:32:46.668414 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:32:46.668414 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:32:46.668414 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:32:46.668414 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:46.668414 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:32:46.668414 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:32:46.671135 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 15:32:46.671135 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 15:32:46.671135 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 15:32:46.671135 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 15:32:46.671135 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 17 15:32:46.671135 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 17 15:32:46.671135 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4ea349d8-8de0-428d-9162-e9d5cf65f47e) Jun 17 15:32:46.671135 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:32:46.671135 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:32:46.671135 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:32:46.671135 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:46.671135 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:32:46.671135 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:32:46.671135 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 15:32:46.671135 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 15:32:46.671135 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4ea349d8-8de0-428d-9162-e9d5cf65f47e) Jun 17 15:32:46.671135 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:32:46.673422 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-f1d26613-5a05-4b4e-bf60-62a8d26aae22 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4ea349d8-8de0-428d-9162-e9d5cf65f47e) {{(pid=117650) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 15:32:46.673422 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-f1d26613-5a05-4b4e-bf60-62a8d26aae22 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "DELETE /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments/713822dc-11e8-4f5c-ae7c-bcf41e01b06d" status: 400 len: 269 microversion: 2.1 time: 0.235792 Jun 17 15:32:46.673422 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Fri Jun 17 15:32:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments/713822dc-11e8-4f5c-ae7c-bcf41e01b06d (ip 10.222.0.48) !!! Jun 17 15:32:46.673422 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Fri Jun 17 15:32:46 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments/713822dc-11e8-4f5c-ae7c-bcf41e01b06d (10.222.0.48) Jun 17 15:32:46.673422 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: CRITICAL nova [None req-f1d26613-5a05-4b4e-bf60-62a8d26aae22 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Unhandled error: OSError: write error Jun 17 15:32:46.673422 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova OSError: write error Jun 17 15:32:46.673422 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova Jun 17 15:32:46.674670 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1003/1591] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Jun 17 15:32:46 2022] DELETE /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments/713822dc-11e8-4f5c-ae7c-bcf41e01b06d => generated 0 bytes in 238 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Jun 17 15:32:46.674670 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-593764bb-95b8-4db1-9a97-7d7532a11e9f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:32:46.674670 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-593764bb-95b8-4db1-9a97-7d7532a11e9f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:32:46.674670 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-593764bb-95b8-4db1-9a97-7d7532a11e9f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:46.675050 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-593764bb-95b8-4db1-9a97-7d7532a11e9f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:46.675050 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-593764bb-95b8-4db1-9a97-7d7532a11e9f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:46.675050 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-593764bb-95b8-4db1-9a97-7d7532a11e9f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:46.801436 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.objects.instance [None req-593764bb-95b8-4db1-9a97-7d7532a11e9f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lazy-loading 'services' on Instance uuid 808f28e6-03bc-4b67-ab1f-f1ef13838924 {{(pid=117650) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 15:32:46.814728 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-8be43758-91fb-4d15-81df-d9ec524daf80 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:32:46.828489 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-8be43758-91fb-4d15-81df-d9ec524daf80 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1563 microversion: 2.1 time: 0.374717 Jun 17 15:32:46.829107 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Fri Jun 17 15:32:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 (ip 10.222.0.48) !!! Jun 17 15:32:46.829107 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Fri Jun 17 15:32:46 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 (10.222.0.48) Jun 17 15:32:46.830138 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: CRITICAL nova [None req-8be43758-91fb-4d15-81df-d9ec524daf80 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Unhandled error: OSError: write error Jun 17 15:32:46.830138 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova OSError: write error Jun 17 15:32:46.830138 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova Jun 17 15:32:46.830385 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 589/1592] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:32:46 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 0 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Jun 17 15:32:46.838406 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-bc8243be-b8d9-4fb8-bba0-1152c78e4776 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:32:46.839250 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-bc8243be-b8d9-4fb8-bba0-1152c78e4776 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:32:46.846190 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bc8243be-b8d9-4fb8-bba0-1152c78e4776 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:46.846682 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bc8243be-b8d9-4fb8-bba0-1152c78e4776 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:46.847582 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bc8243be-b8d9-4fb8-bba0-1152c78e4776 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:46.848918 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bc8243be-b8d9-4fb8-bba0-1152c78e4776 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:46.865985 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.wsgi [None req-bc8243be-b8d9-4fb8-bba0-1152c78e4776 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] HTTP exception thrown: Instance 8fee7bc0-cd0e-4c25-8475-b43e79cb933a could not be found. Jun 17 15:32:46.867799 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-bc8243be-b8d9-4fb8-bba0-1152c78e4776 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Request method failure captured: Jun 17 15:32:46.867799 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: request: GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a HTTP/1.1 Jun 17 15:32:46.867799 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Accept: application/json Jun 17 15:32:46.867799 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Accept-Encoding: identity Jun 17 15:32:46.867799 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Connection: close Jun 17 15:32:46.867799 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Content-Length: 0 Jun 17 15:32:46.867799 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Content-Type: application/json Jun 17 15:32:46.867799 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Host: 10.222.0.48 Jun 17 15:32:46.867799 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Openstack-System-Scope: None Jun 17 15:32:46.867799 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: User-Agent: python-urllib3/1.26.9 Jun 17 15:32:46.867799 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Auth-Token: gAAAAABirJodidJx0AY_qcwoEwWEszpikfHtXmarSN0h6rNL3nP0iBWXeXbu1IBvVskBSxMS5UAzkWIcgkCzT0_jtZtoDW3a4yLFd9G-iV8iuD24PAIeHzq28KHUo0wHpTFHnG1joRgrCGGOeiOwT6JyvzMgTpEgSjE1WKGTngEoPIRC3Gt4VEE Jun 17 15:32:46.867799 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Domain-Id: None Jun 17 15:32:46.867799 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Domain-Name: None Jun 17 15:32:46.867799 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Identity-Status: Confirmed Jun 17 15:32:46.867799 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Is-Admin-Project: True Jun 17 15:32:46.867799 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Domain-Id: default Jun 17 15:32:46.867799 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Domain-Name: Default Jun 17 15:32:46.867799 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Id: 6298c1910e1a488983d5399d7952a5cf Jun 17 15:32:46.867799 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Name: tempest-TestVolumeBootPattern-1895714660 Jun 17 15:32:46.867799 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Role: reader,member Jun 17 15:32:46.867799 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Roles: reader,member Jun 17 15:32:46.870882 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6298c1910e1a488983d5399d7952a5cf", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6298c1910e1a488983d5399d7952a5cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6298c1910e1a488983d5399d7952a5cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6298c1910e1a488983d5399d7952a5cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Jun 17 15:32:46.870882 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant: tempest-TestVolumeBootPattern-1895714660 Jun 17 15:32:46.870882 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant-Id: 6298c1910e1a488983d5399d7952a5cf Jun 17 15:32:46.870882 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant-Name: tempest-TestVolumeBootPattern-1895714660 Jun 17 15:32:46.870882 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User: tempest-TestVolumeBootPattern-1895714660-project Jun 17 15:32:46.870882 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Domain-Id: default Jun 17 15:32:46.870882 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Domain-Name: Default Jun 17 15:32:46.870882 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Id: 4e3e797edb9a453d9142c3196a4f21bb Jun 17 15:32:46.870882 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Name: tempest-TestVolumeBootPattern-1895714660-project Jun 17 15:32:46.870882 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: method: > Jun 17 15:32:46.870882 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: exception: Instance 8fee7bc0-cd0e-4c25-8475-b43e79cb933a could not be found. Jun 17 15:32:46.870882 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: action_args: {'id': '8fee7bc0-cd0e-4c25-8475-b43e79cb933a'} Jun 17 15:32:46.873486 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 15:32:46.873486 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:46.873486 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 15:32:46.873486 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 15:32:46.873486 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 15:32:46.873486 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 15:32:46.873486 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 15:32:46.873486 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 15:32:46.873486 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 15:32:46.873486 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 15:32:46.873486 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fee7bc0-cd0e-4c25-8475-b43e79cb933a could not be found. Jun 17 15:32:46.873486 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:32:46.873486 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:32:46.873486 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:32:46.873486 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:46.873486 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:32:46.873486 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:32:46.873486 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 15:32:46.873486 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 15:32:46.873486 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 15:32:46.876123 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 15:32:46.876123 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 15:32:46.876123 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 15:32:46.876123 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 15:32:46.876123 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 15:32:46.876123 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 15:32:46.876123 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 15:32:46.876123 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fee7bc0-cd0e-4c25-8475-b43e79cb933a could not be found. Jun 17 15:32:46.876123 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:32:46.876123 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:32:46.876123 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:32:46.876123 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:46.876123 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:32:46.876123 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:32:46.876123 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 15:32:46.876123 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 15:32:46.876123 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fee7bc0-cd0e-4c25-8475-b43e79cb933a could not be found. Jun 17 15:32:46.876123 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:32:46.878773 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-bc8243be-b8d9-4fb8-bba0-1152c78e4776 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Returning 404 to user: Instance 8fee7bc0-cd0e-4c25-8475-b43e79cb933a could not be found. {{(pid=117649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 15:32:46.878943 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.wsgi [None req-593764bb-95b8-4db1-9a97-7d7532a11e9f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-66b48f53-7e06-460a-ac83-f1613243a800) Jun 17 15:32:46.879123 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-bc8243be-b8d9-4fb8-bba0-1152c78e4776 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 404 len: 111 microversion: 2.1 time: 0.038421 Jun 17 15:32:46.879123 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Fri Jun 17 15:32:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a (ip 10.222.0.48) !!! Jun 17 15:32:46.879123 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Fri Jun 17 15:32:46 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a (10.222.0.48) Jun 17 15:32:46.879123 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: CRITICAL nova [None req-bc8243be-b8d9-4fb8-bba0-1152c78e4776 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Unhandled error: OSError: write error Jun 17 15:32:46.879123 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova OSError: write error Jun 17 15:32:46.879123 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova Jun 17 15:32:46.879123 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 590/1593] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:32:46 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 0 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 0 bytes (0 switches on core 0) Jun 17 15:32:46.880062 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-593764bb-95b8-4db1-9a97-7d7532a11e9f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Request method failure captured: Jun 17 15:32:46.880062 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: request: DELETE /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924/os-volume_attachments/4e6d668f-6234-4ba9-913a-11f57866e984 HTTP/1.1 Jun 17 15:32:46.880062 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Accept: application/json Jun 17 15:32:46.880062 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Accept-Encoding: identity Jun 17 15:32:46.880062 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Connection: close Jun 17 15:32:46.880062 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Content-Length: 0 Jun 17 15:32:46.880062 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Content-Type: application/json Jun 17 15:32:46.880062 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Host: 10.222.0.48 Jun 17 15:32:46.880062 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Openstack-System-Scope: None Jun 17 15:32:46.880062 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: User-Agent: python-urllib3/1.26.9 Jun 17 15:32:46.880062 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Auth-Token: gAAAAABirJpPRELvo50oKxdbD2bQ6GGouzj8i1DebBt1zfB7fX0V-PDU7hlPCfVEJbYQ9PsMuU2ZA4JvqklZ9Y9hD2QbIWtBnNkd8fMsMcOzOLJcX5MT958XBAGaNkW3F9LEBjk4LnqtyEbVGNYjmbh2tqH5UI9WDRv0xJagRknfyHTSn0wpzG0 Jun 17 15:32:46.880062 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Domain-Id: None Jun 17 15:32:46.880062 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Domain-Name: None Jun 17 15:32:46.880062 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Identity-Status: Confirmed Jun 17 15:32:46.880062 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Is-Admin-Project: True Jun 17 15:32:46.880062 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Domain-Id: default Jun 17 15:32:46.880062 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Domain-Name: Default Jun 17 15:32:46.880062 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Id: 42b42320bc424a19b4ac5e35dae7afb3 Jun 17 15:32:46.880062 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1590813198 Jun 17 15:32:46.880062 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Role: reader,member Jun 17 15:32:46.880062 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Roles: reader,member Jun 17 15:32:46.882771 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_42b42320bc424a19b4ac5e35dae7afb3", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/42b42320bc424a19b4ac5e35dae7afb3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/42b42320bc424a19b4ac5e35dae7afb3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/42b42320bc424a19b4ac5e35dae7afb3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Jun 17 15:32:46.882771 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant: tempest-VolumesSnapshotTestJSON-1590813198 Jun 17 15:32:46.882771 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant-Id: 42b42320bc424a19b4ac5e35dae7afb3 Jun 17 15:32:46.882771 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1590813198 Jun 17 15:32:46.882771 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User: tempest-VolumesSnapshotTestJSON-1590813198-project Jun 17 15:32:46.882771 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Domain-Id: default Jun 17 15:32:46.882771 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Domain-Name: Default Jun 17 15:32:46.882771 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Id: b6ac8cbc7c6d4cce9d2b0a1289846a3d Jun 17 15:32:46.882771 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Name: tempest-VolumesSnapshotTestJSON-1590813198-project Jun 17 15:32:46.882771 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: method: > Jun 17 15:32:46.884720 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-66b48f53-7e06-460a-ac83-f1613243a800) Jun 17 15:32:46.884720 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: action_args: {'server_id': '808f28e6-03bc-4b67-ab1f-f1ef13838924', 'id': '4e6d668f-6234-4ba9-913a-11f57866e984'} Jun 17 15:32:46.884720 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 15:32:46.884720 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:46.884720 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 15:32:46.884720 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 15:32:46.884720 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 15:32:46.884720 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 15:32:46.884720 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 15:32:46.884720 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 15:32:46.884720 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 15:32:46.884720 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 15:32:46.884720 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 15:32:46.884720 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 15:32:46.884720 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 15:32:46.884720 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 15:32:46.884720 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 15:32:46.888954 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 15:32:46.888954 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 15:32:46.888954 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 15:32:46.888954 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-66b48f53-7e06-460a-ac83-f1613243a800) Jun 17 15:32:46.888954 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:32:46.888954 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:32:46.888954 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:32:46.888954 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:46.888954 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 17 15:32:46.888954 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 17 15:32:46.888954 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 17 15:32:46.888954 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 17 15:32:46.888954 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 15:32:46.888954 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 15:32:46.888954 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 15:32:46.888954 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 15:32:46.888954 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 15:32:46.888954 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 15:32:46.888954 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 15:32:46.891968 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 15:32:46.891968 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 15:32:46.891968 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 15:32:46.891968 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 15:32:46.891968 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 15:32:46.891968 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 15:32:46.891968 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 15:32:46.891968 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 15:32:46.891968 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 15:32:46.891968 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 15:32:46.891968 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 15:32:46.891968 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-66b48f53-7e06-460a-ac83-f1613243a800) Jun 17 15:32:46.891968 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:32:46.891968 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:32:46.891968 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:32:46.891968 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:46.891968 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 17 15:32:46.894718 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 17 15:32:46.894718 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 17 15:32:46.894718 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 15:32:46.894718 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 17 15:32:46.894718 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 17 15:32:46.894718 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 17 15:32:46.894718 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 17 15:32:46.894718 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 17 15:32:46.894718 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 15:32:46.894718 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 17 15:32:46.894718 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 17 15:32:46.894718 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-66b48f53-7e06-460a-ac83-f1613243a800) Jun 17 15:32:46.894718 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:32:46.894718 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:32:46.894718 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:32:46.894718 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:46.894718 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:32:46.894718 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:32:46.897345 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 15:32:46.897345 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 15:32:46.897345 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 15:32:46.897345 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 15:32:46.897345 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 17 15:32:46.897345 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 17 15:32:46.897345 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-66b48f53-7e06-460a-ac83-f1613243a800) Jun 17 15:32:46.897345 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:32:46.897345 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:32:46.897345 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:32:46.897345 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:46.897345 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:32:46.897345 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:32:46.897345 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 15:32:46.897345 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 15:32:46.897345 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-66b48f53-7e06-460a-ac83-f1613243a800) Jun 17 15:32:46.897345 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:32:46.902468 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-593764bb-95b8-4db1-9a97-7d7532a11e9f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-66b48f53-7e06-460a-ac83-f1613243a800) {{(pid=117650) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 15:32:46.902468 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-593764bb-95b8-4db1-9a97-7d7532a11e9f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "DELETE /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924/os-volume_attachments/4e6d668f-6234-4ba9-913a-11f57866e984" status: 400 len: 269 microversion: 2.1 time: 0.219273 Jun 17 15:32:46.902468 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Fri Jun 17 15:32:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924/os-volume_attachments/4e6d668f-6234-4ba9-913a-11f57866e984 (ip 10.222.0.48) !!! Jun 17 15:32:46.902468 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Fri Jun 17 15:32:46 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924/os-volume_attachments/4e6d668f-6234-4ba9-913a-11f57866e984 (10.222.0.48) Jun 17 15:32:46.902468 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: CRITICAL nova [None req-593764bb-95b8-4db1-9a97-7d7532a11e9f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Unhandled error: OSError: write error Jun 17 15:32:46.902468 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova OSError: write error Jun 17 15:32:46.902468 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova Jun 17 15:32:46.903958 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1004/1594] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Jun 17 15:32:46 2022] DELETE /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924/os-volume_attachments/4e6d668f-6234-4ba9-913a-11f57866e984 => generated 0 bytes in 222 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Jun 17 15:32:46.904131 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-aa575e00-85fd-482f-a4bd-bbe1013df795 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:32:46.904131 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-aa575e00-85fd-482f-a4bd-bbe1013df795 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:32:46.906144 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-cc249918-88c7-4244-9491-22cd57427e74 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:32:46.906144 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-cc249918-88c7-4244-9491-22cd57427e74 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:32:46.906498 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-aa575e00-85fd-482f-a4bd-bbe1013df795 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:46.906498 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-aa575e00-85fd-482f-a4bd-bbe1013df795 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:46.906498 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-aa575e00-85fd-482f-a4bd-bbe1013df795 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:46.906498 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-aa575e00-85fd-482f-a4bd-bbe1013df795 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:46.907093 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cc249918-88c7-4244-9491-22cd57427e74 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:46.907093 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cc249918-88c7-4244-9491-22cd57427e74 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:46.907093 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cc249918-88c7-4244-9491-22cd57427e74 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:46.907093 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cc249918-88c7-4244-9491-22cd57427e74 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:46.938103 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-aa575e00-85fd-482f-a4bd-bbe1013df795 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063736 Jun 17 15:32:46.938749 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Fri Jun 17 15:32:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments (ip 10.222.0.48) !!! Jun 17 15:32:46.938749 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Fri Jun 17 15:32:46 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments (10.222.0.48) Jun 17 15:32:46.939495 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: CRITICAL nova [None req-aa575e00-85fd-482f-a4bd-bbe1013df795 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Unhandled error: OSError: write error Jun 17 15:32:46.939495 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova OSError: write error Jun 17 15:32:46.939495 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova Jun 17 15:32:46.939780 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 591/1595] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:32:46 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 0 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Jun 17 15:32:46.944859 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-63985aec-de39-4f01-9123-b8f4ecc89f57 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:32:46.945479 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-63985aec-de39-4f01-9123-b8f4ecc89f57 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:32:46.954806 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-63985aec-de39-4f01-9123-b8f4ecc89f57 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:46.955548 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-63985aec-de39-4f01-9123-b8f4ecc89f57 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:46.956889 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-63985aec-de39-4f01-9123-b8f4ecc89f57 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:46.957601 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-63985aec-de39-4f01-9123-b8f4ecc89f57 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:47.010577 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.objects.instance [None req-cc249918-88c7-4244-9491-22cd57427e74 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lazy-loading 'services' on Instance uuid ba5d3180-d42a-4678-af13-c99282e054bf {{(pid=117650) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 15:32:47.091986 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.wsgi [None req-cc249918-88c7-4244-9491-22cd57427e74 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d4597ac2-fa40-4943-9bb5-d5010ef3facc) Jun 17 15:32:47.095077 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-cc249918-88c7-4244-9491-22cd57427e74 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Request method failure captured: Jun 17 15:32:47.095077 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: request: DELETE /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments/713822dc-11e8-4f5c-ae7c-bcf41e01b06d HTTP/1.1 Jun 17 15:32:47.095077 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Accept: application/json Jun 17 15:32:47.095077 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Accept-Encoding: identity Jun 17 15:32:47.095077 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Connection: close Jun 17 15:32:47.095077 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Content-Length: 0 Jun 17 15:32:47.095077 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Content-Type: application/json Jun 17 15:32:47.095077 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Host: 10.222.0.48 Jun 17 15:32:47.095077 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Openstack-System-Scope: None Jun 17 15:32:47.095077 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: User-Agent: python-urllib3/1.26.9 Jun 17 15:32:47.095077 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Auth-Token: gAAAAABirJmQC7m757v9yyJD0BsI2MhqMNm1yc2WpkBWgAGOwCYW524pgy_6_7F6gBQez89A-LSNviRE5zDFwqgj2BZoXTsMX0NmzFHDYuHo31ibepKT71785ic3IrIvGY4IglQk81nqgsevYUUWYR-s69vMdAmv9JQXTwFMOwaCzN_3w4dwj6k Jun 17 15:32:47.095077 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Domain-Id: None Jun 17 15:32:47.095077 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Domain-Name: None Jun 17 15:32:47.095077 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Identity-Status: Confirmed Jun 17 15:32:47.095077 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Is-Admin-Project: True Jun 17 15:32:47.095077 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Domain-Id: default Jun 17 15:32:47.095077 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Domain-Name: Default Jun 17 15:32:47.095077 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Id: 50408ec18fa04036a0abb6236343e258 Jun 17 15:32:47.095077 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1478734135 Jun 17 15:32:47.095077 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Role: reader,member Jun 17 15:32:47.095077 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Roles: reader,member Jun 17 15:32:47.097565 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_50408ec18fa04036a0abb6236343e258", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/50408ec18fa04036a0abb6236343e258"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/50408ec18fa04036a0abb6236343e258"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/50408ec18fa04036a0abb6236343e258"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Jun 17 15:32:47.097565 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1478734135 Jun 17 15:32:47.097565 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant-Id: 50408ec18fa04036a0abb6236343e258 Jun 17 15:32:47.097565 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1478734135 Jun 17 15:32:47.097565 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User: tempest-ServerRescueNegativeTestJSON-1478734135-project Jun 17 15:32:47.097565 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Domain-Id: default Jun 17 15:32:47.097565 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Domain-Name: Default Jun 17 15:32:47.097565 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Id: 562485deaf214fa29eac132464ef93e3 Jun 17 15:32:47.097565 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1478734135-project Jun 17 15:32:47.097565 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: method: > Jun 17 15:32:47.099018 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d4597ac2-fa40-4943-9bb5-d5010ef3facc) Jun 17 15:32:47.099018 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: action_args: {'server_id': 'ba5d3180-d42a-4678-af13-c99282e054bf', 'id': '713822dc-11e8-4f5c-ae7c-bcf41e01b06d'} Jun 17 15:32:47.099018 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 15:32:47.099018 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:47.099018 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 15:32:47.099018 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 15:32:47.099018 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 15:32:47.099018 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 15:32:47.099018 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 15:32:47.099018 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 15:32:47.099018 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 15:32:47.099018 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 15:32:47.099018 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 15:32:47.099018 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 15:32:47.099018 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 15:32:47.099018 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 15:32:47.099018 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 15:32:47.100911 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 15:32:47.100911 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 15:32:47.100911 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 15:32:47.100911 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d4597ac2-fa40-4943-9bb5-d5010ef3facc) Jun 17 15:32:47.100911 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:32:47.100911 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:32:47.100911 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:32:47.100911 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:47.100911 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 17 15:32:47.100911 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 17 15:32:47.100911 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 17 15:32:47.100911 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 17 15:32:47.100911 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 15:32:47.100911 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 15:32:47.100911 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 15:32:47.100911 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 15:32:47.100911 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 15:32:47.100911 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 15:32:47.100911 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 15:32:47.102978 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 15:32:47.102978 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 15:32:47.102978 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 15:32:47.102978 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 15:32:47.102978 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 15:32:47.102978 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 15:32:47.102978 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 15:32:47.102978 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 15:32:47.102978 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 15:32:47.102978 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 15:32:47.102978 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 15:32:47.102978 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d4597ac2-fa40-4943-9bb5-d5010ef3facc) Jun 17 15:32:47.102978 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:32:47.102978 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:32:47.102978 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:32:47.102978 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:47.102978 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 17 15:32:47.105916 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 17 15:32:47.105916 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 17 15:32:47.105916 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 15:32:47.105916 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 17 15:32:47.105916 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 17 15:32:47.105916 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 17 15:32:47.105916 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 17 15:32:47.105916 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 17 15:32:47.105916 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 15:32:47.105916 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 17 15:32:47.105916 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 17 15:32:47.105916 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d4597ac2-fa40-4943-9bb5-d5010ef3facc) Jun 17 15:32:47.105916 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:32:47.105916 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:32:47.105916 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:32:47.105916 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:47.105916 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:32:47.105916 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:32:47.108455 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 15:32:47.108455 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 15:32:47.108455 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 15:32:47.108455 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 15:32:47.108455 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 17 15:32:47.108455 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 17 15:32:47.108455 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d4597ac2-fa40-4943-9bb5-d5010ef3facc) Jun 17 15:32:47.108455 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:32:47.108455 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:32:47.108455 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:32:47.108455 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:47.108455 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:32:47.108455 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:32:47.108455 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 15:32:47.108455 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 15:32:47.108455 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d4597ac2-fa40-4943-9bb5-d5010ef3facc) Jun 17 15:32:47.108455 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:32:47.110746 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-cc249918-88c7-4244-9491-22cd57427e74 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d4597ac2-fa40-4943-9bb5-d5010ef3facc) {{(pid=117650) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 15:32:47.110746 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-cc249918-88c7-4244-9491-22cd57427e74 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "DELETE /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments/713822dc-11e8-4f5c-ae7c-bcf41e01b06d" status: 400 len: 269 microversion: 2.1 time: 0.217777 Jun 17 15:32:47.110746 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Fri Jun 17 15:32:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments/713822dc-11e8-4f5c-ae7c-bcf41e01b06d (ip 10.222.0.48) !!! Jun 17 15:32:47.110746 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Fri Jun 17 15:32:47 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments/713822dc-11e8-4f5c-ae7c-bcf41e01b06d (10.222.0.48) Jun 17 15:32:47.110746 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: CRITICAL nova [None req-cc249918-88c7-4244-9491-22cd57427e74 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Unhandled error: OSError: write error Jun 17 15:32:47.110746 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova OSError: write error Jun 17 15:32:47.110746 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova Jun 17 15:32:47.111796 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1005/1596] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Jun 17 15:32:46 2022] DELETE /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments/713822dc-11e8-4f5c-ae7c-bcf41e01b06d => generated 0 bytes in 220 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Jun 17 15:32:47.111796 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-31b11510-a67b-4e5a-a1ec-6243bead14d8 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:32:47.111796 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-31b11510-a67b-4e5a-a1ec-6243bead14d8 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:32:47.112249 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-31b11510-a67b-4e5a-a1ec-6243bead14d8 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:47.112841 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-31b11510-a67b-4e5a-a1ec-6243bead14d8 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:47.113991 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-31b11510-a67b-4e5a-a1ec-6243bead14d8 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:47.114540 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-31b11510-a67b-4e5a-a1ec-6243bead14d8 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:47.132411 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-63985aec-de39-4f01-9123-b8f4ecc89f57 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:32:47.147073 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-63985aec-de39-4f01-9123-b8f4ecc89f57 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1563 microversion: 2.1 time: 0.205772 Jun 17 15:32:47.147993 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Fri Jun 17 15:32:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 (ip 10.222.0.48) !!! Jun 17 15:32:47.147993 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Fri Jun 17 15:32:47 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 (10.222.0.48) Jun 17 15:32:47.149378 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: CRITICAL nova [None req-63985aec-de39-4f01-9123-b8f4ecc89f57 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Unhandled error: OSError: write error Jun 17 15:32:47.149378 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova OSError: write error Jun 17 15:32:47.149378 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova Jun 17 15:32:47.149815 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 592/1597] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:32:46 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 0 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Jun 17 15:32:47.156256 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-8119c3a5-2500-4677-8e0a-abe0f390b1b1 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:32:47.157176 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-8119c3a5-2500-4677-8e0a-abe0f390b1b1 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:32:47.166182 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8119c3a5-2500-4677-8e0a-abe0f390b1b1 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:47.166683 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8119c3a5-2500-4677-8e0a-abe0f390b1b1 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:47.167693 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8119c3a5-2500-4677-8e0a-abe0f390b1b1 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:47.168440 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8119c3a5-2500-4677-8e0a-abe0f390b1b1 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:47.188864 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.wsgi [None req-8119c3a5-2500-4677-8e0a-abe0f390b1b1 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] HTTP exception thrown: Instance 8fee7bc0-cd0e-4c25-8475-b43e79cb933a could not be found. Jun 17 15:32:47.191474 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-8119c3a5-2500-4677-8e0a-abe0f390b1b1 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Request method failure captured: Jun 17 15:32:47.191474 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: request: GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a HTTP/1.1 Jun 17 15:32:47.191474 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Accept: application/json Jun 17 15:32:47.191474 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Accept-Encoding: identity Jun 17 15:32:47.191474 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Connection: close Jun 17 15:32:47.191474 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Content-Length: 0 Jun 17 15:32:47.191474 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Content-Type: application/json Jun 17 15:32:47.191474 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Host: 10.222.0.48 Jun 17 15:32:47.191474 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Openstack-System-Scope: None Jun 17 15:32:47.191474 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: User-Agent: python-urllib3/1.26.9 Jun 17 15:32:47.191474 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Auth-Token: gAAAAABirJodidJx0AY_qcwoEwWEszpikfHtXmarSN0h6rNL3nP0iBWXeXbu1IBvVskBSxMS5UAzkWIcgkCzT0_jtZtoDW3a4yLFd9G-iV8iuD24PAIeHzq28KHUo0wHpTFHnG1joRgrCGGOeiOwT6JyvzMgTpEgSjE1WKGTngEoPIRC3Gt4VEE Jun 17 15:32:47.191474 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Domain-Id: None Jun 17 15:32:47.191474 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Domain-Name: None Jun 17 15:32:47.191474 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Identity-Status: Confirmed Jun 17 15:32:47.191474 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Is-Admin-Project: True Jun 17 15:32:47.191474 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Domain-Id: default Jun 17 15:32:47.191474 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Domain-Name: Default Jun 17 15:32:47.191474 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Id: 6298c1910e1a488983d5399d7952a5cf Jun 17 15:32:47.191474 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Name: tempest-TestVolumeBootPattern-1895714660 Jun 17 15:32:47.191474 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Role: reader,member Jun 17 15:32:47.191474 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Roles: reader,member Jun 17 15:32:47.194062 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6298c1910e1a488983d5399d7952a5cf", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6298c1910e1a488983d5399d7952a5cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6298c1910e1a488983d5399d7952a5cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6298c1910e1a488983d5399d7952a5cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Jun 17 15:32:47.194062 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant: tempest-TestVolumeBootPattern-1895714660 Jun 17 15:32:47.194062 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant-Id: 6298c1910e1a488983d5399d7952a5cf Jun 17 15:32:47.194062 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant-Name: tempest-TestVolumeBootPattern-1895714660 Jun 17 15:32:47.194062 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User: tempest-TestVolumeBootPattern-1895714660-project Jun 17 15:32:47.194062 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Domain-Id: default Jun 17 15:32:47.194062 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Domain-Name: Default Jun 17 15:32:47.194062 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Id: 4e3e797edb9a453d9142c3196a4f21bb Jun 17 15:32:47.194062 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Name: tempest-TestVolumeBootPattern-1895714660-project Jun 17 15:32:47.194062 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: method: > Jun 17 15:32:47.194062 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: exception: Instance 8fee7bc0-cd0e-4c25-8475-b43e79cb933a could not be found. Jun 17 15:32:47.194062 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: action_args: {'id': '8fee7bc0-cd0e-4c25-8475-b43e79cb933a'} Jun 17 15:32:47.195549 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 15:32:47.195549 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:47.195549 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 15:32:47.195549 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 15:32:47.195549 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 15:32:47.195549 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 15:32:47.195549 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 15:32:47.195549 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 15:32:47.195549 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 15:32:47.195549 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 15:32:47.195549 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fee7bc0-cd0e-4c25-8475-b43e79cb933a could not be found. Jun 17 15:32:47.195549 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:32:47.195549 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:32:47.195549 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:32:47.195549 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:47.195549 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:32:47.195549 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:32:47.195549 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 15:32:47.195549 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 15:32:47.195549 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 15:32:47.199246 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 15:32:47.199246 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 15:32:47.199246 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 15:32:47.199246 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 15:32:47.199246 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 15:32:47.199246 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 15:32:47.199246 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 15:32:47.199246 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fee7bc0-cd0e-4c25-8475-b43e79cb933a could not be found. Jun 17 15:32:47.199246 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:32:47.199246 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:32:47.199246 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:32:47.199246 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:47.199246 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:32:47.199246 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:32:47.199246 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 15:32:47.199246 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 15:32:47.199246 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fee7bc0-cd0e-4c25-8475-b43e79cb933a could not be found. Jun 17 15:32:47.199246 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:32:47.203452 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-8119c3a5-2500-4677-8e0a-abe0f390b1b1 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Returning 404 to user: Instance 8fee7bc0-cd0e-4c25-8475-b43e79cb933a could not be found. {{(pid=117649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 15:32:47.203452 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-8119c3a5-2500-4677-8e0a-abe0f390b1b1 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 404 len: 111 microversion: 2.1 time: 0.042660 Jun 17 15:32:47.203452 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Fri Jun 17 15:32:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a (ip 10.222.0.48) !!! Jun 17 15:32:47.203452 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Fri Jun 17 15:32:47 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a (10.222.0.48) Jun 17 15:32:47.203452 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: CRITICAL nova [None req-8119c3a5-2500-4677-8e0a-abe0f390b1b1 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Unhandled error: OSError: write error Jun 17 15:32:47.203452 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova OSError: write error Jun 17 15:32:47.203452 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova Jun 17 15:32:47.203452 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 593/1598] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:32:47 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 0 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 0 bytes (0 switches on core 0) Jun 17 15:32:47.204807 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-3a1ad9ee-e051-47f4-ad13-b9e0327342ef tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:32:47.206169 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-3a1ad9ee-e051-47f4-ad13-b9e0327342ef tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:32:47.207860 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.objects.instance [None req-31b11510-a67b-4e5a-a1ec-6243bead14d8 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lazy-loading 'services' on Instance uuid 808f28e6-03bc-4b67-ab1f-f1ef13838924 {{(pid=117650) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 15:32:47.217089 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3a1ad9ee-e051-47f4-ad13-b9e0327342ef tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:47.217836 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3a1ad9ee-e051-47f4-ad13-b9e0327342ef tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:47.219195 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3a1ad9ee-e051-47f4-ad13-b9e0327342ef tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:47.219800 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3a1ad9ee-e051-47f4-ad13-b9e0327342ef tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:47.269477 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.wsgi [None req-31b11510-a67b-4e5a-a1ec-6243bead14d8 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9057c298-4d46-43f7-b279-3729382e6309) Jun 17 15:32:47.272560 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-31b11510-a67b-4e5a-a1ec-6243bead14d8 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Request method failure captured: Jun 17 15:32:47.272560 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: request: DELETE /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924/os-volume_attachments/4e6d668f-6234-4ba9-913a-11f57866e984 HTTP/1.1 Jun 17 15:32:47.272560 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Accept: application/json Jun 17 15:32:47.272560 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Accept-Encoding: identity Jun 17 15:32:47.272560 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Connection: close Jun 17 15:32:47.272560 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Content-Length: 0 Jun 17 15:32:47.272560 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Content-Type: application/json Jun 17 15:32:47.272560 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Host: 10.222.0.48 Jun 17 15:32:47.272560 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Openstack-System-Scope: None Jun 17 15:32:47.272560 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: User-Agent: python-urllib3/1.26.9 Jun 17 15:32:47.272560 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Auth-Token: gAAAAABirJpPRELvo50oKxdbD2bQ6GGouzj8i1DebBt1zfB7fX0V-PDU7hlPCfVEJbYQ9PsMuU2ZA4JvqklZ9Y9hD2QbIWtBnNkd8fMsMcOzOLJcX5MT958XBAGaNkW3F9LEBjk4LnqtyEbVGNYjmbh2tqH5UI9WDRv0xJagRknfyHTSn0wpzG0 Jun 17 15:32:47.272560 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Domain-Id: None Jun 17 15:32:47.272560 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Domain-Name: None Jun 17 15:32:47.272560 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Identity-Status: Confirmed Jun 17 15:32:47.272560 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Is-Admin-Project: True Jun 17 15:32:47.272560 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Domain-Id: default Jun 17 15:32:47.272560 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Domain-Name: Default Jun 17 15:32:47.272560 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Id: 42b42320bc424a19b4ac5e35dae7afb3 Jun 17 15:32:47.272560 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1590813198 Jun 17 15:32:47.272560 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Role: reader,member Jun 17 15:32:47.272560 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Roles: reader,member Jun 17 15:32:47.274072 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_42b42320bc424a19b4ac5e35dae7afb3", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/42b42320bc424a19b4ac5e35dae7afb3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/42b42320bc424a19b4ac5e35dae7afb3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/42b42320bc424a19b4ac5e35dae7afb3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Jun 17 15:32:47.274072 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant: tempest-VolumesSnapshotTestJSON-1590813198 Jun 17 15:32:47.274072 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant-Id: 42b42320bc424a19b4ac5e35dae7afb3 Jun 17 15:32:47.274072 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1590813198 Jun 17 15:32:47.274072 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User: tempest-VolumesSnapshotTestJSON-1590813198-project Jun 17 15:32:47.274072 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Domain-Id: default Jun 17 15:32:47.274072 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Domain-Name: Default Jun 17 15:32:47.274072 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Id: b6ac8cbc7c6d4cce9d2b0a1289846a3d Jun 17 15:32:47.274072 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Name: tempest-VolumesSnapshotTestJSON-1590813198-project Jun 17 15:32:47.274072 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: method: > Jun 17 15:32:47.274793 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9057c298-4d46-43f7-b279-3729382e6309) Jun 17 15:32:47.274793 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: action_args: {'server_id': '808f28e6-03bc-4b67-ab1f-f1ef13838924', 'id': '4e6d668f-6234-4ba9-913a-11f57866e984'} Jun 17 15:32:47.274793 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 15:32:47.274793 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:47.274793 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 15:32:47.274793 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 15:32:47.274793 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 15:32:47.274793 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 15:32:47.274793 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 15:32:47.274793 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 15:32:47.274793 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 15:32:47.274793 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 15:32:47.274793 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 15:32:47.274793 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 15:32:47.274793 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 15:32:47.274793 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 15:32:47.274793 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 15:32:47.276762 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 15:32:47.276762 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 15:32:47.276762 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 15:32:47.276762 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9057c298-4d46-43f7-b279-3729382e6309) Jun 17 15:32:47.276762 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:32:47.276762 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:32:47.276762 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:32:47.276762 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:47.276762 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 17 15:32:47.276762 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 17 15:32:47.276762 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 17 15:32:47.276762 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 17 15:32:47.276762 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 15:32:47.276762 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 15:32:47.276762 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 15:32:47.276762 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 15:32:47.276762 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 15:32:47.276762 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 15:32:47.276762 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 15:32:47.279626 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 15:32:47.279626 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 15:32:47.279626 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 15:32:47.279626 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 15:32:47.279626 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 15:32:47.279626 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 15:32:47.279626 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 15:32:47.279626 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 15:32:47.279626 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 15:32:47.279626 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 15:32:47.279626 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 15:32:47.279626 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9057c298-4d46-43f7-b279-3729382e6309) Jun 17 15:32:47.279626 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:32:47.279626 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:32:47.279626 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:32:47.279626 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:47.279626 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 17 15:32:47.282029 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 17 15:32:47.282029 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 17 15:32:47.282029 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 15:32:47.282029 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 17 15:32:47.282029 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 17 15:32:47.282029 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 17 15:32:47.282029 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 17 15:32:47.282029 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 17 15:32:47.282029 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 15:32:47.282029 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 17 15:32:47.282029 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 17 15:32:47.282029 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9057c298-4d46-43f7-b279-3729382e6309) Jun 17 15:32:47.282029 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:32:47.282029 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:32:47.282029 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:32:47.282029 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:47.282029 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:32:47.282029 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:32:47.285385 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 15:32:47.285385 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 15:32:47.285385 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 15:32:47.285385 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 15:32:47.285385 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 17 15:32:47.285385 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 17 15:32:47.285385 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9057c298-4d46-43f7-b279-3729382e6309) Jun 17 15:32:47.285385 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:32:47.285385 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:32:47.285385 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:32:47.285385 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:47.285385 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:32:47.285385 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:32:47.285385 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 15:32:47.285385 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 15:32:47.285385 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9057c298-4d46-43f7-b279-3729382e6309) Jun 17 15:32:47.285385 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:32:47.287583 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-3a1ad9ee-e051-47f4-ad13-b9e0327342ef tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076645 Jun 17 15:32:47.287583 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Fri Jun 17 15:32:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments (ip 10.222.0.48) !!! Jun 17 15:32:47.287583 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Fri Jun 17 15:32:47 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments (10.222.0.48) Jun 17 15:32:47.288048 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-31b11510-a67b-4e5a-a1ec-6243bead14d8 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9057c298-4d46-43f7-b279-3729382e6309) {{(pid=117650) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 15:32:47.288201 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: CRITICAL nova [None req-3a1ad9ee-e051-47f4-ad13-b9e0327342ef tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Unhandled error: OSError: write error Jun 17 15:32:47.288201 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova OSError: write error Jun 17 15:32:47.288201 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova Jun 17 15:32:47.288201 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 594/1599] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:32:47 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 0 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Jun 17 15:32:47.288881 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-31b11510-a67b-4e5a-a1ec-6243bead14d8 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "DELETE /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924/os-volume_attachments/4e6d668f-6234-4ba9-913a-11f57866e984" status: 400 len: 269 microversion: 2.1 time: 0.175411 Jun 17 15:32:47.288881 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Fri Jun 17 15:32:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924/os-volume_attachments/4e6d668f-6234-4ba9-913a-11f57866e984 (ip 10.222.0.48) !!! Jun 17 15:32:47.288881 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Fri Jun 17 15:32:47 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924/os-volume_attachments/4e6d668f-6234-4ba9-913a-11f57866e984 (10.222.0.48) Jun 17 15:32:47.288881 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: CRITICAL nova [None req-31b11510-a67b-4e5a-a1ec-6243bead14d8 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Unhandled error: OSError: write error Jun 17 15:32:47.288881 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova OSError: write error Jun 17 15:32:47.288881 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova Jun 17 15:32:47.288881 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1006/1600] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Jun 17 15:32:47 2022] DELETE /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924/os-volume_attachments/4e6d668f-6234-4ba9-913a-11f57866e984 => generated 0 bytes in 177 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Jun 17 15:32:47.289956 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-ef1aa79f-6f4e-4f46-9a81-c5fb61c9efc7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:32:47.289956 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-ef1aa79f-6f4e-4f46-9a81-c5fb61c9efc7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:32:47.290383 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-01696691-a7ef-4d3b-8106-d48f1a4d17ed tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:32:47.290383 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-01696691-a7ef-4d3b-8106-d48f1a4d17ed tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:32:47.290805 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ef1aa79f-6f4e-4f46-9a81-c5fb61c9efc7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:47.290805 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ef1aa79f-6f4e-4f46-9a81-c5fb61c9efc7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:47.290805 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ef1aa79f-6f4e-4f46-9a81-c5fb61c9efc7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:47.290805 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ef1aa79f-6f4e-4f46-9a81-c5fb61c9efc7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:47.292171 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-01696691-a7ef-4d3b-8106-d48f1a4d17ed tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:47.292952 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-01696691-a7ef-4d3b-8106-d48f1a4d17ed tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:47.293900 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-01696691-a7ef-4d3b-8106-d48f1a4d17ed tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:47.294452 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-01696691-a7ef-4d3b-8106-d48f1a4d17ed tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:47.392404 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.objects.instance [None req-ef1aa79f-6f4e-4f46-9a81-c5fb61c9efc7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lazy-loading 'services' on Instance uuid ba5d3180-d42a-4678-af13-c99282e054bf {{(pid=117649) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 15:32:47.472633 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.wsgi [None req-ef1aa79f-6f4e-4f46-9a81-c5fb61c9efc7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c285f95a-abdf-43ab-b970-02faaf818d14) Jun 17 15:32:47.475092 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-ef1aa79f-6f4e-4f46-9a81-c5fb61c9efc7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Request method failure captured: Jun 17 15:32:47.475092 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: request: DELETE /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments/713822dc-11e8-4f5c-ae7c-bcf41e01b06d HTTP/1.1 Jun 17 15:32:47.475092 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Accept: application/json Jun 17 15:32:47.475092 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Accept-Encoding: identity Jun 17 15:32:47.475092 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Connection: close Jun 17 15:32:47.475092 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Content-Length: 0 Jun 17 15:32:47.475092 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Content-Type: application/json Jun 17 15:32:47.475092 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Host: 10.222.0.48 Jun 17 15:32:47.475092 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Openstack-System-Scope: None Jun 17 15:32:47.475092 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: User-Agent: python-urllib3/1.26.9 Jun 17 15:32:47.475092 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Auth-Token: gAAAAABirJmQC7m757v9yyJD0BsI2MhqMNm1yc2WpkBWgAGOwCYW524pgy_6_7F6gBQez89A-LSNviRE5zDFwqgj2BZoXTsMX0NmzFHDYuHo31ibepKT71785ic3IrIvGY4IglQk81nqgsevYUUWYR-s69vMdAmv9JQXTwFMOwaCzN_3w4dwj6k Jun 17 15:32:47.475092 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Domain-Id: None Jun 17 15:32:47.475092 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Domain-Name: None Jun 17 15:32:47.475092 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Identity-Status: Confirmed Jun 17 15:32:47.475092 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Is-Admin-Project: True Jun 17 15:32:47.475092 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Domain-Id: default Jun 17 15:32:47.475092 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Domain-Name: Default Jun 17 15:32:47.475092 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Id: 50408ec18fa04036a0abb6236343e258 Jun 17 15:32:47.475092 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1478734135 Jun 17 15:32:47.475092 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Role: reader,member Jun 17 15:32:47.475092 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Roles: reader,member Jun 17 15:32:47.476493 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_50408ec18fa04036a0abb6236343e258", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/50408ec18fa04036a0abb6236343e258"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/50408ec18fa04036a0abb6236343e258"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/50408ec18fa04036a0abb6236343e258"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Jun 17 15:32:47.476493 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1478734135 Jun 17 15:32:47.476493 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant-Id: 50408ec18fa04036a0abb6236343e258 Jun 17 15:32:47.476493 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1478734135 Jun 17 15:32:47.476493 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User: tempest-ServerRescueNegativeTestJSON-1478734135-project Jun 17 15:32:47.476493 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Domain-Id: default Jun 17 15:32:47.476493 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Domain-Name: Default Jun 17 15:32:47.476493 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Id: 562485deaf214fa29eac132464ef93e3 Jun 17 15:32:47.476493 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1478734135-project Jun 17 15:32:47.476493 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: method: > Jun 17 15:32:47.477145 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c285f95a-abdf-43ab-b970-02faaf818d14) Jun 17 15:32:47.477145 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: action_args: {'server_id': 'ba5d3180-d42a-4678-af13-c99282e054bf', 'id': '713822dc-11e8-4f5c-ae7c-bcf41e01b06d'} Jun 17 15:32:47.477145 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 15:32:47.477145 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:47.477145 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 15:32:47.477145 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 15:32:47.477145 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 15:32:47.477145 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 15:32:47.477145 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 15:32:47.477145 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 15:32:47.477145 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 15:32:47.477145 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 15:32:47.477145 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 15:32:47.477145 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 15:32:47.477145 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 15:32:47.477145 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 15:32:47.477145 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 15:32:47.478433 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 15:32:47.478433 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 15:32:47.478433 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 15:32:47.478433 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c285f95a-abdf-43ab-b970-02faaf818d14) Jun 17 15:32:47.478433 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:32:47.478433 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:32:47.478433 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:32:47.478433 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:47.478433 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 17 15:32:47.478433 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 17 15:32:47.478433 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 17 15:32:47.478433 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 17 15:32:47.478433 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 15:32:47.478433 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 15:32:47.478433 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 15:32:47.478433 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 15:32:47.478433 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 15:32:47.478433 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 15:32:47.478433 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 15:32:47.480638 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 15:32:47.480638 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 15:32:47.480638 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 15:32:47.480638 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 15:32:47.480638 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 15:32:47.480638 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 15:32:47.480638 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 15:32:47.480638 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 15:32:47.480638 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 15:32:47.480638 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 15:32:47.480638 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 15:32:47.480638 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c285f95a-abdf-43ab-b970-02faaf818d14) Jun 17 15:32:47.480638 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:32:47.480638 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:32:47.480638 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:32:47.480638 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:47.480638 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 17 15:32:47.482884 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 17 15:32:47.482884 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 17 15:32:47.482884 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 15:32:47.482884 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 17 15:32:47.482884 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 17 15:32:47.482884 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 17 15:32:47.482884 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 17 15:32:47.482884 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 17 15:32:47.482884 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 15:32:47.482884 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 17 15:32:47.482884 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 17 15:32:47.482884 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c285f95a-abdf-43ab-b970-02faaf818d14) Jun 17 15:32:47.482884 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:32:47.482884 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:32:47.482884 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:32:47.482884 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:47.482884 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:32:47.482884 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:32:47.484545 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 15:32:47.484545 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 15:32:47.484545 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 15:32:47.484545 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 15:32:47.484545 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 17 15:32:47.484545 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 17 15:32:47.484545 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c285f95a-abdf-43ab-b970-02faaf818d14) Jun 17 15:32:47.484545 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:32:47.484545 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:32:47.484545 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:32:47.484545 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:47.484545 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:32:47.484545 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:32:47.484545 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 15:32:47.484545 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 15:32:47.484545 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c285f95a-abdf-43ab-b970-02faaf818d14) Jun 17 15:32:47.484545 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:32:47.485816 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-ef1aa79f-6f4e-4f46-9a81-c5fb61c9efc7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c285f95a-abdf-43ab-b970-02faaf818d14) {{(pid=117649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 15:32:47.485816 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-ef1aa79f-6f4e-4f46-9a81-c5fb61c9efc7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "DELETE /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments/713822dc-11e8-4f5c-ae7c-bcf41e01b06d" status: 400 len: 269 microversion: 2.1 time: 0.202369 Jun 17 15:32:47.485816 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Fri Jun 17 15:32:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments/713822dc-11e8-4f5c-ae7c-bcf41e01b06d (ip 10.222.0.48) !!! Jun 17 15:32:47.485816 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Fri Jun 17 15:32:47 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments/713822dc-11e8-4f5c-ae7c-bcf41e01b06d (10.222.0.48) Jun 17 15:32:47.485816 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: CRITICAL nova [None req-ef1aa79f-6f4e-4f46-9a81-c5fb61c9efc7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Unhandled error: OSError: write error Jun 17 15:32:47.485816 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova OSError: write error Jun 17 15:32:47.485816 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova Jun 17 15:32:47.486388 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 595/1601] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Jun 17 15:32:47 2022] DELETE /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments/713822dc-11e8-4f5c-ae7c-bcf41e01b06d => generated 0 bytes in 204 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Jun 17 15:32:47.486388 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-2af04a60-761d-4d99-9ad7-2b1338d569b3 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:32:47.486816 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-2af04a60-761d-4d99-9ad7-2b1338d569b3 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:32:47.495506 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2af04a60-761d-4d99-9ad7-2b1338d569b3 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:47.495939 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2af04a60-761d-4d99-9ad7-2b1338d569b3 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:47.497053 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2af04a60-761d-4d99-9ad7-2b1338d569b3 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:47.497847 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2af04a60-761d-4d99-9ad7-2b1338d569b3 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:47.503010 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-01696691-a7ef-4d3b-8106-d48f1a4d17ed tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:32:47.516581 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-01696691-a7ef-4d3b-8106-d48f1a4d17ed tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1563 microversion: 2.1 time: 0.238727 Jun 17 15:32:47.517522 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Fri Jun 17 15:32:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 (ip 10.222.0.48) !!! Jun 17 15:32:47.517850 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Fri Jun 17 15:32:47 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 (10.222.0.48) Jun 17 15:32:47.519113 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: CRITICAL nova [None req-01696691-a7ef-4d3b-8106-d48f1a4d17ed tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Unhandled error: OSError: write error Jun 17 15:32:47.519113 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova OSError: write error Jun 17 15:32:47.519113 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova Jun 17 15:32:47.519810 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1007/1602] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:32:47 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 0 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Jun 17 15:32:47.531960 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-2396de39-336f-4bd0-86d0-7c9d7b76e2b9 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:32:47.533446 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-2396de39-336f-4bd0-86d0-7c9d7b76e2b9 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:32:47.545889 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2396de39-336f-4bd0-86d0-7c9d7b76e2b9 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:47.546695 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2396de39-336f-4bd0-86d0-7c9d7b76e2b9 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:47.548100 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2396de39-336f-4bd0-86d0-7c9d7b76e2b9 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:47.548971 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2396de39-336f-4bd0-86d0-7c9d7b76e2b9 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:47.571452 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.wsgi [None req-2396de39-336f-4bd0-86d0-7c9d7b76e2b9 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] HTTP exception thrown: Instance 8fee7bc0-cd0e-4c25-8475-b43e79cb933a could not be found. Jun 17 15:32:47.574519 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-2396de39-336f-4bd0-86d0-7c9d7b76e2b9 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Request method failure captured: Jun 17 15:32:47.574519 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: request: GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a HTTP/1.1 Jun 17 15:32:47.574519 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Accept: application/json Jun 17 15:32:47.574519 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Accept-Encoding: identity Jun 17 15:32:47.574519 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Connection: close Jun 17 15:32:47.574519 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Content-Length: 0 Jun 17 15:32:47.574519 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Content-Type: application/json Jun 17 15:32:47.574519 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Host: 10.222.0.48 Jun 17 15:32:47.574519 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Openstack-System-Scope: None Jun 17 15:32:47.574519 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: User-Agent: python-urllib3/1.26.9 Jun 17 15:32:47.574519 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Auth-Token: gAAAAABirJodidJx0AY_qcwoEwWEszpikfHtXmarSN0h6rNL3nP0iBWXeXbu1IBvVskBSxMS5UAzkWIcgkCzT0_jtZtoDW3a4yLFd9G-iV8iuD24PAIeHzq28KHUo0wHpTFHnG1joRgrCGGOeiOwT6JyvzMgTpEgSjE1WKGTngEoPIRC3Gt4VEE Jun 17 15:32:47.574519 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Domain-Id: None Jun 17 15:32:47.574519 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Domain-Name: None Jun 17 15:32:47.574519 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Identity-Status: Confirmed Jun 17 15:32:47.574519 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Is-Admin-Project: True Jun 17 15:32:47.574519 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Domain-Id: default Jun 17 15:32:47.574519 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Domain-Name: Default Jun 17 15:32:47.574519 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Id: 6298c1910e1a488983d5399d7952a5cf Jun 17 15:32:47.574519 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Name: tempest-TestVolumeBootPattern-1895714660 Jun 17 15:32:47.574519 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Role: reader,member Jun 17 15:32:47.574519 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Roles: reader,member Jun 17 15:32:47.577657 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6298c1910e1a488983d5399d7952a5cf", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6298c1910e1a488983d5399d7952a5cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6298c1910e1a488983d5399d7952a5cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6298c1910e1a488983d5399d7952a5cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Jun 17 15:32:47.577657 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant: tempest-TestVolumeBootPattern-1895714660 Jun 17 15:32:47.577657 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant-Id: 6298c1910e1a488983d5399d7952a5cf Jun 17 15:32:47.577657 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant-Name: tempest-TestVolumeBootPattern-1895714660 Jun 17 15:32:47.577657 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User: tempest-TestVolumeBootPattern-1895714660-project Jun 17 15:32:47.577657 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Domain-Id: default Jun 17 15:32:47.577657 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Domain-Name: Default Jun 17 15:32:47.577657 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Id: 4e3e797edb9a453d9142c3196a4f21bb Jun 17 15:32:47.577657 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Name: tempest-TestVolumeBootPattern-1895714660-project Jun 17 15:32:47.577657 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: method: > Jun 17 15:32:47.577657 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: exception: Instance 8fee7bc0-cd0e-4c25-8475-b43e79cb933a could not be found. Jun 17 15:32:47.577657 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: action_args: {'id': '8fee7bc0-cd0e-4c25-8475-b43e79cb933a'} Jun 17 15:32:47.579315 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 15:32:47.579315 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:47.579315 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 15:32:47.579315 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 15:32:47.579315 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 15:32:47.579315 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 15:32:47.579315 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 15:32:47.579315 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 15:32:47.579315 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 15:32:47.579315 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 15:32:47.579315 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fee7bc0-cd0e-4c25-8475-b43e79cb933a could not be found. Jun 17 15:32:47.579315 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:32:47.579315 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:32:47.579315 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:32:47.579315 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:47.579315 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:32:47.579315 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:32:47.579315 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 15:32:47.579315 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 15:32:47.579315 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 15:32:47.582266 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 15:32:47.582266 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 15:32:47.582266 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 15:32:47.582266 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 15:32:47.582266 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 15:32:47.582266 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 15:32:47.582266 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 15:32:47.582266 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fee7bc0-cd0e-4c25-8475-b43e79cb933a could not be found. Jun 17 15:32:47.582266 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:32:47.582266 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:32:47.582266 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:32:47.582266 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:47.582266 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:32:47.582266 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:32:47.582266 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 15:32:47.582266 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 15:32:47.582266 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fee7bc0-cd0e-4c25-8475-b43e79cb933a could not be found. Jun 17 15:32:47.582266 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:32:47.584936 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-2396de39-336f-4bd0-86d0-7c9d7b76e2b9 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Returning 404 to user: Instance 8fee7bc0-cd0e-4c25-8475-b43e79cb933a could not be found. {{(pid=117650) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 15:32:47.584936 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-2396de39-336f-4bd0-86d0-7c9d7b76e2b9 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 404 len: 111 microversion: 2.1 time: 0.055408 Jun 17 15:32:47.584936 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Fri Jun 17 15:32:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a (ip 10.222.0.48) !!! Jun 17 15:32:47.584936 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Fri Jun 17 15:32:47 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a (10.222.0.48) Jun 17 15:32:47.584936 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: CRITICAL nova [None req-2396de39-336f-4bd0-86d0-7c9d7b76e2b9 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Unhandled error: OSError: write error Jun 17 15:32:47.584936 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova OSError: write error Jun 17 15:32:47.584936 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova Jun 17 15:32:47.584936 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1008/1603] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:32:47 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 0 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 0 bytes (0 switches on core 0) Jun 17 15:32:47.588216 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-a4f29b82-71a1-4c46-b28f-e47b411d5537 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:32:47.590102 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-a4f29b82-71a1-4c46-b28f-e47b411d5537 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:32:47.602433 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a4f29b82-71a1-4c46-b28f-e47b411d5537 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:47.603238 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a4f29b82-71a1-4c46-b28f-e47b411d5537 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:47.603744 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.objects.instance [None req-2af04a60-761d-4d99-9ad7-2b1338d569b3 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lazy-loading 'services' on Instance uuid 808f28e6-03bc-4b67-ab1f-f1ef13838924 {{(pid=117649) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 15:32:47.604686 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a4f29b82-71a1-4c46-b28f-e47b411d5537 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:47.605484 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a4f29b82-71a1-4c46-b28f-e47b411d5537 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:47.662885 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-a4f29b82-71a1-4c46-b28f-e47b411d5537 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081750 Jun 17 15:32:47.663871 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Fri Jun 17 15:32:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments (ip 10.222.0.48) !!! Jun 17 15:32:47.663871 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Fri Jun 17 15:32:47 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments (10.222.0.48) Jun 17 15:32:47.664995 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: CRITICAL nova [None req-a4f29b82-71a1-4c46-b28f-e47b411d5537 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Unhandled error: OSError: write error Jun 17 15:32:47.664995 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova OSError: write error Jun 17 15:32:47.664995 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova Jun 17 15:32:47.665353 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1009/1604] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:32:47 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 0 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Jun 17 15:32:47.670308 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.wsgi [None req-2af04a60-761d-4d99-9ad7-2b1338d569b3 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-152a60e8-4811-4145-9bd7-8a881fffca89) Jun 17 15:32:47.673195 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-2af04a60-761d-4d99-9ad7-2b1338d569b3 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Request method failure captured: Jun 17 15:32:47.673195 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: request: DELETE /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924/os-volume_attachments/4e6d668f-6234-4ba9-913a-11f57866e984 HTTP/1.1 Jun 17 15:32:47.673195 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Accept: application/json Jun 17 15:32:47.673195 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Accept-Encoding: identity Jun 17 15:32:47.673195 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Connection: close Jun 17 15:32:47.673195 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Content-Length: 0 Jun 17 15:32:47.673195 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Content-Type: application/json Jun 17 15:32:47.673195 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Host: 10.222.0.48 Jun 17 15:32:47.673195 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Openstack-System-Scope: None Jun 17 15:32:47.673195 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: User-Agent: python-urllib3/1.26.9 Jun 17 15:32:47.673195 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Auth-Token: gAAAAABirJpPRELvo50oKxdbD2bQ6GGouzj8i1DebBt1zfB7fX0V-PDU7hlPCfVEJbYQ9PsMuU2ZA4JvqklZ9Y9hD2QbIWtBnNkd8fMsMcOzOLJcX5MT958XBAGaNkW3F9LEBjk4LnqtyEbVGNYjmbh2tqH5UI9WDRv0xJagRknfyHTSn0wpzG0 Jun 17 15:32:47.673195 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Domain-Id: None Jun 17 15:32:47.673195 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Domain-Name: None Jun 17 15:32:47.673195 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Identity-Status: Confirmed Jun 17 15:32:47.673195 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Is-Admin-Project: True Jun 17 15:32:47.673195 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Domain-Id: default Jun 17 15:32:47.673195 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Domain-Name: Default Jun 17 15:32:47.673195 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Id: 42b42320bc424a19b4ac5e35dae7afb3 Jun 17 15:32:47.673195 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1590813198 Jun 17 15:32:47.673195 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Role: reader,member Jun 17 15:32:47.673195 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Roles: reader,member Jun 17 15:32:47.674624 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_42b42320bc424a19b4ac5e35dae7afb3", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/42b42320bc424a19b4ac5e35dae7afb3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/42b42320bc424a19b4ac5e35dae7afb3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/42b42320bc424a19b4ac5e35dae7afb3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Jun 17 15:32:47.674624 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant: tempest-VolumesSnapshotTestJSON-1590813198 Jun 17 15:32:47.674624 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant-Id: 42b42320bc424a19b4ac5e35dae7afb3 Jun 17 15:32:47.674624 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1590813198 Jun 17 15:32:47.674624 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User: tempest-VolumesSnapshotTestJSON-1590813198-project Jun 17 15:32:47.674624 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Domain-Id: default Jun 17 15:32:47.674624 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Domain-Name: Default Jun 17 15:32:47.674624 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Id: b6ac8cbc7c6d4cce9d2b0a1289846a3d Jun 17 15:32:47.674624 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Name: tempest-VolumesSnapshotTestJSON-1590813198-project Jun 17 15:32:47.674624 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: method: > Jun 17 15:32:47.675224 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-152a60e8-4811-4145-9bd7-8a881fffca89) Jun 17 15:32:47.675224 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: action_args: {'server_id': '808f28e6-03bc-4b67-ab1f-f1ef13838924', 'id': '4e6d668f-6234-4ba9-913a-11f57866e984'} Jun 17 15:32:47.675224 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 15:32:47.675224 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:47.675224 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 15:32:47.675224 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 15:32:47.675224 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 15:32:47.675224 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 15:32:47.675224 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 15:32:47.675224 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 15:32:47.675224 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 15:32:47.675224 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 15:32:47.675224 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 15:32:47.675224 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 15:32:47.675224 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 15:32:47.675224 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 15:32:47.675224 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 15:32:47.676258 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 15:32:47.676258 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 15:32:47.676258 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 15:32:47.676258 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-152a60e8-4811-4145-9bd7-8a881fffca89) Jun 17 15:32:47.676258 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:32:47.676258 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:32:47.676258 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:32:47.676258 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:47.676258 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 17 15:32:47.676258 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 17 15:32:47.676258 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 17 15:32:47.676258 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 17 15:32:47.676258 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 15:32:47.676258 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 15:32:47.676258 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 15:32:47.676258 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 15:32:47.676258 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 15:32:47.676258 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 15:32:47.676258 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 15:32:47.677730 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 15:32:47.677730 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 15:32:47.677730 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 15:32:47.677730 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 15:32:47.677730 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 15:32:47.677730 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 15:32:47.677730 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 15:32:47.677730 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 15:32:47.677730 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 15:32:47.677730 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 15:32:47.677730 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 15:32:47.677730 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-152a60e8-4811-4145-9bd7-8a881fffca89) Jun 17 15:32:47.677730 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:32:47.677730 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:32:47.677730 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:32:47.677730 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:47.677730 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 17 15:32:47.679089 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 17 15:32:47.679089 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 17 15:32:47.679089 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 15:32:47.679089 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 17 15:32:47.679089 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 17 15:32:47.679089 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 17 15:32:47.679089 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 17 15:32:47.679089 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 17 15:32:47.679089 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 15:32:47.679089 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 17 15:32:47.679089 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 17 15:32:47.679089 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-152a60e8-4811-4145-9bd7-8a881fffca89) Jun 17 15:32:47.679089 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:32:47.679089 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:32:47.679089 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:32:47.679089 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:47.679089 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:32:47.679089 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:32:47.680444 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 15:32:47.680444 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 15:32:47.680444 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 15:32:47.680444 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 15:32:47.680444 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 17 15:32:47.680444 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 17 15:32:47.680444 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-152a60e8-4811-4145-9bd7-8a881fffca89) Jun 17 15:32:47.680444 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:32:47.680444 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:32:47.680444 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:32:47.680444 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:47.680444 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:32:47.680444 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:32:47.680444 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 15:32:47.680444 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 15:32:47.680444 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-152a60e8-4811-4145-9bd7-8a881fffca89) Jun 17 15:32:47.680444 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:32:47.681591 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-2af04a60-761d-4d99-9ad7-2b1338d569b3 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-152a60e8-4811-4145-9bd7-8a881fffca89) {{(pid=117649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 15:32:47.681591 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-2af04a60-761d-4d99-9ad7-2b1338d569b3 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "DELETE /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924/os-volume_attachments/4e6d668f-6234-4ba9-913a-11f57866e984" status: 400 len: 269 microversion: 2.1 time: 0.195027 Jun 17 15:32:47.681796 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-4d526cd1-e7a7-43be-8452-fe8f3301584f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:32:47.681902 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Fri Jun 17 15:32:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924/os-volume_attachments/4e6d668f-6234-4ba9-913a-11f57866e984 (ip 10.222.0.48) !!! Jun 17 15:32:47.681902 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Fri Jun 17 15:32:47 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924/os-volume_attachments/4e6d668f-6234-4ba9-913a-11f57866e984 (10.222.0.48) Jun 17 15:32:47.682071 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-4d526cd1-e7a7-43be-8452-fe8f3301584f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:32:47.682171 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: CRITICAL nova [None req-2af04a60-761d-4d99-9ad7-2b1338d569b3 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Unhandled error: OSError: write error Jun 17 15:32:47.682171 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova OSError: write error Jun 17 15:32:47.682171 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova Jun 17 15:32:47.682171 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 596/1605] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Jun 17 15:32:47 2022] DELETE /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924/os-volume_attachments/4e6d668f-6234-4ba9-913a-11f57866e984 => generated 0 bytes in 197 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Jun 17 15:32:47.682171 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-183d264f-cae2-464d-aa26-9098d5994719 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:32:47.682171 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-183d264f-cae2-464d-aa26-9098d5994719 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:32:47.687046 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4d526cd1-e7a7-43be-8452-fe8f3301584f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:47.687781 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-183d264f-cae2-464d-aa26-9098d5994719 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:47.687912 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4d526cd1-e7a7-43be-8452-fe8f3301584f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:47.688232 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-183d264f-cae2-464d-aa26-9098d5994719 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:47.689040 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-183d264f-cae2-464d-aa26-9098d5994719 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:47.689247 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4d526cd1-e7a7-43be-8452-fe8f3301584f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:47.689472 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-183d264f-cae2-464d-aa26-9098d5994719 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:47.690034 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4d526cd1-e7a7-43be-8452-fe8f3301584f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:47.839765 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.objects.instance [None req-4d526cd1-e7a7-43be-8452-fe8f3301584f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lazy-loading 'services' on Instance uuid ba5d3180-d42a-4678-af13-c99282e054bf {{(pid=117650) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 15:32:47.888333 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-183d264f-cae2-464d-aa26-9098d5994719 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:32:47.901520 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-183d264f-cae2-464d-aa26-9098d5994719 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1563 microversion: 2.1 time: 0.224078 Jun 17 15:32:47.902481 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 597/1606] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:32:47 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1563 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:32:47.911861 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-5bb55e51-e391-4dbd-82bb-c91565a1088c tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:32:47.912587 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-5bb55e51-e391-4dbd-82bb-c91565a1088c tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:32:47.923086 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5bb55e51-e391-4dbd-82bb-c91565a1088c tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:47.923843 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5bb55e51-e391-4dbd-82bb-c91565a1088c tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:47.925159 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5bb55e51-e391-4dbd-82bb-c91565a1088c tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:47.925863 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5bb55e51-e391-4dbd-82bb-c91565a1088c tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:47.942541 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.wsgi [None req-4d526cd1-e7a7-43be-8452-fe8f3301584f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c372fed0-0f7a-42c9-bb91-d95f8903437e) Jun 17 15:32:47.946744 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-4d526cd1-e7a7-43be-8452-fe8f3301584f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Request method failure captured: Jun 17 15:32:47.946744 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: request: DELETE /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments/713822dc-11e8-4f5c-ae7c-bcf41e01b06d HTTP/1.1 Jun 17 15:32:47.946744 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Accept: application/json Jun 17 15:32:47.946744 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Accept-Encoding: identity Jun 17 15:32:47.946744 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Connection: close Jun 17 15:32:47.946744 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Content-Length: 0 Jun 17 15:32:47.946744 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Content-Type: application/json Jun 17 15:32:47.946744 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Host: 10.222.0.48 Jun 17 15:32:47.946744 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Openstack-System-Scope: None Jun 17 15:32:47.946744 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: User-Agent: python-urllib3/1.26.9 Jun 17 15:32:47.946744 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Auth-Token: gAAAAABirJmQC7m757v9yyJD0BsI2MhqMNm1yc2WpkBWgAGOwCYW524pgy_6_7F6gBQez89A-LSNviRE5zDFwqgj2BZoXTsMX0NmzFHDYuHo31ibepKT71785ic3IrIvGY4IglQk81nqgsevYUUWYR-s69vMdAmv9JQXTwFMOwaCzN_3w4dwj6k Jun 17 15:32:47.946744 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Domain-Id: None Jun 17 15:32:47.946744 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Domain-Name: None Jun 17 15:32:47.946744 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Identity-Status: Confirmed Jun 17 15:32:47.946744 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Is-Admin-Project: True Jun 17 15:32:47.946744 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Domain-Id: default Jun 17 15:32:47.946744 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Domain-Name: Default Jun 17 15:32:47.946744 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Id: 50408ec18fa04036a0abb6236343e258 Jun 17 15:32:47.946744 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1478734135 Jun 17 15:32:47.946744 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Role: reader,member Jun 17 15:32:47.946744 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Roles: reader,member Jun 17 15:32:47.949208 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_50408ec18fa04036a0abb6236343e258", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/50408ec18fa04036a0abb6236343e258"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/50408ec18fa04036a0abb6236343e258"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/50408ec18fa04036a0abb6236343e258"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Jun 17 15:32:47.949208 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1478734135 Jun 17 15:32:47.949208 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant-Id: 50408ec18fa04036a0abb6236343e258 Jun 17 15:32:47.949208 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1478734135 Jun 17 15:32:47.949208 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User: tempest-ServerRescueNegativeTestJSON-1478734135-project Jun 17 15:32:47.949208 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Domain-Id: default Jun 17 15:32:47.949208 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Domain-Name: Default Jun 17 15:32:47.949208 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Id: 562485deaf214fa29eac132464ef93e3 Jun 17 15:32:47.949208 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1478734135-project Jun 17 15:32:47.949208 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: method: > Jun 17 15:32:47.949913 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c372fed0-0f7a-42c9-bb91-d95f8903437e) Jun 17 15:32:47.949913 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: action_args: {'server_id': 'ba5d3180-d42a-4678-af13-c99282e054bf', 'id': '713822dc-11e8-4f5c-ae7c-bcf41e01b06d'} Jun 17 15:32:47.949913 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 15:32:47.949913 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:47.949913 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 15:32:47.949913 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 15:32:47.949913 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 15:32:47.949913 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 15:32:47.949913 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 15:32:47.949913 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 15:32:47.949913 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 15:32:47.949913 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 15:32:47.949913 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 15:32:47.949913 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 15:32:47.949913 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 15:32:47.949913 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 15:32:47.949913 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 15:32:47.952023 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 15:32:47.952023 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 15:32:47.952023 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 15:32:47.952023 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c372fed0-0f7a-42c9-bb91-d95f8903437e) Jun 17 15:32:47.952023 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:32:47.952023 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:32:47.952023 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:32:47.952023 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:47.952023 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 17 15:32:47.952023 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 17 15:32:47.952023 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 17 15:32:47.952023 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 17 15:32:47.952023 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 15:32:47.952023 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 15:32:47.952023 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 15:32:47.952023 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 15:32:47.952023 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 15:32:47.952023 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 15:32:47.952023 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 15:32:47.954616 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 15:32:47.954616 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 15:32:47.954616 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 15:32:47.954616 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 15:32:47.954616 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 15:32:47.954616 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 15:32:47.954616 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 15:32:47.954616 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 15:32:47.954616 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 15:32:47.954616 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 15:32:47.954616 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 15:32:47.954616 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c372fed0-0f7a-42c9-bb91-d95f8903437e) Jun 17 15:32:47.954616 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:32:47.954616 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:32:47.954616 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:32:47.954616 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:47.954616 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 17 15:32:47.956699 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 17 15:32:47.956699 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 17 15:32:47.956699 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 15:32:47.956699 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 17 15:32:47.956699 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 17 15:32:47.956699 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 17 15:32:47.956699 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 17 15:32:47.956699 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 17 15:32:47.956699 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 15:32:47.956699 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 17 15:32:47.956699 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 17 15:32:47.956699 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c372fed0-0f7a-42c9-bb91-d95f8903437e) Jun 17 15:32:47.956699 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:32:47.956699 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:32:47.956699 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:32:47.956699 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:47.956699 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:32:47.956699 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:32:47.958782 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 15:32:47.958782 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 15:32:47.958782 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 15:32:47.958782 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 15:32:47.958782 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 17 15:32:47.958782 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 17 15:32:47.958782 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c372fed0-0f7a-42c9-bb91-d95f8903437e) Jun 17 15:32:47.958782 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:32:47.958782 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:32:47.958782 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:32:47.958782 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:47.958782 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:32:47.958782 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:32:47.958782 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 15:32:47.958782 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 15:32:47.958782 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c372fed0-0f7a-42c9-bb91-d95f8903437e) Jun 17 15:32:47.958782 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:32:47.962325 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-4d526cd1-e7a7-43be-8452-fe8f3301584f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c372fed0-0f7a-42c9-bb91-d95f8903437e) {{(pid=117650) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 15:32:47.962325 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-4d526cd1-e7a7-43be-8452-fe8f3301584f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "DELETE /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments/713822dc-11e8-4f5c-ae7c-bcf41e01b06d" status: 400 len: 269 microversion: 2.1 time: 0.282667 Jun 17 15:32:47.962325 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1010/1607] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Jun 17 15:32:47 2022] DELETE /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments/713822dc-11e8-4f5c-ae7c-bcf41e01b06d => generated 269 bytes in 285 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 17 15:32:47.962325 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-034b7c3c-69cf-4117-a23a-27a942420eb3 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:32:47.962878 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-034b7c3c-69cf-4117-a23a-27a942420eb3 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:32:47.974188 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-034b7c3c-69cf-4117-a23a-27a942420eb3 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:47.974917 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-034b7c3c-69cf-4117-a23a-27a942420eb3 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:47.976263 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-034b7c3c-69cf-4117-a23a-27a942420eb3 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:47.977244 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-034b7c3c-69cf-4117-a23a-27a942420eb3 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:47.996056 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.wsgi [None req-034b7c3c-69cf-4117-a23a-27a942420eb3 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] HTTP exception thrown: Instance 8fee7bc0-cd0e-4c25-8475-b43e79cb933a could not be found. Jun 17 15:32:47.998253 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-034b7c3c-69cf-4117-a23a-27a942420eb3 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Request method failure captured: Jun 17 15:32:47.998253 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: request: GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a HTTP/1.1 Jun 17 15:32:47.998253 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Accept: application/json Jun 17 15:32:47.998253 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Accept-Encoding: identity Jun 17 15:32:47.998253 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Connection: close Jun 17 15:32:47.998253 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Content-Length: 0 Jun 17 15:32:47.998253 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Content-Type: application/json Jun 17 15:32:47.998253 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Host: 10.222.0.48 Jun 17 15:32:47.998253 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Openstack-System-Scope: None Jun 17 15:32:47.998253 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: User-Agent: python-urllib3/1.26.9 Jun 17 15:32:47.998253 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Auth-Token: gAAAAABirJodidJx0AY_qcwoEwWEszpikfHtXmarSN0h6rNL3nP0iBWXeXbu1IBvVskBSxMS5UAzkWIcgkCzT0_jtZtoDW3a4yLFd9G-iV8iuD24PAIeHzq28KHUo0wHpTFHnG1joRgrCGGOeiOwT6JyvzMgTpEgSjE1WKGTngEoPIRC3Gt4VEE Jun 17 15:32:47.998253 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Domain-Id: None Jun 17 15:32:47.998253 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Domain-Name: None Jun 17 15:32:47.998253 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Identity-Status: Confirmed Jun 17 15:32:47.998253 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Is-Admin-Project: True Jun 17 15:32:47.998253 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Domain-Id: default Jun 17 15:32:47.998253 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Domain-Name: Default Jun 17 15:32:47.998253 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Id: 6298c1910e1a488983d5399d7952a5cf Jun 17 15:32:47.998253 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Name: tempest-TestVolumeBootPattern-1895714660 Jun 17 15:32:47.998253 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Role: reader,member Jun 17 15:32:47.998253 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Roles: reader,member Jun 17 15:32:48.002011 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6298c1910e1a488983d5399d7952a5cf", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6298c1910e1a488983d5399d7952a5cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6298c1910e1a488983d5399d7952a5cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6298c1910e1a488983d5399d7952a5cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Jun 17 15:32:48.002011 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant: tempest-TestVolumeBootPattern-1895714660 Jun 17 15:32:48.002011 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant-Id: 6298c1910e1a488983d5399d7952a5cf Jun 17 15:32:48.002011 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant-Name: tempest-TestVolumeBootPattern-1895714660 Jun 17 15:32:48.002011 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User: tempest-TestVolumeBootPattern-1895714660-project Jun 17 15:32:48.002011 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Domain-Id: default Jun 17 15:32:48.002011 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Domain-Name: Default Jun 17 15:32:48.002011 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Id: 4e3e797edb9a453d9142c3196a4f21bb Jun 17 15:32:48.002011 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Name: tempest-TestVolumeBootPattern-1895714660-project Jun 17 15:32:48.002011 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: method: > Jun 17 15:32:48.002011 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: exception: Instance 8fee7bc0-cd0e-4c25-8475-b43e79cb933a could not be found. Jun 17 15:32:48.002011 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: action_args: {'id': '8fee7bc0-cd0e-4c25-8475-b43e79cb933a'} Jun 17 15:32:48.003554 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 15:32:48.003554 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:48.003554 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 15:32:48.003554 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 15:32:48.003554 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 15:32:48.003554 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 15:32:48.003554 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 15:32:48.003554 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 15:32:48.003554 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 15:32:48.003554 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 15:32:48.003554 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fee7bc0-cd0e-4c25-8475-b43e79cb933a could not be found. Jun 17 15:32:48.003554 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:32:48.003554 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:32:48.003554 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:32:48.003554 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:48.003554 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:32:48.003554 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:32:48.003554 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 15:32:48.003554 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 15:32:48.003554 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 15:32:48.006133 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 15:32:48.006133 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 15:32:48.006133 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 15:32:48.006133 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 15:32:48.006133 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 15:32:48.006133 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 15:32:48.006133 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 15:32:48.006133 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fee7bc0-cd0e-4c25-8475-b43e79cb933a could not be found. Jun 17 15:32:48.006133 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:32:48.006133 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:32:48.006133 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:32:48.006133 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:48.006133 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:32:48.006133 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:32:48.006133 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 15:32:48.006133 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 15:32:48.006133 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fee7bc0-cd0e-4c25-8475-b43e79cb933a could not be found. Jun 17 15:32:48.006133 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:32:48.008535 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-034b7c3c-69cf-4117-a23a-27a942420eb3 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Returning 404 to user: Instance 8fee7bc0-cd0e-4c25-8475-b43e79cb933a could not be found. {{(pid=117650) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 15:32:48.008535 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-034b7c3c-69cf-4117-a23a-27a942420eb3 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 404 len: 111 microversion: 2.1 time: 0.046444 Jun 17 15:32:48.008535 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1011/1608] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:32:47 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 15:32:48.008535 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-19a2fd9a-6c46-41cd-a91e-937bfe71863f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:32:48.008535 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-19a2fd9a-6c46-41cd-a91e-937bfe71863f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:32:48.013422 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-19a2fd9a-6c46-41cd-a91e-937bfe71863f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:48.013869 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-19a2fd9a-6c46-41cd-a91e-937bfe71863f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:48.014649 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-19a2fd9a-6c46-41cd-a91e-937bfe71863f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:48.015292 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-19a2fd9a-6c46-41cd-a91e-937bfe71863f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:48.052150 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-19a2fd9a-6c46-41cd-a91e-937bfe71863f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050249 Jun 17 15:32:48.053416 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1012/1609] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:32:48 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:32:48.057801 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.objects.instance [None req-5bb55e51-e391-4dbd-82bb-c91565a1088c tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lazy-loading 'services' on Instance uuid 808f28e6-03bc-4b67-ab1f-f1ef13838924 {{(pid=117649) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 15:32:48.062369 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-61931281-18ca-4221-9036-9ab4ef9e7f84 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:32:48.063454 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-61931281-18ca-4221-9036-9ab4ef9e7f84 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:32:48.073875 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-61931281-18ca-4221-9036-9ab4ef9e7f84 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:48.074654 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-61931281-18ca-4221-9036-9ab4ef9e7f84 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:48.076695 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-61931281-18ca-4221-9036-9ab4ef9e7f84 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:48.077444 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-61931281-18ca-4221-9036-9ab4ef9e7f84 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:48.155115 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.wsgi [None req-5bb55e51-e391-4dbd-82bb-c91565a1088c tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c0299018-4a0c-48bb-af9d-220041ede852) Jun 17 15:32:48.157355 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-5bb55e51-e391-4dbd-82bb-c91565a1088c tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Request method failure captured: Jun 17 15:32:48.157355 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: request: DELETE /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924/os-volume_attachments/4e6d668f-6234-4ba9-913a-11f57866e984 HTTP/1.1 Jun 17 15:32:48.157355 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Accept: application/json Jun 17 15:32:48.157355 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Accept-Encoding: identity Jun 17 15:32:48.157355 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Connection: close Jun 17 15:32:48.157355 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Content-Length: 0 Jun 17 15:32:48.157355 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Content-Type: application/json Jun 17 15:32:48.157355 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Host: 10.222.0.48 Jun 17 15:32:48.157355 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Openstack-System-Scope: None Jun 17 15:32:48.157355 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: User-Agent: python-urllib3/1.26.9 Jun 17 15:32:48.157355 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Auth-Token: gAAAAABirJpPRELvo50oKxdbD2bQ6GGouzj8i1DebBt1zfB7fX0V-PDU7hlPCfVEJbYQ9PsMuU2ZA4JvqklZ9Y9hD2QbIWtBnNkd8fMsMcOzOLJcX5MT958XBAGaNkW3F9LEBjk4LnqtyEbVGNYjmbh2tqH5UI9WDRv0xJagRknfyHTSn0wpzG0 Jun 17 15:32:48.157355 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Domain-Id: None Jun 17 15:32:48.157355 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Domain-Name: None Jun 17 15:32:48.157355 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Identity-Status: Confirmed Jun 17 15:32:48.157355 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Is-Admin-Project: True Jun 17 15:32:48.157355 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Domain-Id: default Jun 17 15:32:48.157355 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Domain-Name: Default Jun 17 15:32:48.157355 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Id: 42b42320bc424a19b4ac5e35dae7afb3 Jun 17 15:32:48.157355 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1590813198 Jun 17 15:32:48.157355 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Role: reader,member Jun 17 15:32:48.157355 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Roles: reader,member Jun 17 15:32:48.159033 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_42b42320bc424a19b4ac5e35dae7afb3", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/42b42320bc424a19b4ac5e35dae7afb3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/42b42320bc424a19b4ac5e35dae7afb3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/42b42320bc424a19b4ac5e35dae7afb3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Jun 17 15:32:48.159033 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant: tempest-VolumesSnapshotTestJSON-1590813198 Jun 17 15:32:48.159033 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant-Id: 42b42320bc424a19b4ac5e35dae7afb3 Jun 17 15:32:48.159033 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1590813198 Jun 17 15:32:48.159033 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User: tempest-VolumesSnapshotTestJSON-1590813198-project Jun 17 15:32:48.159033 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Domain-Id: default Jun 17 15:32:48.159033 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Domain-Name: Default Jun 17 15:32:48.159033 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Id: b6ac8cbc7c6d4cce9d2b0a1289846a3d Jun 17 15:32:48.159033 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Name: tempest-VolumesSnapshotTestJSON-1590813198-project Jun 17 15:32:48.159033 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: method: > Jun 17 15:32:48.159909 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c0299018-4a0c-48bb-af9d-220041ede852) Jun 17 15:32:48.159909 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: action_args: {'server_id': '808f28e6-03bc-4b67-ab1f-f1ef13838924', 'id': '4e6d668f-6234-4ba9-913a-11f57866e984'} Jun 17 15:32:48.159909 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 15:32:48.159909 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:48.159909 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 15:32:48.159909 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 15:32:48.159909 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 15:32:48.159909 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 15:32:48.159909 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 15:32:48.159909 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 15:32:48.159909 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 15:32:48.159909 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 15:32:48.159909 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 15:32:48.159909 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 15:32:48.159909 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 15:32:48.159909 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 15:32:48.159909 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 15:32:48.163657 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 15:32:48.163657 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 15:32:48.163657 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 15:32:48.163657 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c0299018-4a0c-48bb-af9d-220041ede852) Jun 17 15:32:48.163657 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:32:48.163657 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:32:48.163657 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:32:48.163657 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:48.163657 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 17 15:32:48.163657 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 17 15:32:48.163657 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 17 15:32:48.163657 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 17 15:32:48.163657 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 15:32:48.163657 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 15:32:48.163657 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 15:32:48.163657 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 15:32:48.163657 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 15:32:48.163657 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 15:32:48.163657 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 15:32:48.167828 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 15:32:48.167828 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 15:32:48.167828 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 15:32:48.167828 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 15:32:48.167828 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 15:32:48.167828 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 15:32:48.167828 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 15:32:48.167828 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 15:32:48.167828 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 15:32:48.167828 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 15:32:48.167828 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 15:32:48.167828 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c0299018-4a0c-48bb-af9d-220041ede852) Jun 17 15:32:48.167828 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:32:48.167828 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:32:48.167828 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:32:48.167828 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:48.167828 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 17 15:32:48.171724 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 17 15:32:48.171724 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 17 15:32:48.171724 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 15:32:48.171724 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 17 15:32:48.171724 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 17 15:32:48.171724 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 17 15:32:48.171724 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 17 15:32:48.171724 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 17 15:32:48.171724 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 15:32:48.171724 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 17 15:32:48.171724 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 17 15:32:48.171724 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c0299018-4a0c-48bb-af9d-220041ede852) Jun 17 15:32:48.171724 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:32:48.171724 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:32:48.171724 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:32:48.171724 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:48.171724 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:32:48.171724 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:32:48.174596 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 15:32:48.174596 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 15:32:48.174596 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 15:32:48.174596 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 15:32:48.174596 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 17 15:32:48.174596 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 17 15:32:48.174596 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c0299018-4a0c-48bb-af9d-220041ede852) Jun 17 15:32:48.174596 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:32:48.174596 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:32:48.174596 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:32:48.174596 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:48.174596 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:32:48.174596 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:32:48.174596 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 15:32:48.174596 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 15:32:48.174596 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c0299018-4a0c-48bb-af9d-220041ede852) Jun 17 15:32:48.174596 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:32:48.177073 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-5bb55e51-e391-4dbd-82bb-c91565a1088c tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c0299018-4a0c-48bb-af9d-220041ede852) {{(pid=117649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 15:32:48.177073 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-5bb55e51-e391-4dbd-82bb-c91565a1088c tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "DELETE /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924/os-volume_attachments/4e6d668f-6234-4ba9-913a-11f57866e984" status: 400 len: 269 microversion: 2.1 time: 0.255200 Jun 17 15:32:48.177073 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 598/1610] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Jun 17 15:32:47 2022] DELETE /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924/os-volume_attachments/4e6d668f-6234-4ba9-913a-11f57866e984 => generated 269 bytes in 257 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 17 15:32:48.177073 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-2add8224-491c-4f7c-9566-3585aa9542be tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:32:48.177764 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-2add8224-491c-4f7c-9566-3585aa9542be tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:32:48.177764 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2add8224-491c-4f7c-9566-3585aa9542be tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:48.177764 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2add8224-491c-4f7c-9566-3585aa9542be tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:48.177764 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2add8224-491c-4f7c-9566-3585aa9542be tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:48.178526 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2add8224-491c-4f7c-9566-3585aa9542be tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:48.230542 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.objects.instance [None req-61931281-18ca-4221-9036-9ab4ef9e7f84 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lazy-loading 'services' on Instance uuid ba5d3180-d42a-4678-af13-c99282e054bf {{(pid=117650) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 15:32:48.319528 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.wsgi [None req-61931281-18ca-4221-9036-9ab4ef9e7f84 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-890bfaa6-385a-4587-aae3-d949b583fda5) Jun 17 15:32:48.324759 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-61931281-18ca-4221-9036-9ab4ef9e7f84 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Request method failure captured: Jun 17 15:32:48.324759 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: request: DELETE /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments/713822dc-11e8-4f5c-ae7c-bcf41e01b06d HTTP/1.1 Jun 17 15:32:48.324759 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Accept: application/json Jun 17 15:32:48.324759 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Accept-Encoding: identity Jun 17 15:32:48.324759 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Connection: close Jun 17 15:32:48.324759 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Content-Length: 0 Jun 17 15:32:48.324759 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Content-Type: application/json Jun 17 15:32:48.324759 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Host: 10.222.0.48 Jun 17 15:32:48.324759 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Openstack-System-Scope: None Jun 17 15:32:48.324759 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: User-Agent: python-urllib3/1.26.9 Jun 17 15:32:48.324759 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Auth-Token: gAAAAABirJmQC7m757v9yyJD0BsI2MhqMNm1yc2WpkBWgAGOwCYW524pgy_6_7F6gBQez89A-LSNviRE5zDFwqgj2BZoXTsMX0NmzFHDYuHo31ibepKT71785ic3IrIvGY4IglQk81nqgsevYUUWYR-s69vMdAmv9JQXTwFMOwaCzN_3w4dwj6k Jun 17 15:32:48.324759 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Domain-Id: None Jun 17 15:32:48.324759 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Domain-Name: None Jun 17 15:32:48.324759 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Identity-Status: Confirmed Jun 17 15:32:48.324759 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Is-Admin-Project: True Jun 17 15:32:48.324759 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Domain-Id: default Jun 17 15:32:48.324759 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Domain-Name: Default Jun 17 15:32:48.324759 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Id: 50408ec18fa04036a0abb6236343e258 Jun 17 15:32:48.324759 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1478734135 Jun 17 15:32:48.324759 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Role: reader,member Jun 17 15:32:48.324759 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Roles: reader,member Jun 17 15:32:48.327099 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_50408ec18fa04036a0abb6236343e258", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/50408ec18fa04036a0abb6236343e258"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/50408ec18fa04036a0abb6236343e258"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/50408ec18fa04036a0abb6236343e258"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Jun 17 15:32:48.327099 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1478734135 Jun 17 15:32:48.327099 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant-Id: 50408ec18fa04036a0abb6236343e258 Jun 17 15:32:48.327099 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1478734135 Jun 17 15:32:48.327099 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User: tempest-ServerRescueNegativeTestJSON-1478734135-project Jun 17 15:32:48.327099 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Domain-Id: default Jun 17 15:32:48.327099 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Domain-Name: Default Jun 17 15:32:48.327099 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Id: 562485deaf214fa29eac132464ef93e3 Jun 17 15:32:48.327099 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1478734135-project Jun 17 15:32:48.327099 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: method: > Jun 17 15:32:48.328092 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-890bfaa6-385a-4587-aae3-d949b583fda5) Jun 17 15:32:48.328092 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: action_args: {'server_id': 'ba5d3180-d42a-4678-af13-c99282e054bf', 'id': '713822dc-11e8-4f5c-ae7c-bcf41e01b06d'} Jun 17 15:32:48.328092 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 15:32:48.328092 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:48.328092 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 15:32:48.328092 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 15:32:48.328092 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 15:32:48.328092 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 15:32:48.328092 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 15:32:48.328092 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 15:32:48.328092 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 15:32:48.328092 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 15:32:48.328092 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 15:32:48.328092 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 15:32:48.328092 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 15:32:48.328092 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 15:32:48.328092 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 15:32:48.329950 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 15:32:48.329950 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 15:32:48.329950 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 15:32:48.329950 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-890bfaa6-385a-4587-aae3-d949b583fda5) Jun 17 15:32:48.329950 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:32:48.329950 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:32:48.329950 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:32:48.329950 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:48.329950 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 17 15:32:48.329950 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 17 15:32:48.329950 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 17 15:32:48.329950 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 17 15:32:48.329950 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 15:32:48.329950 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 15:32:48.329950 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 15:32:48.329950 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 15:32:48.329950 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 15:32:48.329950 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 15:32:48.329950 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 15:32:48.331301 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 15:32:48.331301 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 15:32:48.331301 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 15:32:48.331301 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 15:32:48.331301 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 15:32:48.331301 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 15:32:48.331301 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 15:32:48.331301 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 15:32:48.331301 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 15:32:48.331301 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 15:32:48.331301 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 15:32:48.331301 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-890bfaa6-385a-4587-aae3-d949b583fda5) Jun 17 15:32:48.331301 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:32:48.331301 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:32:48.331301 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:32:48.331301 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:48.331301 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 17 15:32:48.333430 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 17 15:32:48.333430 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 17 15:32:48.333430 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 15:32:48.333430 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 17 15:32:48.333430 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 17 15:32:48.333430 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 17 15:32:48.333430 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 17 15:32:48.333430 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 17 15:32:48.333430 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 15:32:48.333430 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 17 15:32:48.333430 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 17 15:32:48.333430 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-890bfaa6-385a-4587-aae3-d949b583fda5) Jun 17 15:32:48.333430 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:32:48.333430 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:32:48.333430 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:32:48.333430 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:48.333430 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:32:48.333430 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:32:48.336281 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 15:32:48.336281 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 15:32:48.336281 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 15:32:48.336281 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 15:32:48.336281 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 17 15:32:48.336281 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 17 15:32:48.336281 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-890bfaa6-385a-4587-aae3-d949b583fda5) Jun 17 15:32:48.336281 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:32:48.336281 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:32:48.336281 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:32:48.336281 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:48.336281 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:32:48.336281 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:32:48.336281 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 15:32:48.336281 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 15:32:48.336281 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-890bfaa6-385a-4587-aae3-d949b583fda5) Jun 17 15:32:48.336281 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:32:48.339239 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-61931281-18ca-4221-9036-9ab4ef9e7f84 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-890bfaa6-385a-4587-aae3-d949b583fda5) {{(pid=117650) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 15:32:48.339239 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-61931281-18ca-4221-9036-9ab4ef9e7f84 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "DELETE /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments/713822dc-11e8-4f5c-ae7c-bcf41e01b06d" status: 400 len: 269 microversion: 2.1 time: 0.272618 Jun 17 15:32:48.339239 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1013/1611] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Jun 17 15:32:48 2022] DELETE /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments/713822dc-11e8-4f5c-ae7c-bcf41e01b06d => generated 269 bytes in 275 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 17 15:32:48.339239 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-52b8b009-2e89-4e4d-9e59-eb95d64bdbaa tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:32:48.340028 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-52b8b009-2e89-4e4d-9e59-eb95d64bdbaa tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:32:48.351750 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-52b8b009-2e89-4e4d-9e59-eb95d64bdbaa tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:48.352581 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-52b8b009-2e89-4e4d-9e59-eb95d64bdbaa tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:48.353887 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-52b8b009-2e89-4e4d-9e59-eb95d64bdbaa tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:48.354545 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-52b8b009-2e89-4e4d-9e59-eb95d64bdbaa tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:48.355606 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-2add8224-491c-4f7c-9566-3585aa9542be tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:32:48.370352 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-2add8224-491c-4f7c-9566-3585aa9542be tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1563 microversion: 2.1 time: 0.209125 Jun 17 15:32:48.371434 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 599/1612] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:32:48 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1563 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:32:48.381268 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-1ebad010-1b75-453c-81a2-c650b41f05c5 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:32:48.382377 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-1ebad010-1b75-453c-81a2-c650b41f05c5 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:32:48.393637 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1ebad010-1b75-453c-81a2-c650b41f05c5 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:48.394453 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1ebad010-1b75-453c-81a2-c650b41f05c5 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:48.395899 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1ebad010-1b75-453c-81a2-c650b41f05c5 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:48.396702 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1ebad010-1b75-453c-81a2-c650b41f05c5 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:48.424956 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.wsgi [None req-1ebad010-1b75-453c-81a2-c650b41f05c5 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] HTTP exception thrown: Instance 8fee7bc0-cd0e-4c25-8475-b43e79cb933a could not be found. Jun 17 15:32:48.428090 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-1ebad010-1b75-453c-81a2-c650b41f05c5 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Request method failure captured: Jun 17 15:32:48.428090 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: request: GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a HTTP/1.1 Jun 17 15:32:48.428090 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Accept: application/json Jun 17 15:32:48.428090 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Accept-Encoding: identity Jun 17 15:32:48.428090 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Connection: close Jun 17 15:32:48.428090 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Content-Length: 0 Jun 17 15:32:48.428090 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Content-Type: application/json Jun 17 15:32:48.428090 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Host: 10.222.0.48 Jun 17 15:32:48.428090 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Openstack-System-Scope: None Jun 17 15:32:48.428090 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: User-Agent: python-urllib3/1.26.9 Jun 17 15:32:48.428090 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Auth-Token: gAAAAABirJodidJx0AY_qcwoEwWEszpikfHtXmarSN0h6rNL3nP0iBWXeXbu1IBvVskBSxMS5UAzkWIcgkCzT0_jtZtoDW3a4yLFd9G-iV8iuD24PAIeHzq28KHUo0wHpTFHnG1joRgrCGGOeiOwT6JyvzMgTpEgSjE1WKGTngEoPIRC3Gt4VEE Jun 17 15:32:48.428090 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Domain-Id: None Jun 17 15:32:48.428090 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Domain-Name: None Jun 17 15:32:48.428090 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Identity-Status: Confirmed Jun 17 15:32:48.428090 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Is-Admin-Project: True Jun 17 15:32:48.428090 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Domain-Id: default Jun 17 15:32:48.428090 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Domain-Name: Default Jun 17 15:32:48.428090 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Id: 6298c1910e1a488983d5399d7952a5cf Jun 17 15:32:48.428090 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Name: tempest-TestVolumeBootPattern-1895714660 Jun 17 15:32:48.428090 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Role: reader,member Jun 17 15:32:48.428090 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Roles: reader,member Jun 17 15:32:48.430251 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6298c1910e1a488983d5399d7952a5cf", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6298c1910e1a488983d5399d7952a5cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6298c1910e1a488983d5399d7952a5cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6298c1910e1a488983d5399d7952a5cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Jun 17 15:32:48.430251 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant: tempest-TestVolumeBootPattern-1895714660 Jun 17 15:32:48.430251 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant-Id: 6298c1910e1a488983d5399d7952a5cf Jun 17 15:32:48.430251 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant-Name: tempest-TestVolumeBootPattern-1895714660 Jun 17 15:32:48.430251 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User: tempest-TestVolumeBootPattern-1895714660-project Jun 17 15:32:48.430251 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Domain-Id: default Jun 17 15:32:48.430251 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Domain-Name: Default Jun 17 15:32:48.430251 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Id: 4e3e797edb9a453d9142c3196a4f21bb Jun 17 15:32:48.430251 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Name: tempest-TestVolumeBootPattern-1895714660-project Jun 17 15:32:48.430251 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: method: > Jun 17 15:32:48.430251 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: exception: Instance 8fee7bc0-cd0e-4c25-8475-b43e79cb933a could not be found. Jun 17 15:32:48.430251 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: action_args: {'id': '8fee7bc0-cd0e-4c25-8475-b43e79cb933a'} Jun 17 15:32:48.431119 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 15:32:48.431119 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:48.431119 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 15:32:48.431119 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 15:32:48.431119 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 15:32:48.431119 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 15:32:48.431119 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 15:32:48.431119 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 15:32:48.431119 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 15:32:48.431119 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 15:32:48.431119 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fee7bc0-cd0e-4c25-8475-b43e79cb933a could not be found. Jun 17 15:32:48.431119 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:32:48.431119 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:32:48.431119 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:32:48.431119 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:48.431119 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:32:48.431119 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:32:48.431119 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 15:32:48.431119 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 15:32:48.431119 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 15:32:48.432838 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 15:32:48.432838 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 15:32:48.432838 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 15:32:48.432838 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 15:32:48.432838 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 15:32:48.432838 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 15:32:48.432838 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 15:32:48.432838 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fee7bc0-cd0e-4c25-8475-b43e79cb933a could not be found. Jun 17 15:32:48.432838 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:32:48.432838 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:32:48.432838 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:32:48.432838 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:48.432838 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:32:48.432838 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:32:48.432838 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 15:32:48.432838 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 15:32:48.432838 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fee7bc0-cd0e-4c25-8475-b43e79cb933a could not be found. Jun 17 15:32:48.432838 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:32:48.435285 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-1ebad010-1b75-453c-81a2-c650b41f05c5 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Returning 404 to user: Instance 8fee7bc0-cd0e-4c25-8475-b43e79cb933a could not be found. {{(pid=117649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 15:32:48.435285 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-1ebad010-1b75-453c-81a2-c650b41f05c5 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 404 len: 111 microversion: 2.1 time: 0.057593 Jun 17 15:32:48.435285 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 600/1613] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:32:48 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 15:32:48.440946 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-2774f2e0-991e-4b9c-9547-e2909d967d5a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:32:48.442751 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-2774f2e0-991e-4b9c-9547-e2909d967d5a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:32:48.454003 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2774f2e0-991e-4b9c-9547-e2909d967d5a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:48.454733 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2774f2e0-991e-4b9c-9547-e2909d967d5a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:48.456027 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2774f2e0-991e-4b9c-9547-e2909d967d5a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:48.456798 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2774f2e0-991e-4b9c-9547-e2909d967d5a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:48.475785 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.objects.instance [None req-52b8b009-2e89-4e4d-9e59-eb95d64bdbaa tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lazy-loading 'services' on Instance uuid 808f28e6-03bc-4b67-ab1f-f1ef13838924 {{(pid=117650) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 15:32:48.512698 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-2774f2e0-991e-4b9c-9547-e2909d967d5a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079037 Jun 17 15:32:48.513775 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 601/1614] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:32:48 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:32:48.523003 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-5e049669-5c5f-4d65-9c3d-73e7a6453cd2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:32:48.523894 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-5e049669-5c5f-4d65-9c3d-73e7a6453cd2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:32:48.535141 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5e049669-5c5f-4d65-9c3d-73e7a6453cd2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:48.535661 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5e049669-5c5f-4d65-9c3d-73e7a6453cd2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:48.536659 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5e049669-5c5f-4d65-9c3d-73e7a6453cd2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:48.536913 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.wsgi [None req-52b8b009-2e89-4e4d-9e59-eb95d64bdbaa tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8c2f5e75-b217-494f-bc5b-7b32f00c737e) Jun 17 15:32:48.537424 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5e049669-5c5f-4d65-9c3d-73e7a6453cd2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:48.538978 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-52b8b009-2e89-4e4d-9e59-eb95d64bdbaa tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Request method failure captured: Jun 17 15:32:48.538978 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: request: DELETE /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924/os-volume_attachments/4e6d668f-6234-4ba9-913a-11f57866e984 HTTP/1.1 Jun 17 15:32:48.538978 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Accept: application/json Jun 17 15:32:48.538978 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Accept-Encoding: identity Jun 17 15:32:48.538978 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Connection: close Jun 17 15:32:48.538978 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Content-Length: 0 Jun 17 15:32:48.538978 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Content-Type: application/json Jun 17 15:32:48.538978 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Host: 10.222.0.48 Jun 17 15:32:48.538978 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Openstack-System-Scope: None Jun 17 15:32:48.538978 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: User-Agent: python-urllib3/1.26.9 Jun 17 15:32:48.538978 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Auth-Token: gAAAAABirJpPRELvo50oKxdbD2bQ6GGouzj8i1DebBt1zfB7fX0V-PDU7hlPCfVEJbYQ9PsMuU2ZA4JvqklZ9Y9hD2QbIWtBnNkd8fMsMcOzOLJcX5MT958XBAGaNkW3F9LEBjk4LnqtyEbVGNYjmbh2tqH5UI9WDRv0xJagRknfyHTSn0wpzG0 Jun 17 15:32:48.538978 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Domain-Id: None Jun 17 15:32:48.538978 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Domain-Name: None Jun 17 15:32:48.538978 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Identity-Status: Confirmed Jun 17 15:32:48.538978 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Is-Admin-Project: True Jun 17 15:32:48.538978 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Domain-Id: default Jun 17 15:32:48.538978 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Domain-Name: Default Jun 17 15:32:48.538978 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Id: 42b42320bc424a19b4ac5e35dae7afb3 Jun 17 15:32:48.538978 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1590813198 Jun 17 15:32:48.538978 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Role: reader,member Jun 17 15:32:48.538978 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Roles: reader,member Jun 17 15:32:48.541548 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_42b42320bc424a19b4ac5e35dae7afb3", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/42b42320bc424a19b4ac5e35dae7afb3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/42b42320bc424a19b4ac5e35dae7afb3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/42b42320bc424a19b4ac5e35dae7afb3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Jun 17 15:32:48.541548 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant: tempest-VolumesSnapshotTestJSON-1590813198 Jun 17 15:32:48.541548 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant-Id: 42b42320bc424a19b4ac5e35dae7afb3 Jun 17 15:32:48.541548 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1590813198 Jun 17 15:32:48.541548 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User: tempest-VolumesSnapshotTestJSON-1590813198-project Jun 17 15:32:48.541548 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Domain-Id: default Jun 17 15:32:48.541548 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Domain-Name: Default Jun 17 15:32:48.541548 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Id: b6ac8cbc7c6d4cce9d2b0a1289846a3d Jun 17 15:32:48.541548 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Name: tempest-VolumesSnapshotTestJSON-1590813198-project Jun 17 15:32:48.541548 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: method: > Jun 17 15:32:48.542944 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8c2f5e75-b217-494f-bc5b-7b32f00c737e) Jun 17 15:32:48.542944 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: action_args: {'server_id': '808f28e6-03bc-4b67-ab1f-f1ef13838924', 'id': '4e6d668f-6234-4ba9-913a-11f57866e984'} Jun 17 15:32:48.542944 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 15:32:48.542944 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:48.542944 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 15:32:48.542944 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 15:32:48.542944 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 15:32:48.542944 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 15:32:48.542944 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 15:32:48.542944 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 15:32:48.542944 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 15:32:48.542944 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 15:32:48.542944 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 15:32:48.542944 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 15:32:48.542944 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 15:32:48.542944 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 15:32:48.542944 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 15:32:48.546475 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 15:32:48.546475 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 15:32:48.546475 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 15:32:48.546475 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8c2f5e75-b217-494f-bc5b-7b32f00c737e) Jun 17 15:32:48.546475 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:32:48.546475 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:32:48.546475 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:32:48.546475 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:48.546475 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 17 15:32:48.546475 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 17 15:32:48.546475 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 17 15:32:48.546475 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 17 15:32:48.546475 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 15:32:48.546475 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 15:32:48.546475 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 15:32:48.546475 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 15:32:48.546475 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 15:32:48.546475 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 15:32:48.546475 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 15:32:48.547937 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 15:32:48.547937 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 15:32:48.547937 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 15:32:48.547937 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 15:32:48.547937 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 15:32:48.547937 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 15:32:48.547937 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 15:32:48.547937 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 15:32:48.547937 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 15:32:48.547937 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 15:32:48.547937 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 15:32:48.547937 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8c2f5e75-b217-494f-bc5b-7b32f00c737e) Jun 17 15:32:48.547937 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:32:48.547937 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:32:48.547937 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:32:48.547937 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:48.547937 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 17 15:32:48.550182 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 17 15:32:48.550182 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 17 15:32:48.550182 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 15:32:48.550182 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 17 15:32:48.550182 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 17 15:32:48.550182 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 17 15:32:48.550182 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 17 15:32:48.550182 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 17 15:32:48.550182 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 15:32:48.550182 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 17 15:32:48.550182 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 17 15:32:48.550182 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8c2f5e75-b217-494f-bc5b-7b32f00c737e) Jun 17 15:32:48.550182 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:32:48.550182 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:32:48.550182 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:32:48.550182 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:48.550182 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:32:48.550182 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:32:48.552930 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 15:32:48.552930 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 15:32:48.552930 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 15:32:48.552930 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 15:32:48.552930 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 17 15:32:48.552930 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 17 15:32:48.552930 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8c2f5e75-b217-494f-bc5b-7b32f00c737e) Jun 17 15:32:48.552930 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:32:48.552930 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:32:48.552930 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:32:48.552930 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:48.552930 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:32:48.552930 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:32:48.552930 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 15:32:48.552930 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 15:32:48.552930 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8c2f5e75-b217-494f-bc5b-7b32f00c737e) Jun 17 15:32:48.552930 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:32:48.555621 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-52b8b009-2e89-4e4d-9e59-eb95d64bdbaa tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8c2f5e75-b217-494f-bc5b-7b32f00c737e) {{(pid=117650) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 15:32:48.555621 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-52b8b009-2e89-4e4d-9e59-eb95d64bdbaa tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "DELETE /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924/os-volume_attachments/4e6d668f-6234-4ba9-913a-11f57866e984" status: 400 len: 269 microversion: 2.1 time: 0.210288 Jun 17 15:32:48.555621 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1014/1615] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Jun 17 15:32:48 2022] DELETE /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924/os-volume_attachments/4e6d668f-6234-4ba9-913a-11f57866e984 => generated 269 bytes in 212 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 17 15:32:48.555621 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-9eceb2ad-02c7-4d03-b103-d731a45dd98f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:32:48.556493 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-9eceb2ad-02c7-4d03-b103-d731a45dd98f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:32:48.556493 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9eceb2ad-02c7-4d03-b103-d731a45dd98f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:48.556493 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9eceb2ad-02c7-4d03-b103-d731a45dd98f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:48.556493 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9eceb2ad-02c7-4d03-b103-d731a45dd98f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:48.557219 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9eceb2ad-02c7-4d03-b103-d731a45dd98f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:48.708454 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.objects.instance [None req-5e049669-5c5f-4d65-9c3d-73e7a6453cd2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lazy-loading 'services' on Instance uuid ba5d3180-d42a-4678-af13-c99282e054bf {{(pid=117649) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 15:32:48.774979 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-9eceb2ad-02c7-4d03-b103-d731a45dd98f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:32:48.789588 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-9eceb2ad-02c7-4d03-b103-d731a45dd98f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1563 microversion: 2.1 time: 0.246626 Jun 17 15:32:48.790600 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1015/1616] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:32:48 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1563 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:32:48.799691 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-44b16bd7-223d-42bf-9829-b0ca50e56885 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:32:48.800693 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-44b16bd7-223d-42bf-9829-b0ca50e56885 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:32:48.802169 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.wsgi [None req-5e049669-5c5f-4d65-9c3d-73e7a6453cd2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4c222bd9-1833-45a9-a4c8-75354cfe3086) Jun 17 15:32:48.805896 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-5e049669-5c5f-4d65-9c3d-73e7a6453cd2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Request method failure captured: Jun 17 15:32:48.805896 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: request: DELETE /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments/713822dc-11e8-4f5c-ae7c-bcf41e01b06d HTTP/1.1 Jun 17 15:32:48.805896 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Accept: application/json Jun 17 15:32:48.805896 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Accept-Encoding: identity Jun 17 15:32:48.805896 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Connection: close Jun 17 15:32:48.805896 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Content-Length: 0 Jun 17 15:32:48.805896 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Content-Type: application/json Jun 17 15:32:48.805896 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Host: 10.222.0.48 Jun 17 15:32:48.805896 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Openstack-System-Scope: None Jun 17 15:32:48.805896 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: User-Agent: python-urllib3/1.26.9 Jun 17 15:32:48.805896 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Auth-Token: gAAAAABirJmQC7m757v9yyJD0BsI2MhqMNm1yc2WpkBWgAGOwCYW524pgy_6_7F6gBQez89A-LSNviRE5zDFwqgj2BZoXTsMX0NmzFHDYuHo31ibepKT71785ic3IrIvGY4IglQk81nqgsevYUUWYR-s69vMdAmv9JQXTwFMOwaCzN_3w4dwj6k Jun 17 15:32:48.805896 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Domain-Id: None Jun 17 15:32:48.805896 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Domain-Name: None Jun 17 15:32:48.805896 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Identity-Status: Confirmed Jun 17 15:32:48.805896 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Is-Admin-Project: True Jun 17 15:32:48.805896 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Domain-Id: default Jun 17 15:32:48.805896 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Domain-Name: Default Jun 17 15:32:48.805896 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Id: 50408ec18fa04036a0abb6236343e258 Jun 17 15:32:48.805896 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1478734135 Jun 17 15:32:48.805896 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Role: reader,member Jun 17 15:32:48.805896 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Roles: reader,member Jun 17 15:32:48.807338 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_50408ec18fa04036a0abb6236343e258", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/50408ec18fa04036a0abb6236343e258"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/50408ec18fa04036a0abb6236343e258"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/50408ec18fa04036a0abb6236343e258"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Jun 17 15:32:48.807338 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1478734135 Jun 17 15:32:48.807338 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant-Id: 50408ec18fa04036a0abb6236343e258 Jun 17 15:32:48.807338 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1478734135 Jun 17 15:32:48.807338 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User: tempest-ServerRescueNegativeTestJSON-1478734135-project Jun 17 15:32:48.807338 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Domain-Id: default Jun 17 15:32:48.807338 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Domain-Name: Default Jun 17 15:32:48.807338 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Id: 562485deaf214fa29eac132464ef93e3 Jun 17 15:32:48.807338 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1478734135-project Jun 17 15:32:48.807338 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: method: > Jun 17 15:32:48.807965 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4c222bd9-1833-45a9-a4c8-75354cfe3086) Jun 17 15:32:48.807965 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: action_args: {'server_id': 'ba5d3180-d42a-4678-af13-c99282e054bf', 'id': '713822dc-11e8-4f5c-ae7c-bcf41e01b06d'} Jun 17 15:32:48.807965 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 15:32:48.807965 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:48.807965 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 15:32:48.807965 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 15:32:48.807965 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 15:32:48.807965 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 15:32:48.807965 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 15:32:48.807965 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 15:32:48.807965 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 15:32:48.807965 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 15:32:48.807965 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 15:32:48.807965 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 15:32:48.807965 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 15:32:48.807965 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 15:32:48.807965 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 15:32:48.809044 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 15:32:48.809044 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 15:32:48.809044 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 15:32:48.809044 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4c222bd9-1833-45a9-a4c8-75354cfe3086) Jun 17 15:32:48.809044 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:32:48.809044 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:32:48.809044 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:32:48.809044 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:48.809044 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 17 15:32:48.809044 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 17 15:32:48.809044 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 17 15:32:48.809044 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 17 15:32:48.809044 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 15:32:48.809044 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 15:32:48.809044 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 15:32:48.809044 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 15:32:48.809044 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 15:32:48.809044 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 15:32:48.809044 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 15:32:48.810235 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 15:32:48.810235 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 15:32:48.810235 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 15:32:48.810235 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 15:32:48.810235 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 15:32:48.810235 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 15:32:48.810235 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 15:32:48.810235 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 15:32:48.810235 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 15:32:48.810235 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 15:32:48.810235 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 15:32:48.810235 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4c222bd9-1833-45a9-a4c8-75354cfe3086) Jun 17 15:32:48.810235 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:32:48.810235 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:32:48.810235 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:32:48.810235 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:48.810235 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 17 15:32:48.811271 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 17 15:32:48.811271 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 17 15:32:48.811271 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 15:32:48.811271 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 17 15:32:48.811271 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 17 15:32:48.811271 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 17 15:32:48.811271 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 17 15:32:48.811271 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 17 15:32:48.811271 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 15:32:48.811271 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 17 15:32:48.811271 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 17 15:32:48.811271 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4c222bd9-1833-45a9-a4c8-75354cfe3086) Jun 17 15:32:48.811271 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:32:48.811271 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:32:48.811271 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:32:48.811271 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:48.811271 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:32:48.811271 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:32:48.812432 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 15:32:48.812432 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 15:32:48.812432 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 15:32:48.812432 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 15:32:48.812432 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 17 15:32:48.812432 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 17 15:32:48.812432 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4c222bd9-1833-45a9-a4c8-75354cfe3086) Jun 17 15:32:48.812432 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:32:48.812432 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:32:48.812432 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:32:48.812432 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:48.812432 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:32:48.812432 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:32:48.812432 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 15:32:48.812432 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 15:32:48.812432 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4c222bd9-1833-45a9-a4c8-75354cfe3086) Jun 17 15:32:48.812432 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:32:48.813497 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-5e049669-5c5f-4d65-9c3d-73e7a6453cd2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4c222bd9-1833-45a9-a4c8-75354cfe3086) {{(pid=117649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 15:32:48.813497 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-5e049669-5c5f-4d65-9c3d-73e7a6453cd2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "DELETE /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments/713822dc-11e8-4f5c-ae7c-bcf41e01b06d" status: 400 len: 269 microversion: 2.1 time: 0.293233 Jun 17 15:32:48.813497 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 602/1617] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Jun 17 15:32:48 2022] DELETE /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments/713822dc-11e8-4f5c-ae7c-bcf41e01b06d => generated 269 bytes in 295 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 17 15:32:48.813983 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-44b16bd7-223d-42bf-9829-b0ca50e56885 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:48.814970 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-44b16bd7-223d-42bf-9829-b0ca50e56885 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:48.815952 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-44b16bd7-223d-42bf-9829-b0ca50e56885 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:48.817064 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-44b16bd7-223d-42bf-9829-b0ca50e56885 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:48.817234 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-5b2cb2f9-6b3c-4a72-9eeb-3e76c714a794 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:32:48.818255 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-5b2cb2f9-6b3c-4a72-9eeb-3e76c714a794 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:32:48.829098 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5b2cb2f9-6b3c-4a72-9eeb-3e76c714a794 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:48.829884 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5b2cb2f9-6b3c-4a72-9eeb-3e76c714a794 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:48.831211 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5b2cb2f9-6b3c-4a72-9eeb-3e76c714a794 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:48.831929 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5b2cb2f9-6b3c-4a72-9eeb-3e76c714a794 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:48.858575 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.wsgi [None req-5b2cb2f9-6b3c-4a72-9eeb-3e76c714a794 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] HTTP exception thrown: Instance 8fee7bc0-cd0e-4c25-8475-b43e79cb933a could not be found. Jun 17 15:32:48.860165 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-5b2cb2f9-6b3c-4a72-9eeb-3e76c714a794 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Request method failure captured: Jun 17 15:32:48.860165 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: request: GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a HTTP/1.1 Jun 17 15:32:48.860165 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Accept: application/json Jun 17 15:32:48.860165 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Accept-Encoding: identity Jun 17 15:32:48.860165 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Connection: close Jun 17 15:32:48.860165 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Content-Length: 0 Jun 17 15:32:48.860165 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Content-Type: application/json Jun 17 15:32:48.860165 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Host: 10.222.0.48 Jun 17 15:32:48.860165 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Openstack-System-Scope: None Jun 17 15:32:48.860165 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: User-Agent: python-urllib3/1.26.9 Jun 17 15:32:48.860165 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Auth-Token: gAAAAABirJodidJx0AY_qcwoEwWEszpikfHtXmarSN0h6rNL3nP0iBWXeXbu1IBvVskBSxMS5UAzkWIcgkCzT0_jtZtoDW3a4yLFd9G-iV8iuD24PAIeHzq28KHUo0wHpTFHnG1joRgrCGGOeiOwT6JyvzMgTpEgSjE1WKGTngEoPIRC3Gt4VEE Jun 17 15:32:48.860165 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Domain-Id: None Jun 17 15:32:48.860165 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Domain-Name: None Jun 17 15:32:48.860165 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Identity-Status: Confirmed Jun 17 15:32:48.860165 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Is-Admin-Project: True Jun 17 15:32:48.860165 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Domain-Id: default Jun 17 15:32:48.860165 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Domain-Name: Default Jun 17 15:32:48.860165 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Id: 6298c1910e1a488983d5399d7952a5cf Jun 17 15:32:48.860165 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Name: tempest-TestVolumeBootPattern-1895714660 Jun 17 15:32:48.860165 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Role: reader,member Jun 17 15:32:48.860165 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Roles: reader,member Jun 17 15:32:48.863010 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6298c1910e1a488983d5399d7952a5cf", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6298c1910e1a488983d5399d7952a5cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6298c1910e1a488983d5399d7952a5cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6298c1910e1a488983d5399d7952a5cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Jun 17 15:32:48.863010 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant: tempest-TestVolumeBootPattern-1895714660 Jun 17 15:32:48.863010 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant-Id: 6298c1910e1a488983d5399d7952a5cf Jun 17 15:32:48.863010 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant-Name: tempest-TestVolumeBootPattern-1895714660 Jun 17 15:32:48.863010 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User: tempest-TestVolumeBootPattern-1895714660-project Jun 17 15:32:48.863010 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Domain-Id: default Jun 17 15:32:48.863010 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Domain-Name: Default Jun 17 15:32:48.863010 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Id: 4e3e797edb9a453d9142c3196a4f21bb Jun 17 15:32:48.863010 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Name: tempest-TestVolumeBootPattern-1895714660-project Jun 17 15:32:48.863010 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: method: > Jun 17 15:32:48.863010 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: exception: Instance 8fee7bc0-cd0e-4c25-8475-b43e79cb933a could not be found. Jun 17 15:32:48.863010 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: action_args: {'id': '8fee7bc0-cd0e-4c25-8475-b43e79cb933a'} Jun 17 15:32:48.864785 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 15:32:48.864785 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:48.864785 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 15:32:48.864785 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 15:32:48.864785 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 15:32:48.864785 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 15:32:48.864785 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 15:32:48.864785 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 15:32:48.864785 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 15:32:48.864785 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 15:32:48.864785 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fee7bc0-cd0e-4c25-8475-b43e79cb933a could not be found. Jun 17 15:32:48.864785 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:32:48.864785 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:32:48.864785 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:32:48.864785 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:48.864785 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:32:48.864785 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:32:48.864785 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 15:32:48.864785 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 15:32:48.864785 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 15:32:48.867665 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 15:32:48.867665 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 15:32:48.867665 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 15:32:48.867665 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 15:32:48.867665 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 15:32:48.867665 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 15:32:48.867665 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 15:32:48.867665 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fee7bc0-cd0e-4c25-8475-b43e79cb933a could not be found. Jun 17 15:32:48.867665 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:32:48.867665 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:32:48.867665 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:32:48.867665 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:48.867665 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:32:48.867665 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:32:48.867665 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 15:32:48.867665 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 15:32:48.867665 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fee7bc0-cd0e-4c25-8475-b43e79cb933a could not be found. Jun 17 15:32:48.867665 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:32:48.870257 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-5b2cb2f9-6b3c-4a72-9eeb-3e76c714a794 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Returning 404 to user: Instance 8fee7bc0-cd0e-4c25-8475-b43e79cb933a could not be found. {{(pid=117649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 15:32:48.870257 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-5b2cb2f9-6b3c-4a72-9eeb-3e76c714a794 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 404 len: 111 microversion: 2.1 time: 0.050647 Jun 17 15:32:48.870257 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 603/1618] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:32:48 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 15:32:48.870257 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-1a5d9466-8eba-4c93-a296-979a7096b564 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:32:48.870257 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-1a5d9466-8eba-4c93-a296-979a7096b564 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:32:48.875120 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1a5d9466-8eba-4c93-a296-979a7096b564 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:48.875570 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1a5d9466-8eba-4c93-a296-979a7096b564 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:48.876379 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1a5d9466-8eba-4c93-a296-979a7096b564 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:48.876820 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1a5d9466-8eba-4c93-a296-979a7096b564 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:48.914101 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-1a5d9466-8eba-4c93-a296-979a7096b564 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050649 Jun 17 15:32:48.914872 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 604/1619] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:32:48 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:32:48.922540 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-b18afafa-9b79-4cb7-973f-fc3959f717b5 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:32:48.923070 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-b18afafa-9b79-4cb7-973f-fc3959f717b5 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:32:48.932852 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b18afafa-9b79-4cb7-973f-fc3959f717b5 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:48.933453 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b18afafa-9b79-4cb7-973f-fc3959f717b5 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:48.934421 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b18afafa-9b79-4cb7-973f-fc3959f717b5 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:48.935551 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b18afafa-9b79-4cb7-973f-fc3959f717b5 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:48.942668 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.objects.instance [None req-44b16bd7-223d-42bf-9829-b0ca50e56885 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lazy-loading 'services' on Instance uuid 808f28e6-03bc-4b67-ab1f-f1ef13838924 {{(pid=117650) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 15:32:48.947326 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=100 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:32:49.034246 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.wsgi [None req-44b16bd7-223d-42bf-9829-b0ca50e56885 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-650c9adc-e778-4283-938c-d6e96464d3c0) Jun 17 15:32:49.036904 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-44b16bd7-223d-42bf-9829-b0ca50e56885 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Request method failure captured: Jun 17 15:32:49.036904 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: request: DELETE /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924/os-volume_attachments/4e6d668f-6234-4ba9-913a-11f57866e984 HTTP/1.1 Jun 17 15:32:49.036904 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Accept: application/json Jun 17 15:32:49.036904 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Accept-Encoding: identity Jun 17 15:32:49.036904 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Connection: close Jun 17 15:32:49.036904 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Content-Length: 0 Jun 17 15:32:49.036904 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Content-Type: application/json Jun 17 15:32:49.036904 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Host: 10.222.0.48 Jun 17 15:32:49.036904 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Openstack-System-Scope: None Jun 17 15:32:49.036904 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: User-Agent: python-urllib3/1.26.9 Jun 17 15:32:49.036904 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Auth-Token: gAAAAABirJpPRELvo50oKxdbD2bQ6GGouzj8i1DebBt1zfB7fX0V-PDU7hlPCfVEJbYQ9PsMuU2ZA4JvqklZ9Y9hD2QbIWtBnNkd8fMsMcOzOLJcX5MT958XBAGaNkW3F9LEBjk4LnqtyEbVGNYjmbh2tqH5UI9WDRv0xJagRknfyHTSn0wpzG0 Jun 17 15:32:49.036904 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Domain-Id: None Jun 17 15:32:49.036904 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Domain-Name: None Jun 17 15:32:49.036904 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Identity-Status: Confirmed Jun 17 15:32:49.036904 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Is-Admin-Project: True Jun 17 15:32:49.036904 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Domain-Id: default Jun 17 15:32:49.036904 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Domain-Name: Default Jun 17 15:32:49.036904 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Id: 42b42320bc424a19b4ac5e35dae7afb3 Jun 17 15:32:49.036904 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1590813198 Jun 17 15:32:49.036904 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Role: reader,member Jun 17 15:32:49.036904 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Roles: reader,member Jun 17 15:32:49.039364 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_42b42320bc424a19b4ac5e35dae7afb3", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/42b42320bc424a19b4ac5e35dae7afb3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/42b42320bc424a19b4ac5e35dae7afb3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/42b42320bc424a19b4ac5e35dae7afb3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Jun 17 15:32:49.039364 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant: tempest-VolumesSnapshotTestJSON-1590813198 Jun 17 15:32:49.039364 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant-Id: 42b42320bc424a19b4ac5e35dae7afb3 Jun 17 15:32:49.039364 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1590813198 Jun 17 15:32:49.039364 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User: tempest-VolumesSnapshotTestJSON-1590813198-project Jun 17 15:32:49.039364 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Domain-Id: default Jun 17 15:32:49.039364 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Domain-Name: Default Jun 17 15:32:49.039364 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Id: b6ac8cbc7c6d4cce9d2b0a1289846a3d Jun 17 15:32:49.039364 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Name: tempest-VolumesSnapshotTestJSON-1590813198-project Jun 17 15:32:49.039364 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: method: > Jun 17 15:32:49.041035 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-650c9adc-e778-4283-938c-d6e96464d3c0) Jun 17 15:32:49.041035 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: action_args: {'server_id': '808f28e6-03bc-4b67-ab1f-f1ef13838924', 'id': '4e6d668f-6234-4ba9-913a-11f57866e984'} Jun 17 15:32:49.041035 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 15:32:49.041035 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:49.041035 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 15:32:49.041035 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 15:32:49.041035 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 15:32:49.041035 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 15:32:49.041035 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 15:32:49.041035 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 15:32:49.041035 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 15:32:49.041035 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 15:32:49.041035 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 15:32:49.041035 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 15:32:49.041035 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 15:32:49.041035 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 15:32:49.041035 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 15:32:49.043074 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 15:32:49.043074 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 15:32:49.043074 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 15:32:49.043074 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-650c9adc-e778-4283-938c-d6e96464d3c0) Jun 17 15:32:49.043074 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:32:49.043074 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:32:49.043074 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:32:49.043074 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:49.043074 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 17 15:32:49.043074 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 17 15:32:49.043074 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 17 15:32:49.043074 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 17 15:32:49.043074 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 15:32:49.043074 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 15:32:49.043074 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 15:32:49.043074 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 15:32:49.043074 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 15:32:49.043074 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 15:32:49.043074 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 15:32:49.046642 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 15:32:49.046642 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 15:32:49.046642 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 15:32:49.046642 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 15:32:49.046642 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 15:32:49.046642 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 15:32:49.046642 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 15:32:49.046642 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 15:32:49.046642 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 15:32:49.046642 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 15:32:49.046642 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 15:32:49.046642 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-650c9adc-e778-4283-938c-d6e96464d3c0) Jun 17 15:32:49.046642 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:32:49.046642 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:32:49.046642 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:32:49.046642 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:49.046642 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 17 15:32:49.048445 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 17 15:32:49.048445 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 17 15:32:49.048445 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 15:32:49.048445 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 17 15:32:49.048445 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 17 15:32:49.048445 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 17 15:32:49.048445 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 17 15:32:49.048445 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 17 15:32:49.048445 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 15:32:49.048445 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 17 15:32:49.048445 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 17 15:32:49.048445 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-650c9adc-e778-4283-938c-d6e96464d3c0) Jun 17 15:32:49.048445 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:32:49.048445 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:32:49.048445 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:32:49.048445 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:49.048445 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:32:49.048445 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:32:49.050509 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 15:32:49.050509 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 15:32:49.050509 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 15:32:49.050509 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 15:32:49.050509 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 17 15:32:49.050509 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 17 15:32:49.050509 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-650c9adc-e778-4283-938c-d6e96464d3c0) Jun 17 15:32:49.050509 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:32:49.050509 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:32:49.050509 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:32:49.050509 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:49.050509 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:32:49.050509 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:32:49.050509 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 15:32:49.050509 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 15:32:49.050509 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-650c9adc-e778-4283-938c-d6e96464d3c0) Jun 17 15:32:49.050509 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:32:49.052929 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-44b16bd7-223d-42bf-9829-b0ca50e56885 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-650c9adc-e778-4283-938c-d6e96464d3c0) {{(pid=117650) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 15:32:49.052929 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-44b16bd7-223d-42bf-9829-b0ca50e56885 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "DELETE /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924/os-volume_attachments/4e6d668f-6234-4ba9-913a-11f57866e984" status: 400 len: 269 microversion: 2.1 time: 0.246402 Jun 17 15:32:49.052929 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1016/1620] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Jun 17 15:32:48 2022] DELETE /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924/os-volume_attachments/4e6d668f-6234-4ba9-913a-11f57866e984 => generated 269 bytes in 248 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 17 15:32:49.052929 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-fde6045f-cc8a-487a-a769-495d02c142d2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:32:49.053739 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-fde6045f-cc8a-487a-a769-495d02c142d2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:32:49.060270 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fde6045f-cc8a-487a-a769-495d02c142d2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:49.061074 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fde6045f-cc8a-487a-a769-495d02c142d2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:49.062472 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fde6045f-cc8a-487a-a769-495d02c142d2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:49.063351 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fde6045f-cc8a-487a-a769-495d02c142d2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:49.108506 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell1:SELECT=100 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:32:49.112716 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.objects.instance [None req-b18afafa-9b79-4cb7-973f-fc3959f717b5 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lazy-loading 'services' on Instance uuid ba5d3180-d42a-4678-af13-c99282e054bf {{(pid=117649) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 15:32:49.177173 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.wsgi [None req-b18afafa-9b79-4cb7-973f-fc3959f717b5 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cc65b141-8833-4565-a551-965e7f144730) Jun 17 15:32:49.179398 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-b18afafa-9b79-4cb7-973f-fc3959f717b5 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Request method failure captured: Jun 17 15:32:49.179398 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: request: DELETE /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments/713822dc-11e8-4f5c-ae7c-bcf41e01b06d HTTP/1.1 Jun 17 15:32:49.179398 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Accept: application/json Jun 17 15:32:49.179398 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Accept-Encoding: identity Jun 17 15:32:49.179398 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Connection: close Jun 17 15:32:49.179398 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Content-Length: 0 Jun 17 15:32:49.179398 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Content-Type: application/json Jun 17 15:32:49.179398 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Host: 10.222.0.48 Jun 17 15:32:49.179398 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Openstack-System-Scope: None Jun 17 15:32:49.179398 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: User-Agent: python-urllib3/1.26.9 Jun 17 15:32:49.179398 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Auth-Token: gAAAAABirJmQC7m757v9yyJD0BsI2MhqMNm1yc2WpkBWgAGOwCYW524pgy_6_7F6gBQez89A-LSNviRE5zDFwqgj2BZoXTsMX0NmzFHDYuHo31ibepKT71785ic3IrIvGY4IglQk81nqgsevYUUWYR-s69vMdAmv9JQXTwFMOwaCzN_3w4dwj6k Jun 17 15:32:49.179398 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Domain-Id: None Jun 17 15:32:49.179398 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Domain-Name: None Jun 17 15:32:49.179398 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Identity-Status: Confirmed Jun 17 15:32:49.179398 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Is-Admin-Project: True Jun 17 15:32:49.179398 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Domain-Id: default Jun 17 15:32:49.179398 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Domain-Name: Default Jun 17 15:32:49.179398 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Id: 50408ec18fa04036a0abb6236343e258 Jun 17 15:32:49.179398 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1478734135 Jun 17 15:32:49.179398 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Role: reader,member Jun 17 15:32:49.179398 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Roles: reader,member Jun 17 15:32:49.180896 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_50408ec18fa04036a0abb6236343e258", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/50408ec18fa04036a0abb6236343e258"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/50408ec18fa04036a0abb6236343e258"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/50408ec18fa04036a0abb6236343e258"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Jun 17 15:32:49.180896 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1478734135 Jun 17 15:32:49.180896 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant-Id: 50408ec18fa04036a0abb6236343e258 Jun 17 15:32:49.180896 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1478734135 Jun 17 15:32:49.180896 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User: tempest-ServerRescueNegativeTestJSON-1478734135-project Jun 17 15:32:49.180896 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Domain-Id: default Jun 17 15:32:49.180896 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Domain-Name: Default Jun 17 15:32:49.180896 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Id: 562485deaf214fa29eac132464ef93e3 Jun 17 15:32:49.180896 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1478734135-project Jun 17 15:32:49.180896 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: method: > Jun 17 15:32:49.181514 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cc65b141-8833-4565-a551-965e7f144730) Jun 17 15:32:49.181514 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: action_args: {'server_id': 'ba5d3180-d42a-4678-af13-c99282e054bf', 'id': '713822dc-11e8-4f5c-ae7c-bcf41e01b06d'} Jun 17 15:32:49.181514 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 15:32:49.181514 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:49.181514 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 15:32:49.181514 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 15:32:49.181514 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 15:32:49.181514 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 15:32:49.181514 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 15:32:49.181514 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 15:32:49.181514 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 15:32:49.181514 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 15:32:49.181514 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 15:32:49.181514 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 15:32:49.181514 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 15:32:49.181514 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 15:32:49.181514 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 15:32:49.182552 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 15:32:49.182552 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 15:32:49.182552 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 15:32:49.182552 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cc65b141-8833-4565-a551-965e7f144730) Jun 17 15:32:49.182552 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:32:49.182552 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:32:49.182552 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:32:49.182552 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:49.182552 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 17 15:32:49.182552 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 17 15:32:49.182552 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 17 15:32:49.182552 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 17 15:32:49.182552 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 15:32:49.182552 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 15:32:49.182552 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 15:32:49.182552 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 15:32:49.182552 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 15:32:49.182552 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 15:32:49.182552 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 15:32:49.183694 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 15:32:49.183694 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 15:32:49.183694 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 15:32:49.183694 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 15:32:49.183694 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 15:32:49.183694 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 15:32:49.183694 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 15:32:49.183694 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 15:32:49.183694 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 15:32:49.183694 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 15:32:49.183694 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 15:32:49.183694 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cc65b141-8833-4565-a551-965e7f144730) Jun 17 15:32:49.183694 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:32:49.183694 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:32:49.183694 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:32:49.183694 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:49.183694 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 17 15:32:49.184914 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 17 15:32:49.184914 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 17 15:32:49.184914 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 15:32:49.184914 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 17 15:32:49.184914 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 17 15:32:49.184914 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 17 15:32:49.184914 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 17 15:32:49.184914 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 17 15:32:49.184914 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 15:32:49.184914 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 17 15:32:49.184914 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 17 15:32:49.184914 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cc65b141-8833-4565-a551-965e7f144730) Jun 17 15:32:49.184914 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:32:49.184914 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:32:49.184914 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:32:49.184914 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:49.184914 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:32:49.184914 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:32:49.185995 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 15:32:49.185995 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 15:32:49.185995 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 15:32:49.185995 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 15:32:49.185995 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 17 15:32:49.185995 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 17 15:32:49.185995 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cc65b141-8833-4565-a551-965e7f144730) Jun 17 15:32:49.185995 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:32:49.185995 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:32:49.185995 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:32:49.185995 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:49.185995 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:32:49.185995 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:32:49.185995 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 15:32:49.185995 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 15:32:49.185995 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cc65b141-8833-4565-a551-965e7f144730) Jun 17 15:32:49.185995 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:32:49.187041 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-b18afafa-9b79-4cb7-973f-fc3959f717b5 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cc65b141-8833-4565-a551-965e7f144730) {{(pid=117649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 15:32:49.187041 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-b18afafa-9b79-4cb7-973f-fc3959f717b5 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "DELETE /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments/713822dc-11e8-4f5c-ae7c-bcf41e01b06d" status: 400 len: 269 microversion: 2.1 time: 0.270396 Jun 17 15:32:49.188032 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 605/1621] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Jun 17 15:32:48 2022] DELETE /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments/713822dc-11e8-4f5c-ae7c-bcf41e01b06d => generated 269 bytes in 272 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 17 15:32:49.193783 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-c4279dd3-32a0-4ca2-82e9-3bf40fe394db tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:32:49.194449 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-c4279dd3-32a0-4ca2-82e9-3bf40fe394db tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:32:49.202866 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c4279dd3-32a0-4ca2-82e9-3bf40fe394db tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:49.203589 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c4279dd3-32a0-4ca2-82e9-3bf40fe394db tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:49.205008 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c4279dd3-32a0-4ca2-82e9-3bf40fe394db tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:49.205738 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c4279dd3-32a0-4ca2-82e9-3bf40fe394db tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:49.299475 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-fde6045f-cc8a-487a-a769-495d02c142d2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:32:49.309490 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.objects.instance [None req-c4279dd3-32a0-4ca2-82e9-3bf40fe394db tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lazy-loading 'services' on Instance uuid 808f28e6-03bc-4b67-ab1f-f1ef13838924 {{(pid=117649) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 15:32:49.312009 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-fde6045f-cc8a-487a-a769-495d02c142d2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1563 microversion: 2.1 time: 0.271206 Jun 17 15:32:49.313001 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1017/1622] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:32:49 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1563 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:32:49.320407 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-58afe5c4-f325-41fa-9391-2af304c5f3ad tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:32:49.321492 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-58afe5c4-f325-41fa-9391-2af304c5f3ad tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:32:49.332187 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-58afe5c4-f325-41fa-9391-2af304c5f3ad tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:49.332942 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-58afe5c4-f325-41fa-9391-2af304c5f3ad tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:49.334205 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-58afe5c4-f325-41fa-9391-2af304c5f3ad tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:49.334930 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-58afe5c4-f325-41fa-9391-2af304c5f3ad tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:49.358244 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.wsgi [None req-58afe5c4-f325-41fa-9391-2af304c5f3ad tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] HTTP exception thrown: Instance 8fee7bc0-cd0e-4c25-8475-b43e79cb933a could not be found. Jun 17 15:32:49.360152 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-58afe5c4-f325-41fa-9391-2af304c5f3ad tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Request method failure captured: Jun 17 15:32:49.360152 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: request: GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a HTTP/1.1 Jun 17 15:32:49.360152 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Accept: application/json Jun 17 15:32:49.360152 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Accept-Encoding: identity Jun 17 15:32:49.360152 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Connection: close Jun 17 15:32:49.360152 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Content-Length: 0 Jun 17 15:32:49.360152 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Content-Type: application/json Jun 17 15:32:49.360152 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Host: 10.222.0.48 Jun 17 15:32:49.360152 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Openstack-System-Scope: None Jun 17 15:32:49.360152 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: User-Agent: python-urllib3/1.26.9 Jun 17 15:32:49.360152 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Auth-Token: gAAAAABirJodidJx0AY_qcwoEwWEszpikfHtXmarSN0h6rNL3nP0iBWXeXbu1IBvVskBSxMS5UAzkWIcgkCzT0_jtZtoDW3a4yLFd9G-iV8iuD24PAIeHzq28KHUo0wHpTFHnG1joRgrCGGOeiOwT6JyvzMgTpEgSjE1WKGTngEoPIRC3Gt4VEE Jun 17 15:32:49.360152 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Domain-Id: None Jun 17 15:32:49.360152 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Domain-Name: None Jun 17 15:32:49.360152 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Identity-Status: Confirmed Jun 17 15:32:49.360152 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Is-Admin-Project: True Jun 17 15:32:49.360152 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Domain-Id: default Jun 17 15:32:49.360152 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Domain-Name: Default Jun 17 15:32:49.360152 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Id: 6298c1910e1a488983d5399d7952a5cf Jun 17 15:32:49.360152 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Name: tempest-TestVolumeBootPattern-1895714660 Jun 17 15:32:49.360152 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Role: reader,member Jun 17 15:32:49.360152 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Roles: reader,member Jun 17 15:32:49.363019 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6298c1910e1a488983d5399d7952a5cf", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6298c1910e1a488983d5399d7952a5cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6298c1910e1a488983d5399d7952a5cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6298c1910e1a488983d5399d7952a5cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Jun 17 15:32:49.363019 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant: tempest-TestVolumeBootPattern-1895714660 Jun 17 15:32:49.363019 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant-Id: 6298c1910e1a488983d5399d7952a5cf Jun 17 15:32:49.363019 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant-Name: tempest-TestVolumeBootPattern-1895714660 Jun 17 15:32:49.363019 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User: tempest-TestVolumeBootPattern-1895714660-project Jun 17 15:32:49.363019 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Domain-Id: default Jun 17 15:32:49.363019 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Domain-Name: Default Jun 17 15:32:49.363019 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Id: 4e3e797edb9a453d9142c3196a4f21bb Jun 17 15:32:49.363019 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Name: tempest-TestVolumeBootPattern-1895714660-project Jun 17 15:32:49.363019 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: method: > Jun 17 15:32:49.363019 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: exception: Instance 8fee7bc0-cd0e-4c25-8475-b43e79cb933a could not be found. Jun 17 15:32:49.363019 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: action_args: {'id': '8fee7bc0-cd0e-4c25-8475-b43e79cb933a'} Jun 17 15:32:49.364617 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 15:32:49.364617 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:49.364617 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 15:32:49.364617 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 15:32:49.364617 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 15:32:49.364617 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 15:32:49.364617 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 15:32:49.364617 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 15:32:49.364617 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 15:32:49.364617 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 15:32:49.364617 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fee7bc0-cd0e-4c25-8475-b43e79cb933a could not be found. Jun 17 15:32:49.364617 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:32:49.364617 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:32:49.364617 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:32:49.364617 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:49.364617 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:32:49.364617 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:32:49.364617 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 15:32:49.364617 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 15:32:49.364617 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 15:32:49.367284 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 15:32:49.367284 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 15:32:49.367284 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 15:32:49.367284 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 15:32:49.367284 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 15:32:49.367284 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 15:32:49.367284 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 15:32:49.367284 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fee7bc0-cd0e-4c25-8475-b43e79cb933a could not be found. Jun 17 15:32:49.367284 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:32:49.367284 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:32:49.367284 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:32:49.367284 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:49.367284 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:32:49.367284 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:32:49.367284 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 15:32:49.367284 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 15:32:49.367284 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fee7bc0-cd0e-4c25-8475-b43e79cb933a could not be found. Jun 17 15:32:49.367284 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:32:49.369726 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-58afe5c4-f325-41fa-9391-2af304c5f3ad tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Returning 404 to user: Instance 8fee7bc0-cd0e-4c25-8475-b43e79cb933a could not be found. {{(pid=117650) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 15:32:49.369726 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-58afe5c4-f325-41fa-9391-2af304c5f3ad tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 404 len: 111 microversion: 2.1 time: 0.048000 Jun 17 15:32:49.369726 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1018/1623] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:32:49 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 15:32:49.372643 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-3e06d04f-63f1-444b-a7cb-9cc3d31c1d9a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:32:49.373804 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-3e06d04f-63f1-444b-a7cb-9cc3d31c1d9a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:32:49.382379 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3e06d04f-63f1-444b-a7cb-9cc3d31c1d9a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:49.382840 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3e06d04f-63f1-444b-a7cb-9cc3d31c1d9a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:49.383641 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3e06d04f-63f1-444b-a7cb-9cc3d31c1d9a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:49.384085 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3e06d04f-63f1-444b-a7cb-9cc3d31c1d9a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:49.397892 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.wsgi [None req-c4279dd3-32a0-4ca2-82e9-3bf40fe394db tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b54ec7ae-d447-4834-ac8a-6ca2f4b03c09) Jun 17 15:32:49.401253 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-c4279dd3-32a0-4ca2-82e9-3bf40fe394db tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Request method failure captured: Jun 17 15:32:49.401253 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: request: DELETE /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924/os-volume_attachments/4e6d668f-6234-4ba9-913a-11f57866e984 HTTP/1.1 Jun 17 15:32:49.401253 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Accept: application/json Jun 17 15:32:49.401253 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Accept-Encoding: identity Jun 17 15:32:49.401253 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Connection: close Jun 17 15:32:49.401253 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Content-Length: 0 Jun 17 15:32:49.401253 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Content-Type: application/json Jun 17 15:32:49.401253 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Host: 10.222.0.48 Jun 17 15:32:49.401253 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Openstack-System-Scope: None Jun 17 15:32:49.401253 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: User-Agent: python-urllib3/1.26.9 Jun 17 15:32:49.401253 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Auth-Token: gAAAAABirJpPRELvo50oKxdbD2bQ6GGouzj8i1DebBt1zfB7fX0V-PDU7hlPCfVEJbYQ9PsMuU2ZA4JvqklZ9Y9hD2QbIWtBnNkd8fMsMcOzOLJcX5MT958XBAGaNkW3F9LEBjk4LnqtyEbVGNYjmbh2tqH5UI9WDRv0xJagRknfyHTSn0wpzG0 Jun 17 15:32:49.401253 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Domain-Id: None Jun 17 15:32:49.401253 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Domain-Name: None Jun 17 15:32:49.401253 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Identity-Status: Confirmed Jun 17 15:32:49.401253 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Is-Admin-Project: True Jun 17 15:32:49.401253 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Domain-Id: default Jun 17 15:32:49.401253 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Domain-Name: Default Jun 17 15:32:49.401253 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Id: 42b42320bc424a19b4ac5e35dae7afb3 Jun 17 15:32:49.401253 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1590813198 Jun 17 15:32:49.401253 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Role: reader,member Jun 17 15:32:49.401253 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Roles: reader,member Jun 17 15:32:49.404496 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_42b42320bc424a19b4ac5e35dae7afb3", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/42b42320bc424a19b4ac5e35dae7afb3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/42b42320bc424a19b4ac5e35dae7afb3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/42b42320bc424a19b4ac5e35dae7afb3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Jun 17 15:32:49.404496 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant: tempest-VolumesSnapshotTestJSON-1590813198 Jun 17 15:32:49.404496 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant-Id: 42b42320bc424a19b4ac5e35dae7afb3 Jun 17 15:32:49.404496 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1590813198 Jun 17 15:32:49.404496 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User: tempest-VolumesSnapshotTestJSON-1590813198-project Jun 17 15:32:49.404496 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Domain-Id: default Jun 17 15:32:49.404496 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Domain-Name: Default Jun 17 15:32:49.404496 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Id: b6ac8cbc7c6d4cce9d2b0a1289846a3d Jun 17 15:32:49.404496 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Name: tempest-VolumesSnapshotTestJSON-1590813198-project Jun 17 15:32:49.404496 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: method: > Jun 17 15:32:49.406884 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b54ec7ae-d447-4834-ac8a-6ca2f4b03c09) Jun 17 15:32:49.406884 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: action_args: {'server_id': '808f28e6-03bc-4b67-ab1f-f1ef13838924', 'id': '4e6d668f-6234-4ba9-913a-11f57866e984'} Jun 17 15:32:49.406884 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 15:32:49.406884 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:49.406884 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 15:32:49.406884 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 15:32:49.406884 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 15:32:49.406884 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 15:32:49.406884 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 15:32:49.406884 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 15:32:49.406884 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 15:32:49.406884 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 15:32:49.406884 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 15:32:49.406884 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 15:32:49.406884 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 15:32:49.406884 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 15:32:49.406884 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 15:32:49.409026 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 15:32:49.409026 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 15:32:49.409026 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 15:32:49.409026 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b54ec7ae-d447-4834-ac8a-6ca2f4b03c09) Jun 17 15:32:49.409026 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:32:49.409026 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:32:49.409026 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:32:49.409026 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:49.409026 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 17 15:32:49.409026 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 17 15:32:49.409026 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 17 15:32:49.409026 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 17 15:32:49.409026 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 15:32:49.409026 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 15:32:49.409026 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 15:32:49.409026 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 15:32:49.409026 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 15:32:49.409026 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 15:32:49.409026 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 15:32:49.411576 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 15:32:49.411576 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 15:32:49.411576 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 15:32:49.411576 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 15:32:49.411576 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 15:32:49.411576 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 15:32:49.411576 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 15:32:49.411576 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 15:32:49.411576 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 15:32:49.411576 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 15:32:49.411576 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 15:32:49.411576 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b54ec7ae-d447-4834-ac8a-6ca2f4b03c09) Jun 17 15:32:49.411576 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:32:49.411576 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:32:49.411576 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:32:49.411576 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:49.411576 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 17 15:32:49.413925 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 17 15:32:49.413925 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 17 15:32:49.413925 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 15:32:49.413925 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 17 15:32:49.413925 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 17 15:32:49.413925 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 17 15:32:49.413925 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 17 15:32:49.413925 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 17 15:32:49.413925 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 15:32:49.413925 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 17 15:32:49.413925 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 17 15:32:49.413925 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b54ec7ae-d447-4834-ac8a-6ca2f4b03c09) Jun 17 15:32:49.413925 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:32:49.413925 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:32:49.413925 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:32:49.413925 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:49.413925 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:32:49.413925 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:32:49.417454 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 15:32:49.417454 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 15:32:49.417454 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 15:32:49.417454 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 15:32:49.417454 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 17 15:32:49.417454 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 17 15:32:49.417454 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b54ec7ae-d447-4834-ac8a-6ca2f4b03c09) Jun 17 15:32:49.417454 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:32:49.417454 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:32:49.417454 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:32:49.417454 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:49.417454 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:32:49.417454 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:32:49.417454 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 15:32:49.417454 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 15:32:49.417454 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b54ec7ae-d447-4834-ac8a-6ca2f4b03c09) Jun 17 15:32:49.417454 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:32:49.421600 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-c4279dd3-32a0-4ca2-82e9-3bf40fe394db tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b54ec7ae-d447-4834-ac8a-6ca2f4b03c09) {{(pid=117649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 15:32:49.421600 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-c4279dd3-32a0-4ca2-82e9-3bf40fe394db tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "DELETE /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924/os-volume_attachments/4e6d668f-6234-4ba9-913a-11f57866e984" status: 400 len: 269 microversion: 2.1 time: 0.214230 Jun 17 15:32:49.421600 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 606/1624] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Jun 17 15:32:49 2022] DELETE /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924/os-volume_attachments/4e6d668f-6234-4ba9-913a-11f57866e984 => generated 269 bytes in 217 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 17 15:32:49.421600 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-fa40fde5-0e5a-4a46-9c17-43c3d02f8e11 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:32:49.422994 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-fa40fde5-0e5a-4a46-9c17-43c3d02f8e11 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:32:49.428487 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fa40fde5-0e5a-4a46-9c17-43c3d02f8e11 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:49.428487 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fa40fde5-0e5a-4a46-9c17-43c3d02f8e11 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:49.428487 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fa40fde5-0e5a-4a46-9c17-43c3d02f8e11 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:49.428487 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fa40fde5-0e5a-4a46-9c17-43c3d02f8e11 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:49.431240 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-3e06d04f-63f1-444b-a7cb-9cc3d31c1d9a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065045 Jun 17 15:32:49.431942 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1019/1625] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:32:49 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:32:49.437587 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-34489973-af8a-41bf-b0c2-d8ec623239cb tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:32:49.438361 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-34489973-af8a-41bf-b0c2-d8ec623239cb tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:32:49.445741 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-34489973-af8a-41bf-b0c2-d8ec623239cb tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:49.446200 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-34489973-af8a-41bf-b0c2-d8ec623239cb tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:49.447002 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-34489973-af8a-41bf-b0c2-d8ec623239cb tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:49.447441 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-34489973-af8a-41bf-b0c2-d8ec623239cb tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:49.467614 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-fa40fde5-0e5a-4a46-9c17-43c3d02f8e11 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060501 Jun 17 15:32:49.468318 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 607/1626] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:32:49 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:32:49.477067 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-7ca5a1cb-3c62-4e67-bbf1-bedc75f0593c tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:32:49.477847 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-7ca5a1cb-3c62-4e67-bbf1-bedc75f0593c tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:32:49.488007 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7ca5a1cb-3c62-4e67-bbf1-bedc75f0593c tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:49.488799 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7ca5a1cb-3c62-4e67-bbf1-bedc75f0593c tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:49.490092 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7ca5a1cb-3c62-4e67-bbf1-bedc75f0593c tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:49.490939 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7ca5a1cb-3c62-4e67-bbf1-bedc75f0593c tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:49.615019 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.objects.instance [None req-7ca5a1cb-3c62-4e67-bbf1-bedc75f0593c tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lazy-loading 'services' on Instance uuid 808f28e6-03bc-4b67-ab1f-f1ef13838924 {{(pid=117649) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 15:32:49.634461 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-34489973-af8a-41bf-b0c2-d8ec623239cb tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:32:49.646617 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-34489973-af8a-41bf-b0c2-d8ec623239cb tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1563 microversion: 2.1 time: 0.211121 Jun 17 15:32:49.646617 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1020/1627] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:32:49 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1563 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:32:49.654538 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-dbaacbf1-0d55-47fd-89f8-7499c6fc0e46 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:32:49.656184 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-dbaacbf1-0d55-47fd-89f8-7499c6fc0e46 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:32:49.666531 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-dbaacbf1-0d55-47fd-89f8-7499c6fc0e46 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:49.667068 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-dbaacbf1-0d55-47fd-89f8-7499c6fc0e46 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:49.668114 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-dbaacbf1-0d55-47fd-89f8-7499c6fc0e46 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:49.668753 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-dbaacbf1-0d55-47fd-89f8-7499c6fc0e46 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:49.689685 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.wsgi [None req-dbaacbf1-0d55-47fd-89f8-7499c6fc0e46 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] HTTP exception thrown: Instance 8fee7bc0-cd0e-4c25-8475-b43e79cb933a could not be found. Jun 17 15:32:49.692640 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-dbaacbf1-0d55-47fd-89f8-7499c6fc0e46 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Request method failure captured: Jun 17 15:32:49.692640 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: request: GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a HTTP/1.1 Jun 17 15:32:49.692640 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Accept: application/json Jun 17 15:32:49.692640 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Accept-Encoding: identity Jun 17 15:32:49.692640 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Connection: close Jun 17 15:32:49.692640 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Content-Length: 0 Jun 17 15:32:49.692640 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Content-Type: application/json Jun 17 15:32:49.692640 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Host: 10.222.0.48 Jun 17 15:32:49.692640 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Openstack-System-Scope: None Jun 17 15:32:49.692640 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: User-Agent: python-urllib3/1.26.9 Jun 17 15:32:49.692640 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Auth-Token: gAAAAABirJodidJx0AY_qcwoEwWEszpikfHtXmarSN0h6rNL3nP0iBWXeXbu1IBvVskBSxMS5UAzkWIcgkCzT0_jtZtoDW3a4yLFd9G-iV8iuD24PAIeHzq28KHUo0wHpTFHnG1joRgrCGGOeiOwT6JyvzMgTpEgSjE1WKGTngEoPIRC3Gt4VEE Jun 17 15:32:49.692640 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Domain-Id: None Jun 17 15:32:49.692640 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Domain-Name: None Jun 17 15:32:49.692640 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Identity-Status: Confirmed Jun 17 15:32:49.692640 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Is-Admin-Project: True Jun 17 15:32:49.692640 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Domain-Id: default Jun 17 15:32:49.692640 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Domain-Name: Default Jun 17 15:32:49.692640 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Id: 6298c1910e1a488983d5399d7952a5cf Jun 17 15:32:49.692640 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Name: tempest-TestVolumeBootPattern-1895714660 Jun 17 15:32:49.692640 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Role: reader,member Jun 17 15:32:49.692640 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Roles: reader,member Jun 17 15:32:49.695057 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6298c1910e1a488983d5399d7952a5cf", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6298c1910e1a488983d5399d7952a5cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6298c1910e1a488983d5399d7952a5cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6298c1910e1a488983d5399d7952a5cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Jun 17 15:32:49.695057 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant: tempest-TestVolumeBootPattern-1895714660 Jun 17 15:32:49.695057 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant-Id: 6298c1910e1a488983d5399d7952a5cf Jun 17 15:32:49.695057 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant-Name: tempest-TestVolumeBootPattern-1895714660 Jun 17 15:32:49.695057 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User: tempest-TestVolumeBootPattern-1895714660-project Jun 17 15:32:49.695057 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Domain-Id: default Jun 17 15:32:49.695057 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Domain-Name: Default Jun 17 15:32:49.695057 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Id: 4e3e797edb9a453d9142c3196a4f21bb Jun 17 15:32:49.695057 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Name: tempest-TestVolumeBootPattern-1895714660-project Jun 17 15:32:49.695057 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: method: > Jun 17 15:32:49.695057 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: exception: Instance 8fee7bc0-cd0e-4c25-8475-b43e79cb933a could not be found. Jun 17 15:32:49.695057 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: action_args: {'id': '8fee7bc0-cd0e-4c25-8475-b43e79cb933a'} Jun 17 15:32:49.696469 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 15:32:49.696469 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:49.696469 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 15:32:49.696469 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 15:32:49.696469 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 15:32:49.696469 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 15:32:49.696469 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 15:32:49.696469 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 15:32:49.696469 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 15:32:49.696469 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 15:32:49.696469 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fee7bc0-cd0e-4c25-8475-b43e79cb933a could not be found. Jun 17 15:32:49.696469 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:32:49.696469 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:32:49.696469 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:32:49.696469 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:49.696469 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:32:49.696469 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:32:49.696469 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 15:32:49.696469 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 15:32:49.696469 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 15:32:49.698965 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 15:32:49.698965 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 15:32:49.698965 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 15:32:49.698965 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 15:32:49.698965 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 15:32:49.698965 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 15:32:49.698965 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 15:32:49.698965 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fee7bc0-cd0e-4c25-8475-b43e79cb933a could not be found. Jun 17 15:32:49.698965 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:32:49.698965 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:32:49.698965 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:32:49.698965 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:49.698965 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:32:49.698965 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:32:49.698965 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 15:32:49.698965 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 15:32:49.698965 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fee7bc0-cd0e-4c25-8475-b43e79cb933a could not be found. Jun 17 15:32:49.698965 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:32:49.701230 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-dbaacbf1-0d55-47fd-89f8-7499c6fc0e46 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Returning 404 to user: Instance 8fee7bc0-cd0e-4c25-8475-b43e79cb933a could not be found. {{(pid=117650) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 15:32:49.701230 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-dbaacbf1-0d55-47fd-89f8-7499c6fc0e46 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 404 len: 111 microversion: 2.1 time: 0.048335 Jun 17 15:32:49.701230 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1021/1628] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:32:49 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 15:32:49.705019 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-ea20a991-4e61-490b-a200-ef2f4b9fbcf6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:32:49.705549 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.wsgi [None req-7ca5a1cb-3c62-4e67-bbf1-bedc75f0593c tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f9b72c6d-72f3-421e-90b6-ac849e4f6d75) Jun 17 15:32:49.706723 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-ea20a991-4e61-490b-a200-ef2f4b9fbcf6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:32:49.710285 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-7ca5a1cb-3c62-4e67-bbf1-bedc75f0593c tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Request method failure captured: Jun 17 15:32:49.710285 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: request: DELETE /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924/os-volume_attachments/4e6d668f-6234-4ba9-913a-11f57866e984 HTTP/1.1 Jun 17 15:32:49.710285 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Accept: application/json Jun 17 15:32:49.710285 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Accept-Encoding: identity Jun 17 15:32:49.710285 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Connection: close Jun 17 15:32:49.710285 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Content-Length: 0 Jun 17 15:32:49.710285 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Content-Type: application/json Jun 17 15:32:49.710285 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Host: 10.222.0.48 Jun 17 15:32:49.710285 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Openstack-System-Scope: None Jun 17 15:32:49.710285 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: User-Agent: python-urllib3/1.26.9 Jun 17 15:32:49.710285 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Auth-Token: gAAAAABirJpPRELvo50oKxdbD2bQ6GGouzj8i1DebBt1zfB7fX0V-PDU7hlPCfVEJbYQ9PsMuU2ZA4JvqklZ9Y9hD2QbIWtBnNkd8fMsMcOzOLJcX5MT958XBAGaNkW3F9LEBjk4LnqtyEbVGNYjmbh2tqH5UI9WDRv0xJagRknfyHTSn0wpzG0 Jun 17 15:32:49.710285 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Domain-Id: None Jun 17 15:32:49.710285 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Domain-Name: None Jun 17 15:32:49.710285 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Identity-Status: Confirmed Jun 17 15:32:49.710285 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Is-Admin-Project: True Jun 17 15:32:49.710285 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Domain-Id: default Jun 17 15:32:49.710285 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Domain-Name: Default Jun 17 15:32:49.710285 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Id: 42b42320bc424a19b4ac5e35dae7afb3 Jun 17 15:32:49.710285 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1590813198 Jun 17 15:32:49.710285 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Role: reader,member Jun 17 15:32:49.710285 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Roles: reader,member Jun 17 15:32:49.713042 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_42b42320bc424a19b4ac5e35dae7afb3", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/42b42320bc424a19b4ac5e35dae7afb3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/42b42320bc424a19b4ac5e35dae7afb3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/42b42320bc424a19b4ac5e35dae7afb3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Jun 17 15:32:49.713042 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant: tempest-VolumesSnapshotTestJSON-1590813198 Jun 17 15:32:49.713042 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant-Id: 42b42320bc424a19b4ac5e35dae7afb3 Jun 17 15:32:49.713042 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1590813198 Jun 17 15:32:49.713042 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User: tempest-VolumesSnapshotTestJSON-1590813198-project Jun 17 15:32:49.713042 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Domain-Id: default Jun 17 15:32:49.713042 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Domain-Name: Default Jun 17 15:32:49.713042 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Id: b6ac8cbc7c6d4cce9d2b0a1289846a3d Jun 17 15:32:49.713042 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Name: tempest-VolumesSnapshotTestJSON-1590813198-project Jun 17 15:32:49.713042 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: method: > Jun 17 15:32:49.714388 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f9b72c6d-72f3-421e-90b6-ac849e4f6d75) Jun 17 15:32:49.714388 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: action_args: {'server_id': '808f28e6-03bc-4b67-ab1f-f1ef13838924', 'id': '4e6d668f-6234-4ba9-913a-11f57866e984'} Jun 17 15:32:49.714388 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 15:32:49.714388 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:49.714388 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 15:32:49.714388 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 15:32:49.714388 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 15:32:49.714388 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 15:32:49.714388 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 15:32:49.714388 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 15:32:49.714388 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 15:32:49.714388 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 15:32:49.714388 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 15:32:49.714388 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 15:32:49.714388 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 15:32:49.714388 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 15:32:49.714388 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 15:32:49.717470 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 15:32:49.717470 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 15:32:49.717470 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 15:32:49.717470 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f9b72c6d-72f3-421e-90b6-ac849e4f6d75) Jun 17 15:32:49.717470 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:32:49.717470 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:32:49.717470 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:32:49.717470 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:49.717470 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 17 15:32:49.717470 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 17 15:32:49.717470 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 17 15:32:49.717470 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 17 15:32:49.717470 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 15:32:49.717470 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 15:32:49.717470 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 15:32:49.717470 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 15:32:49.717470 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 15:32:49.717470 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 15:32:49.717470 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 15:32:49.725172 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 15:32:49.725172 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 15:32:49.725172 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 15:32:49.725172 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 15:32:49.725172 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 15:32:49.725172 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 15:32:49.725172 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 15:32:49.725172 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 15:32:49.725172 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 15:32:49.725172 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 15:32:49.725172 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 15:32:49.725172 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f9b72c6d-72f3-421e-90b6-ac849e4f6d75) Jun 17 15:32:49.725172 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:32:49.725172 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:32:49.725172 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:32:49.725172 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:49.725172 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 17 15:32:49.727322 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 17 15:32:49.727322 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 17 15:32:49.727322 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 15:32:49.727322 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 17 15:32:49.727322 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 17 15:32:49.727322 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 17 15:32:49.727322 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 17 15:32:49.727322 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 17 15:32:49.727322 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 15:32:49.727322 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 17 15:32:49.727322 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 17 15:32:49.727322 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f9b72c6d-72f3-421e-90b6-ac849e4f6d75) Jun 17 15:32:49.727322 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:32:49.727322 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:32:49.727322 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:32:49.727322 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:49.727322 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:32:49.727322 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:32:49.730477 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 15:32:49.730477 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 15:32:49.730477 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 15:32:49.730477 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 15:32:49.730477 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 17 15:32:49.730477 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 17 15:32:49.730477 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f9b72c6d-72f3-421e-90b6-ac849e4f6d75) Jun 17 15:32:49.730477 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:32:49.730477 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:32:49.730477 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:32:49.730477 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:49.730477 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:32:49.730477 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:32:49.730477 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 15:32:49.730477 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 15:32:49.730477 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f9b72c6d-72f3-421e-90b6-ac849e4f6d75) Jun 17 15:32:49.730477 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:32:49.734031 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-7ca5a1cb-3c62-4e67-bbf1-bedc75f0593c tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f9b72c6d-72f3-421e-90b6-ac849e4f6d75) {{(pid=117649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 15:32:49.734031 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-7ca5a1cb-3c62-4e67-bbf1-bedc75f0593c tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "DELETE /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924/os-volume_attachments/4e6d668f-6234-4ba9-913a-11f57866e984" status: 400 len: 269 microversion: 2.1 time: 0.243165 Jun 17 15:32:49.734031 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 608/1629] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Jun 17 15:32:49 2022] DELETE /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924/os-volume_attachments/4e6d668f-6234-4ba9-913a-11f57866e984 => generated 269 bytes in 250 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 17 15:32:49.734941 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ea20a991-4e61-490b-a200-ef2f4b9fbcf6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:49.737795 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ea20a991-4e61-490b-a200-ef2f4b9fbcf6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:49.737795 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ea20a991-4e61-490b-a200-ef2f4b9fbcf6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:49.737795 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ea20a991-4e61-490b-a200-ef2f4b9fbcf6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:49.783459 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-ea20a991-4e61-490b-a200-ef2f4b9fbcf6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085407 Jun 17 15:32:49.792912 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1022/1630] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:32:49 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:32:49.811856 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-dc63a29a-9eb7-4736-a76f-d6c09ad4a7d9 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-967677078", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-417419175", "security_groups": [{"name": "tempest-secgroup-smoke-43842466"}], "block_device_mapping_v2": [{"uuid": "d219a8a3-6869-4be6-905b-7575088d2909", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "30077c53-15dd-418f-9772-b61a459cd5ce"}]}} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:32:50.066004 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.network.neutron [None req-dc63a29a-9eb7-4736-a76f-d6c09ad4a7d9 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] validate_networks() for [('30077c53-15dd-418f-9772-b61a459cd5ce', None, None, None, None, None)] {{(pid=117649) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 15:32:50.486443 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-bb8ddb7e-cd7f-41cb-b8d5-68ab61d87d90 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:32:50.488297 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-bb8ddb7e-cd7f-41cb-b8d5-68ab61d87d90 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:32:50.500285 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bb8ddb7e-cd7f-41cb-b8d5-68ab61d87d90 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:50.501154 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bb8ddb7e-cd7f-41cb-b8d5-68ab61d87d90 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:50.502589 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bb8ddb7e-cd7f-41cb-b8d5-68ab61d87d90 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:50.503403 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bb8ddb7e-cd7f-41cb-b8d5-68ab61d87d90 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:50.557628 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-bb8ddb7e-cd7f-41cb-b8d5-68ab61d87d90 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079380 Jun 17 15:32:50.559076 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1023/1631] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:32:50 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:32:50.799835 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-84d070a0-36b9-414a-88f2-33ff694bd81f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:32:50.800709 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-84d070a0-36b9-414a-88f2-33ff694bd81f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:32:50.807466 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-84d070a0-36b9-414a-88f2-33ff694bd81f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:50.807913 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-84d070a0-36b9-414a-88f2-33ff694bd81f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:50.808944 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-84d070a0-36b9-414a-88f2-33ff694bd81f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:50.809564 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-84d070a0-36b9-414a-88f2-33ff694bd81f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:50.920264 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-dc63a29a-9eb7-4736-a76f-d6c09ad4a7d9 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Flavor limits 0:0:0 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 15:32:50.921083 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-dc63a29a-9eb7-4736-a76f-d6c09ad4a7d9 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Image limits 0:0:0 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 15:32:50.921300 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-dc63a29a-9eb7-4736-a76f-d6c09ad4a7d9 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Flavor pref 0:0:0 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 15:32:50.921597 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-dc63a29a-9eb7-4736-a76f-d6c09ad4a7d9 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Image pref 0:0:0 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 15:32:50.922011 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-dc63a29a-9eb7-4736-a76f-d6c09ad4a7d9 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 15:32:50.938575 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-dc63a29a-9eb7-4736-a76f-d6c09ad4a7d9 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:50.939148 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-84d070a0-36b9-414a-88f2-33ff694bd81f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "POST /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/action" status: 200 len: 82595 microversion: 2.1 time: 0.142840 Jun 17 15:32:50.940656 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1024/1632] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jun 17 15:32:50 2022] POST /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/action => generated 82595 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 15:32:50.943134 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-dc63a29a-9eb7-4736-a76f-d6c09ad4a7d9 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:50.944618 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-dc63a29a-9eb7-4736-a76f-d6c09ad4a7d9 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:50.946307 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-dc63a29a-9eb7-4736-a76f-d6c09ad4a7d9 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:50.971211 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-bc6d0bb6-c15b-406b-803e-82fdb71a7963 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:32:50.972836 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-bc6d0bb6-c15b-406b-803e-82fdb71a7963 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:32:50.983613 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.quota [None req-dc63a29a-9eb7-4736-a76f-d6c09ad4a7d9 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Getting quotas for project 6298c1910e1a488983d5399d7952a5cf. Resources: {'cores', 'ram', 'instances'} {{(pid=117649) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 15:32:50.987413 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bc6d0bb6-c15b-406b-803e-82fdb71a7963 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:50.988530 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bc6d0bb6-c15b-406b-803e-82fdb71a7963 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:50.989887 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bc6d0bb6-c15b-406b-803e-82fdb71a7963 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:50.991549 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bc6d0bb6-c15b-406b-803e-82fdb71a7963 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:50.992534 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.quota [None req-dc63a29a-9eb7-4736-a76f-d6c09ad4a7d9 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Getting quotas for user 4e3e797edb9a453d9142c3196a4f21bb and project 6298c1910e1a488983d5399d7952a5cf. Resources: {'cores', 'ram', 'instances'} {{(pid=117649) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 15:32:51.084087 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-dc63a29a-9eb7-4736-a76f-d6c09ad4a7d9 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Going to run 1 instances... {{(pid=117649) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 15:32:51.086539 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-dc63a29a-9eb7-4736-a76f-d6c09ad4a7d9 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: beaecaf4-7789-4dbe-9fd6-f58dbd95daf6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d219a8a3-6869-4be6-905b-7575088d2909',volume_size=None,volume_type=None)] {{(pid=117649) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 15:32:51.228934 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.objects.instance [None req-bc6d0bb6-c15b-406b-803e-82fdb71a7963 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lazy-loading 'services' on Instance uuid 91408900-da01-4985-b392-111577935284 {{(pid=117650) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 15:32:51.288201 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.wsgi [None req-dc63a29a-9eb7-4736-a76f-d6c09ad4a7d9 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Volume d219a8a3-6869-4be6-905b-7575088d2909 status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-154acdb9-31c8-494d-95c2-f730fee481f5) Jun 17 15:32:51.291775 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-dc63a29a-9eb7-4736-a76f-d6c09ad4a7d9 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Request method failure captured: Jun 17 15:32:51.291775 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 17 15:32:51.291775 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Accept: application/json Jun 17 15:32:51.291775 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Accept-Encoding: identity Jun 17 15:32:51.291775 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Connection: close Jun 17 15:32:51.291775 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Content-Length: 474 Jun 17 15:32:51.291775 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Content-Type: application/json Jun 17 15:32:51.291775 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Host: 10.222.0.48 Jun 17 15:32:51.291775 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Openstack-System-Scope: None Jun 17 15:32:51.291775 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: User-Agent: python-urllib3/1.26.9 Jun 17 15:32:51.291775 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Auth-Token: gAAAAABirJodidJx0AY_qcwoEwWEszpikfHtXmarSN0h6rNL3nP0iBWXeXbu1IBvVskBSxMS5UAzkWIcgkCzT0_jtZtoDW3a4yLFd9G-iV8iuD24PAIeHzq28KHUo0wHpTFHnG1joRgrCGGOeiOwT6JyvzMgTpEgSjE1WKGTngEoPIRC3Gt4VEE Jun 17 15:32:51.291775 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Domain-Id: None Jun 17 15:32:51.291775 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Domain-Name: None Jun 17 15:32:51.291775 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Identity-Status: Confirmed Jun 17 15:32:51.291775 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Is-Admin-Project: True Jun 17 15:32:51.291775 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Domain-Id: default Jun 17 15:32:51.291775 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Domain-Name: Default Jun 17 15:32:51.291775 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Id: 6298c1910e1a488983d5399d7952a5cf Jun 17 15:32:51.291775 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Name: tempest-TestVolumeBootPattern-1895714660 Jun 17 15:32:51.291775 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Role: reader,member Jun 17 15:32:51.291775 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Roles: reader,member Jun 17 15:32:51.294775 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6298c1910e1a488983d5399d7952a5cf", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6298c1910e1a488983d5399d7952a5cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6298c1910e1a488983d5399d7952a5cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6298c1910e1a488983d5399d7952a5cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Jun 17 15:32:51.294775 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant: tempest-TestVolumeBootPattern-1895714660 Jun 17 15:32:51.294775 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant-Id: 6298c1910e1a488983d5399d7952a5cf Jun 17 15:32:51.294775 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant-Name: tempest-TestVolumeBootPattern-1895714660 Jun 17 15:32:51.294775 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User: tempest-TestVolumeBootPattern-1895714660-project Jun 17 15:32:51.294775 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Domain-Id: default Jun 17 15:32:51.294775 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Domain-Name: Default Jun 17 15:32:51.294775 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Id: 4e3e797edb9a453d9142c3196a4f21bb Jun 17 15:32:51.294775 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Name: tempest-TestVolumeBootPattern-1895714660-project Jun 17 15:32:51.294775 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Jun 17 15:32:51.297333 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: {"server": {"name": "tempest-TestVolumeBootPattern-server-967677078", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-417419175", "security_groups": [{"name": "tempest-secgroup-smoke-43842466"}], "block_device_mapping_v2": [{"uuid": "d219a8a3-6869-4be6-905b-7575088d2909", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "30077c53-15dd-418f-9772-b61a459cd5ce"}]}} Jun 17 15:32:51.297333 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: method: > Jun 17 15:32:51.297333 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: exception: Invalid volume: Invalid input received: Invalid volume: Volume d219a8a3-6869-4be6-905b-7575088d2909 status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-154acdb9-31c8-494d-95c2-f730fee481f5) Jun 17 15:32:51.297333 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: action_args: {'body': {'server': {'name': 'tempest-TestVolumeBootPattern-server-967677078', 'imageRef': '', 'flavorRef': '452', 'key_name': 'tempest-TestVolumeBootPattern-417419175', 'security_groups': [{'name': 'tempest-secgroup-smoke-43842466'}], 'block_device_mapping_v2': [{'source_type': 'volume', 'destination_type': 'volume', 'boot_index': 0, 'delete_on_termination': False, 'volume_id': 'd219a8a3-6869-4be6-905b-7575088d2909'}], 'networks': [{'uuid': '30077c53-15dd-418f-9772-b61a459cd5ce'}]}}} Jun 17 15:32:51.297333 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 15:32:51.297333 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:51.297333 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 15:32:51.297333 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 15:32:51.297333 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 15:32:51.297333 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 15:32:51.299224 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 808, in attachment_create Jun 17 15:32:51.299224 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi LOG.error('Create attachment failed for volume ' Jun 17 15:32:51.299224 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 17 15:32:51.299224 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 17 15:32:51.299224 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 17 15:32:51.299224 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise self.value Jun 17 15:32:51.299224 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 800, in attachment_create Jun 17 15:32:51.299224 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi attachment_ref = cinderclient(context, '3.44').attachments.create( Jun 17 15:32:51.299224 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/api_versions.py", line 421, in substitution Jun 17 15:32:51.299224 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return method.func(obj, *args, **kwargs) Jun 17 15:32:51.299224 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/attachments.py", line 39, in create Jun 17 15:32:51.299224 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi retval = self._create('/attachments', body, 'attachment') Jun 17 15:32:51.299224 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 306, in _create Jun 17 15:32:51.299224 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 15:32:51.299224 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 15:32:51.299224 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 15:32:51.299224 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 15:32:51.299224 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 15:32:51.301778 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 15:32:51.301778 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 15:32:51.301778 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Volume d219a8a3-6869-4be6-905b-7575088d2909 status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-154acdb9-31c8-494d-95c2-f730fee481f5) Jun 17 15:32:51.301778 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:32:51.301778 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:32:51.301778 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:32:51.301778 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:51.301778 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1914, in _validate_bdm Jun 17 15:32:51.301778 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi self._check_attach_and_reserve_volume( Jun 17 15:32:51.301778 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4858, in _check_attach_and_reserve_volume Jun 17 15:32:51.301778 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi attachment_id = self.volume_api.attachment_create( Jun 17 15:32:51.301778 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 17 15:32:51.301778 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 17 15:32:51.301778 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 15:32:51.301778 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 15:32:51.301778 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 15:32:51.301778 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 15:32:51.301778 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 15:32:51.304132 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 15:32:51.304132 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 808, in attachment_create Jun 17 15:32:51.304132 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi LOG.error('Create attachment failed for volume ' Jun 17 15:32:51.304132 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 17 15:32:51.304132 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 17 15:32:51.304132 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 17 15:32:51.304132 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise self.value Jun 17 15:32:51.304132 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 800, in attachment_create Jun 17 15:32:51.304132 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi attachment_ref = cinderclient(context, '3.44').attachments.create( Jun 17 15:32:51.304132 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/api_versions.py", line 421, in substitution Jun 17 15:32:51.304132 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return method.func(obj, *args, **kwargs) Jun 17 15:32:51.304132 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/attachments.py", line 39, in create Jun 17 15:32:51.304132 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi retval = self._create('/attachments', body, 'attachment') Jun 17 15:32:51.304132 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 306, in _create Jun 17 15:32:51.304132 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 15:32:51.304132 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 15:32:51.304132 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 15:32:51.304132 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 15:32:51.311103 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 15:32:51.311103 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 15:32:51.311103 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 15:32:51.311103 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Volume d219a8a3-6869-4be6-905b-7575088d2909 status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-154acdb9-31c8-494d-95c2-f730fee481f5) Jun 17 15:32:51.311103 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:32:51.311103 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:32:51.311103 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:32:51.311103 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:51.311103 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jun 17 15:32:51.311103 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jun 17 15:32:51.311103 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jun 17 15:32:51.311103 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return self._create_instance( Jun 17 15:32:51.311103 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance Jun 17 15:32:51.311103 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Jun 17 15:32:51.311103 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1536, in _provision_instances Jun 17 15:32:51.311103 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi self._cleanup_build_artifacts(None, instances_to_build) Jun 17 15:32:51.311103 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 17 15:32:51.311103 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 17 15:32:51.313438 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 17 15:32:51.313438 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise self.value Jun 17 15:32:51.313438 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1446, in _provision_instances Jun 17 15:32:51.313438 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi self._bdm_validate_set_size_and_instance(context, Jun 17 15:32:51.313438 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1809, in _bdm_validate_set_size_and_instance Jun 17 15:32:51.313438 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi self._validate_bdm( Jun 17 15:32:51.313438 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1923, in _validate_bdm Jun 17 15:32:51.313438 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 17 15:32:51.313438 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Volume d219a8a3-6869-4be6-905b-7575088d2909 status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-154acdb9-31c8-494d-95c2-f730fee481f5) Jun 17 15:32:51.313438 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:32:51.313438 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:32:51.313438 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:32:51.313438 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:51.313438 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:32:51.313438 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:32:51.313438 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 15:32:51.313438 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 15:32:51.313438 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 15:32:51.317440 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 15:32:51.317440 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 17 15:32:51.317440 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 17 15:32:51.317440 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 17 15:32:51.317440 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 17 15:32:51.317440 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 17 15:32:51.317440 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 17 15:32:51.317440 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jun 17 15:32:51.317440 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jun 17 15:32:51.317440 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jun 17 15:32:51.317440 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Volume d219a8a3-6869-4be6-905b-7575088d2909 status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-154acdb9-31c8-494d-95c2-f730fee481f5) Jun 17 15:32:51.317440 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:32:51.317440 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:32:51.317440 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:32:51.317440 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:51.317440 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:32:51.317440 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:32:51.317440 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 15:32:51.317440 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 15:32:51.319522 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Volume d219a8a3-6869-4be6-905b-7575088d2909 status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-154acdb9-31c8-494d-95c2-f730fee481f5) Jun 17 15:32:51.319522 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:32:51.319522 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-dc63a29a-9eb7-4736-a76f-d6c09ad4a7d9 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Volume d219a8a3-6869-4be6-905b-7575088d2909 status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-154acdb9-31c8-494d-95c2-f730fee481f5) {{(pid=117649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 15:32:51.319522 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-dc63a29a-9eb7-4736-a76f-d6c09ad4a7d9 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 295 microversion: 2.1 time: 1.486280 Jun 17 15:32:51.319522 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 609/1633] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Jun 17 15:32:49 2022] POST /compute/v2.1/servers => generated 295 bytes in 1488 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 17 15:32:51.321983 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-5ed9fd6e-2a87-4894-b6f1-d05db5d5a0b0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:32:51.323069 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-5ed9fd6e-2a87-4894-b6f1-d05db5d5a0b0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:32:51.353512 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.wsgi [None req-bc6d0bb6-c15b-406b-803e-82fdb71a7963 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-54169c91-f76f-4314-be3c-b9d1ee44c533) Jun 17 15:32:51.355675 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-bc6d0bb6-c15b-406b-803e-82fdb71a7963 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Request method failure captured: Jun 17 15:32:51.355675 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: request: DELETE /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments/cde658e2-871f-4bf2-8afb-0912666bb314 HTTP/1.1 Jun 17 15:32:51.355675 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Accept: application/json Jun 17 15:32:51.355675 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Accept-Encoding: identity Jun 17 15:32:51.355675 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Connection: close Jun 17 15:32:51.355675 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Content-Length: 0 Jun 17 15:32:51.355675 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Content-Type: application/json Jun 17 15:32:51.355675 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Host: 10.222.0.48 Jun 17 15:32:51.355675 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Openstack-System-Scope: None Jun 17 15:32:51.355675 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: User-Agent: python-urllib3/1.26.9 Jun 17 15:32:51.355675 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Auth-Token: gAAAAABirJnWab6RsNRLxqlnsOubM9tFHeV32yGbOaFlJe5pg8CftUO8_NhkdMNm7oPsv2910aCf6f8RpJp4wS4eX-mrfXCFOgpNaOl2FZp9WG14_B4DT2YmyYCilFeU22M81sdhbzEhRY-94CW1RMioNqxeZAYGteeO8xL9ochR3l-l4b-yPok Jun 17 15:32:51.355675 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Domain-Id: None Jun 17 15:32:51.355675 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Domain-Name: None Jun 17 15:32:51.355675 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Identity-Status: Confirmed Jun 17 15:32:51.355675 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Is-Admin-Project: True Jun 17 15:32:51.355675 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Domain-Id: default Jun 17 15:32:51.355675 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Domain-Name: Default Jun 17 15:32:51.355675 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Id: 77979ae6c7c440fab7bbce5fbe452210 Jun 17 15:32:51.355675 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Name: tempest-TestMinimumBasicScenario-188271543 Jun 17 15:32:51.355675 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Role: reader,member Jun 17 15:32:51.355675 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Roles: reader,member Jun 17 15:32:51.358954 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_77979ae6c7c440fab7bbce5fbe452210", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/77979ae6c7c440fab7bbce5fbe452210"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/77979ae6c7c440fab7bbce5fbe452210"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/77979ae6c7c440fab7bbce5fbe452210"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Jun 17 15:32:51.358954 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant: tempest-TestMinimumBasicScenario-188271543 Jun 17 15:32:51.358954 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant-Id: 77979ae6c7c440fab7bbce5fbe452210 Jun 17 15:32:51.358954 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant-Name: tempest-TestMinimumBasicScenario-188271543 Jun 17 15:32:51.358954 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User: tempest-TestMinimumBasicScenario-188271543-project Jun 17 15:32:51.358954 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Domain-Id: default Jun 17 15:32:51.358954 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Domain-Name: Default Jun 17 15:32:51.358954 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Id: 6cd3f00536bf479ab15bb968985ea32a Jun 17 15:32:51.358954 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Name: tempest-TestMinimumBasicScenario-188271543-project Jun 17 15:32:51.358954 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: method: > Jun 17 15:32:51.360402 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-54169c91-f76f-4314-be3c-b9d1ee44c533) Jun 17 15:32:51.360402 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: action_args: {'server_id': '91408900-da01-4985-b392-111577935284', 'id': 'cde658e2-871f-4bf2-8afb-0912666bb314'} Jun 17 15:32:51.360402 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 15:32:51.360402 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:51.360402 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 15:32:51.360402 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 15:32:51.360402 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 15:32:51.360402 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 15:32:51.360402 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 15:32:51.360402 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 15:32:51.360402 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 15:32:51.360402 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 15:32:51.360402 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 15:32:51.360402 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 15:32:51.360402 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 15:32:51.360402 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 15:32:51.360402 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 15:32:51.366289 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 15:32:51.366289 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 15:32:51.366289 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 15:32:51.366289 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-54169c91-f76f-4314-be3c-b9d1ee44c533) Jun 17 15:32:51.366289 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:32:51.366289 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:32:51.366289 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:32:51.366289 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:51.366289 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 17 15:32:51.366289 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 17 15:32:51.366289 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 17 15:32:51.366289 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 17 15:32:51.366289 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 15:32:51.366289 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 15:32:51.366289 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 15:32:51.366289 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 15:32:51.366289 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 15:32:51.366289 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 15:32:51.366289 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 17 15:32:51.369760 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 17 15:32:51.369760 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 17 15:32:51.369760 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 17 15:32:51.369760 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 17 15:32:51.369760 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 17 15:32:51.369760 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 17 15:32:51.369760 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 17 15:32:51.369760 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 15:32:51.369760 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 15:32:51.369760 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 15:32:51.369760 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 15:32:51.369760 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-54169c91-f76f-4314-be3c-b9d1ee44c533) Jun 17 15:32:51.369760 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:32:51.369760 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:32:51.369760 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:32:51.369760 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:51.369760 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 17 15:32:51.373066 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 17 15:32:51.373066 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 17 15:32:51.373066 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 15:32:51.373066 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 17 15:32:51.373066 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 17 15:32:51.373066 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 17 15:32:51.373066 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 17 15:32:51.373066 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 17 15:32:51.373066 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 15:32:51.373066 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 17 15:32:51.373066 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 17 15:32:51.373066 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-54169c91-f76f-4314-be3c-b9d1ee44c533) Jun 17 15:32:51.373066 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:32:51.373066 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:32:51.373066 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:32:51.373066 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:51.373066 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:32:51.373066 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:32:51.379618 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 15:32:51.379618 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 15:32:51.379618 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 15:32:51.379618 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 15:32:51.379618 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 17 15:32:51.379618 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 17 15:32:51.379618 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-54169c91-f76f-4314-be3c-b9d1ee44c533) Jun 17 15:32:51.379618 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:32:51.379618 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:32:51.379618 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:32:51.379618 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:51.379618 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:32:51.379618 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:32:51.379618 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 15:32:51.379618 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 15:32:51.379618 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-54169c91-f76f-4314-be3c-b9d1ee44c533) Jun 17 15:32:51.379618 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:32:51.384002 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-bc6d0bb6-c15b-406b-803e-82fdb71a7963 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-54169c91-f76f-4314-be3c-b9d1ee44c533) {{(pid=117650) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 15:32:51.384002 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-bc6d0bb6-c15b-406b-803e-82fdb71a7963 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "DELETE /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments/cde658e2-871f-4bf2-8afb-0912666bb314" status: 400 len: 269 microversion: 2.1 time: 0.398091 Jun 17 15:32:51.384002 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1025/1634] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Jun 17 15:32:50 2022] DELETE /compute/v2.1/servers/91408900-da01-4985-b392-111577935284/os-volume_attachments/cde658e2-871f-4bf2-8afb-0912666bb314 => generated 269 bytes in 401 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 17 15:32:51.384779 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5ed9fd6e-2a87-4894-b6f1-d05db5d5a0b0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:51.384779 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5ed9fd6e-2a87-4894-b6f1-d05db5d5a0b0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:51.384779 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5ed9fd6e-2a87-4894-b6f1-d05db5d5a0b0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:51.384779 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5ed9fd6e-2a87-4894-b6f1-d05db5d5a0b0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:51.491927 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [req-4c44617b-0f4e-4afe-9a65-71e202a43f0e req-354d9fd5-140b-44b5-a7ed-35a3417256af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b30f80f-8b8c-4c07-8653-4f9fd128ce77", "tag": "8bfd0e33-2b14-4398-b80c-8da478f93229"}]} {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:32:51.507549 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-5ed9fd6e-2a87-4894-b6f1-d05db5d5a0b0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Going to try to terminate instance {{(pid=117649) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 15:32:51.520106 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [req-4c44617b-0f4e-4afe-9a65-71e202a43f0e req-354d9fd5-140b-44b5-a7ed-35a3417256af service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:51.523406 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [req-4c44617b-0f4e-4afe-9a65-71e202a43f0e req-354d9fd5-140b-44b5-a7ed-35a3417256af service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:51.576591 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.compute.server_external_events [req-4c44617b-0f4e-4afe-9a65-71e202a43f0e req-354d9fd5-140b-44b5-a7ed-35a3417256af service nova] Creating event network-changed:8bfd0e33-2b14-4398-b80c-8da478f93229 for instance 5b30f80f-8b8c-4c07-8653-4f9fd128ce77 on hv-cinder-82549 Jun 17 15:32:51.582574 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 15:32:51.582574 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Fri Jun 17 15:32:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 (ip 10.222.0.48) !!! Jun 17 15:32:51.593476 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [req-4c44617b-0f4e-4afe-9a65-71e202a43f0e req-354d9fd5-140b-44b5-a7ed-35a3417256af service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.228922 Jun 17 15:32:51.595861 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1026/1635] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 15:32:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:32:51.608059 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-c1b68de6-7807-42e4-a681-757481323ed2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:32:51.610321 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-c1b68de6-7807-42e4-a681-757481323ed2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:32:51.623617 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c1b68de6-7807-42e4-a681-757481323ed2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:51.625283 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c1b68de6-7807-42e4-a681-757481323ed2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:51.626883 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c1b68de6-7807-42e4-a681-757481323ed2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:51.627849 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c1b68de6-7807-42e4-a681-757481323ed2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:51.705283 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-c1b68de6-7807-42e4-a681-757481323ed2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.106529 Jun 17 15:32:51.712429 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1027/1636] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:32:51 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:32:51.770008 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-5ed9fd6e-2a87-4894-b6f1-d05db5d5a0b0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "DELETE /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 204 len: 0 microversion: 2.1 time: 0.472900 Jun 17 15:32:51.788740 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-ddaacd2e-af69-401f-b976-d5c505e4988a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:32:51.788969 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 610/1637] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jun 17 15:32:51 2022] DELETE /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 15:32:51.790278 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-ddaacd2e-af69-401f-b976-d5c505e4988a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:32:51.805737 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ddaacd2e-af69-401f-b976-d5c505e4988a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:51.806955 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ddaacd2e-af69-401f-b976-d5c505e4988a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:51.808857 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ddaacd2e-af69-401f-b976-d5c505e4988a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:51.810653 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ddaacd2e-af69-401f-b976-d5c505e4988a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:52.096148 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-ddaacd2e-af69-401f-b976-d5c505e4988a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:32:52.109996 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-ddaacd2e-af69-401f-b976-d5c505e4988a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1569 microversion: 2.1 time: 0.331106 Jun 17 15:32:52.112959 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1028/1638] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:32:51 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1569 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:32:52.467801 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-47c4eca0-8fef-4599-b2c6-277e8174ce5d tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:32:52.469803 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-47c4eca0-8fef-4599-b2c6-277e8174ce5d tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:32:52.484274 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-47c4eca0-8fef-4599-b2c6-277e8174ce5d tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:52.485462 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-47c4eca0-8fef-4599-b2c6-277e8174ce5d tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:52.487767 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-47c4eca0-8fef-4599-b2c6-277e8174ce5d tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:52.488864 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-47c4eca0-8fef-4599-b2c6-277e8174ce5d tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:52.517841 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.wsgi [None req-47c4eca0-8fef-4599-b2c6-277e8174ce5d tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] HTTP exception thrown: Instance 8fee7bc0-cd0e-4c25-8475-b43e79cb933a could not be found. Jun 17 15:32:52.521778 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-47c4eca0-8fef-4599-b2c6-277e8174ce5d tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Request method failure captured: Jun 17 15:32:52.521778 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: request: DELETE /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a HTTP/1.1 Jun 17 15:32:52.521778 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Accept: application/json Jun 17 15:32:52.521778 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Accept-Encoding: identity Jun 17 15:32:52.521778 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Connection: close Jun 17 15:32:52.521778 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Content-Length: 0 Jun 17 15:32:52.521778 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Content-Type: application/json Jun 17 15:32:52.521778 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Host: 10.222.0.48 Jun 17 15:32:52.521778 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Openstack-System-Scope: None Jun 17 15:32:52.521778 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: User-Agent: python-urllib3/1.26.9 Jun 17 15:32:52.521778 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Auth-Token: gAAAAABirJodidJx0AY_qcwoEwWEszpikfHtXmarSN0h6rNL3nP0iBWXeXbu1IBvVskBSxMS5UAzkWIcgkCzT0_jtZtoDW3a4yLFd9G-iV8iuD24PAIeHzq28KHUo0wHpTFHnG1joRgrCGGOeiOwT6JyvzMgTpEgSjE1WKGTngEoPIRC3Gt4VEE Jun 17 15:32:52.521778 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Domain-Id: None Jun 17 15:32:52.521778 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Domain-Name: None Jun 17 15:32:52.521778 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Identity-Status: Confirmed Jun 17 15:32:52.521778 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Is-Admin-Project: True Jun 17 15:32:52.521778 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Domain-Id: default Jun 17 15:32:52.521778 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Domain-Name: Default Jun 17 15:32:52.521778 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Id: 6298c1910e1a488983d5399d7952a5cf Jun 17 15:32:52.521778 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Name: tempest-TestVolumeBootPattern-1895714660 Jun 17 15:32:52.521778 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Role: reader,member Jun 17 15:32:52.521778 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Roles: reader,member Jun 17 15:32:52.524737 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6298c1910e1a488983d5399d7952a5cf", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6298c1910e1a488983d5399d7952a5cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6298c1910e1a488983d5399d7952a5cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6298c1910e1a488983d5399d7952a5cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Jun 17 15:32:52.524737 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant: tempest-TestVolumeBootPattern-1895714660 Jun 17 15:32:52.524737 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant-Id: 6298c1910e1a488983d5399d7952a5cf Jun 17 15:32:52.524737 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant-Name: tempest-TestVolumeBootPattern-1895714660 Jun 17 15:32:52.524737 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User: tempest-TestVolumeBootPattern-1895714660-project Jun 17 15:32:52.524737 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Domain-Id: default Jun 17 15:32:52.524737 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Domain-Name: Default Jun 17 15:32:52.524737 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Id: 4e3e797edb9a453d9142c3196a4f21bb Jun 17 15:32:52.524737 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Name: tempest-TestVolumeBootPattern-1895714660-project Jun 17 15:32:52.524737 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: method: > Jun 17 15:32:52.524737 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: exception: Instance 8fee7bc0-cd0e-4c25-8475-b43e79cb933a could not be found. Jun 17 15:32:52.524737 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: action_args: {'id': '8fee7bc0-cd0e-4c25-8475-b43e79cb933a'} Jun 17 15:32:52.526159 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 15:32:52.526159 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:52.526159 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 15:32:52.526159 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 15:32:52.526159 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 15:32:52.526159 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 15:32:52.526159 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 15:32:52.526159 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 15:32:52.526159 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 15:32:52.526159 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 15:32:52.526159 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fee7bc0-cd0e-4c25-8475-b43e79cb933a could not be found. Jun 17 15:32:52.526159 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:32:52.526159 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:32:52.526159 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:32:52.526159 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:52.526159 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:32:52.526159 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:32:52.526159 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 15:32:52.526159 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 15:32:52.526159 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 15:32:52.529888 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 15:32:52.529888 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 17 15:32:52.529888 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 17 15:32:52.529888 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 17 15:32:52.529888 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 17 15:32:52.529888 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 15:32:52.529888 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 15:32:52.529888 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 15:32:52.529888 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 15:32:52.529888 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fee7bc0-cd0e-4c25-8475-b43e79cb933a could not be found. Jun 17 15:32:52.529888 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:32:52.529888 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:32:52.529888 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:32:52.529888 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:52.529888 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:32:52.529888 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:32:52.529888 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 15:32:52.529888 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 15:32:52.529888 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fee7bc0-cd0e-4c25-8475-b43e79cb933a could not be found. Jun 17 15:32:52.529888 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:32:52.536603 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-47c4eca0-8fef-4599-b2c6-277e8174ce5d tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Returning 404 to user: Instance 8fee7bc0-cd0e-4c25-8475-b43e79cb933a could not be found. {{(pid=117649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 15:32:52.536603 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-47c4eca0-8fef-4599-b2c6-277e8174ce5d tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "DELETE /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 404 len: 111 microversion: 2.1 time: 0.076285 Jun 17 15:32:52.537374 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 611/1639] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jun 17 15:32:52 2022] DELETE /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 15:32:52.549235 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-8dbcf2a5-1ca0-450e-bcbe-15559da31064 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:32:52.550268 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-8dbcf2a5-1ca0-450e-bcbe-15559da31064 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] [instance: 8fee7bc0-cd0e-4c25-8475-b43e79cb933a] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:32:52.564106 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8dbcf2a5-1ca0-450e-bcbe-15559da31064 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:52.565255 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8dbcf2a5-1ca0-450e-bcbe-15559da31064 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:52.567151 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8dbcf2a5-1ca0-450e-bcbe-15559da31064 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:52.568350 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8dbcf2a5-1ca0-450e-bcbe-15559da31064 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:52.591823 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.wsgi [None req-8dbcf2a5-1ca0-450e-bcbe-15559da31064 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] HTTP exception thrown: Instance 8fee7bc0-cd0e-4c25-8475-b43e79cb933a could not be found. Jun 17 15:32:52.595172 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-8dbcf2a5-1ca0-450e-bcbe-15559da31064 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Request method failure captured: Jun 17 15:32:52.595172 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: request: GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a HTTP/1.1 Jun 17 15:32:52.595172 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Accept: application/json Jun 17 15:32:52.595172 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Accept-Encoding: identity Jun 17 15:32:52.595172 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Connection: close Jun 17 15:32:52.595172 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Content-Length: 0 Jun 17 15:32:52.595172 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Content-Type: application/json Jun 17 15:32:52.595172 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Host: 10.222.0.48 Jun 17 15:32:52.595172 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Openstack-System-Scope: None Jun 17 15:32:52.595172 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: User-Agent: python-urllib3/1.26.9 Jun 17 15:32:52.595172 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Auth-Token: gAAAAABirJodidJx0AY_qcwoEwWEszpikfHtXmarSN0h6rNL3nP0iBWXeXbu1IBvVskBSxMS5UAzkWIcgkCzT0_jtZtoDW3a4yLFd9G-iV8iuD24PAIeHzq28KHUo0wHpTFHnG1joRgrCGGOeiOwT6JyvzMgTpEgSjE1WKGTngEoPIRC3Gt4VEE Jun 17 15:32:52.595172 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Domain-Id: None Jun 17 15:32:52.595172 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Domain-Name: None Jun 17 15:32:52.595172 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Identity-Status: Confirmed Jun 17 15:32:52.595172 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Is-Admin-Project: True Jun 17 15:32:52.595172 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Domain-Id: default Jun 17 15:32:52.595172 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Domain-Name: Default Jun 17 15:32:52.595172 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Id: 6298c1910e1a488983d5399d7952a5cf Jun 17 15:32:52.595172 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Name: tempest-TestVolumeBootPattern-1895714660 Jun 17 15:32:52.595172 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Role: reader,member Jun 17 15:32:52.595172 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Roles: reader,member Jun 17 15:32:52.598301 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6298c1910e1a488983d5399d7952a5cf", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6298c1910e1a488983d5399d7952a5cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6298c1910e1a488983d5399d7952a5cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6298c1910e1a488983d5399d7952a5cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Jun 17 15:32:52.598301 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant: tempest-TestVolumeBootPattern-1895714660 Jun 17 15:32:52.598301 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant-Id: 6298c1910e1a488983d5399d7952a5cf Jun 17 15:32:52.598301 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant-Name: tempest-TestVolumeBootPattern-1895714660 Jun 17 15:32:52.598301 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User: tempest-TestVolumeBootPattern-1895714660-project Jun 17 15:32:52.598301 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Domain-Id: default Jun 17 15:32:52.598301 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Domain-Name: Default Jun 17 15:32:52.598301 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Id: 4e3e797edb9a453d9142c3196a4f21bb Jun 17 15:32:52.598301 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Name: tempest-TestVolumeBootPattern-1895714660-project Jun 17 15:32:52.598301 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: method: > Jun 17 15:32:52.598301 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: exception: Instance 8fee7bc0-cd0e-4c25-8475-b43e79cb933a could not be found. Jun 17 15:32:52.598301 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: action_args: {'id': '8fee7bc0-cd0e-4c25-8475-b43e79cb933a'} Jun 17 15:32:52.599828 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 15:32:52.599828 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:52.599828 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 15:32:52.599828 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 15:32:52.599828 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 15:32:52.599828 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 15:32:52.599828 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 15:32:52.599828 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 15:32:52.599828 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 15:32:52.599828 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 15:32:52.599828 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fee7bc0-cd0e-4c25-8475-b43e79cb933a could not be found. Jun 17 15:32:52.599828 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:32:52.599828 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:32:52.599828 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:32:52.599828 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:52.599828 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:32:52.599828 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:32:52.599828 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 15:32:52.599828 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 15:32:52.599828 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 15:32:52.602461 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 15:32:52.602461 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 15:32:52.602461 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 15:32:52.602461 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 15:32:52.602461 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 15:32:52.602461 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 15:32:52.602461 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 15:32:52.602461 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fee7bc0-cd0e-4c25-8475-b43e79cb933a could not be found. Jun 17 15:32:52.602461 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:32:52.602461 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:32:52.602461 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:32:52.602461 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:32:52.602461 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:32:52.602461 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:32:52.602461 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 15:32:52.602461 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 15:32:52.602461 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fee7bc0-cd0e-4c25-8475-b43e79cb933a could not be found. Jun 17 15:32:52.602461 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:32:52.605001 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-8dbcf2a5-1ca0-450e-bcbe-15559da31064 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Returning 404 to user: Instance 8fee7bc0-cd0e-4c25-8475-b43e79cb933a could not be found. {{(pid=117650) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 15:32:52.605001 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-8dbcf2a5-1ca0-450e-bcbe-15559da31064 tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a" status: 404 len: 111 microversion: 2.1 time: 0.062027 Jun 17 15:32:52.607811 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1029/1640] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:32:52 2022] GET /compute/v2.1/servers/8fee7bc0-cd0e-4c25-8475-b43e79cb933a => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 15:32:52.728084 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-52df8bdb-de13-4fcb-b17d-1be7882ce5fe tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:32:52.732273 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-52df8bdb-de13-4fcb-b17d-1be7882ce5fe tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:32:52.746772 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-52df8bdb-de13-4fcb-b17d-1be7882ce5fe tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:52.748169 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-52df8bdb-de13-4fcb-b17d-1be7882ce5fe tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:52.751810 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-52df8bdb-de13-4fcb-b17d-1be7882ce5fe tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:52.753232 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-52df8bdb-de13-4fcb-b17d-1be7882ce5fe tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:52.821219 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-52df8bdb-de13-4fcb-b17d-1be7882ce5fe tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.104069 Jun 17 15:32:52.822839 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 612/1641] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:32:52 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:32:53.131502 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-2aa61759-8e6e-4e63-9c95-13c4fdb69fa2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:32:53.132162 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-2aa61759-8e6e-4e63-9c95-13c4fdb69fa2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:32:53.147803 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2aa61759-8e6e-4e63-9c95-13c4fdb69fa2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:53.148185 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2aa61759-8e6e-4e63-9c95-13c4fdb69fa2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:53.149452 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2aa61759-8e6e-4e63-9c95-13c4fdb69fa2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:53.152521 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2aa61759-8e6e-4e63-9c95-13c4fdb69fa2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:53.191784 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [req-e83effa1-4482-483c-b557-91d32ffc6087 req-f0b7b0f9-edcd-4337-9078-0a9656ff6f3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b30f80f-8b8c-4c07-8653-4f9fd128ce77", "name": "network-vif-deleted", "tag": "8bfd0e33-2b14-4398-b80c-8da478f93229"}]} {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:32:53.204194 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [req-e83effa1-4482-483c-b557-91d32ffc6087 req-f0b7b0f9-edcd-4337-9078-0a9656ff6f3f service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:53.205149 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [req-e83effa1-4482-483c-b557-91d32ffc6087 req-f0b7b0f9-edcd-4337-9078-0a9656ff6f3f service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:53.232400 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.compute.server_external_events [req-e83effa1-4482-483c-b557-91d32ffc6087 req-f0b7b0f9-edcd-4337-9078-0a9656ff6f3f service nova] Creating event network-vif-deleted:8bfd0e33-2b14-4398-b80c-8da478f93229 for instance 5b30f80f-8b8c-4c07-8653-4f9fd128ce77 on hv-cinder-82549 Jun 17 15:32:53.244843 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [req-e83effa1-4482-483c-b557-91d32ffc6087 req-f0b7b0f9-edcd-4337-9078-0a9656ff6f3f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.186000 Jun 17 15:32:53.246894 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1030/1642] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 15:32:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:32:53.277589 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-2aa61759-8e6e-4e63-9c95-13c4fdb69fa2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:32:53.286875 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-2aa61759-8e6e-4e63-9c95-13c4fdb69fa2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.159729 Jun 17 15:32:53.287546 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 613/1643] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:32:53 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:32:53.836864 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-c0841336-ada4-43c0-843e-3e70c50ec9c0 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:32:53.838183 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-c0841336-ada4-43c0-843e-3e70c50ec9c0 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:32:53.845639 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c0841336-ada4-43c0-843e-3e70c50ec9c0 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:53.846147 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c0841336-ada4-43c0-843e-3e70c50ec9c0 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:53.847096 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c0841336-ada4-43c0-843e-3e70c50ec9c0 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:53.847467 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c0841336-ada4-43c0-843e-3e70c50ec9c0 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:53.881502 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-c0841336-ada4-43c0-843e-3e70c50ec9c0 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049170 Jun 17 15:32:53.882160 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1031/1644] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:32:53 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:32:54.309253 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-92a96ac0-78f2-4ef9-9130-9f035c1c6cc8 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:32:54.310788 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-92a96ac0-78f2-4ef9-9130-9f035c1c6cc8 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:32:54.322485 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-92a96ac0-78f2-4ef9-9130-9f035c1c6cc8 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:54.323341 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-92a96ac0-78f2-4ef9-9130-9f035c1c6cc8 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:54.324878 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-92a96ac0-78f2-4ef9-9130-9f035c1c6cc8 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:54.326294 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-92a96ac0-78f2-4ef9-9130-9f035c1c6cc8 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:54.421158 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-92a96ac0-78f2-4ef9-9130-9f035c1c6cc8 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:32:54.435770 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-92a96ac0-78f2-4ef9-9130-9f035c1c6cc8 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.133255 Jun 17 15:32:54.436858 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 614/1645] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:32:54 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:32:54.893667 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-2fc1076b-d84c-4a53-b653-8a96cef13573 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:32:54.894682 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-2fc1076b-d84c-4a53-b653-8a96cef13573 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:32:54.902831 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2fc1076b-d84c-4a53-b653-8a96cef13573 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:54.902831 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2fc1076b-d84c-4a53-b653-8a96cef13573 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:54.903267 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2fc1076b-d84c-4a53-b653-8a96cef13573 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:54.903594 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2fc1076b-d84c-4a53-b653-8a96cef13573 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:54.941490 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-2fc1076b-d84c-4a53-b653-8a96cef13573 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051856 Jun 17 15:32:54.942072 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1032/1646] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:32:54 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:32:55.400792 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 15:32:55.401034 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Fri Jun 17 15:32:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 15:32:55.461552 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-1ef52c9f-6ac1-43cb-9367-924a1dd40cdc tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:32:55.462287 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-1ef52c9f-6ac1-43cb-9367-924a1dd40cdc tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:32:55.470237 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1ef52c9f-6ac1-43cb-9367-924a1dd40cdc tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:55.470739 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1ef52c9f-6ac1-43cb-9367-924a1dd40cdc tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:55.471771 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1ef52c9f-6ac1-43cb-9367-924a1dd40cdc tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:55.472250 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1ef52c9f-6ac1-43cb-9367-924a1dd40cdc tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:55.540364 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-1ef52c9f-6ac1-43cb-9367-924a1dd40cdc tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:32:55.549561 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-1ef52c9f-6ac1-43cb-9367-924a1dd40cdc tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.092199 Jun 17 15:32:55.550157 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 615/1647] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:32:55 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:32:55.954167 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-4e723ebd-e12e-44d2-b615-6ce958a413c3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:32:55.955129 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-4e723ebd-e12e-44d2-b615-6ce958a413c3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:32:55.962460 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4e723ebd-e12e-44d2-b615-6ce958a413c3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:55.962911 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4e723ebd-e12e-44d2-b615-6ce958a413c3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:55.963710 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4e723ebd-e12e-44d2-b615-6ce958a413c3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:55.964145 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4e723ebd-e12e-44d2-b615-6ce958a413c3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:56.022382 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-4e723ebd-e12e-44d2-b615-6ce958a413c3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072186 Jun 17 15:32:56.023482 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1033/1648] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:32:55 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:32:56.568234 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-834bb3c0-69ef-412b-a324-1e35fe3c407d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:32:56.569233 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-834bb3c0-69ef-412b-a324-1e35fe3c407d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:32:56.577452 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-834bb3c0-69ef-412b-a324-1e35fe3c407d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:56.577905 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-834bb3c0-69ef-412b-a324-1e35fe3c407d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:56.578690 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-834bb3c0-69ef-412b-a324-1e35fe3c407d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:56.579126 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-834bb3c0-69ef-412b-a324-1e35fe3c407d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:56.649556 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-834bb3c0-69ef-412b-a324-1e35fe3c407d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:32:56.657809 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-834bb3c0-69ef-412b-a324-1e35fe3c407d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.094332 Jun 17 15:32:56.658400 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 616/1649] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:32:56 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:32:56.776186 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 15:32:56.776496 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Fri Jun 17 15:32:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 15:32:57.038710 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-c400824a-b77b-421c-b7c5-1122df0aabde tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:32:57.039698 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-c400824a-b77b-421c-b7c5-1122df0aabde tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:32:57.047408 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c400824a-b77b-421c-b7c5-1122df0aabde tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:57.047918 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c400824a-b77b-421c-b7c5-1122df0aabde tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:57.048829 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c400824a-b77b-421c-b7c5-1122df0aabde tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:57.049427 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c400824a-b77b-421c-b7c5-1122df0aabde tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:57.083979 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-c400824a-b77b-421c-b7c5-1122df0aabde tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049362 Jun 17 15:32:57.084806 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1034/1650] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:32:57 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:32:57.676145 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-b4613af3-d550-4018-8d35-e57fcca5c886 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:32:57.676839 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-b4613af3-d550-4018-8d35-e57fcca5c886 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:32:57.683844 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b4613af3-d550-4018-8d35-e57fcca5c886 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:57.684296 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b4613af3-d550-4018-8d35-e57fcca5c886 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:57.685123 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b4613af3-d550-4018-8d35-e57fcca5c886 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:57.685568 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b4613af3-d550-4018-8d35-e57fcca5c886 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:57.781604 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-b4613af3-d550-4018-8d35-e57fcca5c886 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:32:57.790772 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-b4613af3-d550-4018-8d35-e57fcca5c886 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.118780 Jun 17 15:32:57.791364 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 617/1651] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:32:57 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:32:58.096808 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-d253a5ad-b8ad-42d3-8b39-154a81a68d5c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:32:58.097892 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-d253a5ad-b8ad-42d3-8b39-154a81a68d5c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:32:58.106042 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d253a5ad-b8ad-42d3-8b39-154a81a68d5c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:58.107033 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d253a5ad-b8ad-42d3-8b39-154a81a68d5c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:58.107816 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d253a5ad-b8ad-42d3-8b39-154a81a68d5c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:58.108276 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d253a5ad-b8ad-42d3-8b39-154a81a68d5c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:58.143165 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-d253a5ad-b8ad-42d3-8b39-154a81a68d5c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050451 Jun 17 15:32:58.143777 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1035/1652] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:32:58 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:32:58.816212 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-f46b52ae-000f-438c-a149-0a4f30ab3503 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:32:58.816790 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-f46b52ae-000f-438c-a149-0a4f30ab3503 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:32:58.824212 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f46b52ae-000f-438c-a149-0a4f30ab3503 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:58.824686 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f46b52ae-000f-438c-a149-0a4f30ab3503 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:58.825486 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f46b52ae-000f-438c-a149-0a4f30ab3503 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:58.825917 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f46b52ae-000f-438c-a149-0a4f30ab3503 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:58.868283 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 15:32:58.868587 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Fri Jun 17 15:32:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 (ip 10.222.0.48) !!! Jun 17 15:32:58.910879 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-f46b52ae-000f-438c-a149-0a4f30ab3503 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:32:58.919573 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-f46b52ae-000f-438c-a149-0a4f30ab3503 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.106764 Jun 17 15:32:58.920151 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 618/1653] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:32:58 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:32:59.155365 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-e60062f2-b162-43be-bd62-854836dccfb8 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:32:59.156388 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-e60062f2-b162-43be-bd62-854836dccfb8 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:32:59.163801 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e60062f2-b162-43be-bd62-854836dccfb8 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:59.164244 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e60062f2-b162-43be-bd62-854836dccfb8 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:59.165059 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e60062f2-b162-43be-bd62-854836dccfb8 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:59.165492 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e60062f2-b162-43be-bd62-854836dccfb8 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:59.195695 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=100 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:32:59.202241 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-e60062f2-b162-43be-bd62-854836dccfb8 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050840 Jun 17 15:32:59.202831 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1036/1654] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:32:59 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:32:59.936677 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-ccfe40b3-c37b-4ecc-9e31-4155da393cfa tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:32:59.937257 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-ccfe40b3-c37b-4ecc-9e31-4155da393cfa tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:32:59.944014 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ccfe40b3-c37b-4ecc-9e31-4155da393cfa tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:59.944493 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ccfe40b3-c37b-4ecc-9e31-4155da393cfa tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:32:59.945265 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ccfe40b3-c37b-4ecc-9e31-4155da393cfa tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:32:59.945687 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ccfe40b3-c37b-4ecc-9e31-4155da393cfa tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:00.018868 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-ccfe40b3-c37b-4ecc-9e31-4155da393cfa tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:33:00.026562 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-ccfe40b3-c37b-4ecc-9e31-4155da393cfa tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.093841 Jun 17 15:33:00.027133 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 619/1655] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:32:59 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:33:00.215102 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-cb171797-3925-42d6-b5e3-29c6797bba39 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:33:00.215951 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-cb171797-3925-42d6-b5e3-29c6797bba39 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:33:00.223221 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cb171797-3925-42d6-b5e3-29c6797bba39 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:00.223675 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cb171797-3925-42d6-b5e3-29c6797bba39 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:00.224482 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cb171797-3925-42d6-b5e3-29c6797bba39 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:00.224914 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cb171797-3925-42d6-b5e3-29c6797bba39 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:00.259687 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-cb171797-3925-42d6-b5e3-29c6797bba39 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048830 Jun 17 15:33:00.260277 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1037/1656] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:33:00 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:33:01.044981 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-a0d5e82c-ed48-4cd9-991a-7488f3688961 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:33:01.045668 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-a0d5e82c-ed48-4cd9-991a-7488f3688961 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:33:01.048099 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell0:SELECT=2 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:33:01.048801 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell0:SELECT=6 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:33:01.057866 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a0d5e82c-ed48-4cd9-991a-7488f3688961 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:01.058662 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a0d5e82c-ed48-4cd9-991a-7488f3688961 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:01.060135 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a0d5e82c-ed48-4cd9-991a-7488f3688961 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:01.060954 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a0d5e82c-ed48-4cd9-991a-7488f3688961 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:01.158454 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-a0d5e82c-ed48-4cd9-991a-7488f3688961 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:33:01.182349 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-a0d5e82c-ed48-4cd9-991a-7488f3688961 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.141777 Jun 17 15:33:01.182968 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 620/1657] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:33:01 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:33:01.272141 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-708808aa-c59b-41a5-abd4-599ff44dbb4c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:33:01.273109 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-708808aa-c59b-41a5-abd4-599ff44dbb4c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:33:01.280573 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-708808aa-c59b-41a5-abd4-599ff44dbb4c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:01.281021 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-708808aa-c59b-41a5-abd4-599ff44dbb4c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:01.281814 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-708808aa-c59b-41a5-abd4-599ff44dbb4c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:01.282259 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-708808aa-c59b-41a5-abd4-599ff44dbb4c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:01.315405 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-708808aa-c59b-41a5-abd4-599ff44dbb4c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047268 Jun 17 15:33:01.316076 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1038/1658] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:33:01 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:33:02.199267 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-48e161fa-131f-4f1a-b183-f3b5271729df tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:33:02.199963 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-48e161fa-131f-4f1a-b183-f3b5271729df tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:33:02.207092 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-48e161fa-131f-4f1a-b183-f3b5271729df tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:02.207534 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-48e161fa-131f-4f1a-b183-f3b5271729df tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:02.208297 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-48e161fa-131f-4f1a-b183-f3b5271729df tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:02.208761 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-48e161fa-131f-4f1a-b183-f3b5271729df tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:02.213131 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:33:02.285364 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-48e161fa-131f-4f1a-b183-f3b5271729df tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:33:02.293499 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-48e161fa-131f-4f1a-b183-f3b5271729df tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.098361 Jun 17 15:33:02.294122 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 621/1659] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:33:02 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:33:02.329724 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-53e6eddc-6ecd-4729-a16f-e215217766a4 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:33:02.330745 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-53e6eddc-6ecd-4729-a16f-e215217766a4 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:33:02.338116 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-53e6eddc-6ecd-4729-a16f-e215217766a4 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:02.338624 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-53e6eddc-6ecd-4729-a16f-e215217766a4 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:02.339427 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-53e6eddc-6ecd-4729-a16f-e215217766a4 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:02.339869 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-53e6eddc-6ecd-4729-a16f-e215217766a4 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:02.372209 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-53e6eddc-6ecd-4729-a16f-e215217766a4 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048368 Jun 17 15:33:02.373143 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1039/1660] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:33:02 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:33:03.310458 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-afd4160f-eedb-4024-a79e-4260e0eced63 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:33:03.311348 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-afd4160f-eedb-4024-a79e-4260e0eced63 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:33:03.318191 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-afd4160f-eedb-4024-a79e-4260e0eced63 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:03.318641 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-afd4160f-eedb-4024-a79e-4260e0eced63 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:03.319435 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-afd4160f-eedb-4024-a79e-4260e0eced63 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:03.319879 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-afd4160f-eedb-4024-a79e-4260e0eced63 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:03.387323 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-4781aa7f-9212-4ffc-b762-a39e7e6da26b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:33:03.388353 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-afd4160f-eedb-4024-a79e-4260e0eced63 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:33:03.388896 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-4781aa7f-9212-4ffc-b762-a39e7e6da26b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:33:03.397971 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4781aa7f-9212-4ffc-b762-a39e7e6da26b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:03.398574 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4781aa7f-9212-4ffc-b762-a39e7e6da26b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:03.399260 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-afd4160f-eedb-4024-a79e-4260e0eced63 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.092640 Jun 17 15:33:03.399483 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4781aa7f-9212-4ffc-b762-a39e7e6da26b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:03.400356 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4781aa7f-9212-4ffc-b762-a39e7e6da26b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:03.400527 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 622/1661] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:33:03 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:33:03.442991 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-4781aa7f-9212-4ffc-b762-a39e7e6da26b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063274 Jun 17 15:33:03.443593 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1040/1662] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:33:03 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:33:04.424827 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-5fc16652-5bf7-4331-bc62-a01367aa0b7b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:33:04.425633 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-5fc16652-5bf7-4331-bc62-a01367aa0b7b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:33:04.432742 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5fc16652-5bf7-4331-bc62-a01367aa0b7b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:04.433194 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5fc16652-5bf7-4331-bc62-a01367aa0b7b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:04.433976 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5fc16652-5bf7-4331-bc62-a01367aa0b7b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:04.435031 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5fc16652-5bf7-4331-bc62-a01367aa0b7b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:04.456693 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-cf973290-6035-48d1-bb1c-534b6158e41c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:33:04.457738 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-cf973290-6035-48d1-bb1c-534b6158e41c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:33:04.465895 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cf973290-6035-48d1-bb1c-534b6158e41c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:04.466452 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cf973290-6035-48d1-bb1c-534b6158e41c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:04.467330 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cf973290-6035-48d1-bb1c-534b6158e41c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:04.467838 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cf973290-6035-48d1-bb1c-534b6158e41c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:04.504471 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-5fc16652-5bf7-4331-bc62-a01367aa0b7b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:33:04.510100 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-cf973290-6035-48d1-bb1c-534b6158e41c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058128 Jun 17 15:33:04.511003 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1041/1663] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:33:04 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:33:04.512638 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-5fc16652-5bf7-4331-bc62-a01367aa0b7b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.091876 Jun 17 15:33:04.513220 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 623/1664] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:33:04 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:33:05.523894 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-897ea88a-7da1-4312-8438-12789acd324f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:33:05.525238 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-897ea88a-7da1-4312-8438-12789acd324f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:33:05.533684 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-a675f203-8f0a-4ab6-8eee-0468b84ecf68 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:33:05.534539 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-897ea88a-7da1-4312-8438-12789acd324f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:05.534891 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-a675f203-8f0a-4ab6-8eee-0468b84ecf68 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:33:05.535068 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-897ea88a-7da1-4312-8438-12789acd324f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:05.535854 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-897ea88a-7da1-4312-8438-12789acd324f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:05.536524 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-897ea88a-7da1-4312-8438-12789acd324f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:05.545387 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a675f203-8f0a-4ab6-8eee-0468b84ecf68 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:05.546149 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a675f203-8f0a-4ab6-8eee-0468b84ecf68 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:05.547517 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a675f203-8f0a-4ab6-8eee-0468b84ecf68 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:05.548223 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a675f203-8f0a-4ab6-8eee-0468b84ecf68 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:05.587941 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-897ea88a-7da1-4312-8438-12789acd324f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068019 Jun 17 15:33:05.588945 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1042/1665] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:33:05 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:33:05.634206 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-a675f203-8f0a-4ab6-8eee-0468b84ecf68 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:33:05.642557 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-a675f203-8f0a-4ab6-8eee-0468b84ecf68 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.114252 Jun 17 15:33:05.643202 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 624/1666] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:33:05 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:33:06.603548 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-bcb53226-ae22-4ee5-8088-c9aa385e08d4 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:33:06.604393 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-bcb53226-ae22-4ee5-8088-c9aa385e08d4 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:33:06.611922 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bcb53226-ae22-4ee5-8088-c9aa385e08d4 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:06.612411 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bcb53226-ae22-4ee5-8088-c9aa385e08d4 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:06.613235 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bcb53226-ae22-4ee5-8088-c9aa385e08d4 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:06.613672 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bcb53226-ae22-4ee5-8088-c9aa385e08d4 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:06.648089 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-bcb53226-ae22-4ee5-8088-c9aa385e08d4 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048380 Jun 17 15:33:06.648893 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1043/1667] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:33:06 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:33:06.659024 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-5a566e7f-d3f3-4656-afca-53a747074346 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:33:06.659761 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-5a566e7f-d3f3-4656-afca-53a747074346 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:33:06.666219 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5a566e7f-d3f3-4656-afca-53a747074346 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:06.666667 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5a566e7f-d3f3-4656-afca-53a747074346 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:06.667433 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5a566e7f-d3f3-4656-afca-53a747074346 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:06.667864 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5a566e7f-d3f3-4656-afca-53a747074346 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:06.736970 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-5a566e7f-d3f3-4656-afca-53a747074346 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:33:06.744955 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-5a566e7f-d3f3-4656-afca-53a747074346 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.089741 Jun 17 15:33:06.745543 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 625/1668] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:33:06 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:33:07.665453 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-94a84d47-9519-4d7e-b999-7e37ff9814f2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:33:07.666339 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-94a84d47-9519-4d7e-b999-7e37ff9814f2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:33:07.669023 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_api:SELECT=87 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:33:07.674801 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-94a84d47-9519-4d7e-b999-7e37ff9814f2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:07.675257 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-94a84d47-9519-4d7e-b999-7e37ff9814f2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:07.676063 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-94a84d47-9519-4d7e-b999-7e37ff9814f2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:07.676545 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-94a84d47-9519-4d7e-b999-7e37ff9814f2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:07.710313 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-94a84d47-9519-4d7e-b999-7e37ff9814f2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053189 Jun 17 15:33:07.710919 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1044/1669] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:33:07 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:33:07.771009 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-ade0accc-af2e-402c-b306-5cfdd1e82529 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:33:07.771681 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-ade0accc-af2e-402c-b306-5cfdd1e82529 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:33:07.774484 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:33:07.780223 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ade0accc-af2e-402c-b306-5cfdd1e82529 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:07.780709 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ade0accc-af2e-402c-b306-5cfdd1e82529 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:07.781498 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ade0accc-af2e-402c-b306-5cfdd1e82529 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:07.781938 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ade0accc-af2e-402c-b306-5cfdd1e82529 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:08.084504 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-ade0accc-af2e-402c-b306-5cfdd1e82529 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:33:08.092232 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-ade0accc-af2e-402c-b306-5cfdd1e82529 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.325205 Jun 17 15:33:08.092843 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 626/1670] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:33:07 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:33:08.722475 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-2162adfb-a5f9-4655-97b0-ec1b6d94817e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:33:08.723570 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-2162adfb-a5f9-4655-97b0-ec1b6d94817e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:33:08.730380 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2162adfb-a5f9-4655-97b0-ec1b6d94817e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:08.730828 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2162adfb-a5f9-4655-97b0-ec1b6d94817e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:08.731598 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2162adfb-a5f9-4655-97b0-ec1b6d94817e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:08.732028 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2162adfb-a5f9-4655-97b0-ec1b6d94817e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:08.769049 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-2162adfb-a5f9-4655-97b0-ec1b6d94817e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050535 Jun 17 15:33:08.769638 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1045/1671] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:33:08 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:33:09.109575 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-db95edc6-88e5-45b5-bb0f-87d9e06d09cd tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:33:09.110481 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-db95edc6-88e5-45b5-bb0f-87d9e06d09cd tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:33:09.117371 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-db95edc6-88e5-45b5-bb0f-87d9e06d09cd tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:09.117825 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-db95edc6-88e5-45b5-bb0f-87d9e06d09cd tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:09.118604 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-db95edc6-88e5-45b5-bb0f-87d9e06d09cd tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:09.119237 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-db95edc6-88e5-45b5-bb0f-87d9e06d09cd tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:09.195285 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-db95edc6-88e5-45b5-bb0f-87d9e06d09cd tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:33:09.203481 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-db95edc6-88e5-45b5-bb0f-87d9e06d09cd tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.098320 Jun 17 15:33:09.204228 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 627/1672] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:33:09 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:33:09.781180 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-e338dcd8-f143-4975-a3a5-83e19fe48d52 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:33:09.782023 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-e338dcd8-f143-4975-a3a5-83e19fe48d52 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:33:09.788918 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e338dcd8-f143-4975-a3a5-83e19fe48d52 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:09.789368 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e338dcd8-f143-4975-a3a5-83e19fe48d52 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:09.790155 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e338dcd8-f143-4975-a3a5-83e19fe48d52 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:09.790592 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e338dcd8-f143-4975-a3a5-83e19fe48d52 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:09.823549 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-e338dcd8-f143-4975-a3a5-83e19fe48d52 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046341 Jun 17 15:33:09.824124 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1046/1673] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:33:09 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:33:10.221496 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-a2c11abb-2017-4811-abad-6ebfdf9d5c3f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:33:10.222212 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-a2c11abb-2017-4811-abad-6ebfdf9d5c3f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:33:10.229646 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a2c11abb-2017-4811-abad-6ebfdf9d5c3f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:10.230147 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a2c11abb-2017-4811-abad-6ebfdf9d5c3f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:10.231740 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a2c11abb-2017-4811-abad-6ebfdf9d5c3f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:10.232262 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a2c11abb-2017-4811-abad-6ebfdf9d5c3f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:10.301818 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-a2c11abb-2017-4811-abad-6ebfdf9d5c3f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:33:10.310390 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-a2c11abb-2017-4811-abad-6ebfdf9d5c3f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.092816 Jun 17 15:33:10.310988 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 628/1674] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:33:10 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:33:10.835816 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-69487619-6d3a-4965-95ff-b0415036c27e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:33:10.836801 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-69487619-6d3a-4965-95ff-b0415036c27e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:33:10.843977 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-69487619-6d3a-4965-95ff-b0415036c27e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:10.844454 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-69487619-6d3a-4965-95ff-b0415036c27e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:10.845233 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-69487619-6d3a-4965-95ff-b0415036c27e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:10.845663 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-69487619-6d3a-4965-95ff-b0415036c27e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:10.879238 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-69487619-6d3a-4965-95ff-b0415036c27e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047498 Jun 17 15:33:10.879820 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1047/1675] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:33:10 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:33:11.327268 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-1693dacc-59ea-43c2-9e6e-60df6f1e63a0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:33:11.327885 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-1693dacc-59ea-43c2-9e6e-60df6f1e63a0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:33:11.334856 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1693dacc-59ea-43c2-9e6e-60df6f1e63a0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:11.335296 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1693dacc-59ea-43c2-9e6e-60df6f1e63a0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:11.336115 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1693dacc-59ea-43c2-9e6e-60df6f1e63a0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:11.336580 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1693dacc-59ea-43c2-9e6e-60df6f1e63a0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:11.405598 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-1693dacc-59ea-43c2-9e6e-60df6f1e63a0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:33:11.418615 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-1693dacc-59ea-43c2-9e6e-60df6f1e63a0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.095507 Jun 17 15:33:11.419634 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 629/1676] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:33:11 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:33:11.890865 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-db6da422-59c5-417c-bd36-bd3741c79c62 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:33:11.891883 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-db6da422-59c5-417c-bd36-bd3741c79c62 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:33:11.899073 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-db6da422-59c5-417c-bd36-bd3741c79c62 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:11.899527 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-db6da422-59c5-417c-bd36-bd3741c79c62 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:11.900316 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-db6da422-59c5-417c-bd36-bd3741c79c62 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:11.900781 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-db6da422-59c5-417c-bd36-bd3741c79c62 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:11.934909 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-db6da422-59c5-417c-bd36-bd3741c79c62 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047531 Jun 17 15:33:11.935508 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1048/1677] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:33:11 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:33:12.437050 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-5c6d130b-e8c4-4ba3-bb9f-7f88b85a38a3 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:33:12.437766 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-5c6d130b-e8c4-4ba3-bb9f-7f88b85a38a3 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:33:12.445077 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5c6d130b-e8c4-4ba3-bb9f-7f88b85a38a3 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:12.445614 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5c6d130b-e8c4-4ba3-bb9f-7f88b85a38a3 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:12.446525 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5c6d130b-e8c4-4ba3-bb9f-7f88b85a38a3 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:12.447072 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5c6d130b-e8c4-4ba3-bb9f-7f88b85a38a3 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:12.529218 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-5c6d130b-e8c4-4ba3-bb9f-7f88b85a38a3 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:33:12.537396 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-5c6d130b-e8c4-4ba3-bb9f-7f88b85a38a3 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.104808 Jun 17 15:33:12.537988 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 630/1678] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:33:12 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:33:12.950980 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-9d4c57ae-a2f5-4b9e-a741-57b63ff18fc9 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:33:12.952617 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-9d4c57ae-a2f5-4b9e-a741-57b63ff18fc9 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:33:12.963796 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9d4c57ae-a2f5-4b9e-a741-57b63ff18fc9 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:12.964499 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9d4c57ae-a2f5-4b9e-a741-57b63ff18fc9 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:12.965684 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9d4c57ae-a2f5-4b9e-a741-57b63ff18fc9 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:12.966415 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9d4c57ae-a2f5-4b9e-a741-57b63ff18fc9 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:13.025703 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-9d4c57ae-a2f5-4b9e-a741-57b63ff18fc9 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082076 Jun 17 15:33:13.026664 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1049/1679] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:33:12 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:33:13.555138 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-a23ee438-1dce-47ba-bed8-70672478035a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:33:13.555983 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-a23ee438-1dce-47ba-bed8-70672478035a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:33:13.564968 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a23ee438-1dce-47ba-bed8-70672478035a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:13.565410 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a23ee438-1dce-47ba-bed8-70672478035a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:13.566191 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a23ee438-1dce-47ba-bed8-70672478035a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:13.566618 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a23ee438-1dce-47ba-bed8-70672478035a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:13.634768 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-a23ee438-1dce-47ba-bed8-70672478035a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:33:13.643036 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-a23ee438-1dce-47ba-bed8-70672478035a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.092407 Jun 17 15:33:13.643618 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 631/1680] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:33:13 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:33:14.039046 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-fdfaf9db-3269-40f2-8a08-1748ff71efd4 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:33:14.039915 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-fdfaf9db-3269-40f2-8a08-1748ff71efd4 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:33:14.048000 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fdfaf9db-3269-40f2-8a08-1748ff71efd4 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:14.048482 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fdfaf9db-3269-40f2-8a08-1748ff71efd4 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:14.049297 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fdfaf9db-3269-40f2-8a08-1748ff71efd4 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:14.049732 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fdfaf9db-3269-40f2-8a08-1748ff71efd4 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:14.095048 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-fdfaf9db-3269-40f2-8a08-1748ff71efd4 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060406 Jun 17 15:33:14.095655 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1050/1681] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:33:14 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:33:14.660691 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-081646bd-6b7e-45c7-881e-1914795cfb64 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:33:14.661248 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-081646bd-6b7e-45c7-881e-1914795cfb64 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:33:14.667759 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-081646bd-6b7e-45c7-881e-1914795cfb64 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:14.668208 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-081646bd-6b7e-45c7-881e-1914795cfb64 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:14.669028 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-081646bd-6b7e-45c7-881e-1914795cfb64 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:14.669461 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-081646bd-6b7e-45c7-881e-1914795cfb64 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:14.735141 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-081646bd-6b7e-45c7-881e-1914795cfb64 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:33:14.743111 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-081646bd-6b7e-45c7-881e-1914795cfb64 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.086574 Jun 17 15:33:14.743697 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 632/1682] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:33:14 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:33:15.107752 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-9a29253d-f17d-40fd-8b62-0bcc0a9e368b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:33:15.108785 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-9a29253d-f17d-40fd-8b62-0bcc0a9e368b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:33:15.117424 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9a29253d-f17d-40fd-8b62-0bcc0a9e368b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:15.118131 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9a29253d-f17d-40fd-8b62-0bcc0a9e368b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:15.119232 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9a29253d-f17d-40fd-8b62-0bcc0a9e368b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:15.119774 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9a29253d-f17d-40fd-8b62-0bcc0a9e368b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:15.155513 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-9a29253d-f17d-40fd-8b62-0bcc0a9e368b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052219 Jun 17 15:33:15.156214 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1051/1683] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:33:15 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:33:15.765134 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-5edfc4af-d2f6-471e-86d0-d4ccc25a9bdd tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:33:15.765714 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-5edfc4af-d2f6-471e-86d0-d4ccc25a9bdd tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:33:15.772439 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5edfc4af-d2f6-471e-86d0-d4ccc25a9bdd tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:15.772891 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5edfc4af-d2f6-471e-86d0-d4ccc25a9bdd tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:15.773665 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5edfc4af-d2f6-471e-86d0-d4ccc25a9bdd tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:15.774170 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5edfc4af-d2f6-471e-86d0-d4ccc25a9bdd tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:15.851933 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-5edfc4af-d2f6-471e-86d0-d4ccc25a9bdd tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:33:15.860664 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-5edfc4af-d2f6-471e-86d0-d4ccc25a9bdd tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.099427 Jun 17 15:33:15.861259 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 633/1684] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:33:15 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:33:16.168311 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-f9c1afd5-f8fa-46ee-8d29-2641eace341a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:33:16.169958 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-f9c1afd5-f8fa-46ee-8d29-2641eace341a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:33:16.176928 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f9c1afd5-f8fa-46ee-8d29-2641eace341a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:16.177379 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f9c1afd5-f8fa-46ee-8d29-2641eace341a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:16.178168 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f9c1afd5-f8fa-46ee-8d29-2641eace341a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:16.178606 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f9c1afd5-f8fa-46ee-8d29-2641eace341a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:16.210721 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-f9c1afd5-f8fa-46ee-8d29-2641eace341a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046555 Jun 17 15:33:16.211316 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1052/1685] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:33:16 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:33:16.878645 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-7a5258f8-b0bb-4fdb-ad92-6c8356998f54 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:33:16.879318 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-7a5258f8-b0bb-4fdb-ad92-6c8356998f54 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:33:16.886508 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7a5258f8-b0bb-4fdb-ad92-6c8356998f54 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:16.886952 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7a5258f8-b0bb-4fdb-ad92-6c8356998f54 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:16.887750 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7a5258f8-b0bb-4fdb-ad92-6c8356998f54 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:16.888182 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7a5258f8-b0bb-4fdb-ad92-6c8356998f54 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:16.960271 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-7a5258f8-b0bb-4fdb-ad92-6c8356998f54 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:33:16.968476 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-7a5258f8-b0bb-4fdb-ad92-6c8356998f54 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.094226 Jun 17 15:33:16.969057 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 634/1686] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:33:16 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:33:17.223585 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-23029029-8777-446d-bf6d-32f70c82cd99 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:33:17.224461 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-23029029-8777-446d-bf6d-32f70c82cd99 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:33:17.232119 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-23029029-8777-446d-bf6d-32f70c82cd99 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:17.232644 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-23029029-8777-446d-bf6d-32f70c82cd99 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:17.233465 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-23029029-8777-446d-bf6d-32f70c82cd99 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:17.234019 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-23029029-8777-446d-bf6d-32f70c82cd99 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:17.253063 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=100 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:33:17.268095 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-23029029-8777-446d-bf6d-32f70c82cd99 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048935 Jun 17 15:33:17.268713 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1053/1687] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:33:17 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:33:17.991369 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-52068be4-17e3-48ab-b5fe-b8b7e330ea6f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:33:17.992011 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-52068be4-17e3-48ab-b5fe-b8b7e330ea6f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:33:17.999008 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-52068be4-17e3-48ab-b5fe-b8b7e330ea6f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:17.999450 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-52068be4-17e3-48ab-b5fe-b8b7e330ea6f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:18.000231 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-52068be4-17e3-48ab-b5fe-b8b7e330ea6f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:18.000697 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-52068be4-17e3-48ab-b5fe-b8b7e330ea6f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:18.078560 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-52068be4-17e3-48ab-b5fe-b8b7e330ea6f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:33:18.087073 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-52068be4-17e3-48ab-b5fe-b8b7e330ea6f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.099652 Jun 17 15:33:18.087665 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 635/1688] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:33:17 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:33:18.280996 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-f472f3d6-2c65-4eb6-8952-76c2358b3f52 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:33:18.281982 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-f472f3d6-2c65-4eb6-8952-76c2358b3f52 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:33:18.289329 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f472f3d6-2c65-4eb6-8952-76c2358b3f52 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:18.289780 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f472f3d6-2c65-4eb6-8952-76c2358b3f52 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:18.290556 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f472f3d6-2c65-4eb6-8952-76c2358b3f52 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:18.290994 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f472f3d6-2c65-4eb6-8952-76c2358b3f52 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:18.323677 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-f472f3d6-2c65-4eb6-8952-76c2358b3f52 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047166 Jun 17 15:33:18.324356 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1054/1689] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:33:18 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:33:19.105204 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-6316488c-053e-458e-ace9-f09a4e5976cd tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:33:19.106019 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-6316488c-053e-458e-ace9-f09a4e5976cd tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:33:19.113343 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6316488c-053e-458e-ace9-f09a4e5976cd tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:19.113790 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6316488c-053e-458e-ace9-f09a4e5976cd tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:19.114562 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6316488c-053e-458e-ace9-f09a4e5976cd tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:19.114992 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6316488c-053e-458e-ace9-f09a4e5976cd tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:19.180072 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-6316488c-053e-458e-ace9-f09a4e5976cd tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:33:19.192811 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-6316488c-053e-458e-ace9-f09a4e5976cd tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.091415 Jun 17 15:33:19.193570 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 636/1690] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:33:19 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:33:19.337393 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-a7420002-7d63-4863-ba8a-4a350a4277ef tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:33:19.338349 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-a7420002-7d63-4863-ba8a-4a350a4277ef tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:33:19.346297 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a7420002-7d63-4863-ba8a-4a350a4277ef tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:19.346752 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a7420002-7d63-4863-ba8a-4a350a4277ef tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:19.347552 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a7420002-7d63-4863-ba8a-4a350a4277ef tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:19.347987 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a7420002-7d63-4863-ba8a-4a350a4277ef tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:19.381937 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-a7420002-7d63-4863-ba8a-4a350a4277ef tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048758 Jun 17 15:33:19.382553 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1055/1691] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:33:19 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:33:20.210147 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-6288dd5c-3c44-4b41-a659-a46dcdb60ac8 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:33:20.210798 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-6288dd5c-3c44-4b41-a659-a46dcdb60ac8 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:33:20.218540 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6288dd5c-3c44-4b41-a659-a46dcdb60ac8 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:20.219045 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6288dd5c-3c44-4b41-a659-a46dcdb60ac8 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:20.219874 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6288dd5c-3c44-4b41-a659-a46dcdb60ac8 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:20.220380 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6288dd5c-3c44-4b41-a659-a46dcdb60ac8 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:20.297969 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-6288dd5c-3c44-4b41-a659-a46dcdb60ac8 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:33:20.301888 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell1:SELECT=100 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:33:20.307142 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-6288dd5c-3c44-4b41-a659-a46dcdb60ac8 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.100862 Jun 17 15:33:20.307731 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 637/1692] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:33:20 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:33:20.394167 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-837c7318-4ff2-44c3-a1d1-2d18115ef6d2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:33:20.395185 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-837c7318-4ff2-44c3-a1d1-2d18115ef6d2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:33:20.402045 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-837c7318-4ff2-44c3-a1d1-2d18115ef6d2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:20.402494 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-837c7318-4ff2-44c3-a1d1-2d18115ef6d2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:20.403276 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-837c7318-4ff2-44c3-a1d1-2d18115ef6d2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:20.403713 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-837c7318-4ff2-44c3-a1d1-2d18115ef6d2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:20.436726 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-837c7318-4ff2-44c3-a1d1-2d18115ef6d2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046541 Jun 17 15:33:20.437312 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1056/1693] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:33:20 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:33:21.326624 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-0efafaf5-0aa1-4d10-adf2-5a6e0c25b6e4 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:33:21.327282 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-0efafaf5-0aa1-4d10-adf2-5a6e0c25b6e4 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:33:21.343413 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0efafaf5-0aa1-4d10-adf2-5a6e0c25b6e4 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:21.343835 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0efafaf5-0aa1-4d10-adf2-5a6e0c25b6e4 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:21.344718 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0efafaf5-0aa1-4d10-adf2-5a6e0c25b6e4 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:21.345204 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0efafaf5-0aa1-4d10-adf2-5a6e0c25b6e4 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:21.415372 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-0efafaf5-0aa1-4d10-adf2-5a6e0c25b6e4 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:33:21.423916 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-0efafaf5-0aa1-4d10-adf2-5a6e0c25b6e4 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.101754 Jun 17 15:33:21.424558 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 638/1694] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:33:21 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:33:21.451803 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-bc95120c-95bd-45f4-829d-8eeefa05e6c2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:33:21.452786 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-bc95120c-95bd-45f4-829d-8eeefa05e6c2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:33:21.459862 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bc95120c-95bd-45f4-829d-8eeefa05e6c2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:21.460310 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bc95120c-95bd-45f4-829d-8eeefa05e6c2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:21.461184 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bc95120c-95bd-45f4-829d-8eeefa05e6c2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:21.461635 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bc95120c-95bd-45f4-829d-8eeefa05e6c2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:21.493139 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-bc95120c-95bd-45f4-829d-8eeefa05e6c2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046005 Jun 17 15:33:21.493724 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1057/1695] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:33:21 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:33:22.443591 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-fb86897f-bf5b-4634-8753-20c1bf6a0613 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:33:22.444220 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-fb86897f-bf5b-4634-8753-20c1bf6a0613 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:33:22.451359 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fb86897f-bf5b-4634-8753-20c1bf6a0613 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:22.451808 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fb86897f-bf5b-4634-8753-20c1bf6a0613 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:22.452642 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fb86897f-bf5b-4634-8753-20c1bf6a0613 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:22.453084 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fb86897f-bf5b-4634-8753-20c1bf6a0613 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:22.506793 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-2a381cfc-a2d4-43eb-8855-cbfd171c51f8 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:33:22.507969 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-2a381cfc-a2d4-43eb-8855-cbfd171c51f8 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:33:22.515624 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2a381cfc-a2d4-43eb-8855-cbfd171c51f8 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:22.516263 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2a381cfc-a2d4-43eb-8855-cbfd171c51f8 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:22.517170 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2a381cfc-a2d4-43eb-8855-cbfd171c51f8 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:22.517748 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2a381cfc-a2d4-43eb-8855-cbfd171c51f8 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:22.540742 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-fb86897f-bf5b-4634-8753-20c1bf6a0613 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:33:22.554854 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-fb86897f-bf5b-4634-8753-20c1bf6a0613 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.114927 Jun 17 15:33:22.555787 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 639/1696] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:33:22 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:33:22.564711 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-2a381cfc-a2d4-43eb-8855-cbfd171c51f8 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062145 Jun 17 15:33:22.565781 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1058/1697] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:33:22 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:33:23.581852 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-d789e222-a22d-4132-9549-4854ddf669d0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:33:23.582913 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-1432340e-0220-4980-a942-9699ec44e0e6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:33:23.583612 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-d789e222-a22d-4132-9549-4854ddf669d0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:33:23.584420 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-1432340e-0220-4980-a942-9699ec44e0e6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:33:23.594438 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d789e222-a22d-4132-9549-4854ddf669d0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:23.595192 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d789e222-a22d-4132-9549-4854ddf669d0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:23.595837 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1432340e-0220-4980-a942-9699ec44e0e6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:23.596570 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d789e222-a22d-4132-9549-4854ddf669d0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:23.596747 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1432340e-0220-4980-a942-9699ec44e0e6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:23.597283 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d789e222-a22d-4132-9549-4854ddf669d0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:23.597883 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1432340e-0220-4980-a942-9699ec44e0e6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:23.599018 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1432340e-0220-4980-a942-9699ec44e0e6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:23.660486 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-1432340e-0220-4980-a942-9699ec44e0e6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086959 Jun 17 15:33:23.661529 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 640/1698] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:33:23 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:33:23.721922 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-d789e222-a22d-4132-9549-4854ddf669d0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:33:23.736342 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-d789e222-a22d-4132-9549-4854ddf669d0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.161438 Jun 17 15:33:23.737432 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1059/1699] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:33:23 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:33:24.674932 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-97dbda55-e8c8-4da4-91d5-c5a036910788 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:33:24.675873 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-97dbda55-e8c8-4da4-91d5-c5a036910788 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:33:24.683094 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-97dbda55-e8c8-4da4-91d5-c5a036910788 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:24.683546 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-97dbda55-e8c8-4da4-91d5-c5a036910788 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:24.684366 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-97dbda55-e8c8-4da4-91d5-c5a036910788 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:24.684799 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-97dbda55-e8c8-4da4-91d5-c5a036910788 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:24.718359 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-97dbda55-e8c8-4da4-91d5-c5a036910788 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047511 Jun 17 15:33:24.719000 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 641/1700] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:33:24 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:33:24.764221 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-257e3b2f-87dd-40e6-b38a-5272d4fb918a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:33:24.764922 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-257e3b2f-87dd-40e6-b38a-5272d4fb918a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:33:24.772738 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-257e3b2f-87dd-40e6-b38a-5272d4fb918a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:24.773196 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-257e3b2f-87dd-40e6-b38a-5272d4fb918a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:24.774007 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-257e3b2f-87dd-40e6-b38a-5272d4fb918a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:24.774525 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-257e3b2f-87dd-40e6-b38a-5272d4fb918a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:24.844053 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-257e3b2f-87dd-40e6-b38a-5272d4fb918a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:33:24.852674 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-257e3b2f-87dd-40e6-b38a-5272d4fb918a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.092869 Jun 17 15:33:24.853285 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1060/1701] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:33:24 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:33:25.730975 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-272ac7af-ab84-41d6-a897-f83c3933fe7a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:33:25.731989 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-272ac7af-ab84-41d6-a897-f83c3933fe7a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:33:25.739109 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-272ac7af-ab84-41d6-a897-f83c3933fe7a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:25.739644 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-272ac7af-ab84-41d6-a897-f83c3933fe7a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:25.740580 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-272ac7af-ab84-41d6-a897-f83c3933fe7a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:25.741057 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-272ac7af-ab84-41d6-a897-f83c3933fe7a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:25.777053 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-272ac7af-ab84-41d6-a897-f83c3933fe7a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050215 Jun 17 15:33:25.777907 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 642/1702] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:33:25 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:33:25.870431 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-09f7c0c5-efb7-4c62-bdbb-7b841b21b532 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:33:25.871066 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-09f7c0c5-efb7-4c62-bdbb-7b841b21b532 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:33:25.878482 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-09f7c0c5-efb7-4c62-bdbb-7b841b21b532 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:25.878886 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-09f7c0c5-efb7-4c62-bdbb-7b841b21b532 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:25.879733 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-09f7c0c5-efb7-4c62-bdbb-7b841b21b532 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:25.880265 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-09f7c0c5-efb7-4c62-bdbb-7b841b21b532 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:25.952587 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-09f7c0c5-efb7-4c62-bdbb-7b841b21b532 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:33:25.961095 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-09f7c0c5-efb7-4c62-bdbb-7b841b21b532 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.094893 Jun 17 15:33:25.961905 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1061/1703] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:33:25 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:33:26.789234 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-23bcd37d-eb40-430e-9568-5336b08cbe1a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:33:26.790089 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-23bcd37d-eb40-430e-9568-5336b08cbe1a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:33:26.797710 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-23bcd37d-eb40-430e-9568-5336b08cbe1a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:26.798244 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-23bcd37d-eb40-430e-9568-5336b08cbe1a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:26.799291 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-23bcd37d-eb40-430e-9568-5336b08cbe1a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:26.799782 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-23bcd37d-eb40-430e-9568-5336b08cbe1a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:26.833351 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-23bcd37d-eb40-430e-9568-5336b08cbe1a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048267 Jun 17 15:33:26.833945 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 643/1704] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:33:26 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:33:26.978889 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-b29ac77d-b1b0-4d16-9a2c-ed37d8545d44 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:33:26.979490 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-b29ac77d-b1b0-4d16-9a2c-ed37d8545d44 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:33:26.987312 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b29ac77d-b1b0-4d16-9a2c-ed37d8545d44 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:26.987762 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b29ac77d-b1b0-4d16-9a2c-ed37d8545d44 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:26.988618 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b29ac77d-b1b0-4d16-9a2c-ed37d8545d44 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:26.989099 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b29ac77d-b1b0-4d16-9a2c-ed37d8545d44 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:27.056409 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-b29ac77d-b1b0-4d16-9a2c-ed37d8545d44 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:33:27.064900 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-b29ac77d-b1b0-4d16-9a2c-ed37d8545d44 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.089852 Jun 17 15:33:27.065501 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1062/1705] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:33:26 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:33:27.845492 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-c1945e43-7861-4f53-a8f3-5a903f5d1e47 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:33:27.846498 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-c1945e43-7861-4f53-a8f3-5a903f5d1e47 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:33:27.853908 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c1945e43-7861-4f53-a8f3-5a903f5d1e47 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:27.854355 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c1945e43-7861-4f53-a8f3-5a903f5d1e47 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:27.855148 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c1945e43-7861-4f53-a8f3-5a903f5d1e47 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:27.855584 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c1945e43-7861-4f53-a8f3-5a903f5d1e47 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:27.887814 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-c1945e43-7861-4f53-a8f3-5a903f5d1e47 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046611 Jun 17 15:33:27.888422 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 644/1706] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:33:27 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:33:28.082146 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-84406d89-7fa2-4440-9ec9-187c5a5f779e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:33:28.082782 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-84406d89-7fa2-4440-9ec9-187c5a5f779e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:33:28.089804 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-84406d89-7fa2-4440-9ec9-187c5a5f779e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:28.090744 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-84406d89-7fa2-4440-9ec9-187c5a5f779e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:28.091533 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-84406d89-7fa2-4440-9ec9-187c5a5f779e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:28.091968 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-84406d89-7fa2-4440-9ec9-187c5a5f779e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:28.166260 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-84406d89-7fa2-4440-9ec9-187c5a5f779e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:33:28.175045 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-84406d89-7fa2-4440-9ec9-187c5a5f779e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.096893 Jun 17 15:33:28.175663 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1063/1707] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:33:28 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:33:28.899748 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-1869886c-72a8-488b-af33-606bae901701 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:33:28.900728 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-1869886c-72a8-488b-af33-606bae901701 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:33:28.907642 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1869886c-72a8-488b-af33-606bae901701 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:28.908098 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1869886c-72a8-488b-af33-606bae901701 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:28.908920 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1869886c-72a8-488b-af33-606bae901701 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:28.909359 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1869886c-72a8-488b-af33-606bae901701 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:28.942049 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-1869886c-72a8-488b-af33-606bae901701 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046304 Jun 17 15:33:28.942654 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 645/1708] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:33:28 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:33:29.200370 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-d1a6980c-f294-49cb-83d9-623f49069d0a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:33:29.201097 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-d1a6980c-f294-49cb-83d9-623f49069d0a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:33:29.209055 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d1a6980c-f294-49cb-83d9-623f49069d0a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:29.209598 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d1a6980c-f294-49cb-83d9-623f49069d0a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:29.210649 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d1a6980c-f294-49cb-83d9-623f49069d0a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:29.211214 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d1a6980c-f294-49cb-83d9-623f49069d0a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:29.279056 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-d1a6980c-f294-49cb-83d9-623f49069d0a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:33:29.287245 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-d1a6980c-f294-49cb-83d9-623f49069d0a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.091005 Jun 17 15:33:29.287857 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1064/1709] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:33:29 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:33:29.953801 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-620b6fa5-97c8-4ec1-bc2b-8a1df9d41f3a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:33:29.954787 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-620b6fa5-97c8-4ec1-bc2b-8a1df9d41f3a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:33:29.961885 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-620b6fa5-97c8-4ec1-bc2b-8a1df9d41f3a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:29.962331 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-620b6fa5-97c8-4ec1-bc2b-8a1df9d41f3a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:29.963131 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-620b6fa5-97c8-4ec1-bc2b-8a1df9d41f3a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:29.963579 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-620b6fa5-97c8-4ec1-bc2b-8a1df9d41f3a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:29.998450 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-620b6fa5-97c8-4ec1-bc2b-8a1df9d41f3a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048772 Jun 17 15:33:29.999061 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 646/1710] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:33:29 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:33:30.305453 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-02e3c6a6-3d78-49cc-b701-6ec408b21807 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:33:30.306111 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-02e3c6a6-3d78-49cc-b701-6ec408b21807 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:33:30.313198 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-02e3c6a6-3d78-49cc-b701-6ec408b21807 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:30.313646 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-02e3c6a6-3d78-49cc-b701-6ec408b21807 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:30.314428 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-02e3c6a6-3d78-49cc-b701-6ec408b21807 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:30.314872 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-02e3c6a6-3d78-49cc-b701-6ec408b21807 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:30.390120 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-02e3c6a6-3d78-49cc-b701-6ec408b21807 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:33:30.402312 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-02e3c6a6-3d78-49cc-b701-6ec408b21807 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.101263 Jun 17 15:33:30.403604 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1065/1711] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:33:30 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:33:31.011958 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-3df946ad-87d8-498b-affd-455ae9157894 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:33:31.013811 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-3df946ad-87d8-498b-affd-455ae9157894 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:33:31.020490 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3df946ad-87d8-498b-affd-455ae9157894 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:31.020941 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3df946ad-87d8-498b-affd-455ae9157894 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:31.021733 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3df946ad-87d8-498b-affd-455ae9157894 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:31.022168 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3df946ad-87d8-498b-affd-455ae9157894 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:31.055325 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-3df946ad-87d8-498b-affd-455ae9157894 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047861 Jun 17 15:33:31.055927 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 647/1712] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:33:31 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:33:31.419422 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-062e75b1-dc27-405c-aec3-15e4e998a52e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:33:31.420025 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-062e75b1-dc27-405c-aec3-15e4e998a52e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:33:31.428055 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-062e75b1-dc27-405c-aec3-15e4e998a52e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:31.428547 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-062e75b1-dc27-405c-aec3-15e4e998a52e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:31.429318 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-062e75b1-dc27-405c-aec3-15e4e998a52e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:31.429747 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-062e75b1-dc27-405c-aec3-15e4e998a52e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:31.500776 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-062e75b1-dc27-405c-aec3-15e4e998a52e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:33:31.508958 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-062e75b1-dc27-405c-aec3-15e4e998a52e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.093265 Jun 17 15:33:31.509549 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1066/1713] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:33:31 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:33:32.067822 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-eca8dec2-8a55-4731-861d-acc7f2f0c6c5 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:33:32.068685 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-eca8dec2-8a55-4731-861d-acc7f2f0c6c5 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:33:32.075818 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-eca8dec2-8a55-4731-861d-acc7f2f0c6c5 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:32.076318 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-eca8dec2-8a55-4731-861d-acc7f2f0c6c5 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:32.077189 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-eca8dec2-8a55-4731-861d-acc7f2f0c6c5 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:32.077676 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-eca8dec2-8a55-4731-861d-acc7f2f0c6c5 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:32.111399 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-eca8dec2-8a55-4731-861d-acc7f2f0c6c5 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047894 Jun 17 15:33:32.112008 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 648/1714] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:33:32 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:33:32.526487 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-4497857a-0172-4ce7-b350-dfc5b076e68d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:33:32.527122 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-4497857a-0172-4ce7-b350-dfc5b076e68d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:33:32.534106 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4497857a-0172-4ce7-b350-dfc5b076e68d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:32.534771 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4497857a-0172-4ce7-b350-dfc5b076e68d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:32.535541 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4497857a-0172-4ce7-b350-dfc5b076e68d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:32.535974 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4497857a-0172-4ce7-b350-dfc5b076e68d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:32.609121 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-4497857a-0172-4ce7-b350-dfc5b076e68d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:33:32.617636 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-4497857a-0172-4ce7-b350-dfc5b076e68d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.094967 Jun 17 15:33:32.618229 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1067/1715] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:33:32 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:33:33.123437 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-bdad81b6-b7fd-4db9-8782-bd62fa9634a5 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:33:33.124413 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-bdad81b6-b7fd-4db9-8782-bd62fa9634a5 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:33:33.131606 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bdad81b6-b7fd-4db9-8782-bd62fa9634a5 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:33.132053 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bdad81b6-b7fd-4db9-8782-bd62fa9634a5 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:33.132874 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bdad81b6-b7fd-4db9-8782-bd62fa9634a5 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:33.133304 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bdad81b6-b7fd-4db9-8782-bd62fa9634a5 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:33.167049 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-bdad81b6-b7fd-4db9-8782-bd62fa9634a5 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048271 Jun 17 15:33:33.167735 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 649/1716] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:33:33 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:33:33.635828 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-fc8f9887-bd1f-41aa-9324-35744e4ad3ec tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:33:33.636609 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-fc8f9887-bd1f-41aa-9324-35744e4ad3ec tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:33:33.644013 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fc8f9887-bd1f-41aa-9324-35744e4ad3ec tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:33.644499 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fc8f9887-bd1f-41aa-9324-35744e4ad3ec tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:33.645283 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fc8f9887-bd1f-41aa-9324-35744e4ad3ec tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:33.645714 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fc8f9887-bd1f-41aa-9324-35744e4ad3ec tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:33.712365 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-fc8f9887-bd1f-41aa-9324-35744e4ad3ec tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:33:33.721129 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-fc8f9887-bd1f-41aa-9324-35744e4ad3ec tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.089232 Jun 17 15:33:33.721714 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1068/1717] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:33:33 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:33:34.180085 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-df7abd5d-5767-48ec-9706-1fb3fdf86dc1 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:33:34.181428 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-df7abd5d-5767-48ec-9706-1fb3fdf86dc1 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:33:34.189299 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-df7abd5d-5767-48ec-9706-1fb3fdf86dc1 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:34.189802 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-df7abd5d-5767-48ec-9706-1fb3fdf86dc1 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:34.190621 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-df7abd5d-5767-48ec-9706-1fb3fdf86dc1 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:34.191097 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-df7abd5d-5767-48ec-9706-1fb3fdf86dc1 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:34.224517 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-df7abd5d-5767-48ec-9706-1fb3fdf86dc1 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048499 Jun 17 15:33:34.225105 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 650/1718] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:33:34 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:33:34.739345 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-46301977-5aca-4874-8b32-98815dc8e2a0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:33:34.739977 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-46301977-5aca-4874-8b32-98815dc8e2a0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:33:34.747176 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-46301977-5aca-4874-8b32-98815dc8e2a0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:34.747620 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-46301977-5aca-4874-8b32-98815dc8e2a0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:34.748412 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-46301977-5aca-4874-8b32-98815dc8e2a0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:34.748842 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-46301977-5aca-4874-8b32-98815dc8e2a0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:34.816933 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-46301977-5aca-4874-8b32-98815dc8e2a0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:33:34.824611 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-46301977-5aca-4874-8b32-98815dc8e2a0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.089210 Jun 17 15:33:34.825204 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1069/1719] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:33:34 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:33:35.236067 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-985c3c21-cb0e-44fa-ba5c-a1afbb26b9b7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:33:35.237204 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-985c3c21-cb0e-44fa-ba5c-a1afbb26b9b7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:33:35.244718 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-985c3c21-cb0e-44fa-ba5c-a1afbb26b9b7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:35.245217 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-985c3c21-cb0e-44fa-ba5c-a1afbb26b9b7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:35.246050 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-985c3c21-cb0e-44fa-ba5c-a1afbb26b9b7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:35.246526 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-985c3c21-cb0e-44fa-ba5c-a1afbb26b9b7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:35.286174 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-985c3c21-cb0e-44fa-ba5c-a1afbb26b9b7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054359 Jun 17 15:33:35.286767 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 651/1720] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:33:35 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:33:35.842190 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-eb10aaa2-fc6a-4478-b627-c2201ea6ed30 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:33:35.842904 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-eb10aaa2-fc6a-4478-b627-c2201ea6ed30 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:33:35.849933 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-eb10aaa2-fc6a-4478-b627-c2201ea6ed30 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:35.850382 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-eb10aaa2-fc6a-4478-b627-c2201ea6ed30 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:35.851157 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-eb10aaa2-fc6a-4478-b627-c2201ea6ed30 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:35.851586 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-eb10aaa2-fc6a-4478-b627-c2201ea6ed30 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:35.856678 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=100 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:33:35.930494 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-eb10aaa2-fc6a-4478-b627-c2201ea6ed30 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:33:35.943358 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-eb10aaa2-fc6a-4478-b627-c2201ea6ed30 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.104836 Jun 17 15:33:35.944423 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1070/1721] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:33:35 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:33:36.299067 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-78b24d7e-c71b-47f2-9161-f85e26170aca tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:33:36.300092 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-78b24d7e-c71b-47f2-9161-f85e26170aca tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:33:36.307240 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-78b24d7e-c71b-47f2-9161-f85e26170aca tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:36.307686 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-78b24d7e-c71b-47f2-9161-f85e26170aca tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:36.308720 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-78b24d7e-c71b-47f2-9161-f85e26170aca tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:36.309168 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-78b24d7e-c71b-47f2-9161-f85e26170aca tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:36.342583 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-78b24d7e-c71b-47f2-9161-f85e26170aca tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047747 Jun 17 15:33:36.343169 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 652/1722] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:33:36 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:33:36.969725 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-f6d58dd3-d2dd-4b64-8748-c3d5d72db1c7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:33:36.970434 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-f6d58dd3-d2dd-4b64-8748-c3d5d72db1c7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:33:36.977461 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f6d58dd3-d2dd-4b64-8748-c3d5d72db1c7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:36.977904 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f6d58dd3-d2dd-4b64-8748-c3d5d72db1c7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:36.978677 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f6d58dd3-d2dd-4b64-8748-c3d5d72db1c7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:36.979108 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f6d58dd3-d2dd-4b64-8748-c3d5d72db1c7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:37.202784 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-f6d58dd3-d2dd-4b64-8748-c3d5d72db1c7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:33:37.210994 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-f6d58dd3-d2dd-4b64-8748-c3d5d72db1c7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.245922 Jun 17 15:33:37.211648 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1071/1723] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:33:36 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:33:37.357127 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-282ee0b4-87ff-47ad-a9c2-2d6102a27f5a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:33:37.358149 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-282ee0b4-87ff-47ad-a9c2-2d6102a27f5a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:33:37.365566 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-282ee0b4-87ff-47ad-a9c2-2d6102a27f5a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:37.366021 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-282ee0b4-87ff-47ad-a9c2-2d6102a27f5a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:37.366806 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-282ee0b4-87ff-47ad-a9c2-2d6102a27f5a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:37.367247 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-282ee0b4-87ff-47ad-a9c2-2d6102a27f5a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:37.404649 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-282ee0b4-87ff-47ad-a9c2-2d6102a27f5a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051729 Jun 17 15:33:37.405239 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 653/1724] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:33:37 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:33:38.229401 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-e293a185-5d9f-44b0-9fc5-1053eadeff93 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:33:38.230245 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-e293a185-5d9f-44b0-9fc5-1053eadeff93 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:33:38.232620 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_api:SELECT=56 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:33:38.238613 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e293a185-5d9f-44b0-9fc5-1053eadeff93 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:38.239073 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e293a185-5d9f-44b0-9fc5-1053eadeff93 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:38.239865 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e293a185-5d9f-44b0-9fc5-1053eadeff93 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:38.240310 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e293a185-5d9f-44b0-9fc5-1053eadeff93 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:38.307099 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-e293a185-5d9f-44b0-9fc5-1053eadeff93 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:33:38.315349 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-e293a185-5d9f-44b0-9fc5-1053eadeff93 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.089853 Jun 17 15:33:38.315934 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1072/1725] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:33:38 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:33:38.416969 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-b435b538-ce7e-4ee2-b085-1936f2ef71bf tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:33:38.417941 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-b435b538-ce7e-4ee2-b085-1936f2ef71bf tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:33:38.420463 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_api:SELECT=56 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:33:38.426054 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b435b538-ce7e-4ee2-b085-1936f2ef71bf tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:38.426542 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b435b538-ce7e-4ee2-b085-1936f2ef71bf tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:38.427355 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b435b538-ce7e-4ee2-b085-1936f2ef71bf tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:38.427840 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b435b538-ce7e-4ee2-b085-1936f2ef71bf tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:38.446616 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell1:SELECT=100 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:33:38.461492 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-b435b538-ce7e-4ee2-b085-1936f2ef71bf tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048558 Jun 17 15:33:38.462064 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 654/1726] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:33:38 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:33:39.333032 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-987d4a1b-2f58-47d9-9a2f-bc411a6a4fad tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:33:39.334022 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-987d4a1b-2f58-47d9-9a2f-bc411a6a4fad tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:33:39.341718 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-987d4a1b-2f58-47d9-9a2f-bc411a6a4fad tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:39.342231 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-987d4a1b-2f58-47d9-9a2f-bc411a6a4fad tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:39.343053 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-987d4a1b-2f58-47d9-9a2f-bc411a6a4fad tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:39.343523 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-987d4a1b-2f58-47d9-9a2f-bc411a6a4fad tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:39.410826 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-987d4a1b-2f58-47d9-9a2f-bc411a6a4fad tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:33:39.419205 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-987d4a1b-2f58-47d9-9a2f-bc411a6a4fad tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.089997 Jun 17 15:33:39.419789 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1073/1727] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:33:39 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:33:39.475475 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-875623b8-d712-43eb-8be6-1d8b29d5500e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:33:39.476471 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-875623b8-d712-43eb-8be6-1d8b29d5500e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:33:39.483525 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-875623b8-d712-43eb-8be6-1d8b29d5500e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:39.483967 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-875623b8-d712-43eb-8be6-1d8b29d5500e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:39.484812 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-875623b8-d712-43eb-8be6-1d8b29d5500e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:39.485252 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-875623b8-d712-43eb-8be6-1d8b29d5500e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:39.543362 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-875623b8-d712-43eb-8be6-1d8b29d5500e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071265 Jun 17 15:33:39.544463 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 655/1728] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:33:39 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:33:40.437019 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-59381990-7344-43a4-a136-398eef6acd18 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:33:40.437921 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-59381990-7344-43a4-a136-398eef6acd18 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:33:40.444899 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-59381990-7344-43a4-a136-398eef6acd18 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:40.445395 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-59381990-7344-43a4-a136-398eef6acd18 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:40.446241 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-59381990-7344-43a4-a136-398eef6acd18 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:40.446723 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-59381990-7344-43a4-a136-398eef6acd18 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:40.520541 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-59381990-7344-43a4-a136-398eef6acd18 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:33:40.530187 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-59381990-7344-43a4-a136-398eef6acd18 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.097677 Jun 17 15:33:40.530835 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1074/1729] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:33:40 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:33:40.559074 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-fdc5cfb6-94b8-4eaa-9b96-fd5a355a54ed tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:33:40.560167 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-fdc5cfb6-94b8-4eaa-9b96-fd5a355a54ed tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:33:40.567277 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fdc5cfb6-94b8-4eaa-9b96-fd5a355a54ed tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:40.567734 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fdc5cfb6-94b8-4eaa-9b96-fd5a355a54ed tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:40.568566 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fdc5cfb6-94b8-4eaa-9b96-fd5a355a54ed tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:40.569009 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fdc5cfb6-94b8-4eaa-9b96-fd5a355a54ed tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:40.605636 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-fdc5cfb6-94b8-4eaa-9b96-fd5a355a54ed tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050720 Jun 17 15:33:40.606448 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 656/1730] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:33:40 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:33:41.547551 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-3ba8e911-8bd7-4653-8464-686f2e381b1d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:33:41.548215 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-3ba8e911-8bd7-4653-8464-686f2e381b1d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:33:41.554870 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3ba8e911-8bd7-4653-8464-686f2e381b1d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:41.555310 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3ba8e911-8bd7-4653-8464-686f2e381b1d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:41.556083 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3ba8e911-8bd7-4653-8464-686f2e381b1d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:41.556545 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3ba8e911-8bd7-4653-8464-686f2e381b1d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:41.618277 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-f909a23a-6b52-46f8-9fcf-3b5ca04f98cd tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:33:41.619355 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-f909a23a-6b52-46f8-9fcf-3b5ca04f98cd tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:33:41.623377 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-3ba8e911-8bd7-4653-8464-686f2e381b1d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:33:41.626686 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f909a23a-6b52-46f8-9fcf-3b5ca04f98cd tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:41.627212 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f909a23a-6b52-46f8-9fcf-3b5ca04f98cd tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:41.628079 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f909a23a-6b52-46f8-9fcf-3b5ca04f98cd tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:41.628663 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f909a23a-6b52-46f8-9fcf-3b5ca04f98cd tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:41.635691 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-3ba8e911-8bd7-4653-8464-686f2e381b1d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.091913 Jun 17 15:33:41.636425 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1075/1731] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:33:41 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:33:41.660197 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-f909a23a-6b52-46f8-9fcf-3b5ca04f98cd tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045839 Jun 17 15:33:41.660811 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 657/1732] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:33:41 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:33:42.654796 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-13561dae-254a-4561-915a-7b85233ef0c7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:33:42.655387 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-13561dae-254a-4561-915a-7b85233ef0c7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:33:42.662473 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-13561dae-254a-4561-915a-7b85233ef0c7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:42.662920 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-13561dae-254a-4561-915a-7b85233ef0c7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:42.663707 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-13561dae-254a-4561-915a-7b85233ef0c7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:42.664149 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-13561dae-254a-4561-915a-7b85233ef0c7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:42.671935 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-6a85d9af-6950-474a-9b99-1816f9e181b6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:33:42.673026 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-6a85d9af-6950-474a-9b99-1816f9e181b6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:33:42.681378 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6a85d9af-6950-474a-9b99-1816f9e181b6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:42.681914 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6a85d9af-6950-474a-9b99-1816f9e181b6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:42.682804 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6a85d9af-6950-474a-9b99-1816f9e181b6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:42.683308 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6a85d9af-6950-474a-9b99-1816f9e181b6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:42.718775 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-6a85d9af-6950-474a-9b99-1816f9e181b6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051426 Jun 17 15:33:42.719388 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 658/1733] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:33:42 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:33:42.735516 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-13561dae-254a-4561-915a-7b85233ef0c7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:33:42.744001 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-13561dae-254a-4561-915a-7b85233ef0c7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.093868 Jun 17 15:33:42.744624 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1076/1734] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:33:42 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:33:43.731055 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-d39b0e77-f291-4c20-b547-166146244764 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:33:43.731909 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-d39b0e77-f291-4c20-b547-166146244764 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:33:43.738930 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d39b0e77-f291-4c20-b547-166146244764 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:43.739385 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d39b0e77-f291-4c20-b547-166146244764 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:43.740176 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d39b0e77-f291-4c20-b547-166146244764 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:43.740649 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d39b0e77-f291-4c20-b547-166146244764 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:43.772063 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-60e6fc26-737e-4934-8df1-df9ad5e93131 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:33:43.773134 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-60e6fc26-737e-4934-8df1-df9ad5e93131 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:33:43.774862 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-d39b0e77-f291-4c20-b547-166146244764 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048009 Jun 17 15:33:43.775459 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 659/1735] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:33:43 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:33:43.783792 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-60e6fc26-737e-4934-8df1-df9ad5e93131 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:43.784295 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-60e6fc26-737e-4934-8df1-df9ad5e93131 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:43.785134 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-60e6fc26-737e-4934-8df1-df9ad5e93131 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:43.785565 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-60e6fc26-737e-4934-8df1-df9ad5e93131 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:43.861021 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-60e6fc26-737e-4934-8df1-df9ad5e93131 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:33:43.869553 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-60e6fc26-737e-4934-8df1-df9ad5e93131 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.102528 Jun 17 15:33:43.870237 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1077/1736] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:33:43 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:33:44.789208 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-751c6c61-1a56-4c19-8f7c-26818a29be5b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:33:44.790065 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-751c6c61-1a56-4c19-8f7c-26818a29be5b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:33:44.797830 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-751c6c61-1a56-4c19-8f7c-26818a29be5b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:44.798272 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-751c6c61-1a56-4c19-8f7c-26818a29be5b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:44.799058 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-751c6c61-1a56-4c19-8f7c-26818a29be5b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:44.799488 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-751c6c61-1a56-4c19-8f7c-26818a29be5b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:44.834441 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-751c6c61-1a56-4c19-8f7c-26818a29be5b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049540 Jun 17 15:33:44.835051 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 660/1737] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:33:44 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:33:44.888896 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-ab2d69dc-837a-4d61-b018-2a4240b9131d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:33:44.890046 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-ab2d69dc-837a-4d61-b018-2a4240b9131d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:33:44.901052 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ab2d69dc-837a-4d61-b018-2a4240b9131d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:44.901607 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ab2d69dc-837a-4d61-b018-2a4240b9131d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:44.903614 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ab2d69dc-837a-4d61-b018-2a4240b9131d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:44.904374 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ab2d69dc-837a-4d61-b018-2a4240b9131d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:45.000092 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-ab2d69dc-837a-4d61-b018-2a4240b9131d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:33:45.014807 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-ab2d69dc-837a-4d61-b018-2a4240b9131d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.130291 Jun 17 15:33:45.015816 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1078/1738] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:33:44 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:33:45.849507 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-3c8d082a-6a76-48b7-a29a-ec98883569c9 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:33:45.850488 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-3c8d082a-6a76-48b7-a29a-ec98883569c9 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:33:45.857884 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3c8d082a-6a76-48b7-a29a-ec98883569c9 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:45.858328 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3c8d082a-6a76-48b7-a29a-ec98883569c9 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:45.859102 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3c8d082a-6a76-48b7-a29a-ec98883569c9 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:45.859527 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3c8d082a-6a76-48b7-a29a-ec98883569c9 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:45.891643 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-3c8d082a-6a76-48b7-a29a-ec98883569c9 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046365 Jun 17 15:33:45.892235 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 661/1739] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:33:45 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:33:46.031996 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-9b0d81c9-abb4-438a-b4d2-f4a71e827dfa tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:33:46.032677 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-9b0d81c9-abb4-438a-b4d2-f4a71e827dfa tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:33:46.040580 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9b0d81c9-abb4-438a-b4d2-f4a71e827dfa tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:46.041030 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9b0d81c9-abb4-438a-b4d2-f4a71e827dfa tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:46.041804 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9b0d81c9-abb4-438a-b4d2-f4a71e827dfa tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:46.042238 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9b0d81c9-abb4-438a-b4d2-f4a71e827dfa tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:46.107714 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-9b0d81c9-abb4-438a-b4d2-f4a71e827dfa tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:33:46.115684 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-9b0d81c9-abb4-438a-b4d2-f4a71e827dfa tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.087482 Jun 17 15:33:46.116276 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1079/1740] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:33:46 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:33:46.903575 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-533d7447-b73d-44d6-b0bc-6f73570ed2a1 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:33:46.904621 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-533d7447-b73d-44d6-b0bc-6f73570ed2a1 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:33:46.911522 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-533d7447-b73d-44d6-b0bc-6f73570ed2a1 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:46.911967 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-533d7447-b73d-44d6-b0bc-6f73570ed2a1 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:46.912784 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-533d7447-b73d-44d6-b0bc-6f73570ed2a1 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:46.913220 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-533d7447-b73d-44d6-b0bc-6f73570ed2a1 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:46.945417 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-533d7447-b73d-44d6-b0bc-6f73570ed2a1 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045820 Jun 17 15:33:46.946008 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 662/1741] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:33:46 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:33:47.133507 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-80203a55-b820-4e6f-a506-1b33a33aa1ed tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:33:47.134242 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-80203a55-b820-4e6f-a506-1b33a33aa1ed tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:33:47.142600 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-80203a55-b820-4e6f-a506-1b33a33aa1ed tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:47.143042 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-80203a55-b820-4e6f-a506-1b33a33aa1ed tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:47.143820 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-80203a55-b820-4e6f-a506-1b33a33aa1ed tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:47.144249 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-80203a55-b820-4e6f-a506-1b33a33aa1ed tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:47.210119 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-80203a55-b820-4e6f-a506-1b33a33aa1ed tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:33:47.218206 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-80203a55-b820-4e6f-a506-1b33a33aa1ed tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.088632 Jun 17 15:33:47.218859 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1080/1742] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:33:47 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:33:47.958390 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-6fa47fd5-91ad-4cab-bd96-1495ea911d5a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:33:47.959389 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-6fa47fd5-91ad-4cab-bd96-1495ea911d5a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:33:47.966612 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6fa47fd5-91ad-4cab-bd96-1495ea911d5a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:47.967062 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6fa47fd5-91ad-4cab-bd96-1495ea911d5a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:47.967850 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6fa47fd5-91ad-4cab-bd96-1495ea911d5a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:47.968289 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6fa47fd5-91ad-4cab-bd96-1495ea911d5a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:48.002264 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-6fa47fd5-91ad-4cab-bd96-1495ea911d5a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047930 Jun 17 15:33:48.002867 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 663/1743] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:33:47 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:33:48.240127 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-35e09f73-2c38-4f30-8bfc-70005babfbb0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:33:48.241172 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-35e09f73-2c38-4f30-8bfc-70005babfbb0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:33:48.252735 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-35e09f73-2c38-4f30-8bfc-70005babfbb0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:48.253521 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-35e09f73-2c38-4f30-8bfc-70005babfbb0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:48.254916 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-35e09f73-2c38-4f30-8bfc-70005babfbb0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:48.255678 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-35e09f73-2c38-4f30-8bfc-70005babfbb0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:48.335720 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-35e09f73-2c38-4f30-8bfc-70005babfbb0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:33:48.345130 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-35e09f73-2c38-4f30-8bfc-70005babfbb0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.112185 Jun 17 15:33:48.345725 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1081/1744] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:33:48 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:33:49.014945 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-20eec67f-1743-4977-8658-88efe69f5d51 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:33:49.015838 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-20eec67f-1743-4977-8658-88efe69f5d51 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:33:49.023115 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-20eec67f-1743-4977-8658-88efe69f5d51 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:49.023607 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-20eec67f-1743-4977-8658-88efe69f5d51 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:49.024532 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-20eec67f-1743-4977-8658-88efe69f5d51 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:49.025010 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-20eec67f-1743-4977-8658-88efe69f5d51 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:49.059997 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-20eec67f-1743-4977-8658-88efe69f5d51 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049907 Jun 17 15:33:49.060730 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 664/1745] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:33:49 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:33:49.362465 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-8dee00e8-6ea9-4d82-9234-0fc4fcd90fa9 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:33:49.363221 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-8dee00e8-6ea9-4d82-9234-0fc4fcd90fa9 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:33:49.370572 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8dee00e8-6ea9-4d82-9234-0fc4fcd90fa9 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:49.371081 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8dee00e8-6ea9-4d82-9234-0fc4fcd90fa9 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:49.372131 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8dee00e8-6ea9-4d82-9234-0fc4fcd90fa9 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:49.372807 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8dee00e8-6ea9-4d82-9234-0fc4fcd90fa9 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:49.446928 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-8dee00e8-6ea9-4d82-9234-0fc4fcd90fa9 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:33:49.455766 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-8dee00e8-6ea9-4d82-9234-0fc4fcd90fa9 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.097158 Jun 17 15:33:49.456344 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1082/1746] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:33:49 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:33:50.073481 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-608ae12b-3b99-4fe1-b8e3-8580c703d4b3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:33:50.075459 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-608ae12b-3b99-4fe1-b8e3-8580c703d4b3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:33:50.083841 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-608ae12b-3b99-4fe1-b8e3-8580c703d4b3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:50.084433 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-608ae12b-3b99-4fe1-b8e3-8580c703d4b3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:50.085484 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-608ae12b-3b99-4fe1-b8e3-8580c703d4b3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:50.086001 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-608ae12b-3b99-4fe1-b8e3-8580c703d4b3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:50.123677 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-608ae12b-3b99-4fe1-b8e3-8580c703d4b3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056070 Jun 17 15:33:50.124512 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 665/1747] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:33:50 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:33:50.476227 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-ac395c45-cd00-489c-9e23-bf4e90e50409 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:33:50.477297 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-ac395c45-cd00-489c-9e23-bf4e90e50409 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:33:50.487495 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ac395c45-cd00-489c-9e23-bf4e90e50409 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:50.488213 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ac395c45-cd00-489c-9e23-bf4e90e50409 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:50.489597 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ac395c45-cd00-489c-9e23-bf4e90e50409 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:50.490333 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ac395c45-cd00-489c-9e23-bf4e90e50409 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:50.579836 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-ac395c45-cd00-489c-9e23-bf4e90e50409 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:33:50.588052 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-ac395c45-cd00-489c-9e23-bf4e90e50409 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.116299 Jun 17 15:33:50.588721 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1083/1748] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:33:50 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:33:51.137964 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-dbae91a1-cd5f-4d2b-b8c7-f70e5b68ca8b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:33:51.138990 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-dbae91a1-cd5f-4d2b-b8c7-f70e5b68ca8b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:33:51.146635 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-dbae91a1-cd5f-4d2b-b8c7-f70e5b68ca8b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:51.147078 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-dbae91a1-cd5f-4d2b-b8c7-f70e5b68ca8b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:51.147853 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-dbae91a1-cd5f-4d2b-b8c7-f70e5b68ca8b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:51.148283 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-dbae91a1-cd5f-4d2b-b8c7-f70e5b68ca8b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:51.209870 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-dbae91a1-cd5f-4d2b-b8c7-f70e5b68ca8b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077434 Jun 17 15:33:51.210915 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 666/1749] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:33:51 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:33:51.615441 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-484342db-bf5a-4c4b-902a-91ce62075304 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:33:51.616558 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-484342db-bf5a-4c4b-902a-91ce62075304 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:33:51.628611 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-484342db-bf5a-4c4b-902a-91ce62075304 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:51.629305 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-484342db-bf5a-4c4b-902a-91ce62075304 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:51.630635 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-484342db-bf5a-4c4b-902a-91ce62075304 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:51.631389 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-484342db-bf5a-4c4b-902a-91ce62075304 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:51.703467 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-484342db-bf5a-4c4b-902a-91ce62075304 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:33:51.712959 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-484342db-bf5a-4c4b-902a-91ce62075304 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.104560 Jun 17 15:33:51.713892 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1084/1750] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:33:51 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:33:52.222893 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-3483b3ac-61e9-4aee-9344-1c36187b3070 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:33:52.224169 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-3483b3ac-61e9-4aee-9344-1c36187b3070 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:33:52.231645 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3483b3ac-61e9-4aee-9344-1c36187b3070 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:52.232139 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3483b3ac-61e9-4aee-9344-1c36187b3070 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:52.233021 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3483b3ac-61e9-4aee-9344-1c36187b3070 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:52.233590 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3483b3ac-61e9-4aee-9344-1c36187b3070 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:52.268750 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-3483b3ac-61e9-4aee-9344-1c36187b3070 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050019 Jun 17 15:33:52.269334 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 667/1751] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:33:52 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:33:52.732020 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-a00a7114-a2b0-4334-b374-f786873ad972 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:33:52.732779 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-a00a7114-a2b0-4334-b374-f786873ad972 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:33:52.740069 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a00a7114-a2b0-4334-b374-f786873ad972 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:52.740547 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a00a7114-a2b0-4334-b374-f786873ad972 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:52.741327 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a00a7114-a2b0-4334-b374-f786873ad972 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:52.741754 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a00a7114-a2b0-4334-b374-f786873ad972 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:52.817204 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-a00a7114-a2b0-4334-b374-f786873ad972 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:33:52.825777 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-a00a7114-a2b0-4334-b374-f786873ad972 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.098435 Jun 17 15:33:52.826368 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1085/1752] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:33:52 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:33:53.281546 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-749ce3c8-0e59-4145-b236-75da49091af4 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:33:53.282535 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-749ce3c8-0e59-4145-b236-75da49091af4 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:33:53.290062 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-749ce3c8-0e59-4145-b236-75da49091af4 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:53.290593 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-749ce3c8-0e59-4145-b236-75da49091af4 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:53.291484 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-749ce3c8-0e59-4145-b236-75da49091af4 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:53.291976 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-749ce3c8-0e59-4145-b236-75da49091af4 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:53.327607 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-749ce3c8-0e59-4145-b236-75da49091af4 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050377 Jun 17 15:33:53.328342 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 668/1753] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:33:53 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:33:53.843615 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-d82dfb18-5bc2-455e-a09b-414cd725059c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:33:53.844592 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-d82dfb18-5bc2-455e-a09b-414cd725059c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:33:53.851427 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d82dfb18-5bc2-455e-a09b-414cd725059c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:53.851915 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d82dfb18-5bc2-455e-a09b-414cd725059c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:53.852765 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d82dfb18-5bc2-455e-a09b-414cd725059c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:53.853235 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d82dfb18-5bc2-455e-a09b-414cd725059c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:53.923716 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-d82dfb18-5bc2-455e-a09b-414cd725059c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:33:53.927929 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=100 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:33:53.933687 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-d82dfb18-5bc2-455e-a09b-414cd725059c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.094557 Jun 17 15:33:53.934290 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1086/1754] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:33:53 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:33:54.340156 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-9cf06be2-3ef9-448f-b5ab-41e84f4166a1 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:33:54.341196 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-9cf06be2-3ef9-448f-b5ab-41e84f4166a1 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:33:54.348961 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9cf06be2-3ef9-448f-b5ab-41e84f4166a1 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:54.349430 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9cf06be2-3ef9-448f-b5ab-41e84f4166a1 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:54.350204 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9cf06be2-3ef9-448f-b5ab-41e84f4166a1 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:54.350636 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9cf06be2-3ef9-448f-b5ab-41e84f4166a1 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:54.385429 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-9cf06be2-3ef9-448f-b5ab-41e84f4166a1 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049478 Jun 17 15:33:54.385996 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 669/1755] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:33:54 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:33:54.951962 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-df486ee7-0858-497f-aa68-316900b31dc1 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:33:54.952891 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-df486ee7-0858-497f-aa68-316900b31dc1 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:33:54.960082 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-df486ee7-0858-497f-aa68-316900b31dc1 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:54.960562 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-df486ee7-0858-497f-aa68-316900b31dc1 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:54.961338 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-df486ee7-0858-497f-aa68-316900b31dc1 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:54.961780 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-df486ee7-0858-497f-aa68-316900b31dc1 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:55.031285 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-df486ee7-0858-497f-aa68-316900b31dc1 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:33:55.039784 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-df486ee7-0858-497f-aa68-316900b31dc1 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.092193 Jun 17 15:33:55.040613 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1087/1756] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:33:54 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:33:55.397687 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-b1a7b3ec-8568-4ddb-bfb9-6e7cc9b8b439 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:33:55.398610 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-b1a7b3ec-8568-4ddb-bfb9-6e7cc9b8b439 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:33:55.406154 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b1a7b3ec-8568-4ddb-bfb9-6e7cc9b8b439 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:55.406601 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b1a7b3ec-8568-4ddb-bfb9-6e7cc9b8b439 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:55.407376 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b1a7b3ec-8568-4ddb-bfb9-6e7cc9b8b439 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:55.407811 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b1a7b3ec-8568-4ddb-bfb9-6e7cc9b8b439 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:55.440654 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-b1a7b3ec-8568-4ddb-bfb9-6e7cc9b8b439 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047002 Jun 17 15:33:55.441258 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 670/1757] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:33:55 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:33:56.057843 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-ba5644de-ed05-4bd9-b0be-b710f9d7db5a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:33:56.058510 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-ba5644de-ed05-4bd9-b0be-b710f9d7db5a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:33:56.065211 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ba5644de-ed05-4bd9-b0be-b710f9d7db5a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:56.065666 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ba5644de-ed05-4bd9-b0be-b710f9d7db5a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:56.066453 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ba5644de-ed05-4bd9-b0be-b710f9d7db5a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:56.066894 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ba5644de-ed05-4bd9-b0be-b710f9d7db5a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:56.153990 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-ba5644de-ed05-4bd9-b0be-b710f9d7db5a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:33:56.162025 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-ba5644de-ed05-4bd9-b0be-b710f9d7db5a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.108144 Jun 17 15:33:56.162632 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1088/1758] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:33:56 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:33:56.454304 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-b8e53a8b-d7c9-4f3e-bcb8-d34ae2ca2baf tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:33:56.455328 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-b8e53a8b-d7c9-4f3e-bcb8-d34ae2ca2baf tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:33:56.462488 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b8e53a8b-d7c9-4f3e-bcb8-d34ae2ca2baf tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:56.462935 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b8e53a8b-d7c9-4f3e-bcb8-d34ae2ca2baf tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:56.463726 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b8e53a8b-d7c9-4f3e-bcb8-d34ae2ca2baf tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:56.464165 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b8e53a8b-d7c9-4f3e-bcb8-d34ae2ca2baf tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:56.468601 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell1:SELECT=100 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:33:56.517478 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-b8e53a8b-d7c9-4f3e-bcb8-d34ae2ca2baf tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066894 Jun 17 15:33:56.518499 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 671/1759] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:33:56 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:33:57.178783 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-2f8bb770-08cd-4513-99cf-0f31e3842225 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:33:57.179413 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-2f8bb770-08cd-4513-99cf-0f31e3842225 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:33:57.187490 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2f8bb770-08cd-4513-99cf-0f31e3842225 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:57.188078 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2f8bb770-08cd-4513-99cf-0f31e3842225 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:57.189098 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2f8bb770-08cd-4513-99cf-0f31e3842225 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:57.189576 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2f8bb770-08cd-4513-99cf-0f31e3842225 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:57.255494 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-2f8bb770-08cd-4513-99cf-0f31e3842225 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:33:57.263538 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-2f8bb770-08cd-4513-99cf-0f31e3842225 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.088574 Jun 17 15:33:57.264127 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1089/1760] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:33:57 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:33:57.530605 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-ad4d7675-1888-46a7-bdd2-1eeed99bb884 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:33:57.531540 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-ad4d7675-1888-46a7-bdd2-1eeed99bb884 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:33:57.538788 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ad4d7675-1888-46a7-bdd2-1eeed99bb884 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:57.539283 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ad4d7675-1888-46a7-bdd2-1eeed99bb884 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:57.540123 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ad4d7675-1888-46a7-bdd2-1eeed99bb884 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:57.540656 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ad4d7675-1888-46a7-bdd2-1eeed99bb884 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:57.576139 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-ad4d7675-1888-46a7-bdd2-1eeed99bb884 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050134 Jun 17 15:33:57.576857 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 672/1761] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:33:57 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:33:58.281066 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-e79521ab-f63a-4f9b-956d-1ba4a7b93fbb tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:33:58.281750 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-e79521ab-f63a-4f9b-956d-1ba4a7b93fbb tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:33:58.288723 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e79521ab-f63a-4f9b-956d-1ba4a7b93fbb tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:58.289164 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e79521ab-f63a-4f9b-956d-1ba4a7b93fbb tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:58.289937 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e79521ab-f63a-4f9b-956d-1ba4a7b93fbb tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:58.290362 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e79521ab-f63a-4f9b-956d-1ba4a7b93fbb tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:58.363298 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-e79521ab-f63a-4f9b-956d-1ba4a7b93fbb tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:33:58.371832 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-e79521ab-f63a-4f9b-956d-1ba4a7b93fbb tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.095330 Jun 17 15:33:58.372763 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1090/1762] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:33:58 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:33:58.588878 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-65c6ce2d-69fb-4842-847f-f5477d07d31d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:33:58.590453 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-65c6ce2d-69fb-4842-847f-f5477d07d31d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:33:58.597459 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-65c6ce2d-69fb-4842-847f-f5477d07d31d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:58.597914 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-65c6ce2d-69fb-4842-847f-f5477d07d31d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:58.598955 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-65c6ce2d-69fb-4842-847f-f5477d07d31d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:58.599383 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-65c6ce2d-69fb-4842-847f-f5477d07d31d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:58.632022 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-65c6ce2d-69fb-4842-847f-f5477d07d31d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047304 Jun 17 15:33:58.632777 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 673/1763] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:33:58 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:33:59.391434 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-d42f2cc6-6fd4-4620-a30b-518a595b268c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:33:59.392090 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-d42f2cc6-6fd4-4620-a30b-518a595b268c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:33:59.399421 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d42f2cc6-6fd4-4620-a30b-518a595b268c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:59.399867 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d42f2cc6-6fd4-4620-a30b-518a595b268c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:59.400684 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d42f2cc6-6fd4-4620-a30b-518a595b268c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:59.401116 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d42f2cc6-6fd4-4620-a30b-518a595b268c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:59.472494 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-d42f2cc6-6fd4-4620-a30b-518a595b268c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:33:59.487083 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-d42f2cc6-6fd4-4620-a30b-518a595b268c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.099174 Jun 17 15:33:59.488109 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1091/1764] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:33:59 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:33:59.644551 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-e93c7375-3da7-45b5-9cc5-f17f415dadfa tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:33:59.645421 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-e93c7375-3da7-45b5-9cc5-f17f415dadfa tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:33:59.652667 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e93c7375-3da7-45b5-9cc5-f17f415dadfa tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:59.653113 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e93c7375-3da7-45b5-9cc5-f17f415dadfa tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:59.653891 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e93c7375-3da7-45b5-9cc5-f17f415dadfa tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:33:59.654317 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e93c7375-3da7-45b5-9cc5-f17f415dadfa tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:33:59.687287 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-e93c7375-3da7-45b5-9cc5-f17f415dadfa tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046872 Jun 17 15:33:59.687865 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 674/1765] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:33:59 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:34:00.508863 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-0c9e5324-af71-41f2-9ed5-6796b59bf495 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:34:00.509887 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-0c9e5324-af71-41f2-9ed5-6796b59bf495 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:34:00.522606 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0c9e5324-af71-41f2-9ed5-6796b59bf495 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:00.523427 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0c9e5324-af71-41f2-9ed5-6796b59bf495 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:00.524877 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0c9e5324-af71-41f2-9ed5-6796b59bf495 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:00.525646 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0c9e5324-af71-41f2-9ed5-6796b59bf495 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:00.602549 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-0c9e5324-af71-41f2-9ed5-6796b59bf495 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:34:00.611587 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-0c9e5324-af71-41f2-9ed5-6796b59bf495 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.110059 Jun 17 15:34:00.612180 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1092/1766] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:34:00 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:34:00.702183 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-98fa9bc9-a96d-427b-863a-0b5c5e500256 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:34:00.703399 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-98fa9bc9-a96d-427b-863a-0b5c5e500256 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:34:00.711121 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-98fa9bc9-a96d-427b-863a-0b5c5e500256 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:00.711554 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-98fa9bc9-a96d-427b-863a-0b5c5e500256 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:00.712354 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-98fa9bc9-a96d-427b-863a-0b5c5e500256 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:00.712786 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-98fa9bc9-a96d-427b-863a-0b5c5e500256 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:00.747136 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-98fa9bc9-a96d-427b-863a-0b5c5e500256 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049423 Jun 17 15:34:00.747721 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 675/1767] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:34:00 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:34:01.629623 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-20ae5ed8-1ae8-4b3f-82e0-a98df6e5ba68 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:34:01.630552 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-20ae5ed8-1ae8-4b3f-82e0-a98df6e5ba68 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:34:01.637640 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-20ae5ed8-1ae8-4b3f-82e0-a98df6e5ba68 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:01.638079 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-20ae5ed8-1ae8-4b3f-82e0-a98df6e5ba68 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:01.638850 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-20ae5ed8-1ae8-4b3f-82e0-a98df6e5ba68 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:01.639276 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-20ae5ed8-1ae8-4b3f-82e0-a98df6e5ba68 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:01.707951 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-20ae5ed8-1ae8-4b3f-82e0-a98df6e5ba68 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:34:01.732257 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-20ae5ed8-1ae8-4b3f-82e0-a98df6e5ba68 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.102749 Jun 17 15:34:01.732257 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1093/1768] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:34:01 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:34:01.761090 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-c2b2a1ae-fdf6-4aef-b408-5bb16276d1d1 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:34:01.762105 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-c2b2a1ae-fdf6-4aef-b408-5bb16276d1d1 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:34:01.769596 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c2b2a1ae-fdf6-4aef-b408-5bb16276d1d1 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:01.770098 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c2b2a1ae-fdf6-4aef-b408-5bb16276d1d1 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:01.770894 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c2b2a1ae-fdf6-4aef-b408-5bb16276d1d1 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:01.771332 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c2b2a1ae-fdf6-4aef-b408-5bb16276d1d1 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:01.814790 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-c2b2a1ae-fdf6-4aef-b408-5bb16276d1d1 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057879 Jun 17 15:34:01.815473 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 676/1769] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:34:01 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:34:02.753709 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-511b204e-12de-409f-aea0-ad63d3089a17 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:34:02.754344 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-511b204e-12de-409f-aea0-ad63d3089a17 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:34:02.762169 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-511b204e-12de-409f-aea0-ad63d3089a17 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:02.762624 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-511b204e-12de-409f-aea0-ad63d3089a17 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:02.763415 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-511b204e-12de-409f-aea0-ad63d3089a17 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:02.764134 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-511b204e-12de-409f-aea0-ad63d3089a17 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:02.829040 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-dcf8d621-0047-4b89-a1d6-2645a6b6222c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:34:02.830901 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-dcf8d621-0047-4b89-a1d6-2645a6b6222c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:34:02.838072 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-511b204e-12de-409f-aea0-ad63d3089a17 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:34:02.841828 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-dcf8d621-0047-4b89-a1d6-2645a6b6222c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:02.842578 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-dcf8d621-0047-4b89-a1d6-2645a6b6222c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:02.843916 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-dcf8d621-0047-4b89-a1d6-2645a6b6222c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:02.844550 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-dcf8d621-0047-4b89-a1d6-2645a6b6222c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:02.852260 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-511b204e-12de-409f-aea0-ad63d3089a17 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.102486 Jun 17 15:34:02.853028 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1094/1770] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:34:02 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:34:02.888747 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-dcf8d621-0047-4b89-a1d6-2645a6b6222c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065448 Jun 17 15:34:02.889323 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 677/1771] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:34:02 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:34:03.877341 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-61c24540-08e3-43f5-b5d1-432544112e07 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:34:03.878056 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-61c24540-08e3-43f5-b5d1-432544112e07 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:34:03.885502 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-61c24540-08e3-43f5-b5d1-432544112e07 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:03.885946 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-61c24540-08e3-43f5-b5d1-432544112e07 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:03.887220 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-61c24540-08e3-43f5-b5d1-432544112e07 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:03.887647 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-61c24540-08e3-43f5-b5d1-432544112e07 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:03.900971 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-c1ad9343-5ace-427b-91e6-7f7ed4372180 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:34:03.902478 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-c1ad9343-5ace-427b-91e6-7f7ed4372180 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:34:03.909502 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c1ad9343-5ace-427b-91e6-7f7ed4372180 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:03.909947 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c1ad9343-5ace-427b-91e6-7f7ed4372180 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:03.910727 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c1ad9343-5ace-427b-91e6-7f7ed4372180 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:03.911158 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c1ad9343-5ace-427b-91e6-7f7ed4372180 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:03.956678 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-c1ad9343-5ace-427b-91e6-7f7ed4372180 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059206 Jun 17 15:34:03.957739 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 678/1772] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:34:03 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:34:03.977822 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-61c24540-08e3-43f5-b5d1-432544112e07 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:34:03.992354 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-61c24540-08e3-43f5-b5d1-432544112e07 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.118584 Jun 17 15:34:03.993424 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1095/1773] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:34:03 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:34:04.970082 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-c3841180-2e95-4ad6-ab75-fb5cb993bf17 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:34:04.971474 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-c3841180-2e95-4ad6-ab75-fb5cb993bf17 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:34:04.979141 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c3841180-2e95-4ad6-ab75-fb5cb993bf17 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:04.979588 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c3841180-2e95-4ad6-ab75-fb5cb993bf17 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:04.980965 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c3841180-2e95-4ad6-ab75-fb5cb993bf17 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:04.981399 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c3841180-2e95-4ad6-ab75-fb5cb993bf17 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:05.014105 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-c3841180-2e95-4ad6-ab75-fb5cb993bf17 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047924 Jun 17 15:34:05.014705 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 679/1774] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:34:04 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:34:05.022546 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-c02c502f-b9d3-4877-9b53-4e8209cdff59 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:34:05.023352 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-c02c502f-b9d3-4877-9b53-4e8209cdff59 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:34:05.031328 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c02c502f-b9d3-4877-9b53-4e8209cdff59 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:05.031779 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c02c502f-b9d3-4877-9b53-4e8209cdff59 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:05.032604 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c02c502f-b9d3-4877-9b53-4e8209cdff59 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:05.033038 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c02c502f-b9d3-4877-9b53-4e8209cdff59 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:05.102268 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-c02c502f-b9d3-4877-9b53-4e8209cdff59 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:34:05.110935 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-c02c502f-b9d3-4877-9b53-4e8209cdff59 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.095148 Jun 17 15:34:05.111526 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1096/1775] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:34:05 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:34:06.028408 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-70dede9c-a704-4b89-959e-2dfe739b1868 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:34:06.029367 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-70dede9c-a704-4b89-959e-2dfe739b1868 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:34:06.036227 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-70dede9c-a704-4b89-959e-2dfe739b1868 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:06.036721 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-70dede9c-a704-4b89-959e-2dfe739b1868 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:06.037552 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-70dede9c-a704-4b89-959e-2dfe739b1868 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:06.037994 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-70dede9c-a704-4b89-959e-2dfe739b1868 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:06.070018 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-70dede9c-a704-4b89-959e-2dfe739b1868 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046235 Jun 17 15:34:06.070612 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 680/1776] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:34:06 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:34:06.127936 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-b14748b1-e1cf-4a80-a3a6-e795bcc0619b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:34:06.128598 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-b14748b1-e1cf-4a80-a3a6-e795bcc0619b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:34:06.136390 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b14748b1-e1cf-4a80-a3a6-e795bcc0619b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:06.137000 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b14748b1-e1cf-4a80-a3a6-e795bcc0619b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:06.137804 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b14748b1-e1cf-4a80-a3a6-e795bcc0619b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:06.138247 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b14748b1-e1cf-4a80-a3a6-e795bcc0619b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:06.224661 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-b14748b1-e1cf-4a80-a3a6-e795bcc0619b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:34:06.233170 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-b14748b1-e1cf-4a80-a3a6-e795bcc0619b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.109557 Jun 17 15:34:06.233779 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1097/1777] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:34:06 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:34:07.084658 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-f63080ed-88f8-4d6d-b74f-e74e6d53d674 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:34:07.085606 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-f63080ed-88f8-4d6d-b74f-e74e6d53d674 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:34:07.093379 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f63080ed-88f8-4d6d-b74f-e74e6d53d674 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:07.093830 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f63080ed-88f8-4d6d-b74f-e74e6d53d674 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:07.094623 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f63080ed-88f8-4d6d-b74f-e74e6d53d674 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:07.095059 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f63080ed-88f8-4d6d-b74f-e74e6d53d674 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:07.129260 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-f63080ed-88f8-4d6d-b74f-e74e6d53d674 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048656 Jun 17 15:34:07.129855 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 681/1778] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:34:07 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:34:07.250697 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-a3703b11-eae0-4e39-b601-e7be5a5c038a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:34:07.251569 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-a3703b11-eae0-4e39-b601-e7be5a5c038a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:34:07.258388 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a3703b11-eae0-4e39-b601-e7be5a5c038a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:07.258835 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a3703b11-eae0-4e39-b601-e7be5a5c038a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:07.259625 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a3703b11-eae0-4e39-b601-e7be5a5c038a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:07.260078 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a3703b11-eae0-4e39-b601-e7be5a5c038a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:07.337549 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-a3703b11-eae0-4e39-b601-e7be5a5c038a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:34:07.351148 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-a3703b11-eae0-4e39-b601-e7be5a5c038a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.104064 Jun 17 15:34:07.352151 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1098/1779] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:34:07 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:34:08.142505 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-609e4849-6f1a-4cc6-8483-26f3fc7b2749 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:34:08.143458 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-609e4849-6f1a-4cc6-8483-26f3fc7b2749 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:34:08.150466 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-609e4849-6f1a-4cc6-8483-26f3fc7b2749 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:08.150932 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-609e4849-6f1a-4cc6-8483-26f3fc7b2749 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:08.152265 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-609e4849-6f1a-4cc6-8483-26f3fc7b2749 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:08.152738 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-609e4849-6f1a-4cc6-8483-26f3fc7b2749 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:08.185896 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-609e4849-6f1a-4cc6-8483-26f3fc7b2749 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047643 Jun 17 15:34:08.186477 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 682/1780] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:34:08 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:34:08.369834 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-96e9d586-63bc-4e69-b4d2-8fec3698899a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:34:08.371085 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-96e9d586-63bc-4e69-b4d2-8fec3698899a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:34:08.374623 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_api:SELECT=54 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:34:08.383090 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-96e9d586-63bc-4e69-b4d2-8fec3698899a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:08.383586 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-96e9d586-63bc-4e69-b4d2-8fec3698899a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:08.384467 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-96e9d586-63bc-4e69-b4d2-8fec3698899a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:08.384958 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-96e9d586-63bc-4e69-b4d2-8fec3698899a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:08.454556 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-96e9d586-63bc-4e69-b4d2-8fec3698899a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:34:08.462957 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-96e9d586-63bc-4e69-b4d2-8fec3698899a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.097490 Jun 17 15:34:08.463807 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1099/1781] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:34:08 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:34:09.199546 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-45e47cae-4ea1-4cd3-912e-85607e945c4b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:34:09.200948 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-45e47cae-4ea1-4cd3-912e-85607e945c4b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:34:09.204006 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_api:SELECT=58 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:34:09.211001 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-45e47cae-4ea1-4cd3-912e-85607e945c4b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:09.211447 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-45e47cae-4ea1-4cd3-912e-85607e945c4b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:09.212236 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-45e47cae-4ea1-4cd3-912e-85607e945c4b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:09.212709 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-45e47cae-4ea1-4cd3-912e-85607e945c4b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:09.246193 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-45e47cae-4ea1-4cd3-912e-85607e945c4b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051193 Jun 17 15:34:09.246803 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 683/1782] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:34:09 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:34:09.480799 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-11e87bd2-499b-450a-ad4a-52487fe4c051 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:34:09.481417 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-11e87bd2-499b-450a-ad4a-52487fe4c051 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:34:09.488726 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-11e87bd2-499b-450a-ad4a-52487fe4c051 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:09.489176 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-11e87bd2-499b-450a-ad4a-52487fe4c051 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:09.489959 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-11e87bd2-499b-450a-ad4a-52487fe4c051 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:09.490399 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-11e87bd2-499b-450a-ad4a-52487fe4c051 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:09.560627 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-11e87bd2-499b-450a-ad4a-52487fe4c051 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:34:09.569412 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-11e87bd2-499b-450a-ad4a-52487fe4c051 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.092558 Jun 17 15:34:09.570028 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1100/1783] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:34:09 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:34:10.258283 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-eae7caf4-153e-428d-b305-3204d00373e6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:34:10.259237 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-eae7caf4-153e-428d-b305-3204d00373e6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:34:10.267482 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-eae7caf4-153e-428d-b305-3204d00373e6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:10.268111 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-eae7caf4-153e-428d-b305-3204d00373e6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:10.269084 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-eae7caf4-153e-428d-b305-3204d00373e6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:10.269531 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-eae7caf4-153e-428d-b305-3204d00373e6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:10.306075 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-eae7caf4-153e-428d-b305-3204d00373e6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051745 Jun 17 15:34:10.306753 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 684/1784] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:34:10 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:34:10.587085 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-38c18057-936f-448f-9ece-ca8a57cff5d0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:34:10.587833 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-38c18057-936f-448f-9ece-ca8a57cff5d0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:34:10.595304 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-38c18057-936f-448f-9ece-ca8a57cff5d0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:10.595755 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-38c18057-936f-448f-9ece-ca8a57cff5d0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:10.596577 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-38c18057-936f-448f-9ece-ca8a57cff5d0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:10.597017 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-38c18057-936f-448f-9ece-ca8a57cff5d0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:10.666694 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-38c18057-936f-448f-9ece-ca8a57cff5d0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:34:10.675389 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-38c18057-936f-448f-9ece-ca8a57cff5d0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.092310 Jun 17 15:34:10.675983 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1101/1785] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:34:10 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:34:11.319281 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-7d35b6b7-7377-4dc7-b669-1ae575751f29 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:34:11.320411 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-7d35b6b7-7377-4dc7-b669-1ae575751f29 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:34:11.327645 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7d35b6b7-7377-4dc7-b669-1ae575751f29 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:11.328102 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7d35b6b7-7377-4dc7-b669-1ae575751f29 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:11.328941 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7d35b6b7-7377-4dc7-b669-1ae575751f29 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:11.329382 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7d35b6b7-7377-4dc7-b669-1ae575751f29 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:11.364189 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-7d35b6b7-7377-4dc7-b669-1ae575751f29 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049282 Jun 17 15:34:11.364803 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 685/1786] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:34:11 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:34:11.695570 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-48b067c7-9a4d-48da-ba42-16dc27b842e0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:34:11.696230 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-48b067c7-9a4d-48da-ba42-16dc27b842e0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:34:11.704020 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-48b067c7-9a4d-48da-ba42-16dc27b842e0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:11.704515 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-48b067c7-9a4d-48da-ba42-16dc27b842e0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:11.705318 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-48b067c7-9a4d-48da-ba42-16dc27b842e0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:11.705756 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-48b067c7-9a4d-48da-ba42-16dc27b842e0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:11.779784 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-48b067c7-9a4d-48da-ba42-16dc27b842e0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:34:11.788258 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-48b067c7-9a4d-48da-ba42-16dc27b842e0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.096661 Jun 17 15:34:11.788949 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1102/1787] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:34:11 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:34:12.378015 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-5bbba6ed-e5bb-4dbd-9215-761482222372 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:34:12.379659 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-5bbba6ed-e5bb-4dbd-9215-761482222372 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:34:12.388211 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5bbba6ed-e5bb-4dbd-9215-761482222372 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:12.388868 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5bbba6ed-e5bb-4dbd-9215-761482222372 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:12.389845 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5bbba6ed-e5bb-4dbd-9215-761482222372 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:12.390386 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5bbba6ed-e5bb-4dbd-9215-761482222372 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:12.434800 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-5bbba6ed-e5bb-4dbd-9215-761482222372 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062028 Jun 17 15:34:12.435418 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 686/1788] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:34:12 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:34:12.806711 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-18381a32-fe23-4dbe-8fc8-e4ee346bbe8b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:34:12.807437 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-18381a32-fe23-4dbe-8fc8-e4ee346bbe8b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:34:12.815178 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-18381a32-fe23-4dbe-8fc8-e4ee346bbe8b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:12.815628 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-18381a32-fe23-4dbe-8fc8-e4ee346bbe8b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:12.816441 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-18381a32-fe23-4dbe-8fc8-e4ee346bbe8b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:12.816885 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-18381a32-fe23-4dbe-8fc8-e4ee346bbe8b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:12.840157 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=100 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:34:12.888678 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-18381a32-fe23-4dbe-8fc8-e4ee346bbe8b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:34:12.897362 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-18381a32-fe23-4dbe-8fc8-e4ee346bbe8b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.094619 Jun 17 15:34:12.898153 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1103/1789] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:34:12 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:34:13.452127 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-f486ee0e-89e6-4618-b6f8-a84852c14e33 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:34:13.453775 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-f486ee0e-89e6-4618-b6f8-a84852c14e33 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:34:13.465805 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f486ee0e-89e6-4618-b6f8-a84852c14e33 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:13.466575 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f486ee0e-89e6-4618-b6f8-a84852c14e33 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:13.468049 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f486ee0e-89e6-4618-b6f8-a84852c14e33 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:13.469129 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f486ee0e-89e6-4618-b6f8-a84852c14e33 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:13.515232 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell1:SELECT=100 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:34:13.524491 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-f486ee0e-89e6-4618-b6f8-a84852c14e33 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079592 Jun 17 15:34:13.525381 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 687/1790] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:34:13 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:34:13.915893 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-9342aec0-7a9c-4d8a-9b30-af40a0a83e90 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:34:13.916681 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-9342aec0-7a9c-4d8a-9b30-af40a0a83e90 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:34:13.923743 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9342aec0-7a9c-4d8a-9b30-af40a0a83e90 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:13.924456 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9342aec0-7a9c-4d8a-9b30-af40a0a83e90 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:13.925231 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9342aec0-7a9c-4d8a-9b30-af40a0a83e90 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:13.925700 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9342aec0-7a9c-4d8a-9b30-af40a0a83e90 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:14.010103 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-9342aec0-7a9c-4d8a-9b30-af40a0a83e90 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:34:14.019135 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-9342aec0-7a9c-4d8a-9b30-af40a0a83e90 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.107937 Jun 17 15:34:14.019831 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1104/1791] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:34:13 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:34:14.539133 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-5f15ebcc-8554-4bd7-aeab-c5fce6fda61d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:34:14.540592 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-5f15ebcc-8554-4bd7-aeab-c5fce6fda61d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:34:14.548310 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5f15ebcc-8554-4bd7-aeab-c5fce6fda61d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:14.548803 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5f15ebcc-8554-4bd7-aeab-c5fce6fda61d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:14.549610 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5f15ebcc-8554-4bd7-aeab-c5fce6fda61d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:14.550054 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5f15ebcc-8554-4bd7-aeab-c5fce6fda61d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:14.585310 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-5f15ebcc-8554-4bd7-aeab-c5fce6fda61d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050513 Jun 17 15:34:14.585894 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 688/1792] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:34:14 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:34:15.035439 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-c9bc7737-a3b2-4b5c-9fef-87e9cf14ac81 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:34:15.036115 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-c9bc7737-a3b2-4b5c-9fef-87e9cf14ac81 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:34:15.044138 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c9bc7737-a3b2-4b5c-9fef-87e9cf14ac81 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:15.044623 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c9bc7737-a3b2-4b5c-9fef-87e9cf14ac81 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:15.045525 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c9bc7737-a3b2-4b5c-9fef-87e9cf14ac81 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:15.046205 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c9bc7737-a3b2-4b5c-9fef-87e9cf14ac81 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:15.114654 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-c9bc7737-a3b2-4b5c-9fef-87e9cf14ac81 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:34:15.123361 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-c9bc7737-a3b2-4b5c-9fef-87e9cf14ac81 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.091840 Jun 17 15:34:15.124543 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1105/1793] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:34:15 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:34:15.597441 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-ddc9e6ce-181a-45f8-b83b-8affb2b94bae tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:34:15.598688 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-ddc9e6ce-181a-45f8-b83b-8affb2b94bae tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:34:15.606240 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ddc9e6ce-181a-45f8-b83b-8affb2b94bae tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:15.606854 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ddc9e6ce-181a-45f8-b83b-8affb2b94bae tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:15.607903 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ddc9e6ce-181a-45f8-b83b-8affb2b94bae tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:15.608543 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ddc9e6ce-181a-45f8-b83b-8affb2b94bae tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:15.643593 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-ddc9e6ce-181a-45f8-b83b-8affb2b94bae tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050283 Jun 17 15:34:15.644094 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 689/1794] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:34:15 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:34:16.146753 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-c3255dbb-5ef7-44e2-aba1-3a0d36636c06 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:34:16.147593 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-c3255dbb-5ef7-44e2-aba1-3a0d36636c06 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:34:16.154847 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c3255dbb-5ef7-44e2-aba1-3a0d36636c06 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:16.155481 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c3255dbb-5ef7-44e2-aba1-3a0d36636c06 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:16.156317 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c3255dbb-5ef7-44e2-aba1-3a0d36636c06 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:16.156832 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c3255dbb-5ef7-44e2-aba1-3a0d36636c06 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:16.228291 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-c3255dbb-5ef7-44e2-aba1-3a0d36636c06 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:34:16.236685 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-c3255dbb-5ef7-44e2-aba1-3a0d36636c06 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.093855 Jun 17 15:34:16.237276 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1106/1795] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:34:16 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:34:16.658240 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-94e80279-8a92-4904-aa33-0477f5f9d545 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:34:16.659298 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-94e80279-8a92-4904-aa33-0477f5f9d545 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:34:16.666774 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-94e80279-8a92-4904-aa33-0477f5f9d545 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:16.667811 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-94e80279-8a92-4904-aa33-0477f5f9d545 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:16.668750 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-94e80279-8a92-4904-aa33-0477f5f9d545 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:16.669235 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-94e80279-8a92-4904-aa33-0477f5f9d545 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:16.704165 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-94e80279-8a92-4904-aa33-0477f5f9d545 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050005 Jun 17 15:34:16.704729 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 690/1796] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:34:16 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:34:17.254697 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-8922aff6-15b9-4bc8-8fff-a3ece0ac911a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:34:17.255334 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-8922aff6-15b9-4bc8-8fff-a3ece0ac911a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:34:17.263156 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8922aff6-15b9-4bc8-8fff-a3ece0ac911a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:17.263682 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8922aff6-15b9-4bc8-8fff-a3ece0ac911a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:17.264576 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8922aff6-15b9-4bc8-8fff-a3ece0ac911a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:17.265057 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8922aff6-15b9-4bc8-8fff-a3ece0ac911a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:17.332749 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-8922aff6-15b9-4bc8-8fff-a3ece0ac911a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:34:17.341810 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-8922aff6-15b9-4bc8-8fff-a3ece0ac911a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.091057 Jun 17 15:34:17.342505 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1107/1797] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:34:17 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:34:17.716318 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-4ecba6c1-c8e3-4796-83a0-f8e0300ad6f2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:34:17.717313 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-4ecba6c1-c8e3-4796-83a0-f8e0300ad6f2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:34:17.725170 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4ecba6c1-c8e3-4796-83a0-f8e0300ad6f2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:17.725643 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4ecba6c1-c8e3-4796-83a0-f8e0300ad6f2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:17.726438 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4ecba6c1-c8e3-4796-83a0-f8e0300ad6f2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:17.727137 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4ecba6c1-c8e3-4796-83a0-f8e0300ad6f2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:17.759944 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-4ecba6c1-c8e3-4796-83a0-f8e0300ad6f2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047649 Jun 17 15:34:17.760549 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 691/1798] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:34:17 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:34:18.366311 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-9efb0258-8ea4-4eea-87e3-b25a4b682c12 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:34:18.366980 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-9efb0258-8ea4-4eea-87e3-b25a4b682c12 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:34:18.374059 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9efb0258-8ea4-4eea-87e3-b25a4b682c12 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:18.374517 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9efb0258-8ea4-4eea-87e3-b25a4b682c12 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:18.375301 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9efb0258-8ea4-4eea-87e3-b25a4b682c12 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:18.375737 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9efb0258-8ea4-4eea-87e3-b25a4b682c12 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:18.443174 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-9efb0258-8ea4-4eea-87e3-b25a4b682c12 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:34:18.451806 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-9efb0258-8ea4-4eea-87e3-b25a4b682c12 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.089492 Jun 17 15:34:18.452461 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1108/1799] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:34:18 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:34:18.771971 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-50f7dd93-8f35-4d47-8a44-fa884d79b0fa tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:34:18.772978 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-50f7dd93-8f35-4d47-8a44-fa884d79b0fa tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:34:18.781381 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-50f7dd93-8f35-4d47-8a44-fa884d79b0fa tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:18.781831 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-50f7dd93-8f35-4d47-8a44-fa884d79b0fa tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:18.782622 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-50f7dd93-8f35-4d47-8a44-fa884d79b0fa tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:18.783063 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-50f7dd93-8f35-4d47-8a44-fa884d79b0fa tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:18.819105 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-50f7dd93-8f35-4d47-8a44-fa884d79b0fa tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049926 Jun 17 15:34:18.819740 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 692/1800] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:34:18 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:34:19.470068 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-9eeba3a6-d471-4031-a06b-ea38aae45582 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:34:19.470695 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-9eeba3a6-d471-4031-a06b-ea38aae45582 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:34:19.477980 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9eeba3a6-d471-4031-a06b-ea38aae45582 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:19.478436 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9eeba3a6-d471-4031-a06b-ea38aae45582 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:19.479330 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9eeba3a6-d471-4031-a06b-ea38aae45582 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:19.480144 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9eeba3a6-d471-4031-a06b-ea38aae45582 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:19.548035 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-9eeba3a6-d471-4031-a06b-ea38aae45582 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:34:19.557316 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-9eeba3a6-d471-4031-a06b-ea38aae45582 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.091059 Jun 17 15:34:19.558543 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1109/1801] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:34:19 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:34:19.831466 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-2dbff03b-72b2-4296-aaed-fcb28a7a9b9b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:34:19.832728 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-2dbff03b-72b2-4296-aaed-fcb28a7a9b9b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:34:19.840658 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2dbff03b-72b2-4296-aaed-fcb28a7a9b9b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:19.841277 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2dbff03b-72b2-4296-aaed-fcb28a7a9b9b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:19.842142 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2dbff03b-72b2-4296-aaed-fcb28a7a9b9b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:19.842624 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2dbff03b-72b2-4296-aaed-fcb28a7a9b9b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:19.877417 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-2dbff03b-72b2-4296-aaed-fcb28a7a9b9b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050183 Jun 17 15:34:19.878014 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 693/1802] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:34:19 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:34:20.575292 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-a2c2acd3-b911-47ea-9851-46b00684a12b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:34:20.575902 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-a2c2acd3-b911-47ea-9851-46b00684a12b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:34:20.583078 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a2c2acd3-b911-47ea-9851-46b00684a12b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:20.583616 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a2c2acd3-b911-47ea-9851-46b00684a12b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:20.584566 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a2c2acd3-b911-47ea-9851-46b00684a12b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:20.585054 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a2c2acd3-b911-47ea-9851-46b00684a12b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:20.669648 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-a2c2acd3-b911-47ea-9851-46b00684a12b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:34:20.684116 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-a2c2acd3-b911-47ea-9851-46b00684a12b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.112321 Jun 17 15:34:20.685221 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1110/1803] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:34:20 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:34:20.891036 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-7cecd30c-c491-411b-91a7-cd166c434e8c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:34:20.892373 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-7cecd30c-c491-411b-91a7-cd166c434e8c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:34:20.899597 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7cecd30c-c491-411b-91a7-cd166c434e8c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:20.900045 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7cecd30c-c491-411b-91a7-cd166c434e8c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:20.900874 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7cecd30c-c491-411b-91a7-cd166c434e8c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:20.901860 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7cecd30c-c491-411b-91a7-cd166c434e8c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:20.939310 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-7cecd30c-c491-411b-91a7-cd166c434e8c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052107 Jun 17 15:34:20.939927 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 694/1804] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:34:20 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:34:21.713825 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-fdac35ea-87fd-453f-8772-4f34879226bf tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:34:21.716553 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-fdac35ea-87fd-453f-8772-4f34879226bf tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:34:21.727371 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fdac35ea-87fd-453f-8772-4f34879226bf tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:21.728277 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fdac35ea-87fd-453f-8772-4f34879226bf tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:21.730669 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fdac35ea-87fd-453f-8772-4f34879226bf tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:21.731409 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fdac35ea-87fd-453f-8772-4f34879226bf tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:21.825801 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-fdac35ea-87fd-453f-8772-4f34879226bf tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:34:21.838101 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-fdac35ea-87fd-453f-8772-4f34879226bf tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.130943 Jun 17 15:34:21.839231 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1111/1805] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:34:21 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:34:21.951641 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-23bb7371-4aec-4ccc-b3f0-e1ee6de7e11d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:34:21.952633 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-23bb7371-4aec-4ccc-b3f0-e1ee6de7e11d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:34:21.960260 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-23bb7371-4aec-4ccc-b3f0-e1ee6de7e11d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:21.960745 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-23bb7371-4aec-4ccc-b3f0-e1ee6de7e11d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:21.961542 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-23bb7371-4aec-4ccc-b3f0-e1ee6de7e11d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:21.961985 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-23bb7371-4aec-4ccc-b3f0-e1ee6de7e11d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:22.005159 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-23bb7371-4aec-4ccc-b3f0-e1ee6de7e11d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057224 Jun 17 15:34:22.005979 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 695/1806] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:34:21 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:34:22.863860 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-cee0c5cc-a6c7-485d-bc4f-76c87b5196dd tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:34:22.864706 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-cee0c5cc-a6c7-485d-bc4f-76c87b5196dd tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:34:22.871622 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cee0c5cc-a6c7-485d-bc4f-76c87b5196dd tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:22.872069 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cee0c5cc-a6c7-485d-bc4f-76c87b5196dd tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:22.872899 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cee0c5cc-a6c7-485d-bc4f-76c87b5196dd tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:22.873332 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cee0c5cc-a6c7-485d-bc4f-76c87b5196dd tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:22.941948 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-cee0c5cc-a6c7-485d-bc4f-76c87b5196dd tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:34:22.950168 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-cee0c5cc-a6c7-485d-bc4f-76c87b5196dd tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.090195 Jun 17 15:34:22.950783 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1112/1807] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:34:22 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:34:23.017989 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-980b5aa3-dba7-4456-bb36-e795ef27a602 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:34:23.019031 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-980b5aa3-dba7-4456-bb36-e795ef27a602 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:34:23.027007 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-980b5aa3-dba7-4456-bb36-e795ef27a602 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:23.027511 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-980b5aa3-dba7-4456-bb36-e795ef27a602 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:23.028390 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-980b5aa3-dba7-4456-bb36-e795ef27a602 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:23.028893 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-980b5aa3-dba7-4456-bb36-e795ef27a602 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:23.063731 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-980b5aa3-dba7-4456-bb36-e795ef27a602 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049793 Jun 17 15:34:23.064358 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 696/1808] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:34:23 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:34:23.969742 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-3041db8d-cd30-4e87-b41d-2b669f9a8c4f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:34:23.970408 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-3041db8d-cd30-4e87-b41d-2b669f9a8c4f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:34:23.978622 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3041db8d-cd30-4e87-b41d-2b669f9a8c4f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:23.979224 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3041db8d-cd30-4e87-b41d-2b669f9a8c4f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:23.980886 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3041db8d-cd30-4e87-b41d-2b669f9a8c4f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:23.981432 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3041db8d-cd30-4e87-b41d-2b669f9a8c4f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:24.052766 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-3041db8d-cd30-4e87-b41d-2b669f9a8c4f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:34:24.066291 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-3041db8d-cd30-4e87-b41d-2b669f9a8c4f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.100989 Jun 17 15:34:24.067358 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1113/1809] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:34:23 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:34:24.077849 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-1347a69d-6246-4064-a39d-d08bce6f78e8 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:34:24.078848 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-1347a69d-6246-4064-a39d-d08bce6f78e8 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:34:24.085782 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1347a69d-6246-4064-a39d-d08bce6f78e8 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:24.086228 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1347a69d-6246-4064-a39d-d08bce6f78e8 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:24.087014 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1347a69d-6246-4064-a39d-d08bce6f78e8 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:24.087453 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1347a69d-6246-4064-a39d-d08bce6f78e8 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:24.122133 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-1347a69d-6246-4064-a39d-d08bce6f78e8 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048744 Jun 17 15:34:24.122732 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 697/1810] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:34:24 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:34:25.092218 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-c0d4b7e7-edf8-4a39-bf94-bbb2d9295d13 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:34:25.093628 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-c0d4b7e7-edf8-4a39-bf94-bbb2d9295d13 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:34:25.103379 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c0d4b7e7-edf8-4a39-bf94-bbb2d9295d13 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:25.104174 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c0d4b7e7-edf8-4a39-bf94-bbb2d9295d13 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:25.105364 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c0d4b7e7-edf8-4a39-bf94-bbb2d9295d13 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:25.106143 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c0d4b7e7-edf8-4a39-bf94-bbb2d9295d13 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:25.143319 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-48b87aa0-5b30-4133-bcf4-9ad33f14ff7d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:34:25.146243 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-48b87aa0-5b30-4133-bcf4-9ad33f14ff7d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:34:25.160939 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-48b87aa0-5b30-4133-bcf4-9ad33f14ff7d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:25.161788 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-48b87aa0-5b30-4133-bcf4-9ad33f14ff7d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:25.163423 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-48b87aa0-5b30-4133-bcf4-9ad33f14ff7d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:25.164203 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-48b87aa0-5b30-4133-bcf4-9ad33f14ff7d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:25.218380 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-48b87aa0-5b30-4133-bcf4-9ad33f14ff7d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085625 Jun 17 15:34:25.219044 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 698/1811] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:34:25 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:34:25.227394 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-c0d4b7e7-edf8-4a39-bf94-bbb2d9295d13 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:34:25.235739 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-c0d4b7e7-edf8-4a39-bf94-bbb2d9295d13 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.147514 Jun 17 15:34:25.236403 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1114/1812] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:34:25 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:34:26.231076 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-4dd1903f-1ddb-449d-b631-fcf49c32a7ad tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:34:26.232020 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-4dd1903f-1ddb-449d-b631-fcf49c32a7ad tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:34:26.238971 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4dd1903f-1ddb-449d-b631-fcf49c32a7ad tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:26.239422 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4dd1903f-1ddb-449d-b631-fcf49c32a7ad tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:26.240214 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4dd1903f-1ddb-449d-b631-fcf49c32a7ad tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:26.240686 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4dd1903f-1ddb-449d-b631-fcf49c32a7ad tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:26.255111 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-80704a0f-7090-49cf-8ff1-6f80a5a077ad tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:34:26.256020 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-80704a0f-7090-49cf-8ff1-6f80a5a077ad tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:34:26.266170 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-80704a0f-7090-49cf-8ff1-6f80a5a077ad tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:26.266874 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-80704a0f-7090-49cf-8ff1-6f80a5a077ad tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:26.268223 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-80704a0f-7090-49cf-8ff1-6f80a5a077ad tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:26.268967 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-80704a0f-7090-49cf-8ff1-6f80a5a077ad tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:26.274162 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-4dd1903f-1ddb-449d-b631-fcf49c32a7ad tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046972 Jun 17 15:34:26.274766 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 699/1813] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:34:26 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:34:26.338212 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-80704a0f-7090-49cf-8ff1-6f80a5a077ad tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:34:26.347041 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-80704a0f-7090-49cf-8ff1-6f80a5a077ad tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.097394 Jun 17 15:34:26.352390 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1115/1814] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:34:26 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:34:27.287499 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-c9bf05c1-65d3-4f74-b63e-786fa5ee7aa0 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:34:27.288531 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-c9bf05c1-65d3-4f74-b63e-786fa5ee7aa0 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:34:27.295665 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c9bf05c1-65d3-4f74-b63e-786fa5ee7aa0 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:27.296148 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c9bf05c1-65d3-4f74-b63e-786fa5ee7aa0 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:27.296969 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c9bf05c1-65d3-4f74-b63e-786fa5ee7aa0 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:27.297450 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c9bf05c1-65d3-4f74-b63e-786fa5ee7aa0 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:27.331779 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-c9bf05c1-65d3-4f74-b63e-786fa5ee7aa0 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048834 Jun 17 15:34:27.332481 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 700/1815] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:34:27 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:34:27.371584 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-8b68455d-2399-4517-9796-f26a0379a21b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:34:27.372459 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-8b68455d-2399-4517-9796-f26a0379a21b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:34:27.382200 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8b68455d-2399-4517-9796-f26a0379a21b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:27.382785 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8b68455d-2399-4517-9796-f26a0379a21b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:27.383620 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8b68455d-2399-4517-9796-f26a0379a21b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:27.384105 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8b68455d-2399-4517-9796-f26a0379a21b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:27.452020 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-8b68455d-2399-4517-9796-f26a0379a21b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:34:27.460279 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-8b68455d-2399-4517-9796-f26a0379a21b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.093094 Jun 17 15:34:27.460890 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1116/1816] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:34:27 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:34:28.346594 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-60712456-0f12-4b89-a943-2de784b5cdec tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:34:28.347598 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-60712456-0f12-4b89-a943-2de784b5cdec tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:34:28.357423 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-60712456-0f12-4b89-a943-2de784b5cdec tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:28.357423 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-60712456-0f12-4b89-a943-2de784b5cdec tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:28.358155 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-60712456-0f12-4b89-a943-2de784b5cdec tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:28.358640 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-60712456-0f12-4b89-a943-2de784b5cdec tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:28.393323 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-60712456-0f12-4b89-a943-2de784b5cdec tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050934 Jun 17 15:34:28.393923 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 701/1817] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:34:28 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:34:28.482386 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-940a5df4-86f1-4517-9756-29df8ffdc151 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:34:28.483513 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-940a5df4-86f1-4517-9756-29df8ffdc151 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:34:28.495584 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-940a5df4-86f1-4517-9756-29df8ffdc151 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:28.496420 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-940a5df4-86f1-4517-9756-29df8ffdc151 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:28.497788 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-940a5df4-86f1-4517-9756-29df8ffdc151 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:28.498615 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-940a5df4-86f1-4517-9756-29df8ffdc151 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:28.570801 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-940a5df4-86f1-4517-9756-29df8ffdc151 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:34:28.579295 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-940a5df4-86f1-4517-9756-29df8ffdc151 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.104423 Jun 17 15:34:28.579909 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1117/1818] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:34:28 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:34:29.406421 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-fe653ab8-d5dc-4f61-b623-5b00e832acd6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:34:29.407489 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-fe653ab8-d5dc-4f61-b623-5b00e832acd6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:34:29.414845 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fe653ab8-d5dc-4f61-b623-5b00e832acd6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:29.415425 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fe653ab8-d5dc-4f61-b623-5b00e832acd6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:29.416283 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fe653ab8-d5dc-4f61-b623-5b00e832acd6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:29.416774 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fe653ab8-d5dc-4f61-b623-5b00e832acd6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:29.451134 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-fe653ab8-d5dc-4f61-b623-5b00e832acd6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049758 Jun 17 15:34:29.451720 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 702/1819] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:34:29 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:34:29.598052 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-d62bb2d1-a135-4efe-b87d-23b9caa34514 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:34:29.598928 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-d62bb2d1-a135-4efe-b87d-23b9caa34514 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:34:29.606637 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d62bb2d1-a135-4efe-b87d-23b9caa34514 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:29.607084 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d62bb2d1-a135-4efe-b87d-23b9caa34514 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:29.607874 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d62bb2d1-a135-4efe-b87d-23b9caa34514 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:29.608310 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d62bb2d1-a135-4efe-b87d-23b9caa34514 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:29.680095 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-d62bb2d1-a135-4efe-b87d-23b9caa34514 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:34:29.688892 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-d62bb2d1-a135-4efe-b87d-23b9caa34514 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.094848 Jun 17 15:34:29.689497 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1118/1820] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:34:29 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:34:30.464132 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-bef1c1bb-abfe-439f-8843-7173d2c56fcd tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:34:30.465156 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-bef1c1bb-abfe-439f-8843-7173d2c56fcd tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:34:30.472188 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bef1c1bb-abfe-439f-8843-7173d2c56fcd tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:30.472680 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bef1c1bb-abfe-439f-8843-7173d2c56fcd tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:30.473473 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bef1c1bb-abfe-439f-8843-7173d2c56fcd tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:30.474157 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bef1c1bb-abfe-439f-8843-7173d2c56fcd tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:30.508506 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-bef1c1bb-abfe-439f-8843-7173d2c56fcd tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048987 Jun 17 15:34:30.509103 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 703/1821] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:34:30 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:34:30.710655 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-176eed6d-0ca9-461a-b8ba-817db827a676 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:34:30.711662 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-176eed6d-0ca9-461a-b8ba-817db827a676 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:34:30.724276 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-176eed6d-0ca9-461a-b8ba-817db827a676 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:30.725063 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-176eed6d-0ca9-461a-b8ba-817db827a676 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:30.726314 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-176eed6d-0ca9-461a-b8ba-817db827a676 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:30.727043 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-176eed6d-0ca9-461a-b8ba-817db827a676 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:30.827168 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-176eed6d-0ca9-461a-b8ba-817db827a676 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:34:30.835510 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-176eed6d-0ca9-461a-b8ba-817db827a676 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.132572 Jun 17 15:34:30.836171 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1119/1822] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:34:30 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:34:31.521074 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-b47ff3d4-e782-4eae-8f8c-5223c11e9387 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:34:31.522025 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-b47ff3d4-e782-4eae-8f8c-5223c11e9387 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:34:31.529872 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b47ff3d4-e782-4eae-8f8c-5223c11e9387 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:31.530324 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b47ff3d4-e782-4eae-8f8c-5223c11e9387 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:31.531112 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b47ff3d4-e782-4eae-8f8c-5223c11e9387 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:31.531558 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b47ff3d4-e782-4eae-8f8c-5223c11e9387 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:31.553797 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell1:SELECT=100 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:34:31.570330 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-b47ff3d4-e782-4eae-8f8c-5223c11e9387 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053492 Jun 17 15:34:31.570937 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 704/1823] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:34:31 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:34:31.855144 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-6e8e5270-76f0-46e9-9544-eef8a795ab87 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:34:31.855985 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-6e8e5270-76f0-46e9-9544-eef8a795ab87 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:34:31.863471 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6e8e5270-76f0-46e9-9544-eef8a795ab87 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:31.863916 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6e8e5270-76f0-46e9-9544-eef8a795ab87 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:31.864736 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6e8e5270-76f0-46e9-9544-eef8a795ab87 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:31.865181 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6e8e5270-76f0-46e9-9544-eef8a795ab87 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:31.870957 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=100 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:34:31.934627 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-6e8e5270-76f0-46e9-9544-eef8a795ab87 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:34:31.943276 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-6e8e5270-76f0-46e9-9544-eef8a795ab87 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.093168 Jun 17 15:34:31.943872 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1120/1824] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:34:31 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:34:32.582688 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-13c2d4c0-6414-4080-bccb-3e9c3d99c30e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:34:32.583689 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-13c2d4c0-6414-4080-bccb-3e9c3d99c30e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:34:32.591140 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-13c2d4c0-6414-4080-bccb-3e9c3d99c30e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:32.591589 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-13c2d4c0-6414-4080-bccb-3e9c3d99c30e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:32.592413 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-13c2d4c0-6414-4080-bccb-3e9c3d99c30e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:32.592852 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-13c2d4c0-6414-4080-bccb-3e9c3d99c30e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:32.626129 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-13c2d4c0-6414-4080-bccb-3e9c3d99c30e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047374 Jun 17 15:34:32.626610 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 705/1825] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:34:32 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:34:32.961118 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-6f925915-4764-405e-bbb9-53e592e6a58c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:34:32.961723 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-6f925915-4764-405e-bbb9-53e592e6a58c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:34:32.971610 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6f925915-4764-405e-bbb9-53e592e6a58c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:32.972496 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6f925915-4764-405e-bbb9-53e592e6a58c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:32.974181 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6f925915-4764-405e-bbb9-53e592e6a58c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:32.974966 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6f925915-4764-405e-bbb9-53e592e6a58c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:33.069486 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-6f925915-4764-405e-bbb9-53e592e6a58c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:34:33.078093 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-6f925915-4764-405e-bbb9-53e592e6a58c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.121050 Jun 17 15:34:33.078681 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1121/1826] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:34:32 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:34:33.641408 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-77acc346-c332-4e50-b437-8490ce729b40 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:34:33.642431 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-77acc346-c332-4e50-b437-8490ce729b40 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:34:33.649981 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-77acc346-c332-4e50-b437-8490ce729b40 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:33.650407 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-77acc346-c332-4e50-b437-8490ce729b40 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:33.651852 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-77acc346-c332-4e50-b437-8490ce729b40 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:33.652305 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-77acc346-c332-4e50-b437-8490ce729b40 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:33.686442 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-77acc346-c332-4e50-b437-8490ce729b40 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049111 Jun 17 15:34:33.686747 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 706/1827] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:34:33 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:34:34.099263 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-4638fbc3-2710-4546-b12e-aaff13a89729 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:34:34.100284 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-4638fbc3-2710-4546-b12e-aaff13a89729 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:34:34.112553 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4638fbc3-2710-4546-b12e-aaff13a89729 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:34.113352 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4638fbc3-2710-4546-b12e-aaff13a89729 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:34.114749 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4638fbc3-2710-4546-b12e-aaff13a89729 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:34.115481 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4638fbc3-2710-4546-b12e-aaff13a89729 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:34.211227 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-4638fbc3-2710-4546-b12e-aaff13a89729 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:34:34.220261 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-4638fbc3-2710-4546-b12e-aaff13a89729 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.127703 Jun 17 15:34:34.220902 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1122/1828] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:34:34 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:34:34.698471 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-b0964e7f-a3d2-493d-8db0-bccc40827c48 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:34:34.699350 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-b0964e7f-a3d2-493d-8db0-bccc40827c48 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:34:34.706896 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b0964e7f-a3d2-493d-8db0-bccc40827c48 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:34.707402 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b0964e7f-a3d2-493d-8db0-bccc40827c48 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:34.708252 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b0964e7f-a3d2-493d-8db0-bccc40827c48 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:34.708783 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b0964e7f-a3d2-493d-8db0-bccc40827c48 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:34.744197 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-b0964e7f-a3d2-493d-8db0-bccc40827c48 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049875 Jun 17 15:34:34.744898 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 707/1829] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:34:34 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:34:35.239384 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-44846dd5-efaf-4053-9b17-3b0032da5223 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:34:35.240042 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-44846dd5-efaf-4053-9b17-3b0032da5223 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:34:35.247206 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-44846dd5-efaf-4053-9b17-3b0032da5223 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:35.247652 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-44846dd5-efaf-4053-9b17-3b0032da5223 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:35.248476 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-44846dd5-efaf-4053-9b17-3b0032da5223 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:35.248907 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-44846dd5-efaf-4053-9b17-3b0032da5223 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:35.317115 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-44846dd5-efaf-4053-9b17-3b0032da5223 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:34:35.326093 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-44846dd5-efaf-4053-9b17-3b0032da5223 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.091183 Jun 17 15:34:35.326692 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1123/1830] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:34:35 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:34:35.758586 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-b6703621-dff2-4c32-80cc-4e2d9c3d2be4 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:34:35.759543 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-b6703621-dff2-4c32-80cc-4e2d9c3d2be4 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:34:35.767497 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b6703621-dff2-4c32-80cc-4e2d9c3d2be4 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:35.767945 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b6703621-dff2-4c32-80cc-4e2d9c3d2be4 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:35.768780 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b6703621-dff2-4c32-80cc-4e2d9c3d2be4 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:35.769218 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b6703621-dff2-4c32-80cc-4e2d9c3d2be4 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:35.802698 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-b6703621-dff2-4c32-80cc-4e2d9c3d2be4 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048244 Jun 17 15:34:35.803294 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 708/1831] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:34:35 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:34:36.343315 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-2f5bae91-c36e-4bb7-aba2-9aac624b18b9 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:34:36.343966 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-2f5bae91-c36e-4bb7-aba2-9aac624b18b9 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:34:36.351105 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2f5bae91-c36e-4bb7-aba2-9aac624b18b9 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:36.351549 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2f5bae91-c36e-4bb7-aba2-9aac624b18b9 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:36.352411 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2f5bae91-c36e-4bb7-aba2-9aac624b18b9 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:36.352983 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2f5bae91-c36e-4bb7-aba2-9aac624b18b9 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:36.420515 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-2f5bae91-c36e-4bb7-aba2-9aac624b18b9 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:34:36.428658 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-2f5bae91-c36e-4bb7-aba2-9aac624b18b9 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.089271 Jun 17 15:34:36.429238 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1124/1832] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:34:36 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:34:36.816446 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-207e8115-b954-4c70-b26f-71249c778010 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:34:36.817500 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-207e8115-b954-4c70-b26f-71249c778010 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:34:36.824496 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-207e8115-b954-4c70-b26f-71249c778010 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:36.824940 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-207e8115-b954-4c70-b26f-71249c778010 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:36.825719 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-207e8115-b954-4c70-b26f-71249c778010 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:36.826165 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-207e8115-b954-4c70-b26f-71249c778010 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:36.858540 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-207e8115-b954-4c70-b26f-71249c778010 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047766 Jun 17 15:34:36.859146 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 709/1833] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:34:36 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:34:37.446732 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-e20f9527-1f6c-41d2-ae8e-e65078aa1f56 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:34:37.447391 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-e20f9527-1f6c-41d2-ae8e-e65078aa1f56 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:34:37.454421 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e20f9527-1f6c-41d2-ae8e-e65078aa1f56 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:37.454932 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e20f9527-1f6c-41d2-ae8e-e65078aa1f56 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:37.455767 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e20f9527-1f6c-41d2-ae8e-e65078aa1f56 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:37.456243 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e20f9527-1f6c-41d2-ae8e-e65078aa1f56 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:37.523873 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-e20f9527-1f6c-41d2-ae8e-e65078aa1f56 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:34:37.532702 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-e20f9527-1f6c-41d2-ae8e-e65078aa1f56 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.089779 Jun 17 15:34:37.533626 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1125/1834] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:34:37 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:34:37.871153 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-82a853f0-6e5d-4fb3-91a7-76738361fcf9 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:34:37.872343 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-82a853f0-6e5d-4fb3-91a7-76738361fcf9 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:34:37.879930 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-82a853f0-6e5d-4fb3-91a7-76738361fcf9 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:37.880513 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-82a853f0-6e5d-4fb3-91a7-76738361fcf9 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:37.881351 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-82a853f0-6e5d-4fb3-91a7-76738361fcf9 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:37.881853 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-82a853f0-6e5d-4fb3-91a7-76738361fcf9 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:37.915081 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-82a853f0-6e5d-4fb3-91a7-76738361fcf9 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047976 Jun 17 15:34:37.915794 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 710/1835] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:34:37 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:34:38.551720 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-9831bc7c-038a-47c8-b859-131a99d18b38 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:34:38.552453 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-9831bc7c-038a-47c8-b859-131a99d18b38 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:34:38.554858 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_api:SELECT=54 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:34:38.561211 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9831bc7c-038a-47c8-b859-131a99d18b38 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:38.561652 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9831bc7c-038a-47c8-b859-131a99d18b38 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:38.562435 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9831bc7c-038a-47c8-b859-131a99d18b38 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:38.562868 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9831bc7c-038a-47c8-b859-131a99d18b38 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:38.634377 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-9831bc7c-038a-47c8-b859-131a99d18b38 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:34:38.643400 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-9831bc7c-038a-47c8-b859-131a99d18b38 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.095972 Jun 17 15:34:38.643997 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1126/1836] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:34:38 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:34:38.928096 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-3c7464a3-46b4-45be-b67f-09ff40649261 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:34:38.929006 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-3c7464a3-46b4-45be-b67f-09ff40649261 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:34:38.936712 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3c7464a3-46b4-45be-b67f-09ff40649261 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:38.937198 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3c7464a3-46b4-45be-b67f-09ff40649261 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:38.937968 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3c7464a3-46b4-45be-b67f-09ff40649261 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:38.938408 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3c7464a3-46b4-45be-b67f-09ff40649261 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:38.970866 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-3c7464a3-46b4-45be-b67f-09ff40649261 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047330 Jun 17 15:34:38.971452 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 711/1837] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:34:38 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:34:39.661149 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-72de0725-d254-4904-bd73-6217b4695f8f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:34:39.662082 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-72de0725-d254-4904-bd73-6217b4695f8f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:34:39.669152 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-72de0725-d254-4904-bd73-6217b4695f8f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:39.669629 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-72de0725-d254-4904-bd73-6217b4695f8f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:39.670405 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-72de0725-d254-4904-bd73-6217b4695f8f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:39.670872 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-72de0725-d254-4904-bd73-6217b4695f8f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:39.739703 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-72de0725-d254-4904-bd73-6217b4695f8f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:34:39.753496 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-72de0725-d254-4904-bd73-6217b4695f8f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.096172 Jun 17 15:34:39.754210 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1127/1838] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:34:39 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:34:39.985660 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-2d2e58b3-20b5-461a-8261-7341f5005695 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:34:39.986525 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-2d2e58b3-20b5-461a-8261-7341f5005695 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:34:39.988963 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_api:SELECT=58 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:34:39.997157 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2d2e58b3-20b5-461a-8261-7341f5005695 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:39.997584 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2d2e58b3-20b5-461a-8261-7341f5005695 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:39.998371 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2d2e58b3-20b5-461a-8261-7341f5005695 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:39.998875 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2d2e58b3-20b5-461a-8261-7341f5005695 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:40.037371 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-2d2e58b3-20b5-461a-8261-7341f5005695 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057277 Jun 17 15:34:40.037964 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 712/1839] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:34:39 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:34:40.771609 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-3353d008-5b22-40e9-9240-05a2d74a4cc0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:34:40.772647 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-3353d008-5b22-40e9-9240-05a2d74a4cc0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:34:40.779930 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3353d008-5b22-40e9-9240-05a2d74a4cc0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:40.780475 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3353d008-5b22-40e9-9240-05a2d74a4cc0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:40.781256 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3353d008-5b22-40e9-9240-05a2d74a4cc0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:40.781698 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3353d008-5b22-40e9-9240-05a2d74a4cc0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:40.849842 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-3353d008-5b22-40e9-9240-05a2d74a4cc0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:34:40.858015 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-3353d008-5b22-40e9-9240-05a2d74a4cc0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.090584 Jun 17 15:34:40.858666 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1128/1840] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:34:40 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:34:41.049520 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-c542c693-c727-4147-9321-9febac9d8897 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:34:41.050484 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-c542c693-c727-4147-9321-9febac9d8897 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:34:41.057938 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c542c693-c727-4147-9321-9febac9d8897 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:41.058439 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c542c693-c727-4147-9321-9febac9d8897 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:41.059349 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c542c693-c727-4147-9321-9febac9d8897 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:41.059905 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c542c693-c727-4147-9321-9febac9d8897 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:41.092284 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-c542c693-c727-4147-9321-9febac9d8897 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046728 Jun 17 15:34:41.092890 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 713/1841] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:34:41 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:34:41.875019 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-75d9934e-f4e9-4862-8b63-53b06dfb7b3b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:34:41.875958 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-75d9934e-f4e9-4862-8b63-53b06dfb7b3b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:34:41.882751 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-75d9934e-f4e9-4862-8b63-53b06dfb7b3b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:41.883197 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-75d9934e-f4e9-4862-8b63-53b06dfb7b3b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:41.883970 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-75d9934e-f4e9-4862-8b63-53b06dfb7b3b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:41.884438 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-75d9934e-f4e9-4862-8b63-53b06dfb7b3b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:41.952819 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-75d9934e-f4e9-4862-8b63-53b06dfb7b3b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:34:41.961318 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-75d9934e-f4e9-4862-8b63-53b06dfb7b3b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.090084 Jun 17 15:34:41.961907 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1129/1842] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:34:41 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:34:42.107496 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-ea740e7e-ee64-4b25-9fd4-b9f1051283d6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:34:42.109011 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-ea740e7e-ee64-4b25-9fd4-b9f1051283d6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:34:42.118438 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ea740e7e-ee64-4b25-9fd4-b9f1051283d6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:42.118883 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ea740e7e-ee64-4b25-9fd4-b9f1051283d6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:42.119754 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ea740e7e-ee64-4b25-9fd4-b9f1051283d6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:42.120198 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ea740e7e-ee64-4b25-9fd4-b9f1051283d6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:42.155462 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-ea740e7e-ee64-4b25-9fd4-b9f1051283d6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054473 Jun 17 15:34:42.155988 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 714/1843] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:34:42 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:34:42.979497 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-a69673e2-91e0-4a36-8e91-247533950741 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:34:42.980130 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-a69673e2-91e0-4a36-8e91-247533950741 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:34:42.987083 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a69673e2-91e0-4a36-8e91-247533950741 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:42.987525 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a69673e2-91e0-4a36-8e91-247533950741 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:42.988305 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a69673e2-91e0-4a36-8e91-247533950741 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:42.988764 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a69673e2-91e0-4a36-8e91-247533950741 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:43.064878 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-a69673e2-91e0-4a36-8e91-247533950741 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:34:43.073492 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-a69673e2-91e0-4a36-8e91-247533950741 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.097320 Jun 17 15:34:43.074129 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1130/1844] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:34:42 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:34:43.167681 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-363d4bb4-abda-4c96-8a29-12036ba5d84f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:34:43.168656 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-363d4bb4-abda-4c96-8a29-12036ba5d84f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:34:43.175793 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-363d4bb4-abda-4c96-8a29-12036ba5d84f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:43.176236 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-363d4bb4-abda-4c96-8a29-12036ba5d84f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:43.177058 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-363d4bb4-abda-4c96-8a29-12036ba5d84f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:43.177491 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-363d4bb4-abda-4c96-8a29-12036ba5d84f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:43.211407 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-363d4bb4-abda-4c96-8a29-12036ba5d84f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047759 Jun 17 15:34:43.212079 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 715/1845] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:34:43 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:34:44.091677 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-8f4102de-1c1c-492b-957d-adccd876b8f9 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:34:44.092457 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-8f4102de-1c1c-492b-957d-adccd876b8f9 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:34:44.099890 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8f4102de-1c1c-492b-957d-adccd876b8f9 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:44.100395 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8f4102de-1c1c-492b-957d-adccd876b8f9 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:44.101179 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8f4102de-1c1c-492b-957d-adccd876b8f9 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:44.101610 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8f4102de-1c1c-492b-957d-adccd876b8f9 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:44.181398 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-8f4102de-1c1c-492b-957d-adccd876b8f9 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:34:44.190122 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-8f4102de-1c1c-492b-957d-adccd876b8f9 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.103188 Jun 17 15:34:44.190734 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1131/1846] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:34:44 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:34:44.223979 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-2c60f3db-6681-4d4a-8b61-f7bd3ae5855b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:34:44.224949 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-2c60f3db-6681-4d4a-8b61-f7bd3ae5855b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:34:44.231734 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2c60f3db-6681-4d4a-8b61-f7bd3ae5855b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:44.232261 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2c60f3db-6681-4d4a-8b61-f7bd3ae5855b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:44.233113 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2c60f3db-6681-4d4a-8b61-f7bd3ae5855b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:44.233590 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2c60f3db-6681-4d4a-8b61-f7bd3ae5855b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:44.266643 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-2c60f3db-6681-4d4a-8b61-f7bd3ae5855b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047102 Jun 17 15:34:44.267282 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 716/1847] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:34:44 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:34:45.212515 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-0383b699-9537-417a-a6c2-43ad99d1ac36 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:34:45.214088 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-0383b699-9537-417a-a6c2-43ad99d1ac36 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:34:45.226490 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0383b699-9537-417a-a6c2-43ad99d1ac36 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:45.227293 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0383b699-9537-417a-a6c2-43ad99d1ac36 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:45.229304 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0383b699-9537-417a-a6c2-43ad99d1ac36 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:45.230102 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0383b699-9537-417a-a6c2-43ad99d1ac36 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:45.282349 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-f2cd5bed-10fc-45a7-8ae3-d09946937907 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:34:45.284187 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-f2cd5bed-10fc-45a7-8ae3-d09946937907 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:34:45.296152 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f2cd5bed-10fc-45a7-8ae3-d09946937907 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:45.297007 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f2cd5bed-10fc-45a7-8ae3-d09946937907 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:45.298458 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f2cd5bed-10fc-45a7-8ae3-d09946937907 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:45.299262 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f2cd5bed-10fc-45a7-8ae3-d09946937907 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:45.314565 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-0383b699-9537-417a-a6c2-43ad99d1ac36 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:34:45.323066 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-0383b699-9537-417a-a6c2-43ad99d1ac36 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.118376 Jun 17 15:34:45.323790 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1132/1848] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:34:45 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:34:45.340797 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-f2cd5bed-10fc-45a7-8ae3-d09946937907 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065357 Jun 17 15:34:45.341385 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 717/1849] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:34:45 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:34:46.341850 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-4ffbd10d-de79-4b59-8b8a-dcf85b7d4af4 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:34:46.342550 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-4ffbd10d-de79-4b59-8b8a-dcf85b7d4af4 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:34:46.350349 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4ffbd10d-de79-4b59-8b8a-dcf85b7d4af4 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:46.350810 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4ffbd10d-de79-4b59-8b8a-dcf85b7d4af4 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:46.351591 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4ffbd10d-de79-4b59-8b8a-dcf85b7d4af4 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:46.352038 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4ffbd10d-de79-4b59-8b8a-dcf85b7d4af4 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:46.361283 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-a6b49d8a-b55d-4599-877a-76b8eed3c1b7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:34:46.364245 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-a6b49d8a-b55d-4599-877a-76b8eed3c1b7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:34:46.377088 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a6b49d8a-b55d-4599-877a-76b8eed3c1b7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:46.377861 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a6b49d8a-b55d-4599-877a-76b8eed3c1b7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:46.379182 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a6b49d8a-b55d-4599-877a-76b8eed3c1b7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:46.380447 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a6b49d8a-b55d-4599-877a-76b8eed3c1b7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:46.435566 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-a6b49d8a-b55d-4599-877a-76b8eed3c1b7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085594 Jun 17 15:34:46.437185 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 718/1850] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:34:46 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:34:46.465481 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-4ffbd10d-de79-4b59-8b8a-dcf85b7d4af4 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:34:46.474214 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-4ffbd10d-de79-4b59-8b8a-dcf85b7d4af4 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.137197 Jun 17 15:34:46.475109 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1133/1851] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:34:46 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:34:47.449335 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-3fb5354d-7d1c-47db-baca-0f9fe5cde2d9 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:34:47.450338 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-3fb5354d-7d1c-47db-baca-0f9fe5cde2d9 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:34:47.457832 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3fb5354d-7d1c-47db-baca-0f9fe5cde2d9 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:47.458315 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3fb5354d-7d1c-47db-baca-0f9fe5cde2d9 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:47.459257 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3fb5354d-7d1c-47db-baca-0f9fe5cde2d9 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:47.459728 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3fb5354d-7d1c-47db-baca-0f9fe5cde2d9 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:47.493760 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-3fb5354d-7d1c-47db-baca-0f9fe5cde2d9 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049172 Jun 17 15:34:47.494609 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 719/1852] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:34:47 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:34:47.500689 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-214d8634-98c8-4954-9cb0-e0bdd616920e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:34:47.501599 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-214d8634-98c8-4954-9cb0-e0bdd616920e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:34:47.508032 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-214d8634-98c8-4954-9cb0-e0bdd616920e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:47.508539 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-214d8634-98c8-4954-9cb0-e0bdd616920e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:47.509311 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-214d8634-98c8-4954-9cb0-e0bdd616920e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:47.509741 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-214d8634-98c8-4954-9cb0-e0bdd616920e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:47.579585 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-214d8634-98c8-4954-9cb0-e0bdd616920e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:34:47.589098 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-214d8634-98c8-4954-9cb0-e0bdd616920e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.092258 Jun 17 15:34:47.589830 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1134/1853] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:34:47 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:34:48.506906 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-30d172bf-a9c6-4d09-a018-71bd218fb48e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:34:48.507918 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-30d172bf-a9c6-4d09-a018-71bd218fb48e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:34:48.516066 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-30d172bf-a9c6-4d09-a018-71bd218fb48e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:48.516541 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-30d172bf-a9c6-4d09-a018-71bd218fb48e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:48.517330 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-30d172bf-a9c6-4d09-a018-71bd218fb48e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:48.517769 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-30d172bf-a9c6-4d09-a018-71bd218fb48e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:48.551794 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-30d172bf-a9c6-4d09-a018-71bd218fb48e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049326 Jun 17 15:34:48.552535 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 720/1854] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:34:48 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:34:48.608057 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-42854683-aa82-4810-a489-92ce8dd3d0ae tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:34:48.608748 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-42854683-aa82-4810-a489-92ce8dd3d0ae tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:34:48.616050 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-42854683-aa82-4810-a489-92ce8dd3d0ae tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:48.616538 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-42854683-aa82-4810-a489-92ce8dd3d0ae tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:48.617320 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-42854683-aa82-4810-a489-92ce8dd3d0ae tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:48.617749 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-42854683-aa82-4810-a489-92ce8dd3d0ae tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:48.684581 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-42854683-aa82-4810-a489-92ce8dd3d0ae tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:34:48.692917 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-42854683-aa82-4810-a489-92ce8dd3d0ae tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.089710 Jun 17 15:34:48.693508 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1135/1855] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:34:48 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:34:49.563940 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-4bbecb1e-6c39-47fd-829a-d076577c43bd tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:34:49.564943 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-4bbecb1e-6c39-47fd-829a-d076577c43bd tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:34:49.571871 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4bbecb1e-6c39-47fd-829a-d076577c43bd tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:49.572873 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4bbecb1e-6c39-47fd-829a-d076577c43bd tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:49.573676 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4bbecb1e-6c39-47fd-829a-d076577c43bd tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:49.574123 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4bbecb1e-6c39-47fd-829a-d076577c43bd tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:49.578393 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell1:SELECT=100 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:34:49.607983 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-4bbecb1e-6c39-47fd-829a-d076577c43bd tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048435 Jun 17 15:34:49.608611 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 721/1856] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:34:49 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:34:49.721918 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-db5453bf-bdf5-4209-8cb2-76d9180b7e2c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:34:49.722887 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-db5453bf-bdf5-4209-8cb2-76d9180b7e2c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:34:49.735174 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-db5453bf-bdf5-4209-8cb2-76d9180b7e2c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:49.735910 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-db5453bf-bdf5-4209-8cb2-76d9180b7e2c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:49.737295 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-db5453bf-bdf5-4209-8cb2-76d9180b7e2c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:49.738020 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-db5453bf-bdf5-4209-8cb2-76d9180b7e2c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:49.811828 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-db5453bf-bdf5-4209-8cb2-76d9180b7e2c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:34:49.815584 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=100 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:34:49.821157 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-db5453bf-bdf5-4209-8cb2-76d9180b7e2c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.106213 Jun 17 15:34:49.821744 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1136/1857] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:34:49 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:34:50.620853 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-4528b5ad-94de-43b7-9ff5-30248b663b48 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:34:50.621798 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-4528b5ad-94de-43b7-9ff5-30248b663b48 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:34:50.628794 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4528b5ad-94de-43b7-9ff5-30248b663b48 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:50.629158 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4528b5ad-94de-43b7-9ff5-30248b663b48 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:50.629933 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4528b5ad-94de-43b7-9ff5-30248b663b48 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:50.630363 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4528b5ad-94de-43b7-9ff5-30248b663b48 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:50.664040 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-4528b5ad-94de-43b7-9ff5-30248b663b48 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047804 Jun 17 15:34:50.664994 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 722/1858] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:34:50 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:34:50.838516 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-89dd111f-627e-4406-97da-04c22e248016 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:34:50.839424 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-89dd111f-627e-4406-97da-04c22e248016 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:34:50.846247 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-89dd111f-627e-4406-97da-04c22e248016 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:50.846703 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-89dd111f-627e-4406-97da-04c22e248016 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:50.847475 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-89dd111f-627e-4406-97da-04c22e248016 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:50.847909 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-89dd111f-627e-4406-97da-04c22e248016 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:50.933328 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-89dd111f-627e-4406-97da-04c22e248016 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:34:50.943019 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-89dd111f-627e-4406-97da-04c22e248016 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.108182 Jun 17 15:34:50.943735 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1137/1859] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:34:50 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:34:51.678156 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-05d633db-c638-447a-a2f9-26486ef89e33 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:34:51.679013 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-05d633db-c638-447a-a2f9-26486ef89e33 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:34:51.686833 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-05d633db-c638-447a-a2f9-26486ef89e33 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:51.687284 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-05d633db-c638-447a-a2f9-26486ef89e33 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:51.688082 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-05d633db-c638-447a-a2f9-26486ef89e33 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:51.688560 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-05d633db-c638-447a-a2f9-26486ef89e33 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:51.723002 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-05d633db-c638-447a-a2f9-26486ef89e33 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048988 Jun 17 15:34:51.723875 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 723/1860] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:34:51 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:34:51.960993 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-d376e8ec-6125-401f-a726-7fca44e6b5e2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:34:51.961591 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-d376e8ec-6125-401f-a726-7fca44e6b5e2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:34:51.968496 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d376e8ec-6125-401f-a726-7fca44e6b5e2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:51.968961 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d376e8ec-6125-401f-a726-7fca44e6b5e2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:51.969763 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d376e8ec-6125-401f-a726-7fca44e6b5e2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:51.970204 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d376e8ec-6125-401f-a726-7fca44e6b5e2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:52.042698 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-d376e8ec-6125-401f-a726-7fca44e6b5e2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:34:52.056044 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-d376e8ec-6125-401f-a726-7fca44e6b5e2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.098988 Jun 17 15:34:52.057637 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1138/1861] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:34:51 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:34:52.735426 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-bc038c27-9a8e-4716-9cf8-f0d83943e62a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:34:52.736392 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-bc038c27-9a8e-4716-9cf8-f0d83943e62a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:34:52.743289 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bc038c27-9a8e-4716-9cf8-f0d83943e62a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:52.744029 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bc038c27-9a8e-4716-9cf8-f0d83943e62a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:52.745061 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bc038c27-9a8e-4716-9cf8-f0d83943e62a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:52.745763 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bc038c27-9a8e-4716-9cf8-f0d83943e62a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:52.782470 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-bc038c27-9a8e-4716-9cf8-f0d83943e62a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051058 Jun 17 15:34:52.783235 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 724/1862] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:34:52 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:34:53.082980 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-fe983f3e-54a0-4bf8-a681-f2bdd8588685 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:34:53.083610 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-fe983f3e-54a0-4bf8-a681-f2bdd8588685 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:34:53.090914 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fe983f3e-54a0-4bf8-a681-f2bdd8588685 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:53.091367 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fe983f3e-54a0-4bf8-a681-f2bdd8588685 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:53.092149 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fe983f3e-54a0-4bf8-a681-f2bdd8588685 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:53.092623 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fe983f3e-54a0-4bf8-a681-f2bdd8588685 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:53.160187 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-fe983f3e-54a0-4bf8-a681-f2bdd8588685 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:34:53.169251 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-fe983f3e-54a0-4bf8-a681-f2bdd8588685 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.090230 Jun 17 15:34:53.170011 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1139/1863] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:34:53 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:34:53.795741 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-5d113107-37da-4eb1-bfd6-f0ccb344ebc7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:34:53.796709 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-5d113107-37da-4eb1-bfd6-f0ccb344ebc7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:34:53.803695 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5d113107-37da-4eb1-bfd6-f0ccb344ebc7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:53.804196 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5d113107-37da-4eb1-bfd6-f0ccb344ebc7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:53.805024 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5d113107-37da-4eb1-bfd6-f0ccb344ebc7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:53.805459 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5d113107-37da-4eb1-bfd6-f0ccb344ebc7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:53.841148 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-5d113107-37da-4eb1-bfd6-f0ccb344ebc7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050179 Jun 17 15:34:53.841928 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 725/1864] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:34:53 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:34:54.187703 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-f4fea283-c188-42d9-802d-ad14185238f2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:34:54.188395 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-f4fea283-c188-42d9-802d-ad14185238f2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:34:54.196067 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f4fea283-c188-42d9-802d-ad14185238f2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:54.196719 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f4fea283-c188-42d9-802d-ad14185238f2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:54.198237 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f4fea283-c188-42d9-802d-ad14185238f2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:54.198717 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f4fea283-c188-42d9-802d-ad14185238f2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:54.266821 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-f4fea283-c188-42d9-802d-ad14185238f2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:34:54.275097 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-f4fea283-c188-42d9-802d-ad14185238f2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.091558 Jun 17 15:34:54.275880 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1140/1865] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:34:54 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:34:54.858333 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-0f51c9de-5f0a-4886-b641-5832f86d3add tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:34:54.859755 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-0f51c9de-5f0a-4886-b641-5832f86d3add tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:34:54.870590 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0f51c9de-5f0a-4886-b641-5832f86d3add tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:54.871444 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0f51c9de-5f0a-4886-b641-5832f86d3add tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:54.872868 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0f51c9de-5f0a-4886-b641-5832f86d3add tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:54.873931 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0f51c9de-5f0a-4886-b641-5832f86d3add tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:54.924498 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-0f51c9de-5f0a-4886-b641-5832f86d3add tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073086 Jun 17 15:34:54.925494 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 726/1866] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:34:54 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:34:55.294119 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-03b33386-74a1-45c3-a67c-a21aa649ef31 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:34:55.294827 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-03b33386-74a1-45c3-a67c-a21aa649ef31 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:34:55.302000 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-03b33386-74a1-45c3-a67c-a21aa649ef31 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:55.302452 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-03b33386-74a1-45c3-a67c-a21aa649ef31 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:55.303242 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-03b33386-74a1-45c3-a67c-a21aa649ef31 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:55.303679 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-03b33386-74a1-45c3-a67c-a21aa649ef31 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:55.373963 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-03b33386-74a1-45c3-a67c-a21aa649ef31 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:34:55.382873 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-03b33386-74a1-45c3-a67c-a21aa649ef31 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.093259 Jun 17 15:34:55.383480 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1141/1867] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:34:55 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:34:55.937670 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-6da65209-b479-4421-be65-a968de47d394 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:34:55.938628 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-6da65209-b479-4421-be65-a968de47d394 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:34:55.945645 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6da65209-b479-4421-be65-a968de47d394 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:55.946094 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6da65209-b479-4421-be65-a968de47d394 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:55.946880 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6da65209-b479-4421-be65-a968de47d394 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:55.947317 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6da65209-b479-4421-be65-a968de47d394 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:55.987342 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-6da65209-b479-4421-be65-a968de47d394 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053943 Jun 17 15:34:55.987942 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 727/1868] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:34:55 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:34:56.401879 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-0dce0e59-e556-4cab-a9a1-0be523c9b145 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:34:56.402781 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-0dce0e59-e556-4cab-a9a1-0be523c9b145 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:34:56.408878 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0dce0e59-e556-4cab-a9a1-0be523c9b145 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:56.409314 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0dce0e59-e556-4cab-a9a1-0be523c9b145 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:56.410100 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0dce0e59-e556-4cab-a9a1-0be523c9b145 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:56.410533 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0dce0e59-e556-4cab-a9a1-0be523c9b145 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:56.480567 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-0dce0e59-e556-4cab-a9a1-0be523c9b145 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:34:56.489374 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-0dce0e59-e556-4cab-a9a1-0be523c9b145 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.092179 Jun 17 15:34:56.490116 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1142/1869] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:34:56 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:34:57.000091 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-a0335504-b013-498f-afd1-9bf64b998811 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:34:57.001074 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-a0335504-b013-498f-afd1-9bf64b998811 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:34:57.008094 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a0335504-b013-498f-afd1-9bf64b998811 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:57.008586 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a0335504-b013-498f-afd1-9bf64b998811 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:57.009375 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a0335504-b013-498f-afd1-9bf64b998811 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:57.009820 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a0335504-b013-498f-afd1-9bf64b998811 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:57.042091 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-a0335504-b013-498f-afd1-9bf64b998811 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045373 Jun 17 15:34:57.042681 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 728/1870] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:34:56 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:34:57.507515 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-46a57420-69ec-4c1a-b587-122bbf703608 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:34:57.508224 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-46a57420-69ec-4c1a-b587-122bbf703608 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:34:57.515910 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-46a57420-69ec-4c1a-b587-122bbf703608 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:57.516528 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-46a57420-69ec-4c1a-b587-122bbf703608 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:57.517373 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-46a57420-69ec-4c1a-b587-122bbf703608 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:57.517861 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-46a57420-69ec-4c1a-b587-122bbf703608 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:57.589193 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-46a57420-69ec-4c1a-b587-122bbf703608 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:34:57.598323 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-46a57420-69ec-4c1a-b587-122bbf703608 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.094810 Jun 17 15:34:57.599223 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1143/1871] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:34:57 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:34:58.059526 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-3ac70975-14a7-480c-af0d-c9e17c47ea73 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:34:58.061272 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-3ac70975-14a7-480c-af0d-c9e17c47ea73 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:34:58.073013 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3ac70975-14a7-480c-af0d-c9e17c47ea73 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:58.073781 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3ac70975-14a7-480c-af0d-c9e17c47ea73 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:58.074942 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3ac70975-14a7-480c-af0d-c9e17c47ea73 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:58.075393 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3ac70975-14a7-480c-af0d-c9e17c47ea73 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:58.132626 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-3ac70975-14a7-480c-af0d-c9e17c47ea73 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080610 Jun 17 15:34:58.133561 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 729/1872] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:34:58 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:34:58.616295 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-0dd090cf-035b-4b1b-831e-ea1606cf8db2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:34:58.617300 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-0dd090cf-035b-4b1b-831e-ea1606cf8db2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:34:58.624629 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0dd090cf-035b-4b1b-831e-ea1606cf8db2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:58.625073 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0dd090cf-035b-4b1b-831e-ea1606cf8db2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:58.625854 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0dd090cf-035b-4b1b-831e-ea1606cf8db2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:58.626294 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0dd090cf-035b-4b1b-831e-ea1606cf8db2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:58.692167 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-0dd090cf-035b-4b1b-831e-ea1606cf8db2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:34:58.700969 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-0dd090cf-035b-4b1b-831e-ea1606cf8db2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.088718 Jun 17 15:34:58.701568 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1144/1873] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:34:58 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:34:59.147754 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-a23242c7-d12f-42e4-b5f0-d1984695dced tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:34:59.148756 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-a23242c7-d12f-42e4-b5f0-d1984695dced tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:34:59.156670 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a23242c7-d12f-42e4-b5f0-d1984695dced tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:59.157163 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a23242c7-d12f-42e4-b5f0-d1984695dced tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:59.157997 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a23242c7-d12f-42e4-b5f0-d1984695dced tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:59.158475 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a23242c7-d12f-42e4-b5f0-d1984695dced tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:59.193117 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-a23242c7-d12f-42e4-b5f0-d1984695dced tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049371 Jun 17 15:34:59.193710 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 730/1874] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:34:59 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:34:59.727840 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-d5fe8f62-ef21-4968-b2de-07835730eacd tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:34:59.728579 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-d5fe8f62-ef21-4968-b2de-07835730eacd tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:34:59.736152 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d5fe8f62-ef21-4968-b2de-07835730eacd tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:59.736670 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d5fe8f62-ef21-4968-b2de-07835730eacd tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:59.737743 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d5fe8f62-ef21-4968-b2de-07835730eacd tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:34:59.738226 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d5fe8f62-ef21-4968-b2de-07835730eacd tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:34:59.808918 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-d5fe8f62-ef21-4968-b2de-07835730eacd tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:34:59.817452 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-d5fe8f62-ef21-4968-b2de-07835730eacd tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.093842 Jun 17 15:34:59.818107 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1145/1875] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:34:59 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:35:00.207859 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-4d8b1e26-6a31-4569-b409-1211711cf083 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:35:00.208910 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-4d8b1e26-6a31-4569-b409-1211711cf083 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:35:00.216996 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4d8b1e26-6a31-4569-b409-1211711cf083 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:00.217446 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4d8b1e26-6a31-4569-b409-1211711cf083 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:00.218241 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4d8b1e26-6a31-4569-b409-1211711cf083 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:00.218677 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4d8b1e26-6a31-4569-b409-1211711cf083 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:00.252927 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-4d8b1e26-6a31-4569-b409-1211711cf083 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049070 Jun 17 15:35:00.253517 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 731/1876] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:35:00 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:35:00.836273 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-61be67d8-1851-4769-9d4b-29651ce5401c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:35:00.837337 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-61be67d8-1851-4769-9d4b-29651ce5401c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:35:00.845071 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-61be67d8-1851-4769-9d4b-29651ce5401c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:00.845526 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-61be67d8-1851-4769-9d4b-29651ce5401c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:00.846351 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-61be67d8-1851-4769-9d4b-29651ce5401c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:00.846790 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-61be67d8-1851-4769-9d4b-29651ce5401c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:00.919993 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-61be67d8-1851-4769-9d4b-29651ce5401c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:35:00.928510 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-61be67d8-1851-4769-9d4b-29651ce5401c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.096890 Jun 17 15:35:00.929513 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1146/1877] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:35:00 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:35:01.267923 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-410ae335-fc20-45a3-8c91-c079c8d60844 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:35:01.268887 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-410ae335-fc20-45a3-8c91-c079c8d60844 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:35:01.276346 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-410ae335-fc20-45a3-8c91-c079c8d60844 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:01.276885 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-410ae335-fc20-45a3-8c91-c079c8d60844 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:01.277737 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-410ae335-fc20-45a3-8c91-c079c8d60844 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:01.278261 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-410ae335-fc20-45a3-8c91-c079c8d60844 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:01.314158 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-410ae335-fc20-45a3-8c91-c079c8d60844 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050489 Jun 17 15:35:01.315196 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 732/1878] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:35:01 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:35:01.946365 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-05d185d6-da28-4889-9729-1432d84555b6 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:35:01.947094 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-05d185d6-da28-4889-9729-1432d84555b6 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:35:01.954783 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-05d185d6-da28-4889-9729-1432d84555b6 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:01.955144 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-05d185d6-da28-4889-9729-1432d84555b6 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:01.955949 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-05d185d6-da28-4889-9729-1432d84555b6 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:01.956417 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-05d185d6-da28-4889-9729-1432d84555b6 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:02.025820 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-05d185d6-da28-4889-9729-1432d84555b6 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:35:02.034324 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-05d185d6-da28-4889-9729-1432d84555b6 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.091842 Jun 17 15:35:02.034920 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1147/1879] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:35:01 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:35:02.330184 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-f7efa7f7-24ee-4124-bf5a-cf852556b0f3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:35:02.331112 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-f7efa7f7-24ee-4124-bf5a-cf852556b0f3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:35:02.339346 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f7efa7f7-24ee-4124-bf5a-cf852556b0f3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:02.339841 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f7efa7f7-24ee-4124-bf5a-cf852556b0f3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:02.340659 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f7efa7f7-24ee-4124-bf5a-cf852556b0f3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:02.341098 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f7efa7f7-24ee-4124-bf5a-cf852556b0f3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:02.384046 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-f7efa7f7-24ee-4124-bf5a-cf852556b0f3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058676 Jun 17 15:35:02.385366 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 733/1880] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:35:02 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:35:03.052482 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-d0a65361-d5ee-451f-8e00-cb4f46330097 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:35:03.053109 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-d0a65361-d5ee-451f-8e00-cb4f46330097 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:35:03.060600 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d0a65361-d5ee-451f-8e00-cb4f46330097 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:03.061057 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d0a65361-d5ee-451f-8e00-cb4f46330097 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:03.061874 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d0a65361-d5ee-451f-8e00-cb4f46330097 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:03.062311 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d0a65361-d5ee-451f-8e00-cb4f46330097 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:03.131220 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-d0a65361-d5ee-451f-8e00-cb4f46330097 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:35:03.139450 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-d0a65361-d5ee-451f-8e00-cb4f46330097 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.090748 Jun 17 15:35:03.140217 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1148/1881] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:35:03 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:35:03.398740 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-a497e86d-d80d-4c48-a211-28d9c8aa6337 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:35:03.399790 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-a497e86d-d80d-4c48-a211-28d9c8aa6337 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:35:03.407815 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a497e86d-d80d-4c48-a211-28d9c8aa6337 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:03.408407 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a497e86d-d80d-4c48-a211-28d9c8aa6337 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:03.409241 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a497e86d-d80d-4c48-a211-28d9c8aa6337 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:03.409681 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a497e86d-d80d-4c48-a211-28d9c8aa6337 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:03.444749 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-a497e86d-d80d-4c48-a211-28d9c8aa6337 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050164 Jun 17 15:35:03.445348 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 734/1882] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:35:03 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:35:04.157822 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-714b9f67-62fe-493f-a723-5a74796610f0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:35:04.158553 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-714b9f67-62fe-493f-a723-5a74796610f0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:35:04.166702 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-714b9f67-62fe-493f-a723-5a74796610f0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:04.167243 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-714b9f67-62fe-493f-a723-5a74796610f0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:04.168078 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-714b9f67-62fe-493f-a723-5a74796610f0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:04.168588 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-714b9f67-62fe-493f-a723-5a74796610f0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:04.237555 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-714b9f67-62fe-493f-a723-5a74796610f0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:35:04.246726 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-714b9f67-62fe-493f-a723-5a74796610f0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.092918 Jun 17 15:35:04.247428 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1149/1883] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:35:04 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:35:04.457048 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-c33f2b92-b942-465c-835b-fb4b917c96fa tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:35:04.457891 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-c33f2b92-b942-465c-835b-fb4b917c96fa tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:35:04.464908 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c33f2b92-b942-465c-835b-fb4b917c96fa tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:04.465357 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c33f2b92-b942-465c-835b-fb4b917c96fa tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:04.466152 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c33f2b92-b942-465c-835b-fb4b917c96fa tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:04.466589 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c33f2b92-b942-465c-835b-fb4b917c96fa tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:04.501590 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-c33f2b92-b942-465c-835b-fb4b917c96fa tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048740 Jun 17 15:35:04.502194 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 735/1884] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:35:04 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:35:05.272322 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-0db233c4-2846-4255-834e-9ad65076ff32 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:35:05.273107 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-0db233c4-2846-4255-834e-9ad65076ff32 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:35:05.280939 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0db233c4-2846-4255-834e-9ad65076ff32 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:05.281467 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0db233c4-2846-4255-834e-9ad65076ff32 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:05.282327 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0db233c4-2846-4255-834e-9ad65076ff32 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:05.282965 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0db233c4-2846-4255-834e-9ad65076ff32 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:05.356221 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-0db233c4-2846-4255-834e-9ad65076ff32 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:35:05.364451 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-0db233c4-2846-4255-834e-9ad65076ff32 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.096409 Jun 17 15:35:05.365057 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1150/1885] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:35:05 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:35:05.515023 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-95debc74-4aba-4d42-ae4b-94ff3870394a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:35:05.515973 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-95debc74-4aba-4d42-ae4b-94ff3870394a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:35:05.523525 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-95debc74-4aba-4d42-ae4b-94ff3870394a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:05.523885 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-95debc74-4aba-4d42-ae4b-94ff3870394a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:05.524700 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-95debc74-4aba-4d42-ae4b-94ff3870394a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:05.525146 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-95debc74-4aba-4d42-ae4b-94ff3870394a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:05.570432 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-95debc74-4aba-4d42-ae4b-94ff3870394a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059522 Jun 17 15:35:05.571027 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 736/1886] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:35:05 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:35:06.381788 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-fd9d9495-5059-422f-9866-39d2ca5e9211 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:35:06.382658 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-fd9d9495-5059-422f-9866-39d2ca5e9211 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:35:06.389911 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fd9d9495-5059-422f-9866-39d2ca5e9211 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:06.390375 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fd9d9495-5059-422f-9866-39d2ca5e9211 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:06.391143 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fd9d9495-5059-422f-9866-39d2ca5e9211 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:06.391581 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fd9d9495-5059-422f-9866-39d2ca5e9211 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:06.459562 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-fd9d9495-5059-422f-9866-39d2ca5e9211 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:35:06.468223 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-fd9d9495-5059-422f-9866-39d2ca5e9211 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.090486 Jun 17 15:35:06.468850 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1151/1887] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:35:06 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:35:06.582878 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-20260427-9844-445f-918c-6f9f94bdf55f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:35:06.583999 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-20260427-9844-445f-918c-6f9f94bdf55f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:35:06.591951 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-20260427-9844-445f-918c-6f9f94bdf55f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:06.592443 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-20260427-9844-445f-918c-6f9f94bdf55f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:06.593248 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-20260427-9844-445f-918c-6f9f94bdf55f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:06.593684 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-20260427-9844-445f-918c-6f9f94bdf55f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:06.621187 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell1:SELECT=100 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:35:06.626486 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-20260427-9844-445f-918c-6f9f94bdf55f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047641 Jun 17 15:35:06.627075 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 737/1888] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:35:06 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:35:07.484975 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-0bf60833-a50e-4e80-be2f-e0541e86d775 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:35:07.485655 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-0bf60833-a50e-4e80-be2f-e0541e86d775 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:35:07.492622 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0bf60833-a50e-4e80-be2f-e0541e86d775 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:07.493067 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0bf60833-a50e-4e80-be2f-e0541e86d775 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:07.493832 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0bf60833-a50e-4e80-be2f-e0541e86d775 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:07.494269 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0bf60833-a50e-4e80-be2f-e0541e86d775 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:07.563043 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-0bf60833-a50e-4e80-be2f-e0541e86d775 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:35:07.573477 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-0bf60833-a50e-4e80-be2f-e0541e86d775 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.092231 Jun 17 15:35:07.574320 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1152/1889] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:35:07 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:35:07.639939 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-94f52af1-d4af-4001-b311-39df948a0c0d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:35:07.640986 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-94f52af1-d4af-4001-b311-39df948a0c0d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:35:07.649031 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-94f52af1-d4af-4001-b311-39df948a0c0d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:07.649507 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-94f52af1-d4af-4001-b311-39df948a0c0d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:07.650850 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-94f52af1-d4af-4001-b311-39df948a0c0d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:07.651370 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-94f52af1-d4af-4001-b311-39df948a0c0d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:07.686821 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-94f52af1-d4af-4001-b311-39df948a0c0d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051198 Jun 17 15:35:07.687458 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 738/1890] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:35:07 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:35:08.592072 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-5ac0146c-c1ab-41c3-afb1-c46d2a847792 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:35:08.592794 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-5ac0146c-c1ab-41c3-afb1-c46d2a847792 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:35:08.595268 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_api:SELECT=54 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:35:08.602219 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5ac0146c-c1ab-41c3-afb1-c46d2a847792 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:08.602710 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5ac0146c-c1ab-41c3-afb1-c46d2a847792 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:08.603625 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5ac0146c-c1ab-41c3-afb1-c46d2a847792 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:08.604066 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5ac0146c-c1ab-41c3-afb1-c46d2a847792 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:08.624995 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=100 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:35:08.673181 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-5ac0146c-c1ab-41c3-afb1-c46d2a847792 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:35:08.681908 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-5ac0146c-c1ab-41c3-afb1-c46d2a847792 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.093389 Jun 17 15:35:08.682506 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1153/1891] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:35:08 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:35:08.699991 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-371cff3b-44e4-4422-838f-f886f41ca0da tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:35:08.700985 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-371cff3b-44e4-4422-838f-f886f41ca0da tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:35:08.708013 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-371cff3b-44e4-4422-838f-f886f41ca0da tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:08.708492 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-371cff3b-44e4-4422-838f-f886f41ca0da tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:08.709289 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-371cff3b-44e4-4422-838f-f886f41ca0da tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:08.709724 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-371cff3b-44e4-4422-838f-f886f41ca0da tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:08.744964 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-371cff3b-44e4-4422-838f-f886f41ca0da tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048605 Jun 17 15:35:08.746063 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 739/1892] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:35:08 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:35:09.700420 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-7cb9e790-4d59-44ec-b162-eb29d715f256 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:35:09.701072 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-7cb9e790-4d59-44ec-b162-eb29d715f256 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:35:09.707983 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7cb9e790-4d59-44ec-b162-eb29d715f256 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:09.708467 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7cb9e790-4d59-44ec-b162-eb29d715f256 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:09.709268 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7cb9e790-4d59-44ec-b162-eb29d715f256 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:09.709704 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7cb9e790-4d59-44ec-b162-eb29d715f256 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:09.758530 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-bdfa4c19-e487-4442-a3bf-65cd6289e830 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:35:09.759670 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-bdfa4c19-e487-4442-a3bf-65cd6289e830 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:35:09.767664 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bdfa4c19-e487-4442-a3bf-65cd6289e830 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:09.768308 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bdfa4c19-e487-4442-a3bf-65cd6289e830 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:09.769215 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bdfa4c19-e487-4442-a3bf-65cd6289e830 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:09.769713 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bdfa4c19-e487-4442-a3bf-65cd6289e830 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:09.784883 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-7cb9e790-4d59-44ec-b162-eb29d715f256 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:35:09.799653 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-7cb9e790-4d59-44ec-b162-eb29d715f256 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.103693 Jun 17 15:35:09.800705 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1154/1893] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:35:09 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:35:09.813661 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-bdfa4c19-e487-4442-a3bf-65cd6289e830 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059159 Jun 17 15:35:09.814259 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 740/1894] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:35:09 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:35:10.818525 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-559ee3ae-70ab-426c-9b0e-8a4142dcfed8 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:35:10.819486 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-559ee3ae-70ab-426c-9b0e-8a4142dcfed8 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:35:10.830549 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-559ee3ae-70ab-426c-9b0e-8a4142dcfed8 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:10.831321 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-559ee3ae-70ab-426c-9b0e-8a4142dcfed8 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:10.832030 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-378d065c-a476-455a-a604-ee0a49789c85 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:35:10.832687 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-559ee3ae-70ab-426c-9b0e-8a4142dcfed8 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:10.833493 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-559ee3ae-70ab-426c-9b0e-8a4142dcfed8 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:10.833741 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-378d065c-a476-455a-a604-ee0a49789c85 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:35:10.838014 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_api:SELECT=58 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:35:10.847862 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-378d065c-a476-455a-a604-ee0a49789c85 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:10.848960 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-378d065c-a476-455a-a604-ee0a49789c85 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:10.850383 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-378d065c-a476-455a-a604-ee0a49789c85 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:10.851968 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-378d065c-a476-455a-a604-ee0a49789c85 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:10.906615 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-559ee3ae-70ab-426c-9b0e-8a4142dcfed8 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:35:10.912517 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-378d065c-a476-455a-a604-ee0a49789c85 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087779 Jun 17 15:35:10.913412 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 741/1895] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:35:10 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:35:10.917147 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-559ee3ae-70ab-426c-9b0e-8a4142dcfed8 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.102389 Jun 17 15:35:10.918228 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1155/1896] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:35:10 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:35:11.926986 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-f967307e-77f3-4505-8452-e77eedacf7c3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:35:11.927921 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-f967307e-77f3-4505-8452-e77eedacf7c3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:35:11.935883 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-9b88b0c9-fded-4356-8eac-8341a736ec4b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:35:11.936790 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-9b88b0c9-fded-4356-8eac-8341a736ec4b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:35:11.936997 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f967307e-77f3-4505-8452-e77eedacf7c3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:11.937370 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f967307e-77f3-4505-8452-e77eedacf7c3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:11.938272 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f967307e-77f3-4505-8452-e77eedacf7c3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:11.938894 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f967307e-77f3-4505-8452-e77eedacf7c3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:11.944781 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9b88b0c9-fded-4356-8eac-8341a736ec4b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:11.944781 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9b88b0c9-fded-4356-8eac-8341a736ec4b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:11.944781 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9b88b0c9-fded-4356-8eac-8341a736ec4b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:11.945417 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9b88b0c9-fded-4356-8eac-8341a736ec4b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:11.974097 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-f967307e-77f3-4505-8452-e77eedacf7c3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050804 Jun 17 15:35:11.974695 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 742/1897] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:35:11 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:35:12.042051 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-9b88b0c9-fded-4356-8eac-8341a736ec4b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:35:12.050335 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-9b88b0c9-fded-4356-8eac-8341a736ec4b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.119174 Jun 17 15:35:12.050971 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1156/1898] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:35:11 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:35:12.987375 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-0b78e4c6-9bc8-466a-9b13-9ec897650853 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:35:12.988345 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-0b78e4c6-9bc8-466a-9b13-9ec897650853 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:35:12.996138 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0b78e4c6-9bc8-466a-9b13-9ec897650853 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:12.996761 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0b78e4c6-9bc8-466a-9b13-9ec897650853 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:12.997604 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0b78e4c6-9bc8-466a-9b13-9ec897650853 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:12.998089 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0b78e4c6-9bc8-466a-9b13-9ec897650853 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:13.032078 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-0b78e4c6-9bc8-466a-9b13-9ec897650853 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049001 Jun 17 15:35:13.032708 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 743/1899] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:35:12 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:35:13.067740 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-4c6c3669-6a47-4d3b-a148-a313656671d2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:35:13.068520 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-4c6c3669-6a47-4d3b-a148-a313656671d2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:35:13.076737 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4c6c3669-6a47-4d3b-a148-a313656671d2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:13.077195 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4c6c3669-6a47-4d3b-a148-a313656671d2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:13.077989 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4c6c3669-6a47-4d3b-a148-a313656671d2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:13.078437 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4c6c3669-6a47-4d3b-a148-a313656671d2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:13.145873 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-4c6c3669-6a47-4d3b-a148-a313656671d2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:35:13.154547 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-4c6c3669-6a47-4d3b-a148-a313656671d2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.090681 Jun 17 15:35:13.155155 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1157/1900] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:35:13 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:35:14.044901 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-60630c94-5133-4526-ae8d-b59a0239a5c7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:35:14.045875 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-60630c94-5133-4526-ae8d-b59a0239a5c7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:35:14.052968 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-60630c94-5133-4526-ae8d-b59a0239a5c7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:14.053420 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-60630c94-5133-4526-ae8d-b59a0239a5c7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:14.054215 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-60630c94-5133-4526-ae8d-b59a0239a5c7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:14.054660 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-60630c94-5133-4526-ae8d-b59a0239a5c7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:14.088588 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-60630c94-5133-4526-ae8d-b59a0239a5c7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047528 Jun 17 15:35:14.089195 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 744/1901] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:35:14 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:35:14.179799 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-13abdd2a-abd4-4015-83fe-fe941761e8a1 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:35:14.180458 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-13abdd2a-abd4-4015-83fe-fe941761e8a1 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:35:14.187759 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-13abdd2a-abd4-4015-83fe-fe941761e8a1 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:14.188117 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-13abdd2a-abd4-4015-83fe-fe941761e8a1 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:14.188912 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-13abdd2a-abd4-4015-83fe-fe941761e8a1 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:14.189374 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-13abdd2a-abd4-4015-83fe-fe941761e8a1 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:14.260932 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-13abdd2a-abd4-4015-83fe-fe941761e8a1 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:35:14.269301 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-13abdd2a-abd4-4015-83fe-fe941761e8a1 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.093376 Jun 17 15:35:14.269934 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1158/1902] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:35:14 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:35:15.101664 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-45f83102-695c-425b-a8c7-cd65d2b635b8 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:35:15.102784 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-45f83102-695c-425b-a8c7-cd65d2b635b8 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:35:15.110526 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-45f83102-695c-425b-a8c7-cd65d2b635b8 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:15.110969 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-45f83102-695c-425b-a8c7-cd65d2b635b8 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:15.111752 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-45f83102-695c-425b-a8c7-cd65d2b635b8 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:15.112182 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-45f83102-695c-425b-a8c7-cd65d2b635b8 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:15.153669 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-45f83102-695c-425b-a8c7-cd65d2b635b8 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057273 Jun 17 15:35:15.154352 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 745/1903] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:35:15 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:35:15.287660 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-f4f24bbc-3ddc-4366-a5cb-6c68da236aa5 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:35:15.288409 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-f4f24bbc-3ddc-4366-a5cb-6c68da236aa5 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:35:15.296167 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f4f24bbc-3ddc-4366-a5cb-6c68da236aa5 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:15.296690 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f4f24bbc-3ddc-4366-a5cb-6c68da236aa5 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:15.297512 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f4f24bbc-3ddc-4366-a5cb-6c68da236aa5 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:15.298062 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f4f24bbc-3ddc-4366-a5cb-6c68da236aa5 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:15.366901 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-f4f24bbc-3ddc-4366-a5cb-6c68da236aa5 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:35:15.375138 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-f4f24bbc-3ddc-4366-a5cb-6c68da236aa5 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.091615 Jun 17 15:35:15.375730 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1159/1904] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:35:15 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:35:16.166375 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-544e6fbb-0666-4a9f-b199-db5254af7a5a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:35:16.167330 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-544e6fbb-0666-4a9f-b199-db5254af7a5a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:35:16.175091 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-544e6fbb-0666-4a9f-b199-db5254af7a5a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:16.175768 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-544e6fbb-0666-4a9f-b199-db5254af7a5a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:16.176748 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-544e6fbb-0666-4a9f-b199-db5254af7a5a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:16.177294 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-544e6fbb-0666-4a9f-b199-db5254af7a5a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:16.211794 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-544e6fbb-0666-4a9f-b199-db5254af7a5a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049499 Jun 17 15:35:16.212623 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 746/1905] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:35:16 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:35:16.394242 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-59447373-8dd6-4908-9c76-41f50c4e6e9f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:35:16.394864 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-59447373-8dd6-4908-9c76-41f50c4e6e9f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:35:16.402461 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-59447373-8dd6-4908-9c76-41f50c4e6e9f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:16.402909 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-59447373-8dd6-4908-9c76-41f50c4e6e9f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:16.403697 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-59447373-8dd6-4908-9c76-41f50c4e6e9f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:16.404108 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-59447373-8dd6-4908-9c76-41f50c4e6e9f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:16.486553 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-59447373-8dd6-4908-9c76-41f50c4e6e9f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:35:16.496490 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-59447373-8dd6-4908-9c76-41f50c4e6e9f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.106657 Jun 17 15:35:16.497266 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1160/1906] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:35:16 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:35:17.224750 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-d7ab541f-033d-4521-8c8d-6ad94340f727 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:35:17.225755 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-d7ab541f-033d-4521-8c8d-6ad94340f727 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:35:17.232925 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d7ab541f-033d-4521-8c8d-6ad94340f727 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:17.233373 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d7ab541f-033d-4521-8c8d-6ad94340f727 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:17.234153 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d7ab541f-033d-4521-8c8d-6ad94340f727 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:17.234583 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d7ab541f-033d-4521-8c8d-6ad94340f727 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:17.267769 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-d7ab541f-033d-4521-8c8d-6ad94340f727 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047292 Jun 17 15:35:17.268459 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 747/1907] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:35:17 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:35:17.514673 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-809d3db5-b07f-49f7-b4e6-236ff2fcb524 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:35:17.515695 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-809d3db5-b07f-49f7-b4e6-236ff2fcb524 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:35:17.524024 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-809d3db5-b07f-49f7-b4e6-236ff2fcb524 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:17.524548 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-809d3db5-b07f-49f7-b4e6-236ff2fcb524 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:17.525502 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-809d3db5-b07f-49f7-b4e6-236ff2fcb524 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:17.526116 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-809d3db5-b07f-49f7-b4e6-236ff2fcb524 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:17.597796 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-809d3db5-b07f-49f7-b4e6-236ff2fcb524 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:35:17.612216 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-809d3db5-b07f-49f7-b4e6-236ff2fcb524 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.102165 Jun 17 15:35:17.613289 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1161/1908] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:35:17 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:35:18.280700 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-d6578ebb-4193-4afa-87ef-5187798cc56a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:35:18.281715 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-d6578ebb-4193-4afa-87ef-5187798cc56a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:35:18.289806 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d6578ebb-4193-4afa-87ef-5187798cc56a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:18.290317 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d6578ebb-4193-4afa-87ef-5187798cc56a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:18.291361 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d6578ebb-4193-4afa-87ef-5187798cc56a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:18.291860 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d6578ebb-4193-4afa-87ef-5187798cc56a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:18.325520 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-d6578ebb-4193-4afa-87ef-5187798cc56a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049500 Jun 17 15:35:18.326112 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 748/1909] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:35:18 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:35:18.639468 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-af59965b-2e16-47cd-9f2e-adb4614f279f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:35:18.640193 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-af59965b-2e16-47cd-9f2e-adb4614f279f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:35:18.647601 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-af59965b-2e16-47cd-9f2e-adb4614f279f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:18.648115 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-af59965b-2e16-47cd-9f2e-adb4614f279f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:18.649069 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-af59965b-2e16-47cd-9f2e-adb4614f279f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:18.649609 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-af59965b-2e16-47cd-9f2e-adb4614f279f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:18.731781 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-af59965b-2e16-47cd-9f2e-adb4614f279f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:35:18.740939 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-af59965b-2e16-47cd-9f2e-adb4614f279f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.105297 Jun 17 15:35:18.741530 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1162/1910] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:35:18 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:35:19.339640 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-07ab3dab-fd51-4d95-b960-f9511b3ba303 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:35:19.340628 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-07ab3dab-fd51-4d95-b960-f9511b3ba303 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:35:19.347650 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-07ab3dab-fd51-4d95-b960-f9511b3ba303 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:19.348094 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-07ab3dab-fd51-4d95-b960-f9511b3ba303 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:19.349169 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-07ab3dab-fd51-4d95-b960-f9511b3ba303 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:19.349615 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-07ab3dab-fd51-4d95-b960-f9511b3ba303 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:19.385102 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-07ab3dab-fd51-4d95-b960-f9511b3ba303 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049482 Jun 17 15:35:19.385693 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 749/1911] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:35:19 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:35:19.759979 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-3e0887a5-ec9d-4884-b6b3-741bde6b1dd2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:35:19.760650 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-3e0887a5-ec9d-4884-b6b3-741bde6b1dd2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:35:19.768231 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3e0887a5-ec9d-4884-b6b3-741bde6b1dd2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:19.768714 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3e0887a5-ec9d-4884-b6b3-741bde6b1dd2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:19.769496 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3e0887a5-ec9d-4884-b6b3-741bde6b1dd2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:19.769931 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3e0887a5-ec9d-4884-b6b3-741bde6b1dd2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:20.082914 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-3e0887a5-ec9d-4884-b6b3-741bde6b1dd2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:35:20.093898 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-3e0887a5-ec9d-4884-b6b3-741bde6b1dd2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.338664 Jun 17 15:35:20.094514 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1163/1912] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:35:19 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:35:20.397624 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-f34f286b-b120-4b4d-8dc5-7333048cbc6d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:35:20.398614 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-f34f286b-b120-4b4d-8dc5-7333048cbc6d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:35:20.406248 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f34f286b-b120-4b4d-8dc5-7333048cbc6d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:20.406702 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f34f286b-b120-4b4d-8dc5-7333048cbc6d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:20.407540 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f34f286b-b120-4b4d-8dc5-7333048cbc6d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:20.407989 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f34f286b-b120-4b4d-8dc5-7333048cbc6d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:20.443315 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-f34f286b-b120-4b4d-8dc5-7333048cbc6d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050064 Jun 17 15:35:20.443907 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 750/1913] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:35:20 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:35:21.112465 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-39521cca-97d5-45ec-aaa3-a8c6b5efb09c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:35:21.113103 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-39521cca-97d5-45ec-aaa3-a8c6b5efb09c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:35:21.121454 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-39521cca-97d5-45ec-aaa3-a8c6b5efb09c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:21.122246 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-39521cca-97d5-45ec-aaa3-a8c6b5efb09c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:21.123605 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-39521cca-97d5-45ec-aaa3-a8c6b5efb09c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:21.124405 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-39521cca-97d5-45ec-aaa3-a8c6b5efb09c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:21.206091 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-39521cca-97d5-45ec-aaa3-a8c6b5efb09c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:35:21.220132 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-39521cca-97d5-45ec-aaa3-a8c6b5efb09c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.112172 Jun 17 15:35:21.221512 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1164/1914] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:35:21 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:35:21.455601 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-bb525902-d82e-4a98-a9dc-fad097ff05f5 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:35:21.456586 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-bb525902-d82e-4a98-a9dc-fad097ff05f5 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:35:21.463902 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bb525902-d82e-4a98-a9dc-fad097ff05f5 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:21.464382 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bb525902-d82e-4a98-a9dc-fad097ff05f5 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:21.465185 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bb525902-d82e-4a98-a9dc-fad097ff05f5 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:21.465622 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bb525902-d82e-4a98-a9dc-fad097ff05f5 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:21.503595 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-bb525902-d82e-4a98-a9dc-fad097ff05f5 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051929 Jun 17 15:35:21.504519 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 751/1915] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:35:21 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:35:22.247433 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-1e2be925-33a6-420b-bdcc-ea5e44ba5b2c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:35:22.249063 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-1e2be925-33a6-420b-bdcc-ea5e44ba5b2c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:35:22.257606 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1e2be925-33a6-420b-bdcc-ea5e44ba5b2c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:22.258110 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1e2be925-33a6-420b-bdcc-ea5e44ba5b2c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:22.258947 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1e2be925-33a6-420b-bdcc-ea5e44ba5b2c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:22.259953 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1e2be925-33a6-420b-bdcc-ea5e44ba5b2c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:22.330939 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-1e2be925-33a6-420b-bdcc-ea5e44ba5b2c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:35:22.339715 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-1e2be925-33a6-420b-bdcc-ea5e44ba5b2c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.098138 Jun 17 15:35:22.340312 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1165/1916] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:35:22 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:35:22.521985 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-455fbbb1-f5cf-432d-981a-377fb935b114 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:35:22.523320 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-455fbbb1-f5cf-432d-981a-377fb935b114 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:35:22.535337 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-455fbbb1-f5cf-432d-981a-377fb935b114 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:22.535879 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-455fbbb1-f5cf-432d-981a-377fb935b114 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:22.536809 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-455fbbb1-f5cf-432d-981a-377fb935b114 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:22.537339 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-455fbbb1-f5cf-432d-981a-377fb935b114 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:22.572706 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-455fbbb1-f5cf-432d-981a-377fb935b114 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057656 Jun 17 15:35:22.573302 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 752/1917] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:35:22 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:35:23.367329 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-407011ba-185f-4c08-8694-0f778c1dbefa tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:35:23.368434 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-407011ba-185f-4c08-8694-0f778c1dbefa tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:35:23.380558 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-407011ba-185f-4c08-8694-0f778c1dbefa tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:23.381364 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-407011ba-185f-4c08-8694-0f778c1dbefa tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:23.382751 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-407011ba-185f-4c08-8694-0f778c1dbefa tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:23.383541 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-407011ba-185f-4c08-8694-0f778c1dbefa tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:23.468686 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-407011ba-185f-4c08-8694-0f778c1dbefa tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:35:23.481653 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-407011ba-185f-4c08-8694-0f778c1dbefa tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.120145 Jun 17 15:35:23.482711 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1166/1918] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:35:23 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:35:23.586738 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-11b12c5a-ed28-49bc-9931-998237604da6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:35:23.587725 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-11b12c5a-ed28-49bc-9931-998237604da6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:35:23.594660 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-11b12c5a-ed28-49bc-9931-998237604da6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:23.595109 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-11b12c5a-ed28-49bc-9931-998237604da6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:23.595900 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-11b12c5a-ed28-49bc-9931-998237604da6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:23.596368 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-11b12c5a-ed28-49bc-9931-998237604da6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:23.629950 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-11b12c5a-ed28-49bc-9931-998237604da6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047299 Jun 17 15:35:23.630537 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 753/1919] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:35:23 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:35:24.506218 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-88a37e77-2c38-4318-a698-2d6449eca560 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:35:24.506841 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-88a37e77-2c38-4318-a698-2d6449eca560 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:35:24.513840 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-88a37e77-2c38-4318-a698-2d6449eca560 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:24.514370 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-88a37e77-2c38-4318-a698-2d6449eca560 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:24.515145 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-88a37e77-2c38-4318-a698-2d6449eca560 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:24.515583 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-88a37e77-2c38-4318-a698-2d6449eca560 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:24.584104 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-88a37e77-2c38-4318-a698-2d6449eca560 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:35:24.592959 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-88a37e77-2c38-4318-a698-2d6449eca560 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.090662 Jun 17 15:35:24.593551 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1167/1920] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:35:24 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:35:24.641946 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-a35c88f7-1bf5-46df-a4a2-fc8c542e7192 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:35:24.642810 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-a35c88f7-1bf5-46df-a4a2-fc8c542e7192 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:35:24.650439 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a35c88f7-1bf5-46df-a4a2-fc8c542e7192 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:24.650902 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a35c88f7-1bf5-46df-a4a2-fc8c542e7192 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:24.651699 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a35c88f7-1bf5-46df-a4a2-fc8c542e7192 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:24.652140 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a35c88f7-1bf5-46df-a4a2-fc8c542e7192 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:24.670818 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell1:SELECT=100 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:35:24.685735 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-a35c88f7-1bf5-46df-a4a2-fc8c542e7192 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047956 Jun 17 15:35:24.686394 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 754/1921] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:35:24 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:35:25.610821 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-c08dd8e0-677f-40d5-b80f-a080fa5ec3e0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:35:25.611522 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-c08dd8e0-677f-40d5-b80f-a080fa5ec3e0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:35:25.619746 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c08dd8e0-677f-40d5-b80f-a080fa5ec3e0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:25.620254 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c08dd8e0-677f-40d5-b80f-a080fa5ec3e0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:25.621261 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c08dd8e0-677f-40d5-b80f-a080fa5ec3e0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:25.621741 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c08dd8e0-677f-40d5-b80f-a080fa5ec3e0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:25.688879 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-c08dd8e0-677f-40d5-b80f-a080fa5ec3e0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:35:25.697696 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-c08dd8e0-677f-40d5-b80f-a080fa5ec3e0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.091053 Jun 17 15:35:25.698289 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1168/1922] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:35:25 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:35:25.698807 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-cc79cf78-b4e1-4e2f-9cc6-5e54ddcca281 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:35:25.700258 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-cc79cf78-b4e1-4e2f-9cc6-5e54ddcca281 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:35:25.708596 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cc79cf78-b4e1-4e2f-9cc6-5e54ddcca281 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:25.709193 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cc79cf78-b4e1-4e2f-9cc6-5e54ddcca281 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:25.710096 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cc79cf78-b4e1-4e2f-9cc6-5e54ddcca281 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:25.710639 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cc79cf78-b4e1-4e2f-9cc6-5e54ddcca281 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:25.745294 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-cc79cf78-b4e1-4e2f-9cc6-5e54ddcca281 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051217 Jun 17 15:35:25.745891 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 755/1923] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:35:25 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:35:26.716224 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-cd975703-4fcb-4767-b01b-5c5a45dcd14d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:35:26.717287 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-cd975703-4fcb-4767-b01b-5c5a45dcd14d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:35:26.725267 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cd975703-4fcb-4767-b01b-5c5a45dcd14d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:26.725841 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cd975703-4fcb-4767-b01b-5c5a45dcd14d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:26.726722 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cd975703-4fcb-4767-b01b-5c5a45dcd14d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:26.727244 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cd975703-4fcb-4767-b01b-5c5a45dcd14d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:26.761162 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-17f0d999-148f-47f1-bacb-3ad63bab91b1 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:35:26.762774 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-17f0d999-148f-47f1-bacb-3ad63bab91b1 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:35:26.773612 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-17f0d999-148f-47f1-bacb-3ad63bab91b1 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:26.774409 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-17f0d999-148f-47f1-bacb-3ad63bab91b1 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:26.776316 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-17f0d999-148f-47f1-bacb-3ad63bab91b1 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:26.777142 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-17f0d999-148f-47f1-bacb-3ad63bab91b1 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:26.804151 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-cd975703-4fcb-4767-b01b-5c5a45dcd14d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:35:26.812561 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-cd975703-4fcb-4767-b01b-5c5a45dcd14d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.101302 Jun 17 15:35:26.813897 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1169/1924] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:35:26 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:35:26.836119 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-17f0d999-148f-47f1-bacb-3ad63bab91b1 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081771 Jun 17 15:35:26.837786 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 756/1925] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:35:26 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:35:27.831394 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-5754af6c-6ee2-42d7-ac9b-00b045c3f77b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:35:27.832011 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-5754af6c-6ee2-42d7-ac9b-00b045c3f77b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:35:27.839652 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5754af6c-6ee2-42d7-ac9b-00b045c3f77b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:27.840102 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5754af6c-6ee2-42d7-ac9b-00b045c3f77b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:27.841064 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5754af6c-6ee2-42d7-ac9b-00b045c3f77b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:27.841524 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5754af6c-6ee2-42d7-ac9b-00b045c3f77b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:27.846442 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=100 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:35:27.853619 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-27ea86f0-3efa-48ae-b99f-9157f6d29929 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:35:27.855183 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-27ea86f0-3efa-48ae-b99f-9157f6d29929 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:35:27.864096 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-27ea86f0-3efa-48ae-b99f-9157f6d29929 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:27.864674 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-27ea86f0-3efa-48ae-b99f-9157f6d29929 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:27.866127 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-27ea86f0-3efa-48ae-b99f-9157f6d29929 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:27.866644 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-27ea86f0-3efa-48ae-b99f-9157f6d29929 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:27.919309 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-27ea86f0-3efa-48ae-b99f-9157f6d29929 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070990 Jun 17 15:35:27.920632 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 757/1926] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:35:27 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:35:27.937065 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-5754af6c-6ee2-42d7-ac9b-00b045c3f77b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:35:27.951662 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-5754af6c-6ee2-42d7-ac9b-00b045c3f77b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.124089 Jun 17 15:35:27.952755 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1170/1927] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:35:27 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:35:28.934412 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-9a5f182e-052e-4388-9ab4-31ad4ef0420b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:35:28.935361 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-9a5f182e-052e-4388-9ab4-31ad4ef0420b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:35:28.942985 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9a5f182e-052e-4388-9ab4-31ad4ef0420b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:28.943587 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9a5f182e-052e-4388-9ab4-31ad4ef0420b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:28.944443 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9a5f182e-052e-4388-9ab4-31ad4ef0420b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:28.944896 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9a5f182e-052e-4388-9ab4-31ad4ef0420b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:28.976828 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-61826e1a-ad1b-4935-8272-6edc11334d63 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:35:28.977479 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-61826e1a-ad1b-4935-8272-6edc11334d63 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:35:28.985613 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-61826e1a-ad1b-4935-8272-6edc11334d63 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:28.986197 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-61826e1a-ad1b-4935-8272-6edc11334d63 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:28.987001 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-61826e1a-ad1b-4935-8272-6edc11334d63 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:28.987440 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-61826e1a-ad1b-4935-8272-6edc11334d63 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:28.988674 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-9a5f182e-052e-4388-9ab4-31ad4ef0420b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058463 Jun 17 15:35:28.989651 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 758/1928] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:35:28 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:35:29.060436 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-61826e1a-ad1b-4935-8272-6edc11334d63 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:35:29.069092 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-61826e1a-ad1b-4935-8272-6edc11334d63 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.096569 Jun 17 15:35:29.069690 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1171/1929] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:35:28 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:35:30.002965 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-9e1c32ef-69a5-4589-bfa2-f293c4c6a5d4 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:35:30.003905 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-9e1c32ef-69a5-4589-bfa2-f293c4c6a5d4 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:35:30.011094 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9e1c32ef-69a5-4589-bfa2-f293c4c6a5d4 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:30.011543 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9e1c32ef-69a5-4589-bfa2-f293c4c6a5d4 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:30.012350 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9e1c32ef-69a5-4589-bfa2-f293c4c6a5d4 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:30.012798 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9e1c32ef-69a5-4589-bfa2-f293c4c6a5d4 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:30.045554 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-9e1c32ef-69a5-4589-bfa2-f293c4c6a5d4 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046569 Jun 17 15:35:30.046153 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 759/1930] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:35:29 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:35:30.087069 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-b0856f1d-1151-4eee-b95d-b2ec06634595 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:35:30.087929 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-b0856f1d-1151-4eee-b95d-b2ec06634595 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:35:30.094900 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b0856f1d-1151-4eee-b95d-b2ec06634595 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:30.095381 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b0856f1d-1151-4eee-b95d-b2ec06634595 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:30.096158 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b0856f1d-1151-4eee-b95d-b2ec06634595 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:30.096629 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b0856f1d-1151-4eee-b95d-b2ec06634595 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:30.166592 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-b0856f1d-1151-4eee-b95d-b2ec06634595 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:35:30.174639 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-b0856f1d-1151-4eee-b95d-b2ec06634595 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.091566 Jun 17 15:35:30.175239 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1172/1931] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:35:30 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:35:31.058098 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-cf3bb788-6c65-4dc4-a1bf-9eed85e8abdf tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:35:31.059495 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-cf3bb788-6c65-4dc4-a1bf-9eed85e8abdf tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:35:31.071023 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cf3bb788-6c65-4dc4-a1bf-9eed85e8abdf tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:31.071732 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cf3bb788-6c65-4dc4-a1bf-9eed85e8abdf tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:31.072762 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cf3bb788-6c65-4dc4-a1bf-9eed85e8abdf tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:31.073367 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cf3bb788-6c65-4dc4-a1bf-9eed85e8abdf tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:31.117001 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-cf3bb788-6c65-4dc4-a1bf-9eed85e8abdf tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062896 Jun 17 15:35:31.117841 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 760/1932] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:35:31 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:35:31.196825 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-ed8e013f-a983-4bc5-8b7d-ae5ee6ac4ba6 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:35:31.197981 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-ed8e013f-a983-4bc5-8b7d-ae5ee6ac4ba6 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:35:31.208935 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ed8e013f-a983-4bc5-8b7d-ae5ee6ac4ba6 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:31.209729 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ed8e013f-a983-4bc5-8b7d-ae5ee6ac4ba6 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:31.211103 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ed8e013f-a983-4bc5-8b7d-ae5ee6ac4ba6 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:31.211883 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ed8e013f-a983-4bc5-8b7d-ae5ee6ac4ba6 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:31.306347 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-ed8e013f-a983-4bc5-8b7d-ae5ee6ac4ba6 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:35:31.314934 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-ed8e013f-a983-4bc5-8b7d-ae5ee6ac4ba6 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.125331 Jun 17 15:35:31.315555 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1173/1933] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:35:31 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:35:32.130134 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-3d5b5ca4-43b3-42d1-8c76-7774b5b60bdf tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:35:32.131140 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-3d5b5ca4-43b3-42d1-8c76-7774b5b60bdf tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:35:32.138844 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3d5b5ca4-43b3-42d1-8c76-7774b5b60bdf tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:32.139287 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3d5b5ca4-43b3-42d1-8c76-7774b5b60bdf tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:32.140088 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3d5b5ca4-43b3-42d1-8c76-7774b5b60bdf tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:32.140561 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3d5b5ca4-43b3-42d1-8c76-7774b5b60bdf tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:32.195594 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-3d5b5ca4-43b3-42d1-8c76-7774b5b60bdf tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069494 Jun 17 15:35:32.197166 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 761/1934] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:35:32 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:35:32.333628 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-08c8750c-e7b1-4b4d-87a2-37c736f093a8 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:35:32.334276 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-08c8750c-e7b1-4b4d-87a2-37c736f093a8 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:35:32.342265 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-08c8750c-e7b1-4b4d-87a2-37c736f093a8 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:32.342769 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-08c8750c-e7b1-4b4d-87a2-37c736f093a8 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:32.343765 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-08c8750c-e7b1-4b4d-87a2-37c736f093a8 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:32.344453 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-08c8750c-e7b1-4b4d-87a2-37c736f093a8 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:32.442389 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-08c8750c-e7b1-4b4d-87a2-37c736f093a8 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:35:32.458525 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-08c8750c-e7b1-4b4d-87a2-37c736f093a8 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.129142 Jun 17 15:35:32.459137 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1174/1935] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:35:32 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:35:33.211436 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-b46b3487-c901-4c0f-8edb-1480fa0d81e8 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:35:33.212786 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-b46b3487-c901-4c0f-8edb-1480fa0d81e8 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:35:33.220001 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b46b3487-c901-4c0f-8edb-1480fa0d81e8 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:33.220492 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b46b3487-c901-4c0f-8edb-1480fa0d81e8 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:33.221279 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b46b3487-c901-4c0f-8edb-1480fa0d81e8 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:33.221713 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b46b3487-c901-4c0f-8edb-1480fa0d81e8 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:33.256183 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-b46b3487-c901-4c0f-8edb-1480fa0d81e8 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048717 Jun 17 15:35:33.256969 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 762/1936] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:35:33 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:35:33.476785 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-7b8b54bf-b003-431c-af96-3bf410aa15be tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:35:33.477408 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-7b8b54bf-b003-431c-af96-3bf410aa15be tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:35:33.486836 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7b8b54bf-b003-431c-af96-3bf410aa15be tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:33.487612 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7b8b54bf-b003-431c-af96-3bf410aa15be tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:33.489086 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7b8b54bf-b003-431c-af96-3bf410aa15be tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:33.489854 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7b8b54bf-b003-431c-af96-3bf410aa15be tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:33.582861 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-7b8b54bf-b003-431c-af96-3bf410aa15be tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:35:33.591207 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-7b8b54bf-b003-431c-af96-3bf410aa15be tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.118865 Jun 17 15:35:33.591801 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1175/1937] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:35:33 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:35:34.273550 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-78a9af97-a0be-4f7d-b36b-4a38b06f1c14 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:35:34.275263 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-78a9af97-a0be-4f7d-b36b-4a38b06f1c14 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:35:34.287428 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-78a9af97-a0be-4f7d-b36b-4a38b06f1c14 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:34.288251 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-78a9af97-a0be-4f7d-b36b-4a38b06f1c14 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:34.289795 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-78a9af97-a0be-4f7d-b36b-4a38b06f1c14 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:34.291064 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-78a9af97-a0be-4f7d-b36b-4a38b06f1c14 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:34.351621 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-78a9af97-a0be-4f7d-b36b-4a38b06f1c14 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085662 Jun 17 15:35:34.353254 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 763/1938] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:35:34 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:35:34.609529 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-b5d8ef00-7528-459a-93e2-1cf2399b294a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:35:34.610193 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-b5d8ef00-7528-459a-93e2-1cf2399b294a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:35:34.617485 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b5d8ef00-7528-459a-93e2-1cf2399b294a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:34.617936 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b5d8ef00-7528-459a-93e2-1cf2399b294a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:34.619351 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b5d8ef00-7528-459a-93e2-1cf2399b294a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:34.619785 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b5d8ef00-7528-459a-93e2-1cf2399b294a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:34.688525 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-b5d8ef00-7528-459a-93e2-1cf2399b294a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:35:34.696785 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-b5d8ef00-7528-459a-93e2-1cf2399b294a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.091073 Jun 17 15:35:34.697385 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1176/1939] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:35:34 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:35:35.370919 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-c3350d62-4ac3-43d7-9594-d07e4e5bd6f9 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:35:35.372690 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-c3350d62-4ac3-43d7-9594-d07e4e5bd6f9 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:35:35.382095 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c3350d62-4ac3-43d7-9594-d07e4e5bd6f9 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:35.382540 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c3350d62-4ac3-43d7-9594-d07e4e5bd6f9 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:35.383318 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c3350d62-4ac3-43d7-9594-d07e4e5bd6f9 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:35.384276 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c3350d62-4ac3-43d7-9594-d07e4e5bd6f9 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:35.417526 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-c3350d62-4ac3-43d7-9594-d07e4e5bd6f9 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053951 Jun 17 15:35:35.418042 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 764/1940] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:35:35 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:35:35.722516 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-efe23618-9d5b-4f45-9841-315d43276602 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:35:35.723113 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-efe23618-9d5b-4f45-9841-315d43276602 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:35:35.730799 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-efe23618-9d5b-4f45-9841-315d43276602 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:35.731237 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-efe23618-9d5b-4f45-9841-315d43276602 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:35.732000 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-efe23618-9d5b-4f45-9841-315d43276602 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:35.732457 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-efe23618-9d5b-4f45-9841-315d43276602 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:35.803884 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-efe23618-9d5b-4f45-9841-315d43276602 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:35:35.812831 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-efe23618-9d5b-4f45-9841-315d43276602 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.094661 Jun 17 15:35:35.813427 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1177/1941] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:35:35 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:35:36.435421 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-29303658-8103-4b8d-bbab-c4a8681f46ac tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:35:36.437348 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-29303658-8103-4b8d-bbab-c4a8681f46ac tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:35:36.460732 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-29303658-8103-4b8d-bbab-c4a8681f46ac tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:36.461448 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-29303658-8103-4b8d-bbab-c4a8681f46ac tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:36.463273 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-29303658-8103-4b8d-bbab-c4a8681f46ac tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:36.464031 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-29303658-8103-4b8d-bbab-c4a8681f46ac tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:36.512156 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-29303658-8103-4b8d-bbab-c4a8681f46ac tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084512 Jun 17 15:35:36.512926 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 765/1942] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:35:36 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:35:36.831076 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-72d9ad83-b53b-4d3d-87e5-dc7748297543 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:35:36.831786 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-72d9ad83-b53b-4d3d-87e5-dc7748297543 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:35:36.839628 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-72d9ad83-b53b-4d3d-87e5-dc7748297543 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:36.840100 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-72d9ad83-b53b-4d3d-87e5-dc7748297543 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:36.840997 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-72d9ad83-b53b-4d3d-87e5-dc7748297543 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:36.841437 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-72d9ad83-b53b-4d3d-87e5-dc7748297543 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:36.915225 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-72d9ad83-b53b-4d3d-87e5-dc7748297543 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:35:36.923681 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-72d9ad83-b53b-4d3d-87e5-dc7748297543 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.096819 Jun 17 15:35:36.924305 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1178/1943] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:35:36 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:35:37.526108 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-c4086a9c-36e5-4691-903c-e2fa46e3f12f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:35:37.527390 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-c4086a9c-36e5-4691-903c-e2fa46e3f12f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:35:37.534535 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c4086a9c-36e5-4691-903c-e2fa46e3f12f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:37.534984 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c4086a9c-36e5-4691-903c-e2fa46e3f12f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:37.535780 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c4086a9c-36e5-4691-903c-e2fa46e3f12f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:37.536217 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c4086a9c-36e5-4691-903c-e2fa46e3f12f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:37.571498 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-c4086a9c-36e5-4691-903c-e2fa46e3f12f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051147 Jun 17 15:35:37.572199 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 766/1944] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:35:37 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:35:37.998263 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-1a23405f-672d-4ce6-b4aa-961febcd7d1d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:35:37.998999 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-1a23405f-672d-4ce6-b4aa-961febcd7d1d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:35:38.006374 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1a23405f-672d-4ce6-b4aa-961febcd7d1d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:38.006828 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1a23405f-672d-4ce6-b4aa-961febcd7d1d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:38.007646 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1a23405f-672d-4ce6-b4aa-961febcd7d1d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:38.008063 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1a23405f-672d-4ce6-b4aa-961febcd7d1d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:38.074936 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-1a23405f-672d-4ce6-b4aa-961febcd7d1d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:35:38.082958 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-1a23405f-672d-4ce6-b4aa-961febcd7d1d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.088560 Jun 17 15:35:38.083552 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1179/1945] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:35:37 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:35:38.585512 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-56636ff9-a110-4aa6-a3ee-b0ff979ffc85 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:35:38.586486 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-56636ff9-a110-4aa6-a3ee-b0ff979ffc85 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:35:38.593865 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-56636ff9-a110-4aa6-a3ee-b0ff979ffc85 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:38.594313 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-56636ff9-a110-4aa6-a3ee-b0ff979ffc85 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:38.595100 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-56636ff9-a110-4aa6-a3ee-b0ff979ffc85 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:38.595536 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-56636ff9-a110-4aa6-a3ee-b0ff979ffc85 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:38.627877 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-56636ff9-a110-4aa6-a3ee-b0ff979ffc85 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046271 Jun 17 15:35:38.628401 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 767/1946] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:35:38 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:35:39.101937 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-5c02a113-1331-41db-98b5-236688cf613e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:35:39.103159 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-5c02a113-1331-41db-98b5-236688cf613e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:35:39.105592 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_api:SELECT=54 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:35:39.111808 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5c02a113-1331-41db-98b5-236688cf613e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:39.112255 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5c02a113-1331-41db-98b5-236688cf613e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:39.113067 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5c02a113-1331-41db-98b5-236688cf613e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:39.113504 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5c02a113-1331-41db-98b5-236688cf613e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:39.182601 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-5c02a113-1331-41db-98b5-236688cf613e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:35:39.190661 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-5c02a113-1331-41db-98b5-236688cf613e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.093252 Jun 17 15:35:39.191256 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1180/1947] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:35:39 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:35:39.640394 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-7e52583f-17ad-4678-af39-656fd2d30c24 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:35:39.641260 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-7e52583f-17ad-4678-af39-656fd2d30c24 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:35:39.649043 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7e52583f-17ad-4678-af39-656fd2d30c24 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:39.650127 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7e52583f-17ad-4678-af39-656fd2d30c24 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:39.651161 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7e52583f-17ad-4678-af39-656fd2d30c24 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:39.651643 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7e52583f-17ad-4678-af39-656fd2d30c24 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:39.686261 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-7e52583f-17ad-4678-af39-656fd2d30c24 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049953 Jun 17 15:35:39.686878 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 768/1948] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:35:39 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:35:40.209317 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-ffc78901-5f72-42ef-82fa-367f2b48a3bf tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:35:40.210107 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-ffc78901-5f72-42ef-82fa-367f2b48a3bf tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:35:40.217981 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ffc78901-5f72-42ef-82fa-367f2b48a3bf tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:40.218490 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ffc78901-5f72-42ef-82fa-367f2b48a3bf tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:40.219374 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ffc78901-5f72-42ef-82fa-367f2b48a3bf tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:40.219882 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ffc78901-5f72-42ef-82fa-367f2b48a3bf tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:40.291703 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-ffc78901-5f72-42ef-82fa-367f2b48a3bf tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:35:40.301196 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-ffc78901-5f72-42ef-82fa-367f2b48a3bf tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.096616 Jun 17 15:35:40.301932 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1181/1949] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:35:40 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:35:40.699337 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-fb96d501-7b05-490a-ae04-6091b69eb311 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:35:40.700433 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-fb96d501-7b05-490a-ae04-6091b69eb311 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:35:40.707773 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fb96d501-7b05-490a-ae04-6091b69eb311 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:40.708230 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fb96d501-7b05-490a-ae04-6091b69eb311 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:40.709116 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fb96d501-7b05-490a-ae04-6091b69eb311 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:40.709696 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fb96d501-7b05-490a-ae04-6091b69eb311 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:40.745491 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-fb96d501-7b05-490a-ae04-6091b69eb311 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050723 Jun 17 15:35:40.746115 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 769/1950] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:35:40 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:35:41.326605 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-3e571ba8-26c4-40f4-a731-3533f1abf339 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:35:41.327352 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-3e571ba8-26c4-40f4-a731-3533f1abf339 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:35:41.334365 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3e571ba8-26c4-40f4-a731-3533f1abf339 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:41.334812 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3e571ba8-26c4-40f4-a731-3533f1abf339 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:41.335588 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3e571ba8-26c4-40f4-a731-3533f1abf339 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:41.336022 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3e571ba8-26c4-40f4-a731-3533f1abf339 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:41.409847 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-3e571ba8-26c4-40f4-a731-3533f1abf339 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:35:41.418235 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-3e571ba8-26c4-40f4-a731-3533f1abf339 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.095572 Jun 17 15:35:41.418890 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1182/1951] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:35:41 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:35:41.760741 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-664b439b-eeab-4c29-afd3-14f16fbe1d43 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:35:41.761616 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-664b439b-eeab-4c29-afd3-14f16fbe1d43 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:35:41.764179 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_api:SELECT=58 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:35:41.770352 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-664b439b-eeab-4c29-afd3-14f16fbe1d43 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:41.770805 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-664b439b-eeab-4c29-afd3-14f16fbe1d43 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:41.771598 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-664b439b-eeab-4c29-afd3-14f16fbe1d43 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:41.772243 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-664b439b-eeab-4c29-afd3-14f16fbe1d43 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:41.807695 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-664b439b-eeab-4c29-afd3-14f16fbe1d43 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051458 Jun 17 15:35:41.808294 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 770/1952] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:35:41 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:35:42.436404 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-855e41c5-0133-4d85-85d2-5a4740d19381 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:35:42.437612 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-855e41c5-0133-4d85-85d2-5a4740d19381 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:35:42.446745 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-855e41c5-0133-4d85-85d2-5a4740d19381 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:42.447302 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-855e41c5-0133-4d85-85d2-5a4740d19381 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:42.448221 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-855e41c5-0133-4d85-85d2-5a4740d19381 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:42.448686 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-855e41c5-0133-4d85-85d2-5a4740d19381 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:42.516834 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-855e41c5-0133-4d85-85d2-5a4740d19381 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:35:42.525170 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-855e41c5-0133-4d85-85d2-5a4740d19381 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.093245 Jun 17 15:35:42.525764 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1183/1953] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:35:42 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:35:42.819817 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-2ee3aa09-f52e-42ab-9f44-11ad00fdce14 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:35:42.820734 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-2ee3aa09-f52e-42ab-9f44-11ad00fdce14 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:35:42.829188 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2ee3aa09-f52e-42ab-9f44-11ad00fdce14 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:42.829656 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2ee3aa09-f52e-42ab-9f44-11ad00fdce14 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:42.830446 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2ee3aa09-f52e-42ab-9f44-11ad00fdce14 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:42.830890 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2ee3aa09-f52e-42ab-9f44-11ad00fdce14 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:42.835287 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell1:SELECT=100 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:35:42.864461 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-2ee3aa09-f52e-42ab-9f44-11ad00fdce14 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048694 Jun 17 15:35:42.865056 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 771/1954] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:35:42 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:35:43.542980 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-cfe912b0-cbe4-45e3-a04f-08698679c3f3 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:35:43.543778 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-cfe912b0-cbe4-45e3-a04f-08698679c3f3 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:35:43.551847 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cfe912b0-cbe4-45e3-a04f-08698679c3f3 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:43.552386 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cfe912b0-cbe4-45e3-a04f-08698679c3f3 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:43.553393 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cfe912b0-cbe4-45e3-a04f-08698679c3f3 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:43.553948 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cfe912b0-cbe4-45e3-a04f-08698679c3f3 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:43.626760 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-cfe912b0-cbe4-45e3-a04f-08698679c3f3 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:35:43.640957 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-cfe912b0-cbe4-45e3-a04f-08698679c3f3 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.102181 Jun 17 15:35:43.641894 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1184/1955] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:35:43 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:35:43.877140 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-3d117598-8b6d-4930-bb47-cce27d440f22 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:35:43.878599 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-3d117598-8b6d-4930-bb47-cce27d440f22 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:35:43.885898 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3d117598-8b6d-4930-bb47-cce27d440f22 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:43.886346 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3d117598-8b6d-4930-bb47-cce27d440f22 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:43.887127 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3d117598-8b6d-4930-bb47-cce27d440f22 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:43.887566 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3d117598-8b6d-4930-bb47-cce27d440f22 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:43.922709 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-3d117598-8b6d-4930-bb47-cce27d440f22 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049707 Jun 17 15:35:43.923166 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 772/1956] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:35:43 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:35:44.666793 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-4868d490-a55d-48fe-97ae-1a1ee284b8cf tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:35:44.667711 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-4868d490-a55d-48fe-97ae-1a1ee284b8cf tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:35:44.675378 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4868d490-a55d-48fe-97ae-1a1ee284b8cf tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:44.675829 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4868d490-a55d-48fe-97ae-1a1ee284b8cf tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:44.676671 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4868d490-a55d-48fe-97ae-1a1ee284b8cf tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:44.677120 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4868d490-a55d-48fe-97ae-1a1ee284b8cf tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:44.748810 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-4868d490-a55d-48fe-97ae-1a1ee284b8cf tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:35:44.757107 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-4868d490-a55d-48fe-97ae-1a1ee284b8cf tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.094729 Jun 17 15:35:44.757761 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1185/1957] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:35:44 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:35:44.934648 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-adc52290-448f-4e77-983c-0f8b683b71ca tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:35:44.935489 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-adc52290-448f-4e77-983c-0f8b683b71ca tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:35:44.941989 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-adc52290-448f-4e77-983c-0f8b683b71ca tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:44.942466 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-adc52290-448f-4e77-983c-0f8b683b71ca tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:44.943246 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-adc52290-448f-4e77-983c-0f8b683b71ca tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:44.943737 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-adc52290-448f-4e77-983c-0f8b683b71ca tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:44.979236 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-adc52290-448f-4e77-983c-0f8b683b71ca tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049364 Jun 17 15:35:44.980020 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 773/1958] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:35:44 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:35:45.775538 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-6a077372-1234-4c32-a05f-04fb7dd18c31 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:35:45.776478 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-6a077372-1234-4c32-a05f-04fb7dd18c31 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:35:45.783842 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6a077372-1234-4c32-a05f-04fb7dd18c31 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:45.784317 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6a077372-1234-4c32-a05f-04fb7dd18c31 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:45.785128 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6a077372-1234-4c32-a05f-04fb7dd18c31 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:45.785569 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6a077372-1234-4c32-a05f-04fb7dd18c31 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:45.855631 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-6a077372-1234-4c32-a05f-04fb7dd18c31 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:35:45.859297 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=100 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:35:45.864617 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-6a077372-1234-4c32-a05f-04fb7dd18c31 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.093117 Jun 17 15:35:45.865217 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1186/1959] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:35:45 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:35:45.991678 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-d32e55cc-fb77-41a8-9381-dee2db635496 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:35:45.992657 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-d32e55cc-fb77-41a8-9381-dee2db635496 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:35:45.999821 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d32e55cc-fb77-41a8-9381-dee2db635496 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:46.000275 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d32e55cc-fb77-41a8-9381-dee2db635496 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:46.001104 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d32e55cc-fb77-41a8-9381-dee2db635496 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:46.001543 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d32e55cc-fb77-41a8-9381-dee2db635496 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:46.054109 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-d32e55cc-fb77-41a8-9381-dee2db635496 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066104 Jun 17 15:35:46.054906 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 774/1960] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:35:45 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:35:46.882615 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-d914bd1c-78c1-4aab-8a37-5cdf24c8b18e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:35:46.883345 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-d914bd1c-78c1-4aab-8a37-5cdf24c8b18e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:35:46.890346 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d914bd1c-78c1-4aab-8a37-5cdf24c8b18e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:46.890893 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d914bd1c-78c1-4aab-8a37-5cdf24c8b18e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:46.891750 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d914bd1c-78c1-4aab-8a37-5cdf24c8b18e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:46.892281 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d914bd1c-78c1-4aab-8a37-5cdf24c8b18e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:46.966865 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-d914bd1c-78c1-4aab-8a37-5cdf24c8b18e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:35:46.975123 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-d914bd1c-78c1-4aab-8a37-5cdf24c8b18e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.096603 Jun 17 15:35:46.975706 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1187/1961] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:35:46 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:35:47.068870 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-01519c59-703c-4068-9caf-af6519d95f9d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:35:47.070342 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-01519c59-703c-4068-9caf-af6519d95f9d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:35:47.080542 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-01519c59-703c-4068-9caf-af6519d95f9d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:47.081183 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-01519c59-703c-4068-9caf-af6519d95f9d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:47.082514 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-01519c59-703c-4068-9caf-af6519d95f9d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:47.083174 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-01519c59-703c-4068-9caf-af6519d95f9d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:47.117099 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-01519c59-703c-4068-9caf-af6519d95f9d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054271 Jun 17 15:35:47.117675 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 775/1962] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:35:47 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:35:47.994331 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-518369a9-1793-4952-a1f2-e687f260de77 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:35:47.995090 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-518369a9-1793-4952-a1f2-e687f260de77 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:35:48.002676 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-518369a9-1793-4952-a1f2-e687f260de77 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:48.003161 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-518369a9-1793-4952-a1f2-e687f260de77 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:48.003952 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-518369a9-1793-4952-a1f2-e687f260de77 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:48.004409 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-518369a9-1793-4952-a1f2-e687f260de77 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:48.083915 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-518369a9-1793-4952-a1f2-e687f260de77 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:35:48.092441 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-518369a9-1793-4952-a1f2-e687f260de77 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.102560 Jun 17 15:35:48.093029 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1188/1963] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:35:47 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:35:48.130505 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-77fb76bd-1e79-42ab-95ad-4738aeec8571 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:35:48.132747 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-77fb76bd-1e79-42ab-95ad-4738aeec8571 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:35:48.146144 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-77fb76bd-1e79-42ab-95ad-4738aeec8571 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:48.146584 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-77fb76bd-1e79-42ab-95ad-4738aeec8571 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:48.147350 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-77fb76bd-1e79-42ab-95ad-4738aeec8571 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:48.147780 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-77fb76bd-1e79-42ab-95ad-4738aeec8571 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:48.179992 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-77fb76bd-1e79-42ab-95ad-4738aeec8571 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054657 Jun 17 15:35:48.181127 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 776/1964] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:35:48 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:35:49.110735 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-56177b25-12df-49d8-a60e-023e9aac746e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:35:49.111568 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-56177b25-12df-49d8-a60e-023e9aac746e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:35:49.119361 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-56177b25-12df-49d8-a60e-023e9aac746e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:49.119805 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-56177b25-12df-49d8-a60e-023e9aac746e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:49.120606 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-56177b25-12df-49d8-a60e-023e9aac746e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:49.121034 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-56177b25-12df-49d8-a60e-023e9aac746e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:49.189430 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-56177b25-12df-49d8-a60e-023e9aac746e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:35:49.192786 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-bc470fda-d1d1-4b0a-9ab8-57cfbfd3b0e3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:35:49.193742 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-bc470fda-d1d1-4b0a-9ab8-57cfbfd3b0e3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:35:49.199663 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-56177b25-12df-49d8-a60e-023e9aac746e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.092543 Jun 17 15:35:49.200507 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1189/1965] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:35:49 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:35:49.201000 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bc470fda-d1d1-4b0a-9ab8-57cfbfd3b0e3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:49.201460 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bc470fda-d1d1-4b0a-9ab8-57cfbfd3b0e3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:49.202243 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bc470fda-d1d1-4b0a-9ab8-57cfbfd3b0e3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:49.202679 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bc470fda-d1d1-4b0a-9ab8-57cfbfd3b0e3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:49.235352 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-bc470fda-d1d1-4b0a-9ab8-57cfbfd3b0e3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046562 Jun 17 15:35:49.235923 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 777/1966] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:35:49 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:35:50.224548 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-2a28efe6-9b2a-467a-8f1a-28b4f9eb67ed tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:35:50.225688 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-2a28efe6-9b2a-467a-8f1a-28b4f9eb67ed tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:35:50.237715 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2a28efe6-9b2a-467a-8f1a-28b4f9eb67ed tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:50.238487 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2a28efe6-9b2a-467a-8f1a-28b4f9eb67ed tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:50.239862 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2a28efe6-9b2a-467a-8f1a-28b4f9eb67ed tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:50.240669 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2a28efe6-9b2a-467a-8f1a-28b4f9eb67ed tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:50.247759 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-cce33add-ed24-46af-85a4-e76ce641a095 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:35:50.248800 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-cce33add-ed24-46af-85a4-e76ce641a095 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:35:50.255873 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cce33add-ed24-46af-85a4-e76ce641a095 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:50.256345 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cce33add-ed24-46af-85a4-e76ce641a095 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:50.257135 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cce33add-ed24-46af-85a4-e76ce641a095 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:50.257573 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cce33add-ed24-46af-85a4-e76ce641a095 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:50.289116 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-cce33add-ed24-46af-85a4-e76ce641a095 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045951 Jun 17 15:35:50.290194 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 778/1967] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:35:50 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:35:50.339523 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-2a28efe6-9b2a-467a-8f1a-28b4f9eb67ed tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:35:50.350636 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-2a28efe6-9b2a-467a-8f1a-28b4f9eb67ed tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.132348 Jun 17 15:35:50.351498 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1190/1968] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:35:50 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:35:51.302129 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-9a841dd1-4f74-4459-ae8d-58e2fcd30baf tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:35:51.303073 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-9a841dd1-4f74-4459-ae8d-58e2fcd30baf tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:35:51.310380 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9a841dd1-4f74-4459-ae8d-58e2fcd30baf tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:51.310833 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9a841dd1-4f74-4459-ae8d-58e2fcd30baf tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:51.311609 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9a841dd1-4f74-4459-ae8d-58e2fcd30baf tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:51.312046 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9a841dd1-4f74-4459-ae8d-58e2fcd30baf tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:51.344056 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-9a841dd1-4f74-4459-ae8d-58e2fcd30baf tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045918 Jun 17 15:35:51.344675 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 779/1969] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:35:51 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:35:51.369785 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-e500740d-cf41-4408-a368-eaa77fc546de tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:35:51.370386 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-e500740d-cf41-4408-a368-eaa77fc546de tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:35:51.377343 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e500740d-cf41-4408-a368-eaa77fc546de tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:51.377792 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e500740d-cf41-4408-a368-eaa77fc546de tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:51.378573 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e500740d-cf41-4408-a368-eaa77fc546de tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:51.379007 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e500740d-cf41-4408-a368-eaa77fc546de tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:51.446737 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-e500740d-cf41-4408-a368-eaa77fc546de tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:35:51.455008 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-e500740d-cf41-4408-a368-eaa77fc546de tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.089629 Jun 17 15:35:51.455601 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1191/1970] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:35:51 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:35:52.362175 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-d86f9ac8-1d42-4fc8-99fa-2f859c6a6dc2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:35:52.364758 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-d86f9ac8-1d42-4fc8-99fa-2f859c6a6dc2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:35:52.377070 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d86f9ac8-1d42-4fc8-99fa-2f859c6a6dc2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:52.377883 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d86f9ac8-1d42-4fc8-99fa-2f859c6a6dc2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:52.379344 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d86f9ac8-1d42-4fc8-99fa-2f859c6a6dc2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:52.380070 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d86f9ac8-1d42-4fc8-99fa-2f859c6a6dc2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:52.423537 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-d86f9ac8-1d42-4fc8-99fa-2f859c6a6dc2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069636 Jun 17 15:35:52.424201 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 780/1971] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:35:52 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:35:52.476965 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-df61c4f8-2136-441a-aff2-8fe60844d715 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:35:52.478679 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-df61c4f8-2136-441a-aff2-8fe60844d715 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:35:52.488967 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-df61c4f8-2136-441a-aff2-8fe60844d715 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:52.489452 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-df61c4f8-2136-441a-aff2-8fe60844d715 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:52.490799 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-df61c4f8-2136-441a-aff2-8fe60844d715 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:52.491590 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-df61c4f8-2136-441a-aff2-8fe60844d715 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:52.581375 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-df61c4f8-2136-441a-aff2-8fe60844d715 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:35:52.589727 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-df61c4f8-2136-441a-aff2-8fe60844d715 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.119063 Jun 17 15:35:52.590330 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1192/1972] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:35:52 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:35:53.437220 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-f03af4ff-0a9b-4346-a431-b2dc290a7a8e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:35:53.438154 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-f03af4ff-0a9b-4346-a431-b2dc290a7a8e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:35:53.444907 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f03af4ff-0a9b-4346-a431-b2dc290a7a8e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:53.445356 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f03af4ff-0a9b-4346-a431-b2dc290a7a8e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:53.446715 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f03af4ff-0a9b-4346-a431-b2dc290a7a8e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:53.447157 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f03af4ff-0a9b-4346-a431-b2dc290a7a8e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:53.479356 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-f03af4ff-0a9b-4346-a431-b2dc290a7a8e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046092 Jun 17 15:35:53.479955 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 781/1973] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:35:53 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:35:53.608156 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-530151f5-258d-4230-a47e-5ade863ef672 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:35:53.608838 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-530151f5-258d-4230-a47e-5ade863ef672 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:35:53.616197 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-530151f5-258d-4230-a47e-5ade863ef672 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:53.616677 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-530151f5-258d-4230-a47e-5ade863ef672 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:53.617464 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-530151f5-258d-4230-a47e-5ade863ef672 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:53.617901 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-530151f5-258d-4230-a47e-5ade863ef672 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:53.683985 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-530151f5-258d-4230-a47e-5ade863ef672 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:35:53.692731 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-530151f5-258d-4230-a47e-5ade863ef672 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.088670 Jun 17 15:35:53.693326 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1193/1974] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:35:53 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:35:54.491258 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-64822160-7af2-448d-8360-82a7e4cd471a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:35:54.492222 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-64822160-7af2-448d-8360-82a7e4cd471a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:35:54.498951 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-64822160-7af2-448d-8360-82a7e4cd471a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:54.499401 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-64822160-7af2-448d-8360-82a7e4cd471a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:54.500174 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-64822160-7af2-448d-8360-82a7e4cd471a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:54.500641 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-64822160-7af2-448d-8360-82a7e4cd471a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:54.537369 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-64822160-7af2-448d-8360-82a7e4cd471a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050033 Jun 17 15:35:54.537953 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 782/1975] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:35:54 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:35:54.709412 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-f3612fcf-7372-4e16-85e5-f43adcc49258 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:35:54.710038 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-f3612fcf-7372-4e16-85e5-f43adcc49258 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:35:54.718685 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f3612fcf-7372-4e16-85e5-f43adcc49258 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:54.719128 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f3612fcf-7372-4e16-85e5-f43adcc49258 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:54.719899 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f3612fcf-7372-4e16-85e5-f43adcc49258 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:54.720343 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f3612fcf-7372-4e16-85e5-f43adcc49258 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:54.791576 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-f3612fcf-7372-4e16-85e5-f43adcc49258 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:35:54.799853 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-f3612fcf-7372-4e16-85e5-f43adcc49258 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.094531 Jun 17 15:35:54.800484 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1194/1976] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:35:54 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:35:55.550357 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-1d0b6005-476a-4e3c-9f25-3445b34c9838 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:35:55.551317 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-1d0b6005-476a-4e3c-9f25-3445b34c9838 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:35:55.559168 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1d0b6005-476a-4e3c-9f25-3445b34c9838 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:55.559662 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1d0b6005-476a-4e3c-9f25-3445b34c9838 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:55.560538 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1d0b6005-476a-4e3c-9f25-3445b34c9838 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:55.561013 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1d0b6005-476a-4e3c-9f25-3445b34c9838 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:55.593372 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-1d0b6005-476a-4e3c-9f25-3445b34c9838 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047033 Jun 17 15:35:55.593949 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 783/1977] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:35:55 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:35:55.818680 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-f1858135-92c1-4c63-94a5-9df68aa38296 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:35:55.819291 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-f1858135-92c1-4c63-94a5-9df68aa38296 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:35:55.827501 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f1858135-92c1-4c63-94a5-9df68aa38296 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:55.827987 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f1858135-92c1-4c63-94a5-9df68aa38296 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:55.828930 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f1858135-92c1-4c63-94a5-9df68aa38296 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:55.829405 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f1858135-92c1-4c63-94a5-9df68aa38296 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:55.907785 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-f1858135-92c1-4c63-94a5-9df68aa38296 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:35:55.916485 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-f1858135-92c1-4c63-94a5-9df68aa38296 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.102497 Jun 17 15:35:55.917274 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1195/1978] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:35:55 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:35:56.605871 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-d90d67c7-7978-4665-a703-62bc42cd0dc6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:35:56.606812 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-d90d67c7-7978-4665-a703-62bc42cd0dc6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:35:56.613781 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d90d67c7-7978-4665-a703-62bc42cd0dc6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:56.614235 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d90d67c7-7978-4665-a703-62bc42cd0dc6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:56.615015 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d90d67c7-7978-4665-a703-62bc42cd0dc6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:56.615462 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d90d67c7-7978-4665-a703-62bc42cd0dc6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:56.647581 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-d90d67c7-7978-4665-a703-62bc42cd0dc6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045446 Jun 17 15:35:56.648353 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 784/1979] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:35:56 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:35:56.935250 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-d4cd28e1-15d7-47a5-a301-248f5b66e862 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:35:56.936100 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-d4cd28e1-15d7-47a5-a301-248f5b66e862 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:35:56.942806 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d4cd28e1-15d7-47a5-a301-248f5b66e862 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:56.943255 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d4cd28e1-15d7-47a5-a301-248f5b66e862 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:56.944024 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d4cd28e1-15d7-47a5-a301-248f5b66e862 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:56.944488 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d4cd28e1-15d7-47a5-a301-248f5b66e862 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:57.029825 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-d4cd28e1-15d7-47a5-a301-248f5b66e862 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:35:57.038177 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-d4cd28e1-15d7-47a5-a301-248f5b66e862 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.107063 Jun 17 15:35:57.038787 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1196/1980] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:35:56 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:35:57.660122 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-0ed4c37b-0c10-456c-8407-f45be8c03f97 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:35:57.660998 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-0ed4c37b-0c10-456c-8407-f45be8c03f97 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:35:57.668313 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0ed4c37b-0c10-456c-8407-f45be8c03f97 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:57.668785 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0ed4c37b-0c10-456c-8407-f45be8c03f97 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:57.669626 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0ed4c37b-0c10-456c-8407-f45be8c03f97 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:57.670063 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0ed4c37b-0c10-456c-8407-f45be8c03f97 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:57.706809 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-0ed4c37b-0c10-456c-8407-f45be8c03f97 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050652 Jun 17 15:35:57.707466 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 785/1981] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:35:57 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:35:58.056847 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-120cf83a-92da-4491-8997-9ac4fb0b9726 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:35:58.057729 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-120cf83a-92da-4491-8997-9ac4fb0b9726 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:35:58.064961 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-120cf83a-92da-4491-8997-9ac4fb0b9726 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:58.065403 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-120cf83a-92da-4491-8997-9ac4fb0b9726 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:58.066180 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-120cf83a-92da-4491-8997-9ac4fb0b9726 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:58.066610 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-120cf83a-92da-4491-8997-9ac4fb0b9726 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:58.140264 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-120cf83a-92da-4491-8997-9ac4fb0b9726 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:35:58.153269 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-120cf83a-92da-4491-8997-9ac4fb0b9726 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.100470 Jun 17 15:35:58.154351 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1197/1982] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:35:58 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:35:58.719077 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-5619208d-c878-4035-b7ea-4c996664243b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:35:58.719927 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-5619208d-c878-4035-b7ea-4c996664243b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:35:58.727003 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5619208d-c878-4035-b7ea-4c996664243b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:58.727947 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5619208d-c878-4035-b7ea-4c996664243b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:58.728740 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5619208d-c878-4035-b7ea-4c996664243b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:58.729172 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5619208d-c878-4035-b7ea-4c996664243b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:58.760639 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-5619208d-c878-4035-b7ea-4c996664243b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045599 Jun 17 15:35:58.761220 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 786/1983] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:35:58 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:35:59.178427 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-8316a6de-7ae3-47c3-86ff-d53eed366cba tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:35:59.179095 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-8316a6de-7ae3-47c3-86ff-d53eed366cba tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:35:59.186658 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8316a6de-7ae3-47c3-86ff-d53eed366cba tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:59.187148 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8316a6de-7ae3-47c3-86ff-d53eed366cba tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:59.187980 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8316a6de-7ae3-47c3-86ff-d53eed366cba tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:59.188530 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8316a6de-7ae3-47c3-86ff-d53eed366cba tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:59.274963 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-8316a6de-7ae3-47c3-86ff-d53eed366cba tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:35:59.283848 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-8316a6de-7ae3-47c3-86ff-d53eed366cba tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.109282 Jun 17 15:35:59.284495 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1198/1984] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:35:59 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:35:59.773160 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-cfda0d05-ac6c-482b-8e98-4927fe18d5cb tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:35:59.774592 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-cfda0d05-ac6c-482b-8e98-4927fe18d5cb tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:35:59.781632 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cfda0d05-ac6c-482b-8e98-4927fe18d5cb tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:59.782076 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cfda0d05-ac6c-482b-8e98-4927fe18d5cb tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:59.782851 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cfda0d05-ac6c-482b-8e98-4927fe18d5cb tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:35:59.783285 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cfda0d05-ac6c-482b-8e98-4927fe18d5cb tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:35:59.811316 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell1:SELECT=100 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:35:59.816979 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-cfda0d05-ac6c-482b-8e98-4927fe18d5cb tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048086 Jun 17 15:35:59.817563 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 787/1985] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:35:59 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:36:00.308557 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-fcfa5e01-42bf-4de0-a484-4241885444a3 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:36:00.309248 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-fcfa5e01-42bf-4de0-a484-4241885444a3 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:36:00.316214 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fcfa5e01-42bf-4de0-a484-4241885444a3 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:00.316708 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fcfa5e01-42bf-4de0-a484-4241885444a3 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:00.317476 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fcfa5e01-42bf-4de0-a484-4241885444a3 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:00.317906 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fcfa5e01-42bf-4de0-a484-4241885444a3 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:00.408754 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-fcfa5e01-42bf-4de0-a484-4241885444a3 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:36:00.417494 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-fcfa5e01-42bf-4de0-a484-4241885444a3 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.112854 Jun 17 15:36:00.418082 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1199/1986] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:36:00 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:36:00.829870 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-65088870-7fbf-4793-ad9f-53b5d9ef874b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:36:00.830843 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-65088870-7fbf-4793-ad9f-53b5d9ef874b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:36:00.838534 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-65088870-7fbf-4793-ad9f-53b5d9ef874b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:00.838980 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-65088870-7fbf-4793-ad9f-53b5d9ef874b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:00.839765 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-65088870-7fbf-4793-ad9f-53b5d9ef874b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:00.840202 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-65088870-7fbf-4793-ad9f-53b5d9ef874b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:00.872584 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-65088870-7fbf-4793-ad9f-53b5d9ef874b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046957 Jun 17 15:36:00.873339 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 788/1987] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:36:00 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:36:01.435409 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-36d4b287-109a-438a-81ca-1d070357ede7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:36:01.436137 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-36d4b287-109a-438a-81ca-1d070357ede7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:36:01.443022 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-36d4b287-109a-438a-81ca-1d070357ede7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:01.443467 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-36d4b287-109a-438a-81ca-1d070357ede7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:01.444236 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-36d4b287-109a-438a-81ca-1d070357ede7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:01.444707 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-36d4b287-109a-438a-81ca-1d070357ede7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:01.514076 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-36d4b287-109a-438a-81ca-1d070357ede7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:36:01.522018 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-36d4b287-109a-438a-81ca-1d070357ede7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.090615 Jun 17 15:36:01.522598 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1200/1988] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:36:01 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:36:01.884815 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-ab41a5b6-1823-49c1-830c-f4be0cb5c56f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:36:01.885749 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-ab41a5b6-1823-49c1-830c-f4be0cb5c56f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:36:01.892953 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ab41a5b6-1823-49c1-830c-f4be0cb5c56f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:01.893400 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ab41a5b6-1823-49c1-830c-f4be0cb5c56f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:01.894176 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ab41a5b6-1823-49c1-830c-f4be0cb5c56f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:01.894616 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ab41a5b6-1823-49c1-830c-f4be0cb5c56f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:01.927251 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-ab41a5b6-1823-49c1-830c-f4be0cb5c56f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046154 Jun 17 15:36:01.927876 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 789/1989] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:36:01 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:36:02.539993 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-f67b01a5-a9c2-4984-af56-10c632c21679 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:36:02.540626 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-f67b01a5-a9c2-4984-af56-10c632c21679 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:36:02.547489 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f67b01a5-a9c2-4984-af56-10c632c21679 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:02.547929 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f67b01a5-a9c2-4984-af56-10c632c21679 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:02.548734 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f67b01a5-a9c2-4984-af56-10c632c21679 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:02.549163 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f67b01a5-a9c2-4984-af56-10c632c21679 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:02.614561 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-f67b01a5-a9c2-4984-af56-10c632c21679 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:36:02.622534 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-f67b01a5-a9c2-4984-af56-10c632c21679 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.086961 Jun 17 15:36:02.623120 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1201/1990] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:36:02 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:36:02.939548 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-00c82dc0-ea14-422f-b49f-ec3a5b55eff3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:36:02.940521 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-00c82dc0-ea14-422f-b49f-ec3a5b55eff3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:36:02.948017 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-00c82dc0-ea14-422f-b49f-ec3a5b55eff3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:02.948504 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-00c82dc0-ea14-422f-b49f-ec3a5b55eff3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:02.949306 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-00c82dc0-ea14-422f-b49f-ec3a5b55eff3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:02.949742 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-00c82dc0-ea14-422f-b49f-ec3a5b55eff3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:02.983515 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-00c82dc0-ea14-422f-b49f-ec3a5b55eff3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048003 Jun 17 15:36:02.984098 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 790/1991] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:36:02 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:36:03.641096 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-e3637b64-8b5e-48d6-9a7e-8311f308efa9 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:36:03.642044 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-e3637b64-8b5e-48d6-9a7e-8311f308efa9 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:36:03.649335 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e3637b64-8b5e-48d6-9a7e-8311f308efa9 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:03.649783 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e3637b64-8b5e-48d6-9a7e-8311f308efa9 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:03.650571 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e3637b64-8b5e-48d6-9a7e-8311f308efa9 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:03.651010 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e3637b64-8b5e-48d6-9a7e-8311f308efa9 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:03.723482 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-e3637b64-8b5e-48d6-9a7e-8311f308efa9 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:36:03.732669 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-e3637b64-8b5e-48d6-9a7e-8311f308efa9 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.095636 Jun 17 15:36:03.733265 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1202/1992] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:36:03 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:36:03.996392 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-a8c0e4c1-c832-4a0f-a45e-0f750a8a06de tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:36:03.997385 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-a8c0e4c1-c832-4a0f-a45e-0f750a8a06de tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:36:04.004231 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a8c0e4c1-c832-4a0f-a45e-0f750a8a06de tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:04.004718 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a8c0e4c1-c832-4a0f-a45e-0f750a8a06de tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:04.005487 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a8c0e4c1-c832-4a0f-a45e-0f750a8a06de tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:04.006031 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a8c0e4c1-c832-4a0f-a45e-0f750a8a06de tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:04.039591 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-a8c0e4c1-c832-4a0f-a45e-0f750a8a06de tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048088 Jun 17 15:36:04.040238 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 791/1993] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:36:03 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:36:04.759057 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-e42823d6-9235-4e4d-a2d3-284187c289fb tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:36:04.759661 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-e42823d6-9235-4e4d-a2d3-284187c289fb tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:36:04.766872 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e42823d6-9235-4e4d-a2d3-284187c289fb tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:04.767395 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e42823d6-9235-4e4d-a2d3-284187c289fb tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:04.768189 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e42823d6-9235-4e4d-a2d3-284187c289fb tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:04.768714 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e42823d6-9235-4e4d-a2d3-284187c289fb tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:04.788375 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=100 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:36:04.841894 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-e42823d6-9235-4e4d-a2d3-284187c289fb tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:36:04.850750 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-e42823d6-9235-4e4d-a2d3-284187c289fb tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.096278 Jun 17 15:36:04.851335 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1203/1994] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:36:04 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:36:05.052177 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-3273d52e-f895-49df-aa38-8856222f280b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:36:05.053062 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-3273d52e-f895-49df-aa38-8856222f280b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:36:05.061204 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3273d52e-f895-49df-aa38-8856222f280b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:05.061762 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3273d52e-f895-49df-aa38-8856222f280b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:05.062593 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3273d52e-f895-49df-aa38-8856222f280b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:05.063182 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3273d52e-f895-49df-aa38-8856222f280b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:05.095914 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-3273d52e-f895-49df-aa38-8856222f280b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048174 Jun 17 15:36:05.096561 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 792/1995] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:36:05 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:36:05.868947 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-2e0d0e4c-6637-4b79-bcdd-d1fe68e3f89c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:36:05.869618 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-2e0d0e4c-6637-4b79-bcdd-d1fe68e3f89c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:36:05.876286 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2e0d0e4c-6637-4b79-bcdd-d1fe68e3f89c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:05.876757 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2e0d0e4c-6637-4b79-bcdd-d1fe68e3f89c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:05.877519 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2e0d0e4c-6637-4b79-bcdd-d1fe68e3f89c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:05.877949 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2e0d0e4c-6637-4b79-bcdd-d1fe68e3f89c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:05.943530 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-2e0d0e4c-6637-4b79-bcdd-d1fe68e3f89c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:36:05.951855 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-2e0d0e4c-6637-4b79-bcdd-d1fe68e3f89c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.087346 Jun 17 15:36:05.952487 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1204/1996] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:36:05 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:36:06.107872 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-4243345e-68f8-48e2-bbf7-c1ff731735c3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:36:06.109201 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-4243345e-68f8-48e2-bbf7-c1ff731735c3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:36:06.116624 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4243345e-68f8-48e2-bbf7-c1ff731735c3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:06.117085 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4243345e-68f8-48e2-bbf7-c1ff731735c3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:06.117931 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4243345e-68f8-48e2-bbf7-c1ff731735c3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:06.118376 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4243345e-68f8-48e2-bbf7-c1ff731735c3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:06.152272 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-4243345e-68f8-48e2-bbf7-c1ff731735c3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048384 Jun 17 15:36:06.152819 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 793/1997] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:36:06 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:36:06.968890 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-1a1d99e9-d4a1-4cc0-9048-c296ff77b2fa tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:36:06.969585 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-1a1d99e9-d4a1-4cc0-9048-c296ff77b2fa tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:36:06.977487 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1a1d99e9-d4a1-4cc0-9048-c296ff77b2fa tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:06.977940 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1a1d99e9-d4a1-4cc0-9048-c296ff77b2fa tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:06.978728 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1a1d99e9-d4a1-4cc0-9048-c296ff77b2fa tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:06.979166 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1a1d99e9-d4a1-4cc0-9048-c296ff77b2fa tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:07.050836 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-1a1d99e9-d4a1-4cc0-9048-c296ff77b2fa tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:36:07.065115 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-1a1d99e9-d4a1-4cc0-9048-c296ff77b2fa tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.099877 Jun 17 15:36:07.066216 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1205/1998] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:36:06 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:36:07.168541 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-c1b86999-c2d1-4e92-aca7-ff5799036303 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:36:07.170150 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-c1b86999-c2d1-4e92-aca7-ff5799036303 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:36:07.182099 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c1b86999-c2d1-4e92-aca7-ff5799036303 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:07.182881 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c1b86999-c2d1-4e92-aca7-ff5799036303 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:07.184280 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c1b86999-c2d1-4e92-aca7-ff5799036303 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:07.185092 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c1b86999-c2d1-4e92-aca7-ff5799036303 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:07.244983 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-c1b86999-c2d1-4e92-aca7-ff5799036303 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083988 Jun 17 15:36:07.245763 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 794/1999] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:36:07 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:36:08.083696 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-7b615906-a346-4421-a26c-ebb3f8d27c6e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:36:08.084499 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-7b615906-a346-4421-a26c-ebb3f8d27c6e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:36:08.092695 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7b615906-a346-4421-a26c-ebb3f8d27c6e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:08.093188 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7b615906-a346-4421-a26c-ebb3f8d27c6e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:08.094044 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7b615906-a346-4421-a26c-ebb3f8d27c6e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:08.094490 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7b615906-a346-4421-a26c-ebb3f8d27c6e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:08.166216 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-7b615906-a346-4421-a26c-ebb3f8d27c6e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:36:08.174567 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-7b615906-a346-4421-a26c-ebb3f8d27c6e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.095023 Jun 17 15:36:08.175168 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1206/2000] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:36:08 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:36:08.258419 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-42466560-d089-4c76-92ba-d4038b88db0b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:36:08.259380 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-42466560-d089-4c76-92ba-d4038b88db0b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:36:08.266575 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-42466560-d089-4c76-92ba-d4038b88db0b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:08.267028 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-42466560-d089-4c76-92ba-d4038b88db0b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:08.267833 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-42466560-d089-4c76-92ba-d4038b88db0b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:08.268279 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-42466560-d089-4c76-92ba-d4038b88db0b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:08.301999 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-42466560-d089-4c76-92ba-d4038b88db0b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048202 Jun 17 15:36:08.302644 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 795/2001] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:36:08 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:36:09.192232 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-68c4e992-ff8e-4933-b34a-0bc31aad3384 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:36:09.192936 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-68c4e992-ff8e-4933-b34a-0bc31aad3384 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:36:09.195561 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_api:SELECT=54 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:36:09.201949 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-68c4e992-ff8e-4933-b34a-0bc31aad3384 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:09.202388 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-68c4e992-ff8e-4933-b34a-0bc31aad3384 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:09.203447 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-68c4e992-ff8e-4933-b34a-0bc31aad3384 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:09.203889 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-68c4e992-ff8e-4933-b34a-0bc31aad3384 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:09.274724 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-68c4e992-ff8e-4933-b34a-0bc31aad3384 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:36:09.288681 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-68c4e992-ff8e-4933-b34a-0bc31aad3384 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.100027 Jun 17 15:36:09.289751 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1207/2002] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:36:09 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:36:09.315587 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-ca7b25b4-b5ce-463f-8368-8f10145cf163 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:36:09.316686 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-ca7b25b4-b5ce-463f-8368-8f10145cf163 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:36:09.324296 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ca7b25b4-b5ce-463f-8368-8f10145cf163 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:09.324775 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ca7b25b4-b5ce-463f-8368-8f10145cf163 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:09.325578 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ca7b25b4-b5ce-463f-8368-8f10145cf163 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:09.326016 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ca7b25b4-b5ce-463f-8368-8f10145cf163 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:09.359565 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-ca7b25b4-b5ce-463f-8368-8f10145cf163 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048078 Jun 17 15:36:09.360156 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 796/2003] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:36:09 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:36:10.317067 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-1020594a-345c-4abd-8d7e-9b472016fc0e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:36:10.317935 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-1020594a-345c-4abd-8d7e-9b472016fc0e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:36:10.324996 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1020594a-345c-4abd-8d7e-9b472016fc0e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:10.325451 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1020594a-345c-4abd-8d7e-9b472016fc0e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:10.326229 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1020594a-345c-4abd-8d7e-9b472016fc0e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:10.326659 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1020594a-345c-4abd-8d7e-9b472016fc0e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:10.376929 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-f18e5124-52a8-4ddb-bfac-c2aa07ba7ab2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:36:10.378114 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-f18e5124-52a8-4ddb-bfac-c2aa07ba7ab2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:36:10.387621 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f18e5124-52a8-4ddb-bfac-c2aa07ba7ab2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:10.388080 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f18e5124-52a8-4ddb-bfac-c2aa07ba7ab2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:10.388943 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f18e5124-52a8-4ddb-bfac-c2aa07ba7ab2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:10.389381 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f18e5124-52a8-4ddb-bfac-c2aa07ba7ab2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:10.401274 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-1020594a-345c-4abd-8d7e-9b472016fc0e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:36:10.415038 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-1020594a-345c-4abd-8d7e-9b472016fc0e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.101497 Jun 17 15:36:10.416590 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1208/2004] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:36:10 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:36:10.422715 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-f18e5124-52a8-4ddb-bfac-c2aa07ba7ab2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054816 Jun 17 15:36:10.423402 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 797/2005] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:36:10 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:36:11.438345 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-c3f59df7-fbd7-4350-9dee-e4efa62c0f11 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:36:11.439446 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-c3f59df7-fbd7-4350-9dee-e4efa62c0f11 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:36:11.440914 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-23205919-96e6-4245-8ad6-9cf0edfd09a7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:36:11.441659 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-23205919-96e6-4245-8ad6-9cf0edfd09a7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:36:11.447165 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c3f59df7-fbd7-4350-9dee-e4efa62c0f11 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:11.447880 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c3f59df7-fbd7-4350-9dee-e4efa62c0f11 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:11.448870 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c3f59df7-fbd7-4350-9dee-e4efa62c0f11 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:11.449299 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-23205919-96e6-4245-8ad6-9cf0edfd09a7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:11.449531 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c3f59df7-fbd7-4350-9dee-e4efa62c0f11 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:11.449873 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-23205919-96e6-4245-8ad6-9cf0edfd09a7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:11.450863 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-23205919-96e6-4245-8ad6-9cf0edfd09a7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:11.451496 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-23205919-96e6-4245-8ad6-9cf0edfd09a7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:11.488637 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-c3f59df7-fbd7-4350-9dee-e4efa62c0f11 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055336 Jun 17 15:36:11.489226 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1209/2006] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:36:11 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:36:11.598042 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 15:36:11.598391 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Fri Jun 17 15:36:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 (ip 10.222.0.48) !!! Jun 17 15:36:11.609885 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-23205919-96e6-4245-8ad6-9cf0edfd09a7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:36:11.618026 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-23205919-96e6-4245-8ad6-9cf0edfd09a7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.181828 Jun 17 15:36:11.618614 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 798/2007] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:36:11 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:36:12.501248 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-21042705-edab-4cfb-84de-fa00fdf64382 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:36:12.502166 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-21042705-edab-4cfb-84de-fa00fdf64382 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:36:12.508947 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-21042705-edab-4cfb-84de-fa00fdf64382 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:12.509177 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-21042705-edab-4cfb-84de-fa00fdf64382 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:12.509926 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-21042705-edab-4cfb-84de-fa00fdf64382 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:12.510355 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-21042705-edab-4cfb-84de-fa00fdf64382 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:12.540807 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-21042705-edab-4cfb-84de-fa00fdf64382 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043496 Jun 17 15:36:12.541362 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1210/2008] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:36:12 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:36:12.635979 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-e98e9a6c-9937-4d6e-b7af-c14f82b86c3a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:36:12.636578 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-e98e9a6c-9937-4d6e-b7af-c14f82b86c3a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:36:12.639055 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_api:SELECT=58 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:36:12.644754 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e98e9a6c-9937-4d6e-b7af-c14f82b86c3a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:12.645206 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e98e9a6c-9937-4d6e-b7af-c14f82b86c3a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:12.645992 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e98e9a6c-9937-4d6e-b7af-c14f82b86c3a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:12.646431 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e98e9a6c-9937-4d6e-b7af-c14f82b86c3a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:12.711633 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-e98e9a6c-9937-4d6e-b7af-c14f82b86c3a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:36:12.719591 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-e98e9a6c-9937-4d6e-b7af-c14f82b86c3a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.088128 Jun 17 15:36:12.720182 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 799/2009] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:36:12 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:36:13.557492 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-bf4ecb32-73d1-4a7f-80ce-fdafedf866f1 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:36:13.559102 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-bf4ecb32-73d1-4a7f-80ce-fdafedf866f1 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:36:13.570871 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bf4ecb32-73d1-4a7f-80ce-fdafedf866f1 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:13.571646 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bf4ecb32-73d1-4a7f-80ce-fdafedf866f1 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:13.573032 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bf4ecb32-73d1-4a7f-80ce-fdafedf866f1 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:13.573843 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bf4ecb32-73d1-4a7f-80ce-fdafedf866f1 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:13.631631 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-bf4ecb32-73d1-4a7f-80ce-fdafedf866f1 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081237 Jun 17 15:36:13.632599 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1211/2010] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:36:13 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:36:13.738098 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-5eeff536-c397-46e7-8c37-59ebd5374470 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:36:13.738721 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-5eeff536-c397-46e7-8c37-59ebd5374470 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:36:13.746030 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5eeff536-c397-46e7-8c37-59ebd5374470 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:13.746487 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5eeff536-c397-46e7-8c37-59ebd5374470 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:13.747268 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5eeff536-c397-46e7-8c37-59ebd5374470 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:13.747706 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5eeff536-c397-46e7-8c37-59ebd5374470 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:13.816151 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-5eeff536-c397-46e7-8c37-59ebd5374470 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:36:13.825127 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-5eeff536-c397-46e7-8c37-59ebd5374470 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.090856 Jun 17 15:36:13.825721 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 800/2011] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:36:13 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:36:14.646433 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-afb9d7e9-149a-4867-bc5b-457e7bd5c1a6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:36:14.647280 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-afb9d7e9-149a-4867-bc5b-457e7bd5c1a6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:36:14.654149 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-afb9d7e9-149a-4867-bc5b-457e7bd5c1a6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:14.654594 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-afb9d7e9-149a-4867-bc5b-457e7bd5c1a6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:14.655380 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-afb9d7e9-149a-4867-bc5b-457e7bd5c1a6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:14.655810 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-afb9d7e9-149a-4867-bc5b-457e7bd5c1a6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:14.687632 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-afb9d7e9-149a-4867-bc5b-457e7bd5c1a6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045271 Jun 17 15:36:14.688207 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1212/2012] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:36:14 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:36:14.842745 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-ebf43d48-3d73-467c-a03c-42ba1c1e91c8 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:36:14.843376 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-ebf43d48-3d73-467c-a03c-42ba1c1e91c8 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:36:14.850153 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ebf43d48-3d73-467c-a03c-42ba1c1e91c8 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:14.850696 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ebf43d48-3d73-467c-a03c-42ba1c1e91c8 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:14.851387 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ebf43d48-3d73-467c-a03c-42ba1c1e91c8 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:14.852308 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ebf43d48-3d73-467c-a03c-42ba1c1e91c8 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:14.944428 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-ebf43d48-3d73-467c-a03c-42ba1c1e91c8 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:36:14.952484 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-ebf43d48-3d73-467c-a03c-42ba1c1e91c8 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.113915 Jun 17 15:36:14.953069 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 801/2013] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:36:14 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:36:15.410018 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 15:36:15.410283 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Fri Jun 17 15:36:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 15:36:15.699711 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-55982b33-8837-4b2d-96f0-eccbcf367596 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:36:15.700591 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-55982b33-8837-4b2d-96f0-eccbcf367596 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:36:15.707521 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-55982b33-8837-4b2d-96f0-eccbcf367596 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:15.707966 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-55982b33-8837-4b2d-96f0-eccbcf367596 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:15.708774 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-55982b33-8837-4b2d-96f0-eccbcf367596 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:15.709233 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-55982b33-8837-4b2d-96f0-eccbcf367596 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:15.742825 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-55982b33-8837-4b2d-96f0-eccbcf367596 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046681 Jun 17 15:36:15.743609 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1213/2014] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:36:15 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:36:15.969912 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-5aef6f98-cac5-4263-8900-97084a82bf48 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:36:15.970743 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-5aef6f98-cac5-4263-8900-97084a82bf48 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:36:15.979018 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5aef6f98-cac5-4263-8900-97084a82bf48 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:15.979465 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5aef6f98-cac5-4263-8900-97084a82bf48 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:15.980251 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5aef6f98-cac5-4263-8900-97084a82bf48 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:15.980723 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5aef6f98-cac5-4263-8900-97084a82bf48 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:16.050308 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-5aef6f98-cac5-4263-8900-97084a82bf48 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:36:16.058632 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-5aef6f98-cac5-4263-8900-97084a82bf48 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.092937 Jun 17 15:36:16.059227 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 802/2015] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:36:15 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:36:16.757680 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-732b15b2-823f-4fa2-82ba-2525346ee405 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:36:16.758627 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-732b15b2-823f-4fa2-82ba-2525346ee405 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:36:16.765973 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-732b15b2-823f-4fa2-82ba-2525346ee405 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:16.766427 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-732b15b2-823f-4fa2-82ba-2525346ee405 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:16.767231 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-732b15b2-823f-4fa2-82ba-2525346ee405 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:16.767674 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-732b15b2-823f-4fa2-82ba-2525346ee405 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:16.786676 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 15:36:16.786962 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Fri Jun 17 15:36:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments (ip 10.222.0.48) !!! Jun 17 15:36:16.813216 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-732b15b2-823f-4fa2-82ba-2525346ee405 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059840 Jun 17 15:36:16.816192 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1214/2016] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:36:16 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:36:17.076505 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-19c6b2b1-f760-4c8a-a5d0-f5067489c6f1 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:36:17.077466 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-19c6b2b1-f760-4c8a-a5d0-f5067489c6f1 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:36:17.084638 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-19c6b2b1-f760-4c8a-a5d0-f5067489c6f1 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:17.085220 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-19c6b2b1-f760-4c8a-a5d0-f5067489c6f1 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:17.086109 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-19c6b2b1-f760-4c8a-a5d0-f5067489c6f1 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:17.086675 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-19c6b2b1-f760-4c8a-a5d0-f5067489c6f1 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:17.165935 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-19c6b2b1-f760-4c8a-a5d0-f5067489c6f1 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:36:17.179188 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-19c6b2b1-f760-4c8a-a5d0-f5067489c6f1 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.106344 Jun 17 15:36:17.180789 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 803/2017] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:36:17 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:36:17.830409 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-12741115-764f-4432-97e5-0722b7526aef tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:36:17.832076 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-12741115-764f-4432-97e5-0722b7526aef tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:36:17.840103 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-12741115-764f-4432-97e5-0722b7526aef tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:17.840598 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-12741115-764f-4432-97e5-0722b7526aef tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:17.841381 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-12741115-764f-4432-97e5-0722b7526aef tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:17.841819 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-12741115-764f-4432-97e5-0722b7526aef tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:17.876299 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-12741115-764f-4432-97e5-0722b7526aef tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052598 Jun 17 15:36:17.876916 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1215/2018] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:36:17 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:36:18.203826 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-cabc3823-1504-4a03-b9fd-2a271b4d9557 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:36:18.204576 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-cabc3823-1504-4a03-b9fd-2a271b4d9557 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:36:18.211998 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cabc3823-1504-4a03-b9fd-2a271b4d9557 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:18.212550 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cabc3823-1504-4a03-b9fd-2a271b4d9557 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:18.213374 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cabc3823-1504-4a03-b9fd-2a271b4d9557 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:18.213852 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cabc3823-1504-4a03-b9fd-2a271b4d9557 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:18.234672 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell1:SELECT=100 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:36:18.286288 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-cabc3823-1504-4a03-b9fd-2a271b4d9557 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:36:18.294582 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-cabc3823-1504-4a03-b9fd-2a271b4d9557 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.094857 Jun 17 15:36:18.295185 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 804/2019] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:36:18 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:36:18.880147 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 15:36:18.882006 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Fri Jun 17 15:36:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 15:36:18.888356 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-50fec8ee-de77-4220-8ed9-b03e1dcf5030 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:36:18.889434 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-50fec8ee-de77-4220-8ed9-b03e1dcf5030 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:36:18.896522 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-50fec8ee-de77-4220-8ed9-b03e1dcf5030 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:18.896980 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-50fec8ee-de77-4220-8ed9-b03e1dcf5030 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:18.897762 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-50fec8ee-de77-4220-8ed9-b03e1dcf5030 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:18.898199 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-50fec8ee-de77-4220-8ed9-b03e1dcf5030 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:18.933274 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-50fec8ee-de77-4220-8ed9-b03e1dcf5030 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049133 Jun 17 15:36:18.934049 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1216/2020] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:36:18 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:36:19.319886 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-df939bb3-6014-46ce-8cb7-5bf16265e86b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:36:19.321333 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-df939bb3-6014-46ce-8cb7-5bf16265e86b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:36:19.328737 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-df939bb3-6014-46ce-8cb7-5bf16265e86b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:19.329193 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-df939bb3-6014-46ce-8cb7-5bf16265e86b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:19.329988 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-df939bb3-6014-46ce-8cb7-5bf16265e86b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:19.330449 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-df939bb3-6014-46ce-8cb7-5bf16265e86b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:19.401768 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-df939bb3-6014-46ce-8cb7-5bf16265e86b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:36:19.409894 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-df939bb3-6014-46ce-8cb7-5bf16265e86b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.095082 Jun 17 15:36:19.410482 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 805/2021] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:36:19 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:36:19.947082 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-9496c7c8-378b-4a71-924a-2b437ed9ec84 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:36:19.947941 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-9496c7c8-378b-4a71-924a-2b437ed9ec84 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:36:19.955716 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9496c7c8-378b-4a71-924a-2b437ed9ec84 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:19.956419 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9496c7c8-378b-4a71-924a-2b437ed9ec84 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:19.957457 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9496c7c8-378b-4a71-924a-2b437ed9ec84 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:19.957942 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9496c7c8-378b-4a71-924a-2b437ed9ec84 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:19.991570 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-9496c7c8-378b-4a71-924a-2b437ed9ec84 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049405 Jun 17 15:36:19.992927 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1217/2022] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:36:19 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:36:20.427182 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-d0e19e24-7be8-459e-a38a-a95af471bb28 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:36:20.428697 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-d0e19e24-7be8-459e-a38a-a95af471bb28 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:36:20.434939 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d0e19e24-7be8-459e-a38a-a95af471bb28 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:20.435392 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d0e19e24-7be8-459e-a38a-a95af471bb28 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:20.436168 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d0e19e24-7be8-459e-a38a-a95af471bb28 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:20.436648 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d0e19e24-7be8-459e-a38a-a95af471bb28 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:20.499462 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-d0e19e24-7be8-459e-a38a-a95af471bb28 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:36:20.508281 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-d0e19e24-7be8-459e-a38a-a95af471bb28 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.084396 Jun 17 15:36:20.509049 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 806/2023] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:36:20 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:36:21.008116 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-2d18bdca-389e-4c80-949d-78d2753b1c66 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:36:21.009775 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-2d18bdca-389e-4c80-949d-78d2753b1c66 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:36:21.020966 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2d18bdca-389e-4c80-949d-78d2753b1c66 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:21.021787 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2d18bdca-389e-4c80-949d-78d2753b1c66 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:21.023915 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2d18bdca-389e-4c80-949d-78d2753b1c66 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:21.024755 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2d18bdca-389e-4c80-949d-78d2753b1c66 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:21.069289 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-2d18bdca-389e-4c80-949d-78d2753b1c66 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067885 Jun 17 15:36:21.069978 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1218/2024] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:36:20 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:36:21.526696 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-23ceb81f-8b2b-4d6b-9526-4858b140e896 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:36:21.527334 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-23ceb81f-8b2b-4d6b-9526-4858b140e896 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:36:21.534385 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-23ceb81f-8b2b-4d6b-9526-4858b140e896 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:21.534832 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-23ceb81f-8b2b-4d6b-9526-4858b140e896 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:21.535606 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-23ceb81f-8b2b-4d6b-9526-4858b140e896 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:21.536035 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-23ceb81f-8b2b-4d6b-9526-4858b140e896 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:21.605613 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-23ceb81f-8b2b-4d6b-9526-4858b140e896 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:36:21.617611 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-23ceb81f-8b2b-4d6b-9526-4858b140e896 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.094036 Jun 17 15:36:21.618640 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 807/2025] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:36:21 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:36:22.082160 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-f71f908b-1838-4934-ad43-bbacc25fa3d1 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:36:22.083383 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-f71f908b-1838-4934-ad43-bbacc25fa3d1 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:36:22.090595 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f71f908b-1838-4934-ad43-bbacc25fa3d1 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:22.091036 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f71f908b-1838-4934-ad43-bbacc25fa3d1 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:22.091797 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f71f908b-1838-4934-ad43-bbacc25fa3d1 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:22.092225 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f71f908b-1838-4934-ad43-bbacc25fa3d1 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:22.123557 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-f71f908b-1838-4934-ad43-bbacc25fa3d1 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045357 Jun 17 15:36:22.124514 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1219/2026] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:36:22 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:36:22.638455 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-ab183c23-b759-4de7-a5a1-5e9024cc8932 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:36:22.639047 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-ab183c23-b759-4de7-a5a1-5e9024cc8932 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:36:22.645821 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ab183c23-b759-4de7-a5a1-5e9024cc8932 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:22.646269 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ab183c23-b759-4de7-a5a1-5e9024cc8932 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:22.647046 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ab183c23-b759-4de7-a5a1-5e9024cc8932 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:22.647487 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ab183c23-b759-4de7-a5a1-5e9024cc8932 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:22.717113 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-ab183c23-b759-4de7-a5a1-5e9024cc8932 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:36:22.725178 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-ab183c23-b759-4de7-a5a1-5e9024cc8932 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.093461 Jun 17 15:36:22.725756 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 808/2027] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:36:22 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:36:23.136115 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-1cb96dc8-787f-45b9-af16-bf899c5e5dd8 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:36:23.137095 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-1cb96dc8-787f-45b9-af16-bf899c5e5dd8 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:36:23.143728 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1cb96dc8-787f-45b9-af16-bf899c5e5dd8 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:23.144191 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1cb96dc8-787f-45b9-af16-bf899c5e5dd8 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:23.144984 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1cb96dc8-787f-45b9-af16-bf899c5e5dd8 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:23.145418 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1cb96dc8-787f-45b9-af16-bf899c5e5dd8 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:23.150120 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=100 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:36:23.179200 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-1cb96dc8-787f-45b9-af16-bf899c5e5dd8 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047500 Jun 17 15:36:23.179828 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1220/2028] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:36:23 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:36:23.743811 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-9097953f-42df-4114-a582-2e08da09ee5d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:36:23.744466 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-9097953f-42df-4114-a582-2e08da09ee5d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:36:23.751402 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9097953f-42df-4114-a582-2e08da09ee5d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:23.751851 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9097953f-42df-4114-a582-2e08da09ee5d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:23.752683 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9097953f-42df-4114-a582-2e08da09ee5d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:23.753123 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9097953f-42df-4114-a582-2e08da09ee5d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:23.821615 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-9097953f-42df-4114-a582-2e08da09ee5d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:36:23.830186 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-9097953f-42df-4114-a582-2e08da09ee5d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.090322 Jun 17 15:36:23.830796 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 809/2029] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:36:23 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:36:24.191303 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-a5845f72-476c-4258-9a09-b65eea22fdba tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:36:24.192218 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-a5845f72-476c-4258-9a09-b65eea22fdba tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:36:24.198786 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a5845f72-476c-4258-9a09-b65eea22fdba tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:24.199227 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a5845f72-476c-4258-9a09-b65eea22fdba tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:24.199976 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a5845f72-476c-4258-9a09-b65eea22fdba tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:24.200446 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a5845f72-476c-4258-9a09-b65eea22fdba tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:24.234661 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-a5845f72-476c-4258-9a09-b65eea22fdba tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047284 Jun 17 15:36:24.235215 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1221/2030] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:36:24 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:36:24.847630 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-3d62f97b-fea7-4d1a-a16d-d2b67778160c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:36:24.848254 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-3d62f97b-fea7-4d1a-a16d-d2b67778160c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:36:24.855055 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3d62f97b-fea7-4d1a-a16d-d2b67778160c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:24.855505 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3d62f97b-fea7-4d1a-a16d-d2b67778160c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:24.856268 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3d62f97b-fea7-4d1a-a16d-d2b67778160c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:24.856724 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3d62f97b-fea7-4d1a-a16d-d2b67778160c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:24.917447 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-3d62f97b-fea7-4d1a-a16d-d2b67778160c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:36:24.925086 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-3d62f97b-fea7-4d1a-a16d-d2b67778160c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.081326 Jun 17 15:36:24.925646 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 810/2031] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:36:24 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:36:25.247139 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-e7d5ca9e-761f-486b-a24e-8e6cf3422138 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:36:25.248074 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-e7d5ca9e-761f-486b-a24e-8e6cf3422138 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:36:25.255181 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e7d5ca9e-761f-486b-a24e-8e6cf3422138 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:25.255635 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e7d5ca9e-761f-486b-a24e-8e6cf3422138 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:25.256473 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e7d5ca9e-761f-486b-a24e-8e6cf3422138 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:25.256945 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e7d5ca9e-761f-486b-a24e-8e6cf3422138 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:25.287405 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-e7d5ca9e-761f-486b-a24e-8e6cf3422138 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044795 Jun 17 15:36:25.287987 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1222/2032] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:36:25 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:36:25.942417 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-e73395b6-31a8-4930-8375-a7c3682cf0b9 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:36:25.943005 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-e73395b6-31a8-4930-8375-a7c3682cf0b9 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:36:25.949554 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e73395b6-31a8-4930-8375-a7c3682cf0b9 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:25.949997 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e73395b6-31a8-4930-8375-a7c3682cf0b9 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:25.950763 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e73395b6-31a8-4930-8375-a7c3682cf0b9 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:25.951204 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e73395b6-31a8-4930-8375-a7c3682cf0b9 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:26.013224 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-e73395b6-31a8-4930-8375-a7c3682cf0b9 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:36:26.020778 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-e73395b6-31a8-4930-8375-a7c3682cf0b9 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.082209 Jun 17 15:36:26.021570 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 811/2033] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:36:25 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:36:26.300366 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-d5b65d4f-2e70-4e66-9067-cc02ffa82686 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:36:26.301224 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-d5b65d4f-2e70-4e66-9067-cc02ffa82686 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:36:26.307614 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d5b65d4f-2e70-4e66-9067-cc02ffa82686 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:26.308056 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d5b65d4f-2e70-4e66-9067-cc02ffa82686 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:26.308848 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d5b65d4f-2e70-4e66-9067-cc02ffa82686 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:26.309277 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d5b65d4f-2e70-4e66-9067-cc02ffa82686 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:26.340971 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-d5b65d4f-2e70-4e66-9067-cc02ffa82686 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044688 Jun 17 15:36:26.341553 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1223/2034] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:36:26 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:36:27.038241 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-6580b2a3-9fb2-42cf-ba66-1f83552023cd tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:36:27.038838 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-6580b2a3-9fb2-42cf-ba66-1f83552023cd tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:36:27.046096 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6580b2a3-9fb2-42cf-ba66-1f83552023cd tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:27.046543 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6580b2a3-9fb2-42cf-ba66-1f83552023cd tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:27.047329 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6580b2a3-9fb2-42cf-ba66-1f83552023cd tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:27.047759 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6580b2a3-9fb2-42cf-ba66-1f83552023cd tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:27.113828 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-6580b2a3-9fb2-42cf-ba66-1f83552023cd tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:36:27.122122 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-6580b2a3-9fb2-42cf-ba66-1f83552023cd tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.087696 Jun 17 15:36:27.123462 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 812/2035] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:36:27 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:36:27.353956 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-0f02c4d8-b2c5-4f1f-b4c4-20f053669607 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:36:27.354886 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-0f02c4d8-b2c5-4f1f-b4c4-20f053669607 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:36:27.361470 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0f02c4d8-b2c5-4f1f-b4c4-20f053669607 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:27.361913 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0f02c4d8-b2c5-4f1f-b4c4-20f053669607 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:27.362666 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0f02c4d8-b2c5-4f1f-b4c4-20f053669607 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:27.363096 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0f02c4d8-b2c5-4f1f-b4c4-20f053669607 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:27.393398 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-0f02c4d8-b2c5-4f1f-b4c4-20f053669607 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044279 Jun 17 15:36:27.393972 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1224/2036] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:36:27 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:36:28.139557 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-42569554-7035-4660-a092-a7cf029c2d1c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:36:28.140216 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-42569554-7035-4660-a092-a7cf029c2d1c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:36:28.147104 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-42569554-7035-4660-a092-a7cf029c2d1c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:28.147554 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-42569554-7035-4660-a092-a7cf029c2d1c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:28.148917 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-42569554-7035-4660-a092-a7cf029c2d1c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:28.149279 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-42569554-7035-4660-a092-a7cf029c2d1c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:28.212204 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-42569554-7035-4660-a092-a7cf029c2d1c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:36:28.220003 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-42569554-7035-4660-a092-a7cf029c2d1c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.084313 Jun 17 15:36:28.220625 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 813/2037] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:36:28 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:36:28.406828 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-b8185565-2440-42d9-986a-ee32a44a77f9 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:36:28.407796 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-b8185565-2440-42d9-986a-ee32a44a77f9 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:36:28.414597 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b8185565-2440-42d9-986a-ee32a44a77f9 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:28.415041 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b8185565-2440-42d9-986a-ee32a44a77f9 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:28.415822 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b8185565-2440-42d9-986a-ee32a44a77f9 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:28.416261 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b8185565-2440-42d9-986a-ee32a44a77f9 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:28.447981 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-b8185565-2440-42d9-986a-ee32a44a77f9 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046539 Jun 17 15:36:28.448602 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1225/2038] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:36:28 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:36:29.238225 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-0a40cc87-28d7-4a33-bfac-e367397f66f1 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:36:29.238826 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-0a40cc87-28d7-4a33-bfac-e367397f66f1 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:36:29.246249 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0a40cc87-28d7-4a33-bfac-e367397f66f1 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:29.246693 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0a40cc87-28d7-4a33-bfac-e367397f66f1 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:29.247464 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0a40cc87-28d7-4a33-bfac-e367397f66f1 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:29.247900 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0a40cc87-28d7-4a33-bfac-e367397f66f1 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:29.315333 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-0a40cc87-28d7-4a33-bfac-e367397f66f1 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:36:29.323011 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-0a40cc87-28d7-4a33-bfac-e367397f66f1 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.088885 Jun 17 15:36:29.323586 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 814/2039] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:36:29 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:36:29.459408 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-278c9f95-8a5f-4bec-8a6b-09d000c352ec tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:36:29.460375 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-278c9f95-8a5f-4bec-8a6b-09d000c352ec tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:36:29.467359 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-278c9f95-8a5f-4bec-8a6b-09d000c352ec tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:29.467801 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-278c9f95-8a5f-4bec-8a6b-09d000c352ec tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:29.468583 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-278c9f95-8a5f-4bec-8a6b-09d000c352ec tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:29.469015 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-278c9f95-8a5f-4bec-8a6b-09d000c352ec tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:29.500052 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-278c9f95-8a5f-4bec-8a6b-09d000c352ec tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044604 Jun 17 15:36:29.500574 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1226/2040] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:36:29 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:36:30.339771 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-725bd988-f937-4f4b-bdc9-51eb23ea9178 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:36:30.340444 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-725bd988-f937-4f4b-bdc9-51eb23ea9178 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:36:30.347137 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-725bd988-f937-4f4b-bdc9-51eb23ea9178 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:30.347584 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-725bd988-f937-4f4b-bdc9-51eb23ea9178 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:30.348376 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-725bd988-f937-4f4b-bdc9-51eb23ea9178 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:30.348813 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-725bd988-f937-4f4b-bdc9-51eb23ea9178 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:30.413414 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-725bd988-f937-4f4b-bdc9-51eb23ea9178 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:36:30.421499 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-725bd988-f937-4f4b-bdc9-51eb23ea9178 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.085460 Jun 17 15:36:30.422305 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 815/2041] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:36:30 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:36:30.512606 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-c21b0707-126a-4a2d-bccd-e385d1086217 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:36:30.513538 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-c21b0707-126a-4a2d-bccd-e385d1086217 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:36:30.520555 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c21b0707-126a-4a2d-bccd-e385d1086217 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:30.521002 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c21b0707-126a-4a2d-bccd-e385d1086217 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:30.521779 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c21b0707-126a-4a2d-bccd-e385d1086217 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:30.522220 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c21b0707-126a-4a2d-bccd-e385d1086217 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:30.556862 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-c21b0707-126a-4a2d-bccd-e385d1086217 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048903 Jun 17 15:36:30.557470 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1227/2042] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:36:30 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:36:31.439249 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-3a9f02db-ed9c-42af-ae8c-941b08559819 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:36:31.439890 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-3a9f02db-ed9c-42af-ae8c-941b08559819 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:36:31.447553 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3a9f02db-ed9c-42af-ae8c-941b08559819 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:31.448002 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3a9f02db-ed9c-42af-ae8c-941b08559819 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:31.448821 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3a9f02db-ed9c-42af-ae8c-941b08559819 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:31.449260 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3a9f02db-ed9c-42af-ae8c-941b08559819 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:31.522847 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-3a9f02db-ed9c-42af-ae8c-941b08559819 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:36:31.534987 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-3a9f02db-ed9c-42af-ae8c-941b08559819 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.099629 Jun 17 15:36:31.535585 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 816/2043] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:36:31 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:36:31.569326 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-3410c52a-e4b9-4e26-b934-373743d75b3e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:36:31.571142 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-3410c52a-e4b9-4e26-b934-373743d75b3e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:36:31.578404 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3410c52a-e4b9-4e26-b934-373743d75b3e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:31.578859 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3410c52a-e4b9-4e26-b934-373743d75b3e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:31.579651 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3410c52a-e4b9-4e26-b934-373743d75b3e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:31.580092 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3410c52a-e4b9-4e26-b934-373743d75b3e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:31.620748 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-3410c52a-e4b9-4e26-b934-373743d75b3e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055622 Jun 17 15:36:31.621334 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1228/2044] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:36:31 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:36:32.552600 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-d8cf389e-6ad2-4b73-b880-72e31acca9fe tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:36:32.553499 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-d8cf389e-6ad2-4b73-b880-72e31acca9fe tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:36:32.560102 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d8cf389e-6ad2-4b73-b880-72e31acca9fe tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:32.560662 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d8cf389e-6ad2-4b73-b880-72e31acca9fe tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:32.561453 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d8cf389e-6ad2-4b73-b880-72e31acca9fe tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:32.561883 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d8cf389e-6ad2-4b73-b880-72e31acca9fe tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:32.629464 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-d8cf389e-6ad2-4b73-b880-72e31acca9fe tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:36:32.633438 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-6e36e8ad-f29e-475b-81f9-4c83d41644c5 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:36:32.634386 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-6e36e8ad-f29e-475b-81f9-4c83d41644c5 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:36:32.638603 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-d8cf389e-6ad2-4b73-b880-72e31acca9fe tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.090016 Jun 17 15:36:32.639482 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 817/2045] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:36:32 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:36:32.643335 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6e36e8ad-f29e-475b-81f9-4c83d41644c5 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:32.643905 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6e36e8ad-f29e-475b-81f9-4c83d41644c5 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:32.644831 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6e36e8ad-f29e-475b-81f9-4c83d41644c5 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:32.645357 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6e36e8ad-f29e-475b-81f9-4c83d41644c5 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:32.677552 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-6e36e8ad-f29e-475b-81f9-4c83d41644c5 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049027 Jun 17 15:36:32.678121 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1229/2046] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:36:32 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:36:33.654752 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-5703aa16-f140-4a6b-98c4-d8b9409c2c5d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:36:33.655329 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-5703aa16-f140-4a6b-98c4-d8b9409c2c5d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:36:33.661802 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5703aa16-f140-4a6b-98c4-d8b9409c2c5d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:33.662248 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5703aa16-f140-4a6b-98c4-d8b9409c2c5d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:33.663002 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5703aa16-f140-4a6b-98c4-d8b9409c2c5d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:33.663439 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5703aa16-f140-4a6b-98c4-d8b9409c2c5d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:33.689203 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-52adfbb6-43df-4215-b3ba-05abb380d8d2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:36:33.690125 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-52adfbb6-43df-4215-b3ba-05abb380d8d2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:36:33.696713 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-52adfbb6-43df-4215-b3ba-05abb380d8d2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:33.697169 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-52adfbb6-43df-4215-b3ba-05abb380d8d2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:33.697944 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-52adfbb6-43df-4215-b3ba-05abb380d8d2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:33.698386 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-52adfbb6-43df-4215-b3ba-05abb380d8d2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:33.723644 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-5703aa16-f140-4a6b-98c4-d8b9409c2c5d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:36:33.729194 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-52adfbb6-43df-4215-b3ba-05abb380d8d2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043910 Jun 17 15:36:33.729768 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1230/2047] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:36:33 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:36:33.731955 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-5703aa16-f140-4a6b-98c4-d8b9409c2c5d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.081141 Jun 17 15:36:33.732619 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 818/2048] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:36:33 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:36:34.740801 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-1885a3ad-42cf-4ee0-97a7-7f695e57b657 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:36:34.741726 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-1885a3ad-42cf-4ee0-97a7-7f695e57b657 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:36:34.749121 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1885a3ad-42cf-4ee0-97a7-7f695e57b657 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:34.749384 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-3fadf3f5-fbae-48b8-80e1-334ec5fe800f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:36:34.749811 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1885a3ad-42cf-4ee0-97a7-7f695e57b657 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:34.749911 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-3fadf3f5-fbae-48b8-80e1-334ec5fe800f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:36:34.750734 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1885a3ad-42cf-4ee0-97a7-7f695e57b657 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:34.750906 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1885a3ad-42cf-4ee0-97a7-7f695e57b657 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:34.756410 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3fadf3f5-fbae-48b8-80e1-334ec5fe800f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:34.756865 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3fadf3f5-fbae-48b8-80e1-334ec5fe800f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:34.757631 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3fadf3f5-fbae-48b8-80e1-334ec5fe800f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:34.758635 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3fadf3f5-fbae-48b8-80e1-334ec5fe800f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:34.782347 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-1885a3ad-42cf-4ee0-97a7-7f695e57b657 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045682 Jun 17 15:36:34.783022 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1231/2049] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:36:34 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:36:34.824597 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-3fadf3f5-fbae-48b8-80e1-334ec5fe800f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:36:34.832622 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-3fadf3f5-fbae-48b8-80e1-334ec5fe800f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.087207 Jun 17 15:36:34.833211 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 819/2050] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:36:34 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:36:35.794079 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-695a24d5-ea92-4375-8588-f71435167770 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:36:35.794997 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-695a24d5-ea92-4375-8588-f71435167770 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:36:35.801765 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-695a24d5-ea92-4375-8588-f71435167770 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:35.802214 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-695a24d5-ea92-4375-8588-f71435167770 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:35.802980 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-695a24d5-ea92-4375-8588-f71435167770 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:35.803476 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-695a24d5-ea92-4375-8588-f71435167770 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:35.834497 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-695a24d5-ea92-4375-8588-f71435167770 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044329 Jun 17 15:36:35.835078 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1232/2051] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:36:35 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:36:35.849696 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-9be5ef0d-3d67-4682-9159-81984dc8f3e3 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:36:35.850302 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-9be5ef0d-3d67-4682-9159-81984dc8f3e3 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:36:35.861044 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9be5ef0d-3d67-4682-9159-81984dc8f3e3 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:35.861495 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9be5ef0d-3d67-4682-9159-81984dc8f3e3 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:35.862270 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9be5ef0d-3d67-4682-9159-81984dc8f3e3 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:35.862708 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9be5ef0d-3d67-4682-9159-81984dc8f3e3 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:35.931018 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-9be5ef0d-3d67-4682-9159-81984dc8f3e3 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:36:35.938685 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-9be5ef0d-3d67-4682-9159-81984dc8f3e3 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.093060 Jun 17 15:36:35.939262 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 820/2052] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:36:35 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:36:36.846532 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-b2de8ef0-8756-4fc0-b886-325481d9b2ac tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:36:36.847464 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-b2de8ef0-8756-4fc0-b886-325481d9b2ac tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:36:36.854372 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b2de8ef0-8756-4fc0-b886-325481d9b2ac tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:36.854830 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b2de8ef0-8756-4fc0-b886-325481d9b2ac tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:36.855599 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b2de8ef0-8756-4fc0-b886-325481d9b2ac tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:36.856032 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b2de8ef0-8756-4fc0-b886-325481d9b2ac tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:36.888443 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-b2de8ef0-8756-4fc0-b886-325481d9b2ac tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046031 Jun 17 15:36:36.889038 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1233/2053] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:36:36 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:36:36.955634 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-8c7f7eb2-57a6-424c-a80c-7e40d8aab226 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:36:36.956266 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-8c7f7eb2-57a6-424c-a80c-7e40d8aab226 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:36:36.963111 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8c7f7eb2-57a6-424c-a80c-7e40d8aab226 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:36.963561 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8c7f7eb2-57a6-424c-a80c-7e40d8aab226 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:36.964366 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8c7f7eb2-57a6-424c-a80c-7e40d8aab226 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:36.964810 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8c7f7eb2-57a6-424c-a80c-7e40d8aab226 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:36.969340 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell1:SELECT=100 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:36:37.029312 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-8c7f7eb2-57a6-424c-a80c-7e40d8aab226 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:36:37.037185 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-8c7f7eb2-57a6-424c-a80c-7e40d8aab226 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.085339 Jun 17 15:36:37.037777 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 821/2054] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:36:36 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:36:37.900684 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-0429f2ea-2b14-42c6-93d7-8ff7aa05f026 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:36:37.901604 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-0429f2ea-2b14-42c6-93d7-8ff7aa05f026 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:36:37.908084 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0429f2ea-2b14-42c6-93d7-8ff7aa05f026 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:37.908587 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0429f2ea-2b14-42c6-93d7-8ff7aa05f026 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:37.909338 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0429f2ea-2b14-42c6-93d7-8ff7aa05f026 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:37.909763 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0429f2ea-2b14-42c6-93d7-8ff7aa05f026 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:37.939551 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-0429f2ea-2b14-42c6-93d7-8ff7aa05f026 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043329 Jun 17 15:36:37.940140 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1234/2055] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:36:37 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:36:38.053898 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-febf56d5-97bd-4991-818c-8e01c0ea178d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:36:38.054510 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-febf56d5-97bd-4991-818c-8e01c0ea178d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:36:38.061091 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-febf56d5-97bd-4991-818c-8e01c0ea178d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:38.061537 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-febf56d5-97bd-4991-818c-8e01c0ea178d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:38.062298 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-febf56d5-97bd-4991-818c-8e01c0ea178d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:38.062747 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-febf56d5-97bd-4991-818c-8e01c0ea178d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:38.128446 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-febf56d5-97bd-4991-818c-8e01c0ea178d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:36:38.136623 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-febf56d5-97bd-4991-818c-8e01c0ea178d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.086554 Jun 17 15:36:38.137216 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 822/2056] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:36:38 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:36:38.951184 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-7ac78db4-9025-41a4-888a-0faf85225f77 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:36:38.952140 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-7ac78db4-9025-41a4-888a-0faf85225f77 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:36:38.958760 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7ac78db4-9025-41a4-888a-0faf85225f77 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:38.959219 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7ac78db4-9025-41a4-888a-0faf85225f77 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:38.959977 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7ac78db4-9025-41a4-888a-0faf85225f77 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:38.960449 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7ac78db4-9025-41a4-888a-0faf85225f77 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:38.989641 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-7ac78db4-9025-41a4-888a-0faf85225f77 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042455 Jun 17 15:36:38.990194 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1235/2057] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:36:38 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:36:39.154490 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-806b9700-569c-43cd-8655-9c049727b2b1 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:36:39.155164 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-806b9700-569c-43cd-8655-9c049727b2b1 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:36:39.161592 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-806b9700-569c-43cd-8655-9c049727b2b1 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:39.162038 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-806b9700-569c-43cd-8655-9c049727b2b1 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:39.162787 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-806b9700-569c-43cd-8655-9c049727b2b1 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:39.163218 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-806b9700-569c-43cd-8655-9c049727b2b1 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:39.225592 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-806b9700-569c-43cd-8655-9c049727b2b1 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:36:39.233698 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-806b9700-569c-43cd-8655-9c049727b2b1 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.083097 Jun 17 15:36:39.234254 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 823/2058] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:36:39 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:36:40.002446 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-af90d261-ad70-4a5e-9ab6-571092067e08 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:36:40.003368 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-af90d261-ad70-4a5e-9ab6-571092067e08 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:36:40.005739 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_api:SELECT=58 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:36:40.011610 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-af90d261-ad70-4a5e-9ab6-571092067e08 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:40.012056 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-af90d261-ad70-4a5e-9ab6-571092067e08 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:40.012848 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-af90d261-ad70-4a5e-9ab6-571092067e08 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:40.013286 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-af90d261-ad70-4a5e-9ab6-571092067e08 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:40.037663 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=100 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:36:40.042583 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-af90d261-ad70-4a5e-9ab6-571092067e08 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044212 Jun 17 15:36:40.043141 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1236/2059] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:36:39 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:36:40.251033 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-9699b772-5cb9-48be-ae1f-77d700d5afef tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:36:40.251679 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-9699b772-5cb9-48be-ae1f-77d700d5afef tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:36:40.258834 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9699b772-5cb9-48be-ae1f-77d700d5afef tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:40.259234 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9699b772-5cb9-48be-ae1f-77d700d5afef tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:40.259992 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9699b772-5cb9-48be-ae1f-77d700d5afef tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:40.260448 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9699b772-5cb9-48be-ae1f-77d700d5afef tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:40.323637 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-9699b772-5cb9-48be-ae1f-77d700d5afef tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:36:40.331186 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-9699b772-5cb9-48be-ae1f-77d700d5afef tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.084008 Jun 17 15:36:40.331739 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 824/2060] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:36:40 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:36:41.054801 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-e1b83f33-1214-4080-b30e-065f21bfe4d4 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:36:41.055754 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-e1b83f33-1214-4080-b30e-065f21bfe4d4 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:36:41.062308 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e1b83f33-1214-4080-b30e-065f21bfe4d4 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:41.062756 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e1b83f33-1214-4080-b30e-065f21bfe4d4 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:41.063530 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e1b83f33-1214-4080-b30e-065f21bfe4d4 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:41.063965 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e1b83f33-1214-4080-b30e-065f21bfe4d4 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:41.093379 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-e1b83f33-1214-4080-b30e-065f21bfe4d4 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043035 Jun 17 15:36:41.093929 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1237/2061] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:36:41 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:36:41.348018 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-71f3d713-dbab-4697-8022-81acb664993c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:36:41.348741 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-71f3d713-dbab-4697-8022-81acb664993c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:36:41.355844 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-71f3d713-dbab-4697-8022-81acb664993c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:41.356292 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-71f3d713-dbab-4697-8022-81acb664993c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:41.357087 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-71f3d713-dbab-4697-8022-81acb664993c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:41.357522 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-71f3d713-dbab-4697-8022-81acb664993c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:41.418385 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-71f3d713-dbab-4697-8022-81acb664993c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:36:41.425854 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-71f3d713-dbab-4697-8022-81acb664993c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.081728 Jun 17 15:36:41.426418 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 825/2062] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:36:41 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:36:42.105338 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-785b1c5d-555f-4e82-8a37-ac93689ce105 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:36:42.106265 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-785b1c5d-555f-4e82-8a37-ac93689ce105 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:36:42.112765 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-785b1c5d-555f-4e82-8a37-ac93689ce105 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:42.113214 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-785b1c5d-555f-4e82-8a37-ac93689ce105 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:42.113974 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-785b1c5d-555f-4e82-8a37-ac93689ce105 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:42.114408 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-785b1c5d-555f-4e82-8a37-ac93689ce105 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:42.144428 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-785b1c5d-555f-4e82-8a37-ac93689ce105 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043545 Jun 17 15:36:42.144983 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1238/2063] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:36:42 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:36:42.443130 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-373b3897-17e7-4bb7-9fee-c29e52e9d7da tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:36:42.443744 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-373b3897-17e7-4bb7-9fee-c29e52e9d7da tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:36:42.450394 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-373b3897-17e7-4bb7-9fee-c29e52e9d7da tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:42.450833 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-373b3897-17e7-4bb7-9fee-c29e52e9d7da tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:42.451630 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-373b3897-17e7-4bb7-9fee-c29e52e9d7da tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:42.452071 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-373b3897-17e7-4bb7-9fee-c29e52e9d7da tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:42.513946 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-373b3897-17e7-4bb7-9fee-c29e52e9d7da tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:36:42.521455 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-373b3897-17e7-4bb7-9fee-c29e52e9d7da tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.082272 Jun 17 15:36:42.522021 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 826/2064] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:36:42 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:36:43.156114 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-91324f48-748c-4706-8701-1f4db7322ef5 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:36:43.157061 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-91324f48-748c-4706-8701-1f4db7322ef5 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:36:43.163658 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-91324f48-748c-4706-8701-1f4db7322ef5 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:43.164110 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-91324f48-748c-4706-8701-1f4db7322ef5 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:43.164895 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-91324f48-748c-4706-8701-1f4db7322ef5 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:43.165363 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-91324f48-748c-4706-8701-1f4db7322ef5 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:43.193742 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-91324f48-748c-4706-8701-1f4db7322ef5 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041641 Jun 17 15:36:43.194292 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1239/2065] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:36:43 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:36:43.538908 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-03867cee-1e0b-4a49-899a-d56b33a4d0b4 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:36:43.539968 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-03867cee-1e0b-4a49-899a-d56b33a4d0b4 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:36:43.542196 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_api:SELECT=56 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:36:43.547499 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-03867cee-1e0b-4a49-899a-d56b33a4d0b4 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:43.547937 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-03867cee-1e0b-4a49-899a-d56b33a4d0b4 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:43.548717 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-03867cee-1e0b-4a49-899a-d56b33a4d0b4 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:43.549145 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-03867cee-1e0b-4a49-899a-d56b33a4d0b4 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:43.612226 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-03867cee-1e0b-4a49-899a-d56b33a4d0b4 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:36:43.620272 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-03867cee-1e0b-4a49-899a-d56b33a4d0b4 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.085276 Jun 17 15:36:43.620847 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 827/2066] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:36:43 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:36:44.206297 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-e67db258-68fd-42e8-a37f-ca0b2c4f9374 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:36:44.207219 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-e67db258-68fd-42e8-a37f-ca0b2c4f9374 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:36:44.214438 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e67db258-68fd-42e8-a37f-ca0b2c4f9374 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:44.214862 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e67db258-68fd-42e8-a37f-ca0b2c4f9374 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:44.215615 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e67db258-68fd-42e8-a37f-ca0b2c4f9374 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:44.216050 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e67db258-68fd-42e8-a37f-ca0b2c4f9374 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:44.244825 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-e67db258-68fd-42e8-a37f-ca0b2c4f9374 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042424 Jun 17 15:36:44.245392 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1240/2067] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:36:44 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:36:44.637775 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-09016041-fa09-486a-b3a8-9c93619dbb2c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:36:44.638420 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-09016041-fa09-486a-b3a8-9c93619dbb2c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:36:44.644629 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-09016041-fa09-486a-b3a8-9c93619dbb2c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:44.645083 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-09016041-fa09-486a-b3a8-9c93619dbb2c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:44.645846 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-09016041-fa09-486a-b3a8-9c93619dbb2c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:44.646281 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-09016041-fa09-486a-b3a8-9c93619dbb2c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:44.711224 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-09016041-fa09-486a-b3a8-9c93619dbb2c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:36:44.719633 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-09016041-fa09-486a-b3a8-9c93619dbb2c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.086420 Jun 17 15:36:44.720252 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 828/2068] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:36:44 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:36:45.256361 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-ef03d3b4-1216-42c9-b725-ca20dd5e504a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:36:45.257286 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-ef03d3b4-1216-42c9-b725-ca20dd5e504a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:36:45.263700 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ef03d3b4-1216-42c9-b725-ca20dd5e504a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:45.264140 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ef03d3b4-1216-42c9-b725-ca20dd5e504a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:45.264926 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ef03d3b4-1216-42c9-b725-ca20dd5e504a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:45.265359 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ef03d3b4-1216-42c9-b725-ca20dd5e504a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:45.294309 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-ef03d3b4-1216-42c9-b725-ca20dd5e504a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041889 Jun 17 15:36:45.294900 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1241/2069] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:36:45 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:36:45.738999 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-c9a0d65a-1ca6-46e5-8668-276460418bcb tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:36:45.739609 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-c9a0d65a-1ca6-46e5-8668-276460418bcb tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:36:45.746059 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c9a0d65a-1ca6-46e5-8668-276460418bcb tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:45.746505 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c9a0d65a-1ca6-46e5-8668-276460418bcb tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:45.747261 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c9a0d65a-1ca6-46e5-8668-276460418bcb tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:45.747696 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c9a0d65a-1ca6-46e5-8668-276460418bcb tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:45.808074 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-c9a0d65a-1ca6-46e5-8668-276460418bcb tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:36:45.815635 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-c9a0d65a-1ca6-46e5-8668-276460418bcb tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.080476 Jun 17 15:36:45.816137 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 829/2070] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:36:45 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:36:46.306775 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-46c6d205-528d-4489-86fa-ca8a9ea4cd38 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:36:46.307689 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-46c6d205-528d-4489-86fa-ca8a9ea4cd38 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:36:46.314613 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-46c6d205-528d-4489-86fa-ca8a9ea4cd38 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:46.315059 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-46c6d205-528d-4489-86fa-ca8a9ea4cd38 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:46.315810 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-46c6d205-528d-4489-86fa-ca8a9ea4cd38 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:46.316240 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-46c6d205-528d-4489-86fa-ca8a9ea4cd38 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:46.344865 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-46c6d205-528d-4489-86fa-ca8a9ea4cd38 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042842 Jun 17 15:36:46.345417 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1242/2071] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:36:46 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:36:46.832723 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-da0c68d9-e665-4db7-80f8-5263a35fda6a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:36:46.833540 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-da0c68d9-e665-4db7-80f8-5263a35fda6a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:36:46.841142 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-da0c68d9-e665-4db7-80f8-5263a35fda6a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:46.841597 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-da0c68d9-e665-4db7-80f8-5263a35fda6a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:46.842360 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-da0c68d9-e665-4db7-80f8-5263a35fda6a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:46.842794 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-da0c68d9-e665-4db7-80f8-5263a35fda6a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:46.906492 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-da0c68d9-e665-4db7-80f8-5263a35fda6a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:36:46.914234 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-da0c68d9-e665-4db7-80f8-5263a35fda6a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.085354 Jun 17 15:36:46.914821 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 830/2072] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:36:46 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:36:47.359348 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-d4b1ba8c-afc2-4da3-99ae-c37f85c6bd75 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:36:47.360589 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-d4b1ba8c-afc2-4da3-99ae-c37f85c6bd75 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:36:47.369785 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d4b1ba8c-afc2-4da3-99ae-c37f85c6bd75 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:47.370369 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d4b1ba8c-afc2-4da3-99ae-c37f85c6bd75 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:47.371136 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d4b1ba8c-afc2-4da3-99ae-c37f85c6bd75 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:47.371570 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d4b1ba8c-afc2-4da3-99ae-c37f85c6bd75 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:47.401244 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-d4b1ba8c-afc2-4da3-99ae-c37f85c6bd75 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047882 Jun 17 15:36:47.401793 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1243/2073] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:36:47 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:36:47.930973 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-fff5896f-8b6b-4586-8d82-d7418701b331 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:36:47.931576 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-fff5896f-8b6b-4586-8d82-d7418701b331 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:36:47.938601 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fff5896f-8b6b-4586-8d82-d7418701b331 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:47.939048 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fff5896f-8b6b-4586-8d82-d7418701b331 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:47.939811 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fff5896f-8b6b-4586-8d82-d7418701b331 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:47.940255 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fff5896f-8b6b-4586-8d82-d7418701b331 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:48.007306 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-fff5896f-8b6b-4586-8d82-d7418701b331 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:36:48.014812 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-fff5896f-8b6b-4586-8d82-d7418701b331 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.087726 Jun 17 15:36:48.015381 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 831/2074] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:36:47 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:36:48.412686 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-702a1057-f650-4f3f-8769-782c493ad1a6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:36:48.413610 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-702a1057-f650-4f3f-8769-782c493ad1a6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:36:48.420681 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-702a1057-f650-4f3f-8769-782c493ad1a6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:48.421134 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-702a1057-f650-4f3f-8769-782c493ad1a6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:48.421895 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-702a1057-f650-4f3f-8769-782c493ad1a6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:48.422365 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-702a1057-f650-4f3f-8769-782c493ad1a6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:48.452471 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-702a1057-f650-4f3f-8769-782c493ad1a6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043896 Jun 17 15:36:48.453028 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1244/2075] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:36:48 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:36:49.031757 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-d452aca8-1bed-4d1c-95f1-3ecaff8d5427 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:36:49.032411 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-d452aca8-1bed-4d1c-95f1-3ecaff8d5427 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:36:49.039398 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d452aca8-1bed-4d1c-95f1-3ecaff8d5427 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:49.039846 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d452aca8-1bed-4d1c-95f1-3ecaff8d5427 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:49.040642 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d452aca8-1bed-4d1c-95f1-3ecaff8d5427 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:49.041087 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d452aca8-1bed-4d1c-95f1-3ecaff8d5427 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:49.106282 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-d452aca8-1bed-4d1c-95f1-3ecaff8d5427 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:36:49.113986 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-d452aca8-1bed-4d1c-95f1-3ecaff8d5427 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.086165 Jun 17 15:36:49.114566 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 832/2076] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:36:49 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:36:49.463394 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-b90bb188-107a-445d-8e38-e71d1fdfb39e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:36:49.464304 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-b90bb188-107a-445d-8e38-e71d1fdfb39e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:36:49.470746 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b90bb188-107a-445d-8e38-e71d1fdfb39e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:49.471183 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b90bb188-107a-445d-8e38-e71d1fdfb39e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:49.472034 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b90bb188-107a-445d-8e38-e71d1fdfb39e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:49.472503 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b90bb188-107a-445d-8e38-e71d1fdfb39e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:49.502253 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-b90bb188-107a-445d-8e38-e71d1fdfb39e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043093 Jun 17 15:36:49.502802 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1245/2077] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:36:49 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:36:50.131029 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-33c5cbca-3747-4682-8147-4beeb742a40f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:36:50.131636 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-33c5cbca-3747-4682-8147-4beeb742a40f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:36:50.138592 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-33c5cbca-3747-4682-8147-4beeb742a40f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:50.139034 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-33c5cbca-3747-4682-8147-4beeb742a40f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:50.139780 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-33c5cbca-3747-4682-8147-4beeb742a40f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:50.140213 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-33c5cbca-3747-4682-8147-4beeb742a40f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:50.201495 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-33c5cbca-3747-4682-8147-4beeb742a40f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:36:50.209192 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-33c5cbca-3747-4682-8147-4beeb742a40f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.082022 Jun 17 15:36:50.209763 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 833/2078] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:36:50 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:36:50.514391 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-515a22e9-10e1-4dd0-b011-ab5414e691a4 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:36:50.515304 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-515a22e9-10e1-4dd0-b011-ab5414e691a4 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:36:50.521729 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-515a22e9-10e1-4dd0-b011-ab5414e691a4 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:50.522172 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-515a22e9-10e1-4dd0-b011-ab5414e691a4 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:50.522919 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-515a22e9-10e1-4dd0-b011-ab5414e691a4 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:50.523350 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-515a22e9-10e1-4dd0-b011-ab5414e691a4 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:50.551556 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-515a22e9-10e1-4dd0-b011-ab5414e691a4 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041758 Jun 17 15:36:50.552122 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1246/2079] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:36:50 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:36:51.227570 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-3e6d710c-78b9-4bde-b705-a7fce877825a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:36:51.228182 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-3e6d710c-78b9-4bde-b705-a7fce877825a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:36:51.235521 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3e6d710c-78b9-4bde-b705-a7fce877825a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:51.235970 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3e6d710c-78b9-4bde-b705-a7fce877825a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:51.236761 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3e6d710c-78b9-4bde-b705-a7fce877825a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:51.237320 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3e6d710c-78b9-4bde-b705-a7fce877825a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:51.300544 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-3e6d710c-78b9-4bde-b705-a7fce877825a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:36:51.308496 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-3e6d710c-78b9-4bde-b705-a7fce877825a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.085104 Jun 17 15:36:51.309070 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 834/2080] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:36:51 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:36:51.563272 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-b153de5d-7da4-44e1-bc91-7e5dfe45d41f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:36:51.564421 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-b153de5d-7da4-44e1-bc91-7e5dfe45d41f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:36:51.570666 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b153de5d-7da4-44e1-bc91-7e5dfe45d41f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:51.571112 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b153de5d-7da4-44e1-bc91-7e5dfe45d41f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:51.571867 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b153de5d-7da4-44e1-bc91-7e5dfe45d41f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:51.572294 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b153de5d-7da4-44e1-bc91-7e5dfe45d41f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:51.602196 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-b153de5d-7da4-44e1-bc91-7e5dfe45d41f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042959 Jun 17 15:36:51.602748 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1247/2081] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:36:51 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:36:52.325812 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-946289ff-5005-4d6c-946e-f6e704bc8bdf tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:36:52.326413 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-946289ff-5005-4d6c-946e-f6e704bc8bdf tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:36:52.334180 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-946289ff-5005-4d6c-946e-f6e704bc8bdf tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:52.334655 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-946289ff-5005-4d6c-946e-f6e704bc8bdf tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:52.335641 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-946289ff-5005-4d6c-946e-f6e704bc8bdf tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:52.336281 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-946289ff-5005-4d6c-946e-f6e704bc8bdf tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:52.407393 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-946289ff-5005-4d6c-946e-f6e704bc8bdf tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:36:52.415442 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-946289ff-5005-4d6c-946e-f6e704bc8bdf tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.093510 Jun 17 15:36:52.416012 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 835/2082] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:36:52 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:36:52.613879 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-ee999693-956f-452f-a1ad-2177111efc41 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:36:52.614794 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-ee999693-956f-452f-a1ad-2177111efc41 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:36:52.621181 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ee999693-956f-452f-a1ad-2177111efc41 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:52.621623 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ee999693-956f-452f-a1ad-2177111efc41 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:52.622366 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ee999693-956f-452f-a1ad-2177111efc41 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:52.622789 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ee999693-956f-452f-a1ad-2177111efc41 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:52.650835 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-ee999693-956f-452f-a1ad-2177111efc41 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040938 Jun 17 15:36:52.651393 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1248/2083] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:36:52 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:36:53.432789 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-b53650d6-a2cd-4840-9b10-c5c700661910 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:36:53.433594 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-b53650d6-a2cd-4840-9b10-c5c700661910 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:36:53.440794 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b53650d6-a2cd-4840-9b10-c5c700661910 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:53.441233 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b53650d6-a2cd-4840-9b10-c5c700661910 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:53.441992 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b53650d6-a2cd-4840-9b10-c5c700661910 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:53.442590 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b53650d6-a2cd-4840-9b10-c5c700661910 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:53.508466 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-b53650d6-a2cd-4840-9b10-c5c700661910 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:36:53.516966 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-b53650d6-a2cd-4840-9b10-c5c700661910 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.088032 Jun 17 15:36:53.517558 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 836/2084] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:36:53 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:36:53.663233 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-054983e8-682f-42a3-b80a-70029f48eb05 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:36:53.664132 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-054983e8-682f-42a3-b80a-70029f48eb05 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:36:53.671300 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-054983e8-682f-42a3-b80a-70029f48eb05 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:53.671784 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-054983e8-682f-42a3-b80a-70029f48eb05 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:53.672598 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-054983e8-682f-42a3-b80a-70029f48eb05 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:53.673029 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-054983e8-682f-42a3-b80a-70029f48eb05 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:53.705957 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-054983e8-682f-42a3-b80a-70029f48eb05 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046387 Jun 17 15:36:53.706703 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1249/2085] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:36:53 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:36:54.534788 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-1f2e551f-4af8-4d15-b262-ad2582af4b7b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:36:54.535332 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-1f2e551f-4af8-4d15-b262-ad2582af4b7b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:36:54.542069 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1f2e551f-4af8-4d15-b262-ad2582af4b7b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:54.542505 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1f2e551f-4af8-4d15-b262-ad2582af4b7b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:54.543398 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1f2e551f-4af8-4d15-b262-ad2582af4b7b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:54.543827 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1f2e551f-4af8-4d15-b262-ad2582af4b7b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:54.618230 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-1f2e551f-4af8-4d15-b262-ad2582af4b7b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:36:54.622411 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell1:SELECT=100 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:36:54.627741 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-1f2e551f-4af8-4d15-b262-ad2582af4b7b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.096524 Jun 17 15:36:54.628797 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 837/2086] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:36:54 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:36:54.718342 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-5df2b1c1-6ace-47b3-8215-a098460bab66 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:36:54.719264 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-5df2b1c1-6ace-47b3-8215-a098460bab66 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:36:54.725986 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5df2b1c1-6ace-47b3-8215-a098460bab66 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:54.726431 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5df2b1c1-6ace-47b3-8215-a098460bab66 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:54.727185 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5df2b1c1-6ace-47b3-8215-a098460bab66 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:54.727650 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5df2b1c1-6ace-47b3-8215-a098460bab66 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:54.756126 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-5df2b1c1-6ace-47b3-8215-a098460bab66 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042369 Jun 17 15:36:54.756718 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1250/2087] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:36:54 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:36:55.646143 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-6f630e43-9d9a-4443-a2c9-611c63056d8c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:36:55.646693 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-6f630e43-9d9a-4443-a2c9-611c63056d8c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:36:55.653878 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6f630e43-9d9a-4443-a2c9-611c63056d8c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:55.654328 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6f630e43-9d9a-4443-a2c9-611c63056d8c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:55.655091 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6f630e43-9d9a-4443-a2c9-611c63056d8c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:55.655528 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6f630e43-9d9a-4443-a2c9-611c63056d8c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:55.714782 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-6f630e43-9d9a-4443-a2c9-611c63056d8c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:36:55.722767 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-6f630e43-9d9a-4443-a2c9-611c63056d8c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.080709 Jun 17 15:36:55.723329 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 838/2088] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:36:55 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:36:55.767547 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-3d9f1eb5-32ec-4e64-99d3-cb9301273ec8 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:36:55.768516 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-3d9f1eb5-32ec-4e64-99d3-cb9301273ec8 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:36:55.775423 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3d9f1eb5-32ec-4e64-99d3-cb9301273ec8 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:55.775880 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3d9f1eb5-32ec-4e64-99d3-cb9301273ec8 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:55.776665 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3d9f1eb5-32ec-4e64-99d3-cb9301273ec8 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:55.777102 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3d9f1eb5-32ec-4e64-99d3-cb9301273ec8 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:55.806715 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-3d9f1eb5-32ec-4e64-99d3-cb9301273ec8 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043058 Jun 17 15:36:55.807266 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1251/2089] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:36:55 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:36:56.739916 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-b03e5000-ca6d-4d12-a94b-873fd1a969f4 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:36:56.740521 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-b03e5000-ca6d-4d12-a94b-873fd1a969f4 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:36:56.747521 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b03e5000-ca6d-4d12-a94b-873fd1a969f4 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:56.747967 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b03e5000-ca6d-4d12-a94b-873fd1a969f4 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:56.748749 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b03e5000-ca6d-4d12-a94b-873fd1a969f4 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:56.749179 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b03e5000-ca6d-4d12-a94b-873fd1a969f4 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:56.808545 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-b03e5000-ca6d-4d12-a94b-873fd1a969f4 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:36:56.817032 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-b03e5000-ca6d-4d12-a94b-873fd1a969f4 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.080989 Jun 17 15:36:56.817613 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-a61c89c0-73fb-438b-8260-ddd342bc6e29 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:36:56.818129 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 839/2090] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:36:56 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:36:56.818557 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-a61c89c0-73fb-438b-8260-ddd342bc6e29 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:36:56.826506 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a61c89c0-73fb-438b-8260-ddd342bc6e29 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:56.826956 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a61c89c0-73fb-438b-8260-ddd342bc6e29 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:56.827815 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a61c89c0-73fb-438b-8260-ddd342bc6e29 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:56.828252 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a61c89c0-73fb-438b-8260-ddd342bc6e29 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:56.858028 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-a61c89c0-73fb-438b-8260-ddd342bc6e29 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044262 Jun 17 15:36:56.858590 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1252/2091] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:36:56 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:36:57.834219 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-07813811-835d-4d43-9461-2fc86c6b0759 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:36:57.834837 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-07813811-835d-4d43-9461-2fc86c6b0759 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:36:57.841297 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-07813811-835d-4d43-9461-2fc86c6b0759 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:57.841748 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-07813811-835d-4d43-9461-2fc86c6b0759 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:57.842533 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-07813811-835d-4d43-9461-2fc86c6b0759 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:57.842967 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-07813811-835d-4d43-9461-2fc86c6b0759 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:57.869724 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-374bd51c-5fa4-4f80-a105-9e76e7cdd960 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:36:57.870649 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-374bd51c-5fa4-4f80-a105-9e76e7cdd960 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:36:57.877936 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-374bd51c-5fa4-4f80-a105-9e76e7cdd960 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:57.878382 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-374bd51c-5fa4-4f80-a105-9e76e7cdd960 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:57.879141 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-374bd51c-5fa4-4f80-a105-9e76e7cdd960 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:57.879567 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-374bd51c-5fa4-4f80-a105-9e76e7cdd960 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:57.897335 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=100 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:36:57.910243 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-07813811-835d-4d43-9461-2fc86c6b0759 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:36:57.910868 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-374bd51c-5fa4-4f80-a105-9e76e7cdd960 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045065 Jun 17 15:36:57.911438 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1253/2092] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:36:57 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:36:57.917889 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-07813811-835d-4d43-9461-2fc86c6b0759 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.087510 Jun 17 15:36:57.918453 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 840/2093] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:36:57 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:36:58.922567 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-51a2a492-1b2c-4b3c-a1ea-268f4a17cf7a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:36:58.923519 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-51a2a492-1b2c-4b3c-a1ea-268f4a17cf7a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:36:58.930146 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-51a2a492-1b2c-4b3c-a1ea-268f4a17cf7a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:58.930594 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-51a2a492-1b2c-4b3c-a1ea-268f4a17cf7a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:58.931356 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-51a2a492-1b2c-4b3c-a1ea-268f4a17cf7a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:58.931790 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-51a2a492-1b2c-4b3c-a1ea-268f4a17cf7a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:58.934275 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-7412f384-b2d5-48ec-9364-99489023c896 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:36:58.935659 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-7412f384-b2d5-48ec-9364-99489023c896 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:36:58.941306 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7412f384-b2d5-48ec-9364-99489023c896 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:58.941754 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7412f384-b2d5-48ec-9364-99489023c896 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:58.942513 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7412f384-b2d5-48ec-9364-99489023c896 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:58.942945 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7412f384-b2d5-48ec-9364-99489023c896 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:58.962348 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-51a2a492-1b2c-4b3c-a1ea-268f4a17cf7a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044249 Jun 17 15:36:58.962918 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1254/2094] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:36:58 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:36:59.005474 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-7412f384-b2d5-48ec-9364-99489023c896 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:36:59.013714 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-7412f384-b2d5-48ec-9364-99489023c896 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.083330 Jun 17 15:36:59.014283 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 841/2095] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:36:58 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:36:59.975410 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-74c12374-47c0-46ec-b564-025242673e9c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:36:59.976368 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-74c12374-47c0-46ec-b564-025242673e9c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:36:59.983446 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-74c12374-47c0-46ec-b564-025242673e9c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:59.983888 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-74c12374-47c0-46ec-b564-025242673e9c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:36:59.984678 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-74c12374-47c0-46ec-b564-025242673e9c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:36:59.985115 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-74c12374-47c0-46ec-b564-025242673e9c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:00.014090 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-74c12374-47c0-46ec-b564-025242673e9c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042887 Jun 17 15:37:00.014648 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1255/2096] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:36:59 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:37:00.031093 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-a34f9150-f099-4a28-a5d6-78904c3df6c2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:37:00.031701 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-a34f9150-f099-4a28-a5d6-78904c3df6c2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:37:00.039585 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a34f9150-f099-4a28-a5d6-78904c3df6c2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:00.040377 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a34f9150-f099-4a28-a5d6-78904c3df6c2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:00.041703 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a34f9150-f099-4a28-a5d6-78904c3df6c2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:00.042461 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a34f9150-f099-4a28-a5d6-78904c3df6c2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:00.112429 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-a34f9150-f099-4a28-a5d6-78904c3df6c2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:37:00.119815 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-a34f9150-f099-4a28-a5d6-78904c3df6c2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.093069 Jun 17 15:37:00.120385 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 842/2097] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:37:00 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:37:01.025689 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-014ee7ec-8480-4d78-bd28-bd005e4a0ae0 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:37:01.026609 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-014ee7ec-8480-4d78-bd28-bd005e4a0ae0 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:37:01.033061 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-014ee7ec-8480-4d78-bd28-bd005e4a0ae0 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:01.033506 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-014ee7ec-8480-4d78-bd28-bd005e4a0ae0 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:01.034263 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-014ee7ec-8480-4d78-bd28-bd005e4a0ae0 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:01.034696 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-014ee7ec-8480-4d78-bd28-bd005e4a0ae0 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:01.064265 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-014ee7ec-8480-4d78-bd28-bd005e4a0ae0 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042500 Jun 17 15:37:01.065130 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1256/2098] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:37:01 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:37:01.136630 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-79edd75d-9833-43b0-a9e8-3eb1eb41523f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:37:01.137961 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-79edd75d-9833-43b0-a9e8-3eb1eb41523f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:37:01.144533 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-79edd75d-9833-43b0-a9e8-3eb1eb41523f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:01.144985 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-79edd75d-9833-43b0-a9e8-3eb1eb41523f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:01.145739 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-79edd75d-9833-43b0-a9e8-3eb1eb41523f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:01.146174 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-79edd75d-9833-43b0-a9e8-3eb1eb41523f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:01.206410 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-79edd75d-9833-43b0-a9e8-3eb1eb41523f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:37:01.214097 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-79edd75d-9833-43b0-a9e8-3eb1eb41523f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.081389 Jun 17 15:37:01.214669 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 843/2099] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:37:01 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:37:02.076933 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-cb4a80b0-4ad5-43ab-85cb-8f2c4538c4a2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:37:02.077845 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-cb4a80b0-4ad5-43ab-85cb-8f2c4538c4a2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:37:02.084273 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cb4a80b0-4ad5-43ab-85cb-8f2c4538c4a2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:02.084752 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cb4a80b0-4ad5-43ab-85cb-8f2c4538c4a2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:02.085503 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cb4a80b0-4ad5-43ab-85cb-8f2c4538c4a2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:02.085937 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cb4a80b0-4ad5-43ab-85cb-8f2c4538c4a2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:02.115451 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-cb4a80b0-4ad5-43ab-85cb-8f2c4538c4a2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043071 Jun 17 15:37:02.115999 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1257/2100] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:37:02 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:37:02.230852 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-2a1ac989-c467-4116-a774-258721606765 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:37:02.231461 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-2a1ac989-c467-4116-a774-258721606765 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:37:02.237988 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2a1ac989-c467-4116-a774-258721606765 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:02.238434 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2a1ac989-c467-4116-a774-258721606765 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:02.239177 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2a1ac989-c467-4116-a774-258721606765 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:02.239605 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2a1ac989-c467-4116-a774-258721606765 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:02.303091 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-2a1ac989-c467-4116-a774-258721606765 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:37:02.311070 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-2a1ac989-c467-4116-a774-258721606765 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.084132 Jun 17 15:37:02.311627 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 844/2101] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:37:02 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:37:03.127324 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-2343ee87-2c09-48c5-8d17-57618b1729f4 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:37:03.128247 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-2343ee87-2c09-48c5-8d17-57618b1729f4 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:37:03.134943 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2343ee87-2c09-48c5-8d17-57618b1729f4 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:03.135397 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2343ee87-2c09-48c5-8d17-57618b1729f4 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:03.136159 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2343ee87-2c09-48c5-8d17-57618b1729f4 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:03.136625 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2343ee87-2c09-48c5-8d17-57618b1729f4 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:03.165840 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-2343ee87-2c09-48c5-8d17-57618b1729f4 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042511 Jun 17 15:37:03.166395 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1258/2102] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:37:03 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:37:03.327953 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-118075f7-443d-4737-9be9-70c26cd2b3f7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:37:03.328707 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-118075f7-443d-4737-9be9-70c26cd2b3f7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:37:03.335106 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-118075f7-443d-4737-9be9-70c26cd2b3f7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:03.335540 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-118075f7-443d-4737-9be9-70c26cd2b3f7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:03.336287 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-118075f7-443d-4737-9be9-70c26cd2b3f7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:03.336738 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-118075f7-443d-4737-9be9-70c26cd2b3f7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:03.399936 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-118075f7-443d-4737-9be9-70c26cd2b3f7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:37:03.408437 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-118075f7-443d-4737-9be9-70c26cd2b3f7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.084312 Jun 17 15:37:03.408995 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 845/2103] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:37:03 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:37:04.178272 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-150312bd-e35b-4b0a-8b55-fac6bc7d4816 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:37:04.179098 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-150312bd-e35b-4b0a-8b55-fac6bc7d4816 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:37:04.186279 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-150312bd-e35b-4b0a-8b55-fac6bc7d4816 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:04.186722 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-150312bd-e35b-4b0a-8b55-fac6bc7d4816 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:04.187474 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-150312bd-e35b-4b0a-8b55-fac6bc7d4816 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:04.187903 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-150312bd-e35b-4b0a-8b55-fac6bc7d4816 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:04.216280 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-150312bd-e35b-4b0a-8b55-fac6bc7d4816 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041989 Jun 17 15:37:04.216860 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1259/2104] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:37:04 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:37:04.425782 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-5fb674d3-29db-44f9-8f54-541214ff3f0d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:37:04.426396 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-5fb674d3-29db-44f9-8f54-541214ff3f0d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:37:04.433031 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5fb674d3-29db-44f9-8f54-541214ff3f0d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:04.433423 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5fb674d3-29db-44f9-8f54-541214ff3f0d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:04.434807 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5fb674d3-29db-44f9-8f54-541214ff3f0d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:04.435241 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5fb674d3-29db-44f9-8f54-541214ff3f0d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:04.495605 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-5fb674d3-29db-44f9-8f54-541214ff3f0d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:37:04.504395 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-5fb674d3-29db-44f9-8f54-541214ff3f0d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.082498 Jun 17 15:37:04.504964 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 846/2105] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:37:04 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:37:05.227564 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-67e7543e-2184-4ce0-b204-ae66cd9fe988 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:37:05.228538 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-67e7543e-2184-4ce0-b204-ae66cd9fe988 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:37:05.235259 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-67e7543e-2184-4ce0-b204-ae66cd9fe988 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:05.235725 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-67e7543e-2184-4ce0-b204-ae66cd9fe988 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:05.236598 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-67e7543e-2184-4ce0-b204-ae66cd9fe988 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:05.237034 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-67e7543e-2184-4ce0-b204-ae66cd9fe988 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:05.266904 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-67e7543e-2184-4ce0-b204-ae66cd9fe988 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043837 Jun 17 15:37:05.267484 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1260/2106] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:37:05 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:37:05.522879 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-0f868bd8-a1de-45a8-adcb-e50a3903468a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:37:05.523441 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-0f868bd8-a1de-45a8-adcb-e50a3903468a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:37:05.530012 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0f868bd8-a1de-45a8-adcb-e50a3903468a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:05.530462 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0f868bd8-a1de-45a8-adcb-e50a3903468a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:05.531224 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0f868bd8-a1de-45a8-adcb-e50a3903468a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:05.531658 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0f868bd8-a1de-45a8-adcb-e50a3903468a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:05.593703 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-0f868bd8-a1de-45a8-adcb-e50a3903468a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:37:05.601465 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-0f868bd8-a1de-45a8-adcb-e50a3903468a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.082600 Jun 17 15:37:05.602025 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 847/2107] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:37:05 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:37:06.278747 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-a181deec-98b5-4571-a98b-26480c3a2a00 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:37:06.280150 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-a181deec-98b5-4571-a98b-26480c3a2a00 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:37:06.286616 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a181deec-98b5-4571-a98b-26480c3a2a00 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:06.287066 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a181deec-98b5-4571-a98b-26480c3a2a00 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:06.287819 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a181deec-98b5-4571-a98b-26480c3a2a00 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:06.288255 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a181deec-98b5-4571-a98b-26480c3a2a00 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:06.317248 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-a181deec-98b5-4571-a98b-26480c3a2a00 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042467 Jun 17 15:37:06.317800 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1261/2108] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:37:06 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:37:06.617610 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-491f9d3b-ce13-4a2c-a6c7-fd38bdc359d7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:37:06.618222 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-491f9d3b-ce13-4a2c-a6c7-fd38bdc359d7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:37:06.624635 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-491f9d3b-ce13-4a2c-a6c7-fd38bdc359d7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:06.625080 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-491f9d3b-ce13-4a2c-a6c7-fd38bdc359d7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:06.625823 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-491f9d3b-ce13-4a2c-a6c7-fd38bdc359d7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:06.626276 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-491f9d3b-ce13-4a2c-a6c7-fd38bdc359d7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:06.689629 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-491f9d3b-ce13-4a2c-a6c7-fd38bdc359d7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:37:06.697765 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-491f9d3b-ce13-4a2c-a6c7-fd38bdc359d7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.083867 Jun 17 15:37:06.698222 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 848/2109] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:37:06 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:37:07.329003 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-c671ea23-efe7-4307-8c9d-025ad7288679 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:37:07.329916 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-c671ea23-efe7-4307-8c9d-025ad7288679 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:37:07.336275 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c671ea23-efe7-4307-8c9d-025ad7288679 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:07.336744 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c671ea23-efe7-4307-8c9d-025ad7288679 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:07.337491 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c671ea23-efe7-4307-8c9d-025ad7288679 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:07.337919 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c671ea23-efe7-4307-8c9d-025ad7288679 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:07.370417 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-c671ea23-efe7-4307-8c9d-025ad7288679 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045416 Jun 17 15:37:07.370968 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1262/2110] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:37:07 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:37:07.714817 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-ba02c71d-6be3-4a48-838a-72396b32fc07 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:37:07.715442 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-ba02c71d-6be3-4a48-838a-72396b32fc07 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:37:07.722416 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ba02c71d-6be3-4a48-838a-72396b32fc07 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:07.722866 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ba02c71d-6be3-4a48-838a-72396b32fc07 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:07.723620 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ba02c71d-6be3-4a48-838a-72396b32fc07 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:07.724052 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ba02c71d-6be3-4a48-838a-72396b32fc07 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:07.784435 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-ba02c71d-6be3-4a48-838a-72396b32fc07 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:37:07.791858 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-ba02c71d-6be3-4a48-838a-72396b32fc07 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.080889 Jun 17 15:37:07.792439 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 849/2111] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:37:07 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:37:08.382807 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-3f35fe0e-1d76-4d03-9136-18dca3f16098 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:37:08.383720 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-3f35fe0e-1d76-4d03-9136-18dca3f16098 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:37:08.390890 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3f35fe0e-1d76-4d03-9136-18dca3f16098 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:08.391319 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3f35fe0e-1d76-4d03-9136-18dca3f16098 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:08.392021 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3f35fe0e-1d76-4d03-9136-18dca3f16098 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:08.392486 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3f35fe0e-1d76-4d03-9136-18dca3f16098 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:08.420297 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-3f35fe0e-1d76-4d03-9136-18dca3f16098 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041419 Jun 17 15:37:08.420898 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1263/2112] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:37:08 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:37:08.808548 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-ac042d8f-1f53-4735-8e52-66c856e4dd5f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:37:08.809108 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-ac042d8f-1f53-4735-8e52-66c856e4dd5f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:37:08.816134 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ac042d8f-1f53-4735-8e52-66c856e4dd5f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:08.816618 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ac042d8f-1f53-4735-8e52-66c856e4dd5f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:08.817373 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ac042d8f-1f53-4735-8e52-66c856e4dd5f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:08.817838 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ac042d8f-1f53-4735-8e52-66c856e4dd5f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:08.881254 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-ac042d8f-1f53-4735-8e52-66c856e4dd5f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:37:08.889213 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-ac042d8f-1f53-4735-8e52-66c856e4dd5f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.084176 Jun 17 15:37:08.889843 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 850/2113] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:37:08 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:37:09.431934 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-4b9a1e0f-e0d3-4cc6-8361-69c61f16a598 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:37:09.432917 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-4b9a1e0f-e0d3-4cc6-8361-69c61f16a598 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:37:09.439486 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4b9a1e0f-e0d3-4cc6-8361-69c61f16a598 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:09.439932 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4b9a1e0f-e0d3-4cc6-8361-69c61f16a598 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:09.440733 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4b9a1e0f-e0d3-4cc6-8361-69c61f16a598 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:09.441172 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4b9a1e0f-e0d3-4cc6-8361-69c61f16a598 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:09.473840 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-4b9a1e0f-e0d3-4cc6-8361-69c61f16a598 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045851 Jun 17 15:37:09.474672 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1264/2114] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:37:09 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:37:09.906330 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-ee88451e-45d9-41fc-ae7a-d003adfd9f3f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:37:09.906946 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-ee88451e-45d9-41fc-ae7a-d003adfd9f3f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:37:09.913375 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ee88451e-45d9-41fc-ae7a-d003adfd9f3f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:09.913817 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ee88451e-45d9-41fc-ae7a-d003adfd9f3f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:09.914604 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ee88451e-45d9-41fc-ae7a-d003adfd9f3f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:09.915032 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ee88451e-45d9-41fc-ae7a-d003adfd9f3f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:09.975694 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-ee88451e-45d9-41fc-ae7a-d003adfd9f3f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:37:09.983458 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-ee88451e-45d9-41fc-ae7a-d003adfd9f3f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.080972 Jun 17 15:37:09.984051 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 851/2115] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:37:09 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:37:10.486492 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-a6e5054b-c750-4168-a110-3c70739a6a1e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:37:10.487406 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-a6e5054b-c750-4168-a110-3c70739a6a1e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:37:10.489690 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_api:SELECT=58 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:37:10.494984 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a6e5054b-c750-4168-a110-3c70739a6a1e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:10.495427 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a6e5054b-c750-4168-a110-3c70739a6a1e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:10.496180 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a6e5054b-c750-4168-a110-3c70739a6a1e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:10.496636 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a6e5054b-c750-4168-a110-3c70739a6a1e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:10.525383 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-a6e5054b-c750-4168-a110-3c70739a6a1e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043653 Jun 17 15:37:10.525931 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1265/2116] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:37:10 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:37:11.000660 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-739dfb73-1da4-4b76-a869-399307e376c5 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:37:11.001209 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-739dfb73-1da4-4b76-a869-399307e376c5 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:37:11.007848 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-739dfb73-1da4-4b76-a869-399307e376c5 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:11.008292 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-739dfb73-1da4-4b76-a869-399307e376c5 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:11.009068 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-739dfb73-1da4-4b76-a869-399307e376c5 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:11.009530 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-739dfb73-1da4-4b76-a869-399307e376c5 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:11.073900 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-739dfb73-1da4-4b76-a869-399307e376c5 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:37:11.082182 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-739dfb73-1da4-4b76-a869-399307e376c5 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.085469 Jun 17 15:37:11.082761 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 852/2117] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:37:10 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:37:11.537186 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-9db01e43-2205-414c-a424-f9b3a5a793bc tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:37:11.538142 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-9db01e43-2205-414c-a424-f9b3a5a793bc tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:37:11.544586 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9db01e43-2205-414c-a424-f9b3a5a793bc tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:11.545035 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9db01e43-2205-414c-a424-f9b3a5a793bc tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:11.545787 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9db01e43-2205-414c-a424-f9b3a5a793bc tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:11.546217 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9db01e43-2205-414c-a424-f9b3a5a793bc tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:11.575386 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-9db01e43-2205-414c-a424-f9b3a5a793bc tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042247 Jun 17 15:37:11.575954 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1266/2118] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:37:11 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:37:12.099786 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-69cb0dfe-2b39-4327-8e53-f0002f9683ed tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:37:12.100491 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-69cb0dfe-2b39-4327-8e53-f0002f9683ed tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:37:12.107042 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-69cb0dfe-2b39-4327-8e53-f0002f9683ed tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:12.107490 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-69cb0dfe-2b39-4327-8e53-f0002f9683ed tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:12.108862 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-69cb0dfe-2b39-4327-8e53-f0002f9683ed tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:12.109297 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-69cb0dfe-2b39-4327-8e53-f0002f9683ed tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:12.173063 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-69cb0dfe-2b39-4327-8e53-f0002f9683ed tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:37:12.180616 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-69cb0dfe-2b39-4327-8e53-f0002f9683ed tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.084957 Jun 17 15:37:12.181193 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 853/2119] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:37:12 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:37:12.587542 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-151e7e2f-458e-47ed-b21b-83b6442b35c2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:37:12.588492 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-151e7e2f-458e-47ed-b21b-83b6442b35c2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:37:12.595557 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-151e7e2f-458e-47ed-b21b-83b6442b35c2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:12.596012 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-151e7e2f-458e-47ed-b21b-83b6442b35c2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:12.596867 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-151e7e2f-458e-47ed-b21b-83b6442b35c2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:12.597306 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-151e7e2f-458e-47ed-b21b-83b6442b35c2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:12.625642 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-151e7e2f-458e-47ed-b21b-83b6442b35c2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042055 Jun 17 15:37:12.626192 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1267/2120] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:37:12 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:37:13.198877 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-d7145ad9-637d-40c1-97b7-5cc07dfeb048 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:37:13.199485 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-d7145ad9-637d-40c1-97b7-5cc07dfeb048 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:37:13.206229 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d7145ad9-637d-40c1-97b7-5cc07dfeb048 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:13.206700 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d7145ad9-637d-40c1-97b7-5cc07dfeb048 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:13.207477 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d7145ad9-637d-40c1-97b7-5cc07dfeb048 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:13.207912 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d7145ad9-637d-40c1-97b7-5cc07dfeb048 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:13.228530 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell1:SELECT=100 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:37:13.275448 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-d7145ad9-637d-40c1-97b7-5cc07dfeb048 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:37:13.284006 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-d7145ad9-637d-40c1-97b7-5cc07dfeb048 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.088882 Jun 17 15:37:13.284644 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 854/2121] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:37:13 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:37:13.637570 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-a580fd83-024b-493d-86c8-eb0717121d69 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:37:13.638500 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-a580fd83-024b-493d-86c8-eb0717121d69 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:37:13.645189 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a580fd83-024b-493d-86c8-eb0717121d69 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:13.645637 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a580fd83-024b-493d-86c8-eb0717121d69 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:13.646413 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a580fd83-024b-493d-86c8-eb0717121d69 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:13.646846 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a580fd83-024b-493d-86c8-eb0717121d69 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:13.677971 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-a580fd83-024b-493d-86c8-eb0717121d69 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044456 Jun 17 15:37:13.678547 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1268/2122] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:37:13 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:37:14.301242 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-9d002b3c-6cd9-4935-b838-10acfd57d5b0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:37:14.301874 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-9d002b3c-6cd9-4935-b838-10acfd57d5b0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:37:14.303914 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_api:SELECT=56 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:37:14.309398 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9d002b3c-6cd9-4935-b838-10acfd57d5b0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:14.309840 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9d002b3c-6cd9-4935-b838-10acfd57d5b0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:14.310603 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9d002b3c-6cd9-4935-b838-10acfd57d5b0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:14.311534 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9d002b3c-6cd9-4935-b838-10acfd57d5b0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:14.374154 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-9d002b3c-6cd9-4935-b838-10acfd57d5b0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:37:14.382075 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-9d002b3c-6cd9-4935-b838-10acfd57d5b0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.084693 Jun 17 15:37:14.382660 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 855/2123] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:37:14 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:37:14.690421 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-1a618f28-0751-4966-bd4b-31c418553719 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:37:14.691338 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-1a618f28-0751-4966-bd4b-31c418553719 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:37:14.698037 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1a618f28-0751-4966-bd4b-31c418553719 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:14.698478 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1a618f28-0751-4966-bd4b-31c418553719 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:14.699244 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1a618f28-0751-4966-bd4b-31c418553719 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:14.699671 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1a618f28-0751-4966-bd4b-31c418553719 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:14.729887 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-1a618f28-0751-4966-bd4b-31c418553719 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044038 Jun 17 15:37:14.730460 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1269/2124] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:37:14 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:37:15.398712 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-7d649bec-b5a7-421a-9d9b-148136cb906b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:37:15.399360 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-7d649bec-b5a7-421a-9d9b-148136cb906b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:37:15.407077 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7d649bec-b5a7-421a-9d9b-148136cb906b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:15.407519 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7d649bec-b5a7-421a-9d9b-148136cb906b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:15.408292 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7d649bec-b5a7-421a-9d9b-148136cb906b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:15.408756 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7d649bec-b5a7-421a-9d9b-148136cb906b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:15.473690 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-7d649bec-b5a7-421a-9d9b-148136cb906b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:37:15.487505 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-7d649bec-b5a7-421a-9d9b-148136cb906b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.092272 Jun 17 15:37:15.488515 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 856/2125] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:37:15 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:37:15.742154 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-77474864-1c8a-42e7-8767-03c3da5e7017 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:37:15.742992 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-77474864-1c8a-42e7-8767-03c3da5e7017 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:37:15.749868 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-77474864-1c8a-42e7-8767-03c3da5e7017 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:15.750322 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-77474864-1c8a-42e7-8767-03c3da5e7017 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:15.751070 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-77474864-1c8a-42e7-8767-03c3da5e7017 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:15.751523 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-77474864-1c8a-42e7-8767-03c3da5e7017 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:15.755158 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=100 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:37:15.780717 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-77474864-1c8a-42e7-8767-03c3da5e7017 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042540 Jun 17 15:37:15.781258 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1270/2126] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:37:15 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:37:16.505689 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-741b1752-fe98-482b-9518-65bf0698cd69 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:37:16.506369 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-741b1752-fe98-482b-9518-65bf0698cd69 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:37:16.513030 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-741b1752-fe98-482b-9518-65bf0698cd69 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:16.513473 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-741b1752-fe98-482b-9518-65bf0698cd69 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:16.514264 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-741b1752-fe98-482b-9518-65bf0698cd69 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:16.514700 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-741b1752-fe98-482b-9518-65bf0698cd69 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:16.581419 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-741b1752-fe98-482b-9518-65bf0698cd69 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:37:16.589234 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-741b1752-fe98-482b-9518-65bf0698cd69 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.087517 Jun 17 15:37:16.589806 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 857/2127] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:37:16 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:37:16.792808 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-05b2857f-9cb7-46b5-ad6b-10b727ee4870 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:37:16.793658 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-05b2857f-9cb7-46b5-ad6b-10b727ee4870 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:37:16.801745 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-05b2857f-9cb7-46b5-ad6b-10b727ee4870 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:16.802188 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-05b2857f-9cb7-46b5-ad6b-10b727ee4870 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:16.803040 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-05b2857f-9cb7-46b5-ad6b-10b727ee4870 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:16.803475 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-05b2857f-9cb7-46b5-ad6b-10b727ee4870 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:16.834758 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-05b2857f-9cb7-46b5-ad6b-10b727ee4870 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046139 Jun 17 15:37:16.835341 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1271/2128] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:37:16 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:37:17.606375 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-ca655314-8dcb-44a5-9c09-3769c9240974 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:37:17.607014 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-ca655314-8dcb-44a5-9c09-3769c9240974 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:37:17.614577 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ca655314-8dcb-44a5-9c09-3769c9240974 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:17.615023 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ca655314-8dcb-44a5-9c09-3769c9240974 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:17.615805 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ca655314-8dcb-44a5-9c09-3769c9240974 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:17.616275 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ca655314-8dcb-44a5-9c09-3769c9240974 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:17.678723 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-ca655314-8dcb-44a5-9c09-3769c9240974 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:37:17.686908 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-ca655314-8dcb-44a5-9c09-3769c9240974 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.083801 Jun 17 15:37:17.687471 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 858/2129] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:37:17 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:37:17.846912 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-12cff7ec-8a27-4fe3-9c76-20182376d22e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:37:17.847959 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-12cff7ec-8a27-4fe3-9c76-20182376d22e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:37:17.854931 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-12cff7ec-8a27-4fe3-9c76-20182376d22e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:17.855370 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-12cff7ec-8a27-4fe3-9c76-20182376d22e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:17.856135 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-12cff7ec-8a27-4fe3-9c76-20182376d22e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:17.856589 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-12cff7ec-8a27-4fe3-9c76-20182376d22e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:17.888290 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-12cff7ec-8a27-4fe3-9c76-20182376d22e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045476 Jun 17 15:37:17.888897 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1272/2130] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:37:17 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:37:18.703995 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-66829c8d-98ab-44ff-8f2f-2c39a24a68fd tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:37:18.704616 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-66829c8d-98ab-44ff-8f2f-2c39a24a68fd tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:37:18.711180 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-66829c8d-98ab-44ff-8f2f-2c39a24a68fd tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:18.711627 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-66829c8d-98ab-44ff-8f2f-2c39a24a68fd tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:18.712409 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-66829c8d-98ab-44ff-8f2f-2c39a24a68fd tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:18.712840 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-66829c8d-98ab-44ff-8f2f-2c39a24a68fd tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:18.777003 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-66829c8d-98ab-44ff-8f2f-2c39a24a68fd tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:37:18.784710 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-66829c8d-98ab-44ff-8f2f-2c39a24a68fd tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.085290 Jun 17 15:37:18.785292 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 859/2131] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:37:18 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:37:18.899285 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-72aa7f06-d6b3-40b6-872b-a3a2c990b81e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:37:18.900200 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-72aa7f06-d6b3-40b6-872b-a3a2c990b81e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:37:18.906720 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-72aa7f06-d6b3-40b6-872b-a3a2c990b81e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:18.907167 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-72aa7f06-d6b3-40b6-872b-a3a2c990b81e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:18.907924 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-72aa7f06-d6b3-40b6-872b-a3a2c990b81e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:18.908382 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-72aa7f06-d6b3-40b6-872b-a3a2c990b81e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:18.938290 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-72aa7f06-d6b3-40b6-872b-a3a2c990b81e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042945 Jun 17 15:37:18.938867 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1273/2132] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:37:18 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:37:19.802544 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-eb600dce-2359-4200-816f-13228bb407da tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:37:19.803165 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-eb600dce-2359-4200-816f-13228bb407da tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:37:19.809790 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-eb600dce-2359-4200-816f-13228bb407da tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:19.810233 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-eb600dce-2359-4200-816f-13228bb407da tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:19.811014 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-eb600dce-2359-4200-816f-13228bb407da tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:19.811420 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-eb600dce-2359-4200-816f-13228bb407da tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:19.882250 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-eb600dce-2359-4200-816f-13228bb407da tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:37:19.891092 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-eb600dce-2359-4200-816f-13228bb407da tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.092511 Jun 17 15:37:19.892056 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 860/2133] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:37:19 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:37:19.949392 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-27be6135-dd41-458f-a4b5-ae0d70c056f1 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:37:19.950318 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-27be6135-dd41-458f-a4b5-ae0d70c056f1 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:37:19.957395 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-27be6135-dd41-458f-a4b5-ae0d70c056f1 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:19.957844 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-27be6135-dd41-458f-a4b5-ae0d70c056f1 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:19.958658 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-27be6135-dd41-458f-a4b5-ae0d70c056f1 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:19.959092 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-27be6135-dd41-458f-a4b5-ae0d70c056f1 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:19.997195 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-27be6135-dd41-458f-a4b5-ae0d70c056f1 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051753 Jun 17 15:37:19.997780 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1274/2134] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:37:19 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:37:20.908171 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-e5eda3ea-be8f-4e34-8ad1-592631510a5b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:37:20.908848 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-e5eda3ea-be8f-4e34-8ad1-592631510a5b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:37:20.915371 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e5eda3ea-be8f-4e34-8ad1-592631510a5b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:20.915824 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e5eda3ea-be8f-4e34-8ad1-592631510a5b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:20.916641 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e5eda3ea-be8f-4e34-8ad1-592631510a5b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:20.917077 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e5eda3ea-be8f-4e34-8ad1-592631510a5b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:20.979554 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-e5eda3ea-be8f-4e34-8ad1-592631510a5b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:37:20.988078 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-e5eda3ea-be8f-4e34-8ad1-592631510a5b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.083740 Jun 17 15:37:20.988684 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 861/2135] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:37:20 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:37:21.009400 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-6002c5ec-9333-43cb-b831-42e957a23447 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:37:21.010317 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-6002c5ec-9333-43cb-b831-42e957a23447 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:37:21.017876 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6002c5ec-9333-43cb-b831-42e957a23447 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:21.018325 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6002c5ec-9333-43cb-b831-42e957a23447 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:21.019080 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6002c5ec-9333-43cb-b831-42e957a23447 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:21.019513 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6002c5ec-9333-43cb-b831-42e957a23447 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:21.049158 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-6002c5ec-9333-43cb-b831-42e957a23447 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043766 Jun 17 15:37:21.049714 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1275/2136] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:37:21 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:37:22.005565 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-75b8a5b2-af19-4810-957a-e0d802661711 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:37:22.006131 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-75b8a5b2-af19-4810-957a-e0d802661711 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:37:22.012637 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-75b8a5b2-af19-4810-957a-e0d802661711 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:22.013086 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-75b8a5b2-af19-4810-957a-e0d802661711 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:22.013856 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-75b8a5b2-af19-4810-957a-e0d802661711 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:22.014872 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-75b8a5b2-af19-4810-957a-e0d802661711 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:22.061732 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-79ab9e92-dae9-49d1-b67e-7e19de31041c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:37:22.062653 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-79ab9e92-dae9-49d1-b67e-7e19de31041c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:37:22.069572 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-79ab9e92-dae9-49d1-b67e-7e19de31041c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:22.070014 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-79ab9e92-dae9-49d1-b67e-7e19de31041c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:22.070781 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-79ab9e92-dae9-49d1-b67e-7e19de31041c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:22.071204 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-79ab9e92-dae9-49d1-b67e-7e19de31041c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:22.078746 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-75b8a5b2-af19-4810-957a-e0d802661711 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:37:22.086587 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-75b8a5b2-af19-4810-957a-e0d802661711 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.084936 Jun 17 15:37:22.087177 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 862/2137] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:37:22 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:37:22.101885 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-79ab9e92-dae9-49d1-b67e-7e19de31041c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044616 Jun 17 15:37:22.102446 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1276/2138] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:37:22 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:37:23.103148 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-2d2ea025-2356-4cb1-9cac-1c3a05c022ce tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:37:23.103878 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-2d2ea025-2356-4cb1-9cac-1c3a05c022ce tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:37:23.110708 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2d2ea025-2356-4cb1-9cac-1c3a05c022ce tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:23.111152 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2d2ea025-2356-4cb1-9cac-1c3a05c022ce tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:23.111908 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2d2ea025-2356-4cb1-9cac-1c3a05c022ce tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:23.112352 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2d2ea025-2356-4cb1-9cac-1c3a05c022ce tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:23.113891 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-5761375c-6707-4938-805c-889c49af0405 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:37:23.114810 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-5761375c-6707-4938-805c-889c49af0405 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:37:23.121379 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5761375c-6707-4938-805c-889c49af0405 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:23.121831 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5761375c-6707-4938-805c-889c49af0405 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:23.122588 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5761375c-6707-4938-805c-889c49af0405 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:23.123020 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5761375c-6707-4938-805c-889c49af0405 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:23.152576 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-5761375c-6707-4938-805c-889c49af0405 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042622 Jun 17 15:37:23.153145 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1277/2139] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:37:23 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:37:23.173784 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-2d2ea025-2356-4cb1-9cac-1c3a05c022ce tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:37:23.181327 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-2d2ea025-2356-4cb1-9cac-1c3a05c022ce tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.082261 Jun 17 15:37:23.181897 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 863/2140] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:37:23 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:37:24.164606 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-f7d3214a-6383-4b27-b8d3-02296ee52c1d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:37:24.165519 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-f7d3214a-6383-4b27-b8d3-02296ee52c1d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:37:24.172589 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f7d3214a-6383-4b27-b8d3-02296ee52c1d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:24.173038 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f7d3214a-6383-4b27-b8d3-02296ee52c1d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:24.173799 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f7d3214a-6383-4b27-b8d3-02296ee52c1d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:24.174227 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f7d3214a-6383-4b27-b8d3-02296ee52c1d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:24.198070 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-200c30a7-0321-4417-b1cd-dce9bedc4b15 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:37:24.198695 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-200c30a7-0321-4417-b1cd-dce9bedc4b15 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:37:24.203144 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-f7d3214a-6383-4b27-b8d3-02296ee52c1d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042509 Jun 17 15:37:24.203714 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1278/2141] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:37:24 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:37:24.205202 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-200c30a7-0321-4417-b1cd-dce9bedc4b15 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:24.205654 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-200c30a7-0321-4417-b1cd-dce9bedc4b15 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:24.206416 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-200c30a7-0321-4417-b1cd-dce9bedc4b15 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:24.206849 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-200c30a7-0321-4417-b1cd-dce9bedc4b15 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:24.270386 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-200c30a7-0321-4417-b1cd-dce9bedc4b15 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:37:24.277898 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-200c30a7-0321-4417-b1cd-dce9bedc4b15 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.083702 Jun 17 15:37:24.278484 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 864/2142] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:37:24 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:37:25.214821 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-50bac5ae-2d3f-4118-a040-cc822efe077b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:37:25.215793 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-50bac5ae-2d3f-4118-a040-cc822efe077b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:37:25.222398 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-50bac5ae-2d3f-4118-a040-cc822efe077b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:25.222840 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-50bac5ae-2d3f-4118-a040-cc822efe077b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:25.223619 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-50bac5ae-2d3f-4118-a040-cc822efe077b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:25.224047 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-50bac5ae-2d3f-4118-a040-cc822efe077b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:25.253956 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-50bac5ae-2d3f-4118-a040-cc822efe077b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043145 Jun 17 15:37:25.254500 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1279/2143] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:37:25 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:37:25.295687 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-4ab153e3-9d90-4d34-8b65-f7718c180b33 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:37:25.296198 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-4ab153e3-9d90-4d34-8b65-f7718c180b33 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:37:25.302832 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4ab153e3-9d90-4d34-8b65-f7718c180b33 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:25.303277 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4ab153e3-9d90-4d34-8b65-f7718c180b33 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:25.304050 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4ab153e3-9d90-4d34-8b65-f7718c180b33 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:25.304512 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4ab153e3-9d90-4d34-8b65-f7718c180b33 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:25.366952 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-4ab153e3-9d90-4d34-8b65-f7718c180b33 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:37:25.375395 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-4ab153e3-9d90-4d34-8b65-f7718c180b33 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.084173 Jun 17 15:37:25.375979 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 865/2144] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:37:25 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:37:26.266092 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-f2501789-23a5-4edc-b940-86b65f1b750b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:37:26.267020 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-f2501789-23a5-4edc-b940-86b65f1b750b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:37:26.273178 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f2501789-23a5-4edc-b940-86b65f1b750b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:26.273630 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f2501789-23a5-4edc-b940-86b65f1b750b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:26.274389 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f2501789-23a5-4edc-b940-86b65f1b750b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:26.274829 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f2501789-23a5-4edc-b940-86b65f1b750b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:26.304264 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-f2501789-23a5-4edc-b940-86b65f1b750b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042595 Jun 17 15:37:26.304869 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1280/2145] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:37:26 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:37:26.392666 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-ea9ba1ac-634e-468b-b7cb-f9077790081a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:37:26.393287 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-ea9ba1ac-634e-468b-b7cb-f9077790081a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:37:26.399775 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ea9ba1ac-634e-468b-b7cb-f9077790081a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:26.400225 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ea9ba1ac-634e-468b-b7cb-f9077790081a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:26.401035 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ea9ba1ac-634e-468b-b7cb-f9077790081a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:26.401470 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ea9ba1ac-634e-468b-b7cb-f9077790081a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:26.462134 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-ea9ba1ac-634e-468b-b7cb-f9077790081a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:37:26.469927 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-ea9ba1ac-634e-468b-b7cb-f9077790081a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.081769 Jun 17 15:37:26.470514 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 866/2146] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:37:26 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:37:27.316654 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-e9ee2ec0-afd8-41ae-ac61-ac99f5fe76b7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:37:27.317610 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-e9ee2ec0-afd8-41ae-ac61-ac99f5fe76b7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:37:27.324212 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e9ee2ec0-afd8-41ae-ac61-ac99f5fe76b7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:27.324699 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e9ee2ec0-afd8-41ae-ac61-ac99f5fe76b7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:27.325464 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e9ee2ec0-afd8-41ae-ac61-ac99f5fe76b7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:27.325900 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e9ee2ec0-afd8-41ae-ac61-ac99f5fe76b7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:27.358407 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-e9ee2ec0-afd8-41ae-ac61-ac99f5fe76b7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045347 Jun 17 15:37:27.358978 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1281/2147] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:37:27 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:37:27.487980 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-52bda3b0-565b-4330-96a3-c97ea26aeb1d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:37:27.488672 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-52bda3b0-565b-4330-96a3-c97ea26aeb1d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:37:27.495092 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-52bda3b0-565b-4330-96a3-c97ea26aeb1d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:27.495541 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-52bda3b0-565b-4330-96a3-c97ea26aeb1d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:27.496299 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-52bda3b0-565b-4330-96a3-c97ea26aeb1d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:27.496763 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-52bda3b0-565b-4330-96a3-c97ea26aeb1d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:27.558576 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-52bda3b0-565b-4330-96a3-c97ea26aeb1d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:37:27.566720 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-52bda3b0-565b-4330-96a3-c97ea26aeb1d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.082566 Jun 17 15:37:27.567230 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 867/2148] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:37:27 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:37:28.369953 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-e46fd5b8-ce02-4a2f-8855-670a774948d8 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:37:28.370904 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-e46fd5b8-ce02-4a2f-8855-670a774948d8 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:37:28.377594 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e46fd5b8-ce02-4a2f-8855-670a774948d8 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:28.378040 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e46fd5b8-ce02-4a2f-8855-670a774948d8 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:28.378807 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e46fd5b8-ce02-4a2f-8855-670a774948d8 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:28.379232 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e46fd5b8-ce02-4a2f-8855-670a774948d8 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:28.412674 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-e46fd5b8-ce02-4a2f-8855-670a774948d8 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046556 Jun 17 15:37:28.413364 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1282/2149] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:37:28 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:37:28.590148 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-5b7afb09-0012-406d-83d7-54b58bf3cc25 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:37:28.590802 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-5b7afb09-0012-406d-83d7-54b58bf3cc25 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:37:28.597413 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5b7afb09-0012-406d-83d7-54b58bf3cc25 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:28.597864 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5b7afb09-0012-406d-83d7-54b58bf3cc25 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:28.598636 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5b7afb09-0012-406d-83d7-54b58bf3cc25 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:28.599073 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5b7afb09-0012-406d-83d7-54b58bf3cc25 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:28.664860 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-5b7afb09-0012-406d-83d7-54b58bf3cc25 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:37:28.672850 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-5b7afb09-0012-406d-83d7-54b58bf3cc25 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.086534 Jun 17 15:37:28.673434 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 868/2150] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:37:28 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:37:29.425000 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-0fa1ed09-cc91-41ce-9f94-39508f4bbf32 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:37:29.425950 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-0fa1ed09-cc91-41ce-9f94-39508f4bbf32 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:37:29.432465 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0fa1ed09-cc91-41ce-9f94-39508f4bbf32 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:29.432915 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0fa1ed09-cc91-41ce-9f94-39508f4bbf32 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:29.433668 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0fa1ed09-cc91-41ce-9f94-39508f4bbf32 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:29.434101 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0fa1ed09-cc91-41ce-9f94-39508f4bbf32 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:29.463327 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-0fa1ed09-cc91-41ce-9f94-39508f4bbf32 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042871 Jun 17 15:37:29.463890 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1283/2151] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:37:29 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:37:29.689744 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-0af474a2-d880-455d-b243-582b5bcdcdce tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:37:29.690301 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-0af474a2-d880-455d-b243-582b5bcdcdce tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:37:29.696967 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0af474a2-d880-455d-b243-582b5bcdcdce tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:29.697412 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0af474a2-d880-455d-b243-582b5bcdcdce tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:29.698177 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0af474a2-d880-455d-b243-582b5bcdcdce tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:29.698609 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0af474a2-d880-455d-b243-582b5bcdcdce tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:29.761444 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-0af474a2-d880-455d-b243-582b5bcdcdce tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:37:29.769511 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-0af474a2-d880-455d-b243-582b5bcdcdce tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.083766 Jun 17 15:37:29.770073 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 869/2152] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:37:29 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:37:30.476066 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-109caad5-8955-48fd-a7e3-52b12c28250b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:37:30.477024 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-109caad5-8955-48fd-a7e3-52b12c28250b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:37:30.484316 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-109caad5-8955-48fd-a7e3-52b12c28250b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:30.484776 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-109caad5-8955-48fd-a7e3-52b12c28250b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:30.485546 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-109caad5-8955-48fd-a7e3-52b12c28250b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:30.485981 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-109caad5-8955-48fd-a7e3-52b12c28250b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:30.517588 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-109caad5-8955-48fd-a7e3-52b12c28250b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045676 Jun 17 15:37:30.518163 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1284/2153] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:37:30 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:37:30.786261 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-55aad788-c698-4f3e-9c42-7f8482dd86ef tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:37:30.786818 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-55aad788-c698-4f3e-9c42-7f8482dd86ef tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:37:30.793516 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-55aad788-c698-4f3e-9c42-7f8482dd86ef tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:30.794212 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-55aad788-c698-4f3e-9c42-7f8482dd86ef tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:30.794984 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-55aad788-c698-4f3e-9c42-7f8482dd86ef tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:30.795966 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-55aad788-c698-4f3e-9c42-7f8482dd86ef tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:30.863341 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-55aad788-c698-4f3e-9c42-7f8482dd86ef tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:37:30.871142 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-55aad788-c698-4f3e-9c42-7f8482dd86ef tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.088883 Jun 17 15:37:30.871736 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 870/2154] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:37:30 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:37:31.529318 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-86598406-e75a-4c80-8d6d-f271ae1d9957 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:37:31.530238 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-86598406-e75a-4c80-8d6d-f271ae1d9957 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:37:31.537122 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-86598406-e75a-4c80-8d6d-f271ae1d9957 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:31.537571 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-86598406-e75a-4c80-8d6d-f271ae1d9957 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:31.538342 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-86598406-e75a-4c80-8d6d-f271ae1d9957 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:31.538774 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-86598406-e75a-4c80-8d6d-f271ae1d9957 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:31.568444 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-86598406-e75a-4c80-8d6d-f271ae1d9957 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043011 Jun 17 15:37:31.569014 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1285/2155] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:37:31 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:37:31.890094 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-a5c964ee-63a9-4557-9f36-6517f3687f9d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:37:31.890696 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-a5c964ee-63a9-4557-9f36-6517f3687f9d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:37:31.897377 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a5c964ee-63a9-4557-9f36-6517f3687f9d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:31.897824 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a5c964ee-63a9-4557-9f36-6517f3687f9d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:31.898590 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a5c964ee-63a9-4557-9f36-6517f3687f9d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:31.899018 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a5c964ee-63a9-4557-9f36-6517f3687f9d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:31.903165 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell1:SELECT=100 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:37:31.961626 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-a5c964ee-63a9-4557-9f36-6517f3687f9d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:37:31.969305 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-a5c964ee-63a9-4557-9f36-6517f3687f9d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.083055 Jun 17 15:37:31.969963 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 871/2156] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:37:31 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:37:32.579231 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-b8551e5a-de95-4ec9-954b-9abc9e645d93 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:37:32.580142 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-b8551e5a-de95-4ec9-954b-9abc9e645d93 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:37:32.586723 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b8551e5a-de95-4ec9-954b-9abc9e645d93 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:32.587172 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b8551e5a-de95-4ec9-954b-9abc9e645d93 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:32.587921 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b8551e5a-de95-4ec9-954b-9abc9e645d93 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:32.588364 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b8551e5a-de95-4ec9-954b-9abc9e645d93 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:32.613695 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=100 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:37:32.618538 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-b8551e5a-de95-4ec9-954b-9abc9e645d93 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043341 Jun 17 15:37:32.619100 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1286/2157] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:37:32 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:37:32.986436 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-4fc55318-5f88-4a9e-9ade-9aa354806782 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:37:32.986984 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-4fc55318-5f88-4a9e-9ade-9aa354806782 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:37:32.993423 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4fc55318-5f88-4a9e-9ade-9aa354806782 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:32.993870 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4fc55318-5f88-4a9e-9ade-9aa354806782 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:32.994629 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4fc55318-5f88-4a9e-9ade-9aa354806782 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:32.995064 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4fc55318-5f88-4a9e-9ade-9aa354806782 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:33.057850 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-4fc55318-5f88-4a9e-9ade-9aa354806782 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:37:33.065966 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-4fc55318-5f88-4a9e-9ade-9aa354806782 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.083458 Jun 17 15:37:33.066536 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 872/2158] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:37:32 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:37:33.630383 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-e9787417-fc2b-4da1-99ac-9d7b202c1e8c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:37:33.631231 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-e9787417-fc2b-4da1-99ac-9d7b202c1e8c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:37:33.637852 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e9787417-fc2b-4da1-99ac-9d7b202c1e8c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:33.638295 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e9787417-fc2b-4da1-99ac-9d7b202c1e8c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:33.639541 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e9787417-fc2b-4da1-99ac-9d7b202c1e8c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:33.639969 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e9787417-fc2b-4da1-99ac-9d7b202c1e8c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:33.668579 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-e9787417-fc2b-4da1-99ac-9d7b202c1e8c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042317 Jun 17 15:37:33.669127 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1287/2159] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:37:33 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:37:34.083480 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-a98e714b-407b-4bb9-bd03-c60d48b66afb tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:37:34.084095 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-a98e714b-407b-4bb9-bd03-c60d48b66afb tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:37:34.090593 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a98e714b-407b-4bb9-bd03-c60d48b66afb tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:34.091040 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a98e714b-407b-4bb9-bd03-c60d48b66afb tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:34.091791 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a98e714b-407b-4bb9-bd03-c60d48b66afb tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:34.092228 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a98e714b-407b-4bb9-bd03-c60d48b66afb tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:34.156636 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-a98e714b-407b-4bb9-bd03-c60d48b66afb tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:37:34.164124 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-a98e714b-407b-4bb9-bd03-c60d48b66afb tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.084540 Jun 17 15:37:34.164678 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 873/2160] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:37:34 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:37:34.680919 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-3805340c-2e7c-44c2-a0fa-531c559103aa tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:37:34.681751 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-3805340c-2e7c-44c2-a0fa-531c559103aa tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:37:34.688143 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3805340c-2e7c-44c2-a0fa-531c559103aa tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:34.688619 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3805340c-2e7c-44c2-a0fa-531c559103aa tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:34.689364 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3805340c-2e7c-44c2-a0fa-531c559103aa tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:34.689796 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3805340c-2e7c-44c2-a0fa-531c559103aa tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:34.718110 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-3805340c-2e7c-44c2-a0fa-531c559103aa tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041331 Jun 17 15:37:34.718661 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1288/2161] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:37:34 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:37:35.181554 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-7cd64527-adec-4075-9017-80b7ed098628 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:37:35.182163 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-7cd64527-adec-4075-9017-80b7ed098628 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:37:35.188574 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7cd64527-adec-4075-9017-80b7ed098628 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:35.189016 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7cd64527-adec-4075-9017-80b7ed098628 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:35.189761 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7cd64527-adec-4075-9017-80b7ed098628 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:35.190190 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7cd64527-adec-4075-9017-80b7ed098628 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:35.250419 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-7cd64527-adec-4075-9017-80b7ed098628 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:37:35.257801 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-7cd64527-adec-4075-9017-80b7ed098628 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.080085 Jun 17 15:37:35.258388 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 874/2162] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:37:35 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:37:35.730025 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-b48e3e5a-36cb-4845-8271-1c84af9b2a1e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:37:35.730953 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-b48e3e5a-36cb-4845-8271-1c84af9b2a1e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:37:35.738011 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b48e3e5a-36cb-4845-8271-1c84af9b2a1e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:35.738461 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b48e3e5a-36cb-4845-8271-1c84af9b2a1e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:35.739218 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b48e3e5a-36cb-4845-8271-1c84af9b2a1e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:35.739651 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b48e3e5a-36cb-4845-8271-1c84af9b2a1e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:35.768390 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-b48e3e5a-36cb-4845-8271-1c84af9b2a1e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042289 Jun 17 15:37:35.768944 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1289/2163] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:37:35 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:37:36.274805 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-8fd1ac26-fa90-4b07-95ac-0fd35eadb6bb tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:37:36.275418 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-8fd1ac26-fa90-4b07-95ac-0fd35eadb6bb tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:37:36.282620 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8fd1ac26-fa90-4b07-95ac-0fd35eadb6bb tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:36.283062 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8fd1ac26-fa90-4b07-95ac-0fd35eadb6bb tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:36.283812 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8fd1ac26-fa90-4b07-95ac-0fd35eadb6bb tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:36.284242 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8fd1ac26-fa90-4b07-95ac-0fd35eadb6bb tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:36.345718 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-8fd1ac26-fa90-4b07-95ac-0fd35eadb6bb tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:37:36.353380 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-8fd1ac26-fa90-4b07-95ac-0fd35eadb6bb tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.082348 Jun 17 15:37:36.353943 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 875/2164] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:37:36 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:37:36.780214 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-e8e3b91a-2a66-4c88-b7d3-92a96643481e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:37:36.781801 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-e8e3b91a-2a66-4c88-b7d3-92a96643481e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:37:36.788838 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e8e3b91a-2a66-4c88-b7d3-92a96643481e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:36.789291 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e8e3b91a-2a66-4c88-b7d3-92a96643481e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:36.790055 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e8e3b91a-2a66-4c88-b7d3-92a96643481e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:36.790490 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e8e3b91a-2a66-4c88-b7d3-92a96643481e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:36.820490 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-e8e3b91a-2a66-4c88-b7d3-92a96643481e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044759 Jun 17 15:37:36.821051 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1290/2165] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:37:36 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:37:37.370485 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-091e0602-4280-482b-8dd4-1c013f7a4ad7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:37:37.371089 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-091e0602-4280-482b-8dd4-1c013f7a4ad7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:37:37.378324 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-091e0602-4280-482b-8dd4-1c013f7a4ad7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:37.379235 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-091e0602-4280-482b-8dd4-1c013f7a4ad7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:37.379498 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-091e0602-4280-482b-8dd4-1c013f7a4ad7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:37.379925 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-091e0602-4280-482b-8dd4-1c013f7a4ad7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:37.442668 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-091e0602-4280-482b-8dd4-1c013f7a4ad7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:37:37.450106 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-091e0602-4280-482b-8dd4-1c013f7a4ad7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.083451 Jun 17 15:37:37.450669 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 876/2166] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:37:37 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:37:37.831981 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-27aa7ac4-062b-4c66-87ff-6c8b7823a00f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:37:37.832925 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-27aa7ac4-062b-4c66-87ff-6c8b7823a00f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:37:37.839365 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-27aa7ac4-062b-4c66-87ff-6c8b7823a00f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:37.839809 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-27aa7ac4-062b-4c66-87ff-6c8b7823a00f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:37.840582 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-27aa7ac4-062b-4c66-87ff-6c8b7823a00f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:37.841011 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-27aa7ac4-062b-4c66-87ff-6c8b7823a00f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:37.870707 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-27aa7ac4-062b-4c66-87ff-6c8b7823a00f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042658 Jun 17 15:37:37.871267 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1291/2167] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:37:37 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:37:38.467157 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-3c01d830-bc04-4ca8-9c7c-f410dec9c6d7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:37:38.467762 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-3c01d830-bc04-4ca8-9c7c-f410dec9c6d7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:37:38.474240 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3c01d830-bc04-4ca8-9c7c-f410dec9c6d7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:38.474934 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3c01d830-bc04-4ca8-9c7c-f410dec9c6d7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:38.475682 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3c01d830-bc04-4ca8-9c7c-f410dec9c6d7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:38.476109 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3c01d830-bc04-4ca8-9c7c-f410dec9c6d7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:38.536234 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-3c01d830-bc04-4ca8-9c7c-f410dec9c6d7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:37:38.543725 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-3c01d830-bc04-4ca8-9c7c-f410dec9c6d7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.080668 Jun 17 15:37:38.544311 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 877/2168] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:37:38 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:37:38.884115 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-d3605f92-5309-44b2-812a-7d01cc5b2948 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:37:38.885077 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-d3605f92-5309-44b2-812a-7d01cc5b2948 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:37:38.891491 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d3605f92-5309-44b2-812a-7d01cc5b2948 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:38.891941 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d3605f92-5309-44b2-812a-7d01cc5b2948 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:38.892746 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d3605f92-5309-44b2-812a-7d01cc5b2948 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:38.893170 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d3605f92-5309-44b2-812a-7d01cc5b2948 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:38.922449 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-d3605f92-5309-44b2-812a-7d01cc5b2948 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043173 Jun 17 15:37:38.923014 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1292/2169] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:37:38 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:37:39.559951 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-645f07fb-3517-4b10-88a4-f2de95a328ea tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:37:39.560589 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-645f07fb-3517-4b10-88a4-f2de95a328ea tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:37:39.567219 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-645f07fb-3517-4b10-88a4-f2de95a328ea tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:39.567673 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-645f07fb-3517-4b10-88a4-f2de95a328ea tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:39.568473 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-645f07fb-3517-4b10-88a4-f2de95a328ea tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:39.568913 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-645f07fb-3517-4b10-88a4-f2de95a328ea tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:39.634225 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-645f07fb-3517-4b10-88a4-f2de95a328ea tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:37:39.642371 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-645f07fb-3517-4b10-88a4-f2de95a328ea tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.086469 Jun 17 15:37:39.642942 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 878/2170] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:37:39 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:37:39.933714 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-24774b24-7f7a-4782-bf38-f8b7c97f17df tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:37:39.934580 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-24774b24-7f7a-4782-bf38-f8b7c97f17df tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:37:39.941597 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-24774b24-7f7a-4782-bf38-f8b7c97f17df tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:39.942042 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-24774b24-7f7a-4782-bf38-f8b7c97f17df tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:39.942798 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-24774b24-7f7a-4782-bf38-f8b7c97f17df tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:39.943231 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-24774b24-7f7a-4782-bf38-f8b7c97f17df tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:39.972340 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-24774b24-7f7a-4782-bf38-f8b7c97f17df tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042623 Jun 17 15:37:39.972932 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1293/2171] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:37:39 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:37:40.659668 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-1774b33a-65e6-4924-bd1f-1fbc00646d34 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:37:40.660217 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-1774b33a-65e6-4924-bd1f-1fbc00646d34 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:37:40.666718 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1774b33a-65e6-4924-bd1f-1fbc00646d34 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:40.667165 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1774b33a-65e6-4924-bd1f-1fbc00646d34 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:40.667921 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1774b33a-65e6-4924-bd1f-1fbc00646d34 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:40.668372 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1774b33a-65e6-4924-bd1f-1fbc00646d34 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:40.728898 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-1774b33a-65e6-4924-bd1f-1fbc00646d34 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:37:40.737261 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-1774b33a-65e6-4924-bd1f-1fbc00646d34 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.081513 Jun 17 15:37:40.737833 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 879/2172] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:37:40 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:37:40.984445 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-5595ac82-8760-4e88-854f-92c7273ff69c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:37:40.985292 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-5595ac82-8760-4e88-854f-92c7273ff69c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:37:40.987583 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_api:SELECT=58 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:37:40.992895 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5595ac82-8760-4e88-854f-92c7273ff69c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:40.993332 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5595ac82-8760-4e88-854f-92c7273ff69c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:40.994094 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5595ac82-8760-4e88-854f-92c7273ff69c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:40.994529 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5595ac82-8760-4e88-854f-92c7273ff69c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:41.025270 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-5595ac82-8760-4e88-854f-92c7273ff69c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044960 Jun 17 15:37:41.025822 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1294/2173] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:37:40 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:37:41.755053 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-5293cf47-9836-4386-9d24-9d0011a47cf8 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:37:41.755626 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-5293cf47-9836-4386-9d24-9d0011a47cf8 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:37:41.761996 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5293cf47-9836-4386-9d24-9d0011a47cf8 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:41.762439 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5293cf47-9836-4386-9d24-9d0011a47cf8 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:41.763182 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5293cf47-9836-4386-9d24-9d0011a47cf8 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:41.763612 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5293cf47-9836-4386-9d24-9d0011a47cf8 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:41.828211 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-5293cf47-9836-4386-9d24-9d0011a47cf8 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:37:41.835720 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-5293cf47-9836-4386-9d24-9d0011a47cf8 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.084574 Jun 17 15:37:41.836279 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 880/2174] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:37:41 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:37:42.037134 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-f1703c8f-ecfe-4dcf-8cd7-75d8f537c743 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:37:42.038045 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-f1703c8f-ecfe-4dcf-8cd7-75d8f537c743 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:37:42.044550 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f1703c8f-ecfe-4dcf-8cd7-75d8f537c743 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:42.045654 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f1703c8f-ecfe-4dcf-8cd7-75d8f537c743 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:42.046411 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f1703c8f-ecfe-4dcf-8cd7-75d8f537c743 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:42.046846 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f1703c8f-ecfe-4dcf-8cd7-75d8f537c743 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:42.076342 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-f1703c8f-ecfe-4dcf-8cd7-75d8f537c743 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043338 Jun 17 15:37:42.076943 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1295/2175] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:37:42 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:37:42.852627 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-eec868fb-cdfb-43ac-9070-dc9879b7db1b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:37:42.853284 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-eec868fb-cdfb-43ac-9070-dc9879b7db1b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:37:42.860248 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-eec868fb-cdfb-43ac-9070-dc9879b7db1b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:42.860726 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-eec868fb-cdfb-43ac-9070-dc9879b7db1b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:42.861492 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-eec868fb-cdfb-43ac-9070-dc9879b7db1b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:42.861925 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-eec868fb-cdfb-43ac-9070-dc9879b7db1b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:42.923682 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-eec868fb-cdfb-43ac-9070-dc9879b7db1b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:37:42.931702 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-eec868fb-cdfb-43ac-9070-dc9879b7db1b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.083231 Jun 17 15:37:42.932273 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 881/2176] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:37:42 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:37:43.087957 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-34ba9e74-8924-4231-9cee-9abe87e1cba9 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:37:43.088921 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-34ba9e74-8924-4231-9cee-9abe87e1cba9 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:37:43.095761 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-34ba9e74-8924-4231-9cee-9abe87e1cba9 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:43.096203 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-34ba9e74-8924-4231-9cee-9abe87e1cba9 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:43.096995 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-34ba9e74-8924-4231-9cee-9abe87e1cba9 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:43.097420 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-34ba9e74-8924-4231-9cee-9abe87e1cba9 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:43.126847 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-34ba9e74-8924-4231-9cee-9abe87e1cba9 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042759 Jun 17 15:37:43.127323 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1296/2177] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:37:43 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:37:43.948528 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-1abe5942-b197-478b-b00e-2cb1403fbd54 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:37:43.949164 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-1abe5942-b197-478b-b00e-2cb1403fbd54 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:37:43.955525 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1abe5942-b197-478b-b00e-2cb1403fbd54 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:43.955965 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1abe5942-b197-478b-b00e-2cb1403fbd54 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:43.956760 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1abe5942-b197-478b-b00e-2cb1403fbd54 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:43.957186 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1abe5942-b197-478b-b00e-2cb1403fbd54 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:44.018563 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-1abe5942-b197-478b-b00e-2cb1403fbd54 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:37:44.026121 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-1abe5942-b197-478b-b00e-2cb1403fbd54 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.081483 Jun 17 15:37:44.026678 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 882/2178] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:37:43 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:37:44.139035 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-bbac2446-82a0-4d77-86bc-e09fa88d2ef1 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:37:44.139958 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-bbac2446-82a0-4d77-86bc-e09fa88d2ef1 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:37:44.146446 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bbac2446-82a0-4d77-86bc-e09fa88d2ef1 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:44.146894 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bbac2446-82a0-4d77-86bc-e09fa88d2ef1 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:44.147649 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bbac2446-82a0-4d77-86bc-e09fa88d2ef1 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:44.148081 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bbac2446-82a0-4d77-86bc-e09fa88d2ef1 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:44.177013 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-bbac2446-82a0-4d77-86bc-e09fa88d2ef1 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042494 Jun 17 15:37:44.177566 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1297/2179] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:37:44 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:37:45.042864 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-8375a113-c43b-453f-9ff7-836343626063 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:37:45.043513 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-8375a113-c43b-453f-9ff7-836343626063 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:37:45.045450 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_api:SELECT=56 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:37:45.050449 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8375a113-c43b-453f-9ff7-836343626063 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:45.050898 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8375a113-c43b-453f-9ff7-836343626063 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:45.051663 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8375a113-c43b-453f-9ff7-836343626063 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:45.052097 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8375a113-c43b-453f-9ff7-836343626063 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:45.112966 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-8375a113-c43b-453f-9ff7-836343626063 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:37:45.120354 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-8375a113-c43b-453f-9ff7-836343626063 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.081495 Jun 17 15:37:45.120919 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 883/2180] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:37:45 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:37:45.189359 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-8bbafd47-6ab5-4595-ba48-b4405f61de17 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:37:45.190268 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-8bbafd47-6ab5-4595-ba48-b4405f61de17 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:37:45.196635 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8bbafd47-6ab5-4595-ba48-b4405f61de17 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:45.197080 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8bbafd47-6ab5-4595-ba48-b4405f61de17 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:45.197821 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8bbafd47-6ab5-4595-ba48-b4405f61de17 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:45.198247 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8bbafd47-6ab5-4595-ba48-b4405f61de17 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:45.227044 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-8bbafd47-6ab5-4595-ba48-b4405f61de17 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042247 Jun 17 15:37:45.227589 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1298/2181] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:37:45 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:37:46.137792 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-98ab0e07-4194-46e2-9f15-b5ea34c20035 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:37:46.138403 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-98ab0e07-4194-46e2-9f15-b5ea34c20035 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:37:46.144870 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-98ab0e07-4194-46e2-9f15-b5ea34c20035 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:46.145322 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-98ab0e07-4194-46e2-9f15-b5ea34c20035 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:46.146083 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-98ab0e07-4194-46e2-9f15-b5ea34c20035 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:46.146516 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-98ab0e07-4194-46e2-9f15-b5ea34c20035 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:46.209524 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-98ab0e07-4194-46e2-9f15-b5ea34c20035 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:37:46.216947 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-98ab0e07-4194-46e2-9f15-b5ea34c20035 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.083041 Jun 17 15:37:46.217508 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 884/2182] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:37:46 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:37:46.239009 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-aa73b4a1-de3e-4bd5-935b-137f505df5a6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:37:46.239929 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-aa73b4a1-de3e-4bd5-935b-137f505df5a6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:37:46.246462 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-aa73b4a1-de3e-4bd5-935b-137f505df5a6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:46.246913 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-aa73b4a1-de3e-4bd5-935b-137f505df5a6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:46.247683 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-aa73b4a1-de3e-4bd5-935b-137f505df5a6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:46.248775 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-aa73b4a1-de3e-4bd5-935b-137f505df5a6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:46.276705 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-aa73b4a1-de3e-4bd5-935b-137f505df5a6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041622 Jun 17 15:37:46.277248 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1299/2183] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:37:46 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:37:47.359470 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-cb658a0d-6676-4258-bdd9-dfbc6b83260f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:37:47.360083 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-cb658a0d-6676-4258-bdd9-dfbc6b83260f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:37:47.366001 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cb658a0d-6676-4258-bdd9-dfbc6b83260f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:47.366438 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cb658a0d-6676-4258-bdd9-dfbc6b83260f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:47.367186 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cb658a0d-6676-4258-bdd9-dfbc6b83260f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:47.367612 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cb658a0d-6676-4258-bdd9-dfbc6b83260f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:47.430953 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-cb658a0d-6676-4258-bdd9-dfbc6b83260f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:37:47.439008 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-cb658a0d-6676-4258-bdd9-dfbc6b83260f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.209829 Jun 17 15:37:47.439564 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 885/2184] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:37:47 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:37:47.467567 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-5cf70ce7-604e-4ed4-ae42-6d83ac061bf8 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:37:47.468524 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-5cf70ce7-604e-4ed4-ae42-6d83ac061bf8 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:37:47.474468 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5cf70ce7-604e-4ed4-ae42-6d83ac061bf8 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:47.475166 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5cf70ce7-604e-4ed4-ae42-6d83ac061bf8 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:47.475920 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5cf70ce7-604e-4ed4-ae42-6d83ac061bf8 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:47.476365 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5cf70ce7-604e-4ed4-ae42-6d83ac061bf8 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:47.505436 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-5cf70ce7-604e-4ed4-ae42-6d83ac061bf8 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.221105 Jun 17 15:37:47.505910 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1300/2185] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:37:47 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:37:48.456106 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-e3d517df-ce96-4532-aaee-598dc1cb2b01 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:37:48.456736 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-e3d517df-ce96-4532-aaee-598dc1cb2b01 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:37:48.463188 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e3d517df-ce96-4532-aaee-598dc1cb2b01 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:48.463636 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e3d517df-ce96-4532-aaee-598dc1cb2b01 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:48.464414 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e3d517df-ce96-4532-aaee-598dc1cb2b01 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:48.464848 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e3d517df-ce96-4532-aaee-598dc1cb2b01 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:48.517628 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-67c97dff-f41f-4dba-8b2c-7baca4c6d972 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:37:48.518551 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-67c97dff-f41f-4dba-8b2c-7baca4c6d972 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:37:48.525057 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-67c97dff-f41f-4dba-8b2c-7baca4c6d972 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:48.525309 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-e3d517df-ce96-4532-aaee-598dc1cb2b01 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:37:48.525571 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-67c97dff-f41f-4dba-8b2c-7baca4c6d972 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:48.526275 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-67c97dff-f41f-4dba-8b2c-7baca4c6d972 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:48.526710 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-67c97dff-f41f-4dba-8b2c-7baca4c6d972 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:48.533340 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-e3d517df-ce96-4532-aaee-598dc1cb2b01 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.081093 Jun 17 15:37:48.533905 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 886/2186] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:37:48 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:37:48.556456 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-67c97dff-f41f-4dba-8b2c-7baca4c6d972 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043264 Jun 17 15:37:48.557017 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1301/2187] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:37:48 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:37:49.550165 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-928191e0-dadf-448e-bfde-5883bd58a7d3 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:37:49.550786 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-928191e0-dadf-448e-bfde-5883bd58a7d3 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:37:49.557473 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-928191e0-dadf-448e-bfde-5883bd58a7d3 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:49.557919 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-928191e0-dadf-448e-bfde-5883bd58a7d3 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:49.558673 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-928191e0-dadf-448e-bfde-5883bd58a7d3 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:49.559130 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-928191e0-dadf-448e-bfde-5883bd58a7d3 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:49.567249 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-83206c13-314d-4068-acde-84f29706cbd3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:37:49.568165 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-83206c13-314d-4068-acde-84f29706cbd3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:37:49.574856 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-83206c13-314d-4068-acde-84f29706cbd3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:49.575307 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-83206c13-314d-4068-acde-84f29706cbd3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:49.576750 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-83206c13-314d-4068-acde-84f29706cbd3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:49.577186 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-83206c13-314d-4068-acde-84f29706cbd3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:49.609879 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-83206c13-314d-4068-acde-84f29706cbd3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046475 Jun 17 15:37:49.610475 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1302/2188] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:37:49 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:37:49.622577 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-928191e0-dadf-448e-bfde-5883bd58a7d3 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:37:49.626445 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell1:SELECT=100 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:37:49.631421 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-928191e0-dadf-448e-bfde-5883bd58a7d3 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.085147 Jun 17 15:37:49.631921 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 887/2189] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:37:49 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:37:50.621597 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-0765c041-9986-4c1f-9b5c-2e809bcd77ff tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:37:50.622508 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-0765c041-9986-4c1f-9b5c-2e809bcd77ff tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:37:50.629087 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0765c041-9986-4c1f-9b5c-2e809bcd77ff tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:50.629451 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0765c041-9986-4c1f-9b5c-2e809bcd77ff tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:50.630239 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0765c041-9986-4c1f-9b5c-2e809bcd77ff tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:50.630637 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0765c041-9986-4c1f-9b5c-2e809bcd77ff tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:50.647534 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=100 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:37:50.649272 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-67f93ac0-e43f-4298-b7f0-d629a56a402c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:37:50.649924 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-67f93ac0-e43f-4298-b7f0-d629a56a402c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:37:50.657343 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-67f93ac0-e43f-4298-b7f0-d629a56a402c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:50.657792 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-67f93ac0-e43f-4298-b7f0-d629a56a402c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:50.658548 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-67f93ac0-e43f-4298-b7f0-d629a56a402c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:50.658975 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-67f93ac0-e43f-4298-b7f0-d629a56a402c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:50.661391 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-0765c041-9986-4c1f-9b5c-2e809bcd77ff tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043780 Jun 17 15:37:50.661955 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1303/2190] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:37:50 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:37:50.723125 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-67f93ac0-e43f-4298-b7f0-d629a56a402c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:37:50.730801 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-67f93ac0-e43f-4298-b7f0-d629a56a402c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.086099 Jun 17 15:37:50.731367 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 888/2191] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:37:50 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:37:51.673212 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-afb520e5-f0e6-4d9a-8549-c232a00d030b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:37:51.674062 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-afb520e5-f0e6-4d9a-8549-c232a00d030b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:37:51.680553 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-afb520e5-f0e6-4d9a-8549-c232a00d030b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:51.681004 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-afb520e5-f0e6-4d9a-8549-c232a00d030b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:51.681761 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-afb520e5-f0e6-4d9a-8549-c232a00d030b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:51.682199 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-afb520e5-f0e6-4d9a-8549-c232a00d030b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:51.720959 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-afb520e5-f0e6-4d9a-8549-c232a00d030b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051747 Jun 17 15:37:51.721533 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1304/2192] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:37:51 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:37:51.747346 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-8feb3be9-78a8-4e84-af38-8ee2e2001bb4 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:37:51.747969 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-8feb3be9-78a8-4e84-af38-8ee2e2001bb4 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:37:51.755070 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8feb3be9-78a8-4e84-af38-8ee2e2001bb4 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:51.755524 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8feb3be9-78a8-4e84-af38-8ee2e2001bb4 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:51.756280 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8feb3be9-78a8-4e84-af38-8ee2e2001bb4 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:51.756746 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8feb3be9-78a8-4e84-af38-8ee2e2001bb4 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:51.817001 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-8feb3be9-78a8-4e84-af38-8ee2e2001bb4 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:37:51.824376 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-8feb3be9-78a8-4e84-af38-8ee2e2001bb4 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.080935 Jun 17 15:37:51.824938 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 889/2193] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:37:51 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:37:52.733008 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-915ef8c3-4cda-46e8-8a91-656d38508a6c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:37:52.733846 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-915ef8c3-4cda-46e8-8a91-656d38508a6c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:37:52.741052 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-915ef8c3-4cda-46e8-8a91-656d38508a6c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:52.741507 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-915ef8c3-4cda-46e8-8a91-656d38508a6c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:52.742268 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-915ef8c3-4cda-46e8-8a91-656d38508a6c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:52.742704 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-915ef8c3-4cda-46e8-8a91-656d38508a6c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:52.771047 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-915ef8c3-4cda-46e8-8a91-656d38508a6c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042151 Jun 17 15:37:52.771599 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1305/2194] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:37:52 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:37:52.841500 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-0b8dcbfa-2976-4ea6-bb94-08c64589401f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:37:52.842109 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-0b8dcbfa-2976-4ea6-bb94-08c64589401f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:37:52.849169 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0b8dcbfa-2976-4ea6-bb94-08c64589401f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:52.849865 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0b8dcbfa-2976-4ea6-bb94-08c64589401f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:52.850615 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0b8dcbfa-2976-4ea6-bb94-08c64589401f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:52.851044 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0b8dcbfa-2976-4ea6-bb94-08c64589401f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:52.912472 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-0b8dcbfa-2976-4ea6-bb94-08c64589401f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:37:52.920046 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-0b8dcbfa-2976-4ea6-bb94-08c64589401f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.082389 Jun 17 15:37:52.920660 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 890/2195] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:37:52 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:37:53.783497 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-581747d8-950f-4c34-9d70-688a3918f999 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:37:53.784349 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-581747d8-950f-4c34-9d70-688a3918f999 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:37:53.790843 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-581747d8-950f-4c34-9d70-688a3918f999 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:53.791287 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-581747d8-950f-4c34-9d70-688a3918f999 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:53.792048 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-581747d8-950f-4c34-9d70-688a3918f999 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:53.792525 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-581747d8-950f-4c34-9d70-688a3918f999 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:53.820417 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-581747d8-950f-4c34-9d70-688a3918f999 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041723 Jun 17 15:37:53.820963 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1306/2196] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:37:53 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:37:53.937115 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-1ad891cf-bb7f-4a0d-ab97-7d8216e04e6f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:37:53.937757 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-1ad891cf-bb7f-4a0d-ab97-7d8216e04e6f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:37:53.944749 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1ad891cf-bb7f-4a0d-ab97-7d8216e04e6f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:53.945198 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1ad891cf-bb7f-4a0d-ab97-7d8216e04e6f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:53.945958 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1ad891cf-bb7f-4a0d-ab97-7d8216e04e6f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:53.946388 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1ad891cf-bb7f-4a0d-ab97-7d8216e04e6f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:54.007848 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-1ad891cf-bb7f-4a0d-ab97-7d8216e04e6f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:37:54.015435 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-1ad891cf-bb7f-4a0d-ab97-7d8216e04e6f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.082231 Jun 17 15:37:54.016040 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 891/2197] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:37:53 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:37:54.831893 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-1644e506-6ac5-4ba1-89ab-1fefeb0f7fd8 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:37:54.832840 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-1644e506-6ac5-4ba1-89ab-1fefeb0f7fd8 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:37:54.839280 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1644e506-6ac5-4ba1-89ab-1fefeb0f7fd8 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:54.839728 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1644e506-6ac5-4ba1-89ab-1fefeb0f7fd8 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:54.840588 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1644e506-6ac5-4ba1-89ab-1fefeb0f7fd8 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:54.841026 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1644e506-6ac5-4ba1-89ab-1fefeb0f7fd8 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:54.870518 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-1644e506-6ac5-4ba1-89ab-1fefeb0f7fd8 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042677 Jun 17 15:37:54.871071 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1307/2198] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:37:54 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:37:55.033694 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-495a3848-ec20-4962-b40e-baf1cf2d4dcf tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:37:55.034299 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-495a3848-ec20-4962-b40e-baf1cf2d4dcf tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:37:55.040695 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-495a3848-ec20-4962-b40e-baf1cf2d4dcf tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:55.041139 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-495a3848-ec20-4962-b40e-baf1cf2d4dcf tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:55.041888 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-495a3848-ec20-4962-b40e-baf1cf2d4dcf tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:55.042315 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-495a3848-ec20-4962-b40e-baf1cf2d4dcf tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:55.106052 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-495a3848-ec20-4962-b40e-baf1cf2d4dcf tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:37:55.113819 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-495a3848-ec20-4962-b40e-baf1cf2d4dcf tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.084569 Jun 17 15:37:55.114380 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 892/2199] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:37:55 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:37:55.882472 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-43d91596-7bea-4b3a-85d9-2f68b32284b7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:37:55.883389 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-43d91596-7bea-4b3a-85d9-2f68b32284b7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:37:55.889388 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-43d91596-7bea-4b3a-85d9-2f68b32284b7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:55.889887 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-43d91596-7bea-4b3a-85d9-2f68b32284b7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:55.890573 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-43d91596-7bea-4b3a-85d9-2f68b32284b7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:55.891047 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-43d91596-7bea-4b3a-85d9-2f68b32284b7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:55.921851 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-43d91596-7bea-4b3a-85d9-2f68b32284b7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043446 Jun 17 15:37:55.923021 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1308/2200] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:37:55 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:37:56.130935 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-38f527df-1ae5-4ada-adb0-665e66522ef0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:37:56.131540 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-38f527df-1ae5-4ada-adb0-665e66522ef0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:37:56.138007 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-38f527df-1ae5-4ada-adb0-665e66522ef0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:56.138393 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-38f527df-1ae5-4ada-adb0-665e66522ef0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:56.139140 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-38f527df-1ae5-4ada-adb0-665e66522ef0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:56.139569 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-38f527df-1ae5-4ada-adb0-665e66522ef0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:56.201777 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-38f527df-1ae5-4ada-adb0-665e66522ef0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:37:56.209164 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-38f527df-1ae5-4ada-adb0-665e66522ef0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.082075 Jun 17 15:37:56.209720 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 893/2201] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:37:56 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:37:56.933893 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-755aea68-e6a4-4884-8647-2c2065071173 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:37:56.934844 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-755aea68-e6a4-4884-8647-2c2065071173 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:37:56.942061 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-755aea68-e6a4-4884-8647-2c2065071173 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:56.942498 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-755aea68-e6a4-4884-8647-2c2065071173 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:56.943251 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-755aea68-e6a4-4884-8647-2c2065071173 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:56.943678 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-755aea68-e6a4-4884-8647-2c2065071173 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:56.971018 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR oslo.messaging._drivers.impl_rabbit [None req-755aea68-e6a4-4884-8647-2c2065071173 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [68f03182-4da5-4610-8824-893b25af720e] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 17 15:37:57.226282 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-e1e3a68e-2dab-46f4-b382-8925402d3c6e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:37:57.227157 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-e1e3a68e-2dab-46f4-b382-8925402d3c6e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:37:57.233894 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e1e3a68e-2dab-46f4-b382-8925402d3c6e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:57.234337 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e1e3a68e-2dab-46f4-b382-8925402d3c6e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:57.235094 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e1e3a68e-2dab-46f4-b382-8925402d3c6e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:57.235523 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e1e3a68e-2dab-46f4-b382-8925402d3c6e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:57.296541 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-e1e3a68e-2dab-46f4-b382-8925402d3c6e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:37:57.304943 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-e1e3a68e-2dab-46f4-b382-8925402d3c6e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.083009 Jun 17 15:37:57.305726 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 894/2202] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:37:57 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:37:57.978215 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO oslo.messaging._drivers.impl_rabbit [None req-755aea68-e6a4-4884-8647-2c2065071173 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [68f03182-4da5-4610-8824-893b25af720e] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 46638. Jun 17 15:37:58.054629 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-755aea68-e6a4-4884-8647-2c2065071173 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "POST /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/action" status: 200 len: 118550 microversion: 2.1 time: 1.124572 Jun 17 15:37:58.055309 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1309/2203] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jun 17 15:37:56 2022] POST /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf/action => generated 118550 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:37:58.322423 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-10a6c75d-a347-4522-b5da-3ab8b1702fe5 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:37:58.322974 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-10a6c75d-a347-4522-b5da-3ab8b1702fe5 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:37:58.329999 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-10a6c75d-a347-4522-b5da-3ab8b1702fe5 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:58.330442 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-10a6c75d-a347-4522-b5da-3ab8b1702fe5 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:58.331192 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-10a6c75d-a347-4522-b5da-3ab8b1702fe5 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:58.331630 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-10a6c75d-a347-4522-b5da-3ab8b1702fe5 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:58.394807 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-10a6c75d-a347-4522-b5da-3ab8b1702fe5 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:37:58.402270 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-10a6c75d-a347-4522-b5da-3ab8b1702fe5 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.083811 Jun 17 15:37:58.402832 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 895/2204] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:37:58 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:37:59.419325 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-c97fb3d8-dce5-4568-8c79-a3b0989d6967 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:37:59.420026 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-c97fb3d8-dce5-4568-8c79-a3b0989d6967 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:37:59.427745 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c97fb3d8-dce5-4568-8c79-a3b0989d6967 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:59.428188 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c97fb3d8-dce5-4568-8c79-a3b0989d6967 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:59.428970 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c97fb3d8-dce5-4568-8c79-a3b0989d6967 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:37:59.429408 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c97fb3d8-dce5-4568-8c79-a3b0989d6967 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:37:59.558726 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-c97fb3d8-dce5-4568-8c79-a3b0989d6967 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:37:59.566690 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-c97fb3d8-dce5-4568-8c79-a3b0989d6967 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.151566 Jun 17 15:37:59.567242 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1310/2205] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:37:59 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:38:00.582901 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-e1c1b1c7-fd59-43ae-8e6c-240ae9d4df1c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:38:00.583519 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-e1c1b1c7-fd59-43ae-8e6c-240ae9d4df1c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:38:00.589996 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e1c1b1c7-fd59-43ae-8e6c-240ae9d4df1c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:00.590439 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e1c1b1c7-fd59-43ae-8e6c-240ae9d4df1c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:00.591192 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e1c1b1c7-fd59-43ae-8e6c-240ae9d4df1c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:00.591621 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e1c1b1c7-fd59-43ae-8e6c-240ae9d4df1c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:00.654440 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-e1c1b1c7-fd59-43ae-8e6c-240ae9d4df1c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:38:00.662306 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-e1c1b1c7-fd59-43ae-8e6c-240ae9d4df1c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.083251 Jun 17 15:38:00.662877 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 896/2206] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:38:00 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:38:01.679002 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-6ec0053d-87ad-41f0-8eef-6ce32940e1c3 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:38:01.679565 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-6ec0053d-87ad-41f0-8eef-6ce32940e1c3 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:38:01.686017 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6ec0053d-87ad-41f0-8eef-6ce32940e1c3 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:01.686456 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6ec0053d-87ad-41f0-8eef-6ce32940e1c3 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:01.687204 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6ec0053d-87ad-41f0-8eef-6ce32940e1c3 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:01.687629 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6ec0053d-87ad-41f0-8eef-6ce32940e1c3 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:01.749446 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-6ec0053d-87ad-41f0-8eef-6ce32940e1c3 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:38:01.765607 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-6ec0053d-87ad-41f0-8eef-6ce32940e1c3 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.090024 Jun 17 15:38:01.766750 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1311/2207] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:38:01 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:38:02.784144 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-d7913ffe-279e-41a7-80b5-055863dba1c9 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:38:02.784712 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-d7913ffe-279e-41a7-80b5-055863dba1c9 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:38:02.791144 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d7913ffe-279e-41a7-80b5-055863dba1c9 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:02.791575 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d7913ffe-279e-41a7-80b5-055863dba1c9 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:02.792391 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d7913ffe-279e-41a7-80b5-055863dba1c9 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:02.792827 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d7913ffe-279e-41a7-80b5-055863dba1c9 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:02.853000 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-d7913ffe-279e-41a7-80b5-055863dba1c9 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:38:02.860458 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-d7913ffe-279e-41a7-80b5-055863dba1c9 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.080927 Jun 17 15:38:02.861020 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 897/2208] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:38:02 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:38:03.877056 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-3034c798-9b01-42be-80c8-22807ab6bd8a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:38:03.877659 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-3034c798-9b01-42be-80c8-22807ab6bd8a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:38:03.884177 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3034c798-9b01-42be-80c8-22807ab6bd8a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:03.884668 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3034c798-9b01-42be-80c8-22807ab6bd8a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:03.885419 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3034c798-9b01-42be-80c8-22807ab6bd8a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:03.885844 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3034c798-9b01-42be-80c8-22807ab6bd8a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:03.948242 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-3034c798-9b01-42be-80c8-22807ab6bd8a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:38:03.956033 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-3034c798-9b01-42be-80c8-22807ab6bd8a tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.082919 Jun 17 15:38:03.956670 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1312/2209] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:38:03 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:38:04.972777 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-c6fc0b76-d4e4-474c-8a2e-637c6851ff47 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:38:04.973423 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-c6fc0b76-d4e4-474c-8a2e-637c6851ff47 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:38:04.980087 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c6fc0b76-d4e4-474c-8a2e-637c6851ff47 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:04.980565 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c6fc0b76-d4e4-474c-8a2e-637c6851ff47 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:04.981319 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c6fc0b76-d4e4-474c-8a2e-637c6851ff47 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:04.981749 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c6fc0b76-d4e4-474c-8a2e-637c6851ff47 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:05.044254 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-c6fc0b76-d4e4-474c-8a2e-637c6851ff47 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:38:05.052263 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-c6fc0b76-d4e4-474c-8a2e-637c6851ff47 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.083396 Jun 17 15:38:05.052889 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 898/2210] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:38:04 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:38:06.070095 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-becc0468-af52-4d25-a22f-1c769f3c2dc5 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:38:06.070641 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-becc0468-af52-4d25-a22f-1c769f3c2dc5 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:38:06.077443 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-becc0468-af52-4d25-a22f-1c769f3c2dc5 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:06.077909 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-becc0468-af52-4d25-a22f-1c769f3c2dc5 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:06.079263 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-becc0468-af52-4d25-a22f-1c769f3c2dc5 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:06.079697 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-becc0468-af52-4d25-a22f-1c769f3c2dc5 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:06.142613 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-becc0468-af52-4d25-a22f-1c769f3c2dc5 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:38:06.150552 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-becc0468-af52-4d25-a22f-1c769f3c2dc5 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.084404 Jun 17 15:38:06.151120 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1313/2211] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:38:06 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:38:07.167652 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-9b35a384-98da-4475-84c1-a40aa58c9ac2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:38:07.168273 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-9b35a384-98da-4475-84c1-a40aa58c9ac2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:38:07.174891 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9b35a384-98da-4475-84c1-a40aa58c9ac2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:07.175339 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9b35a384-98da-4475-84c1-a40aa58c9ac2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:07.176108 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9b35a384-98da-4475-84c1-a40aa58c9ac2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:07.176580 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9b35a384-98da-4475-84c1-a40aa58c9ac2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:07.241277 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-9b35a384-98da-4475-84c1-a40aa58c9ac2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:38:07.249211 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-9b35a384-98da-4475-84c1-a40aa58c9ac2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.085363 Jun 17 15:38:07.249830 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 899/2212] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:38:07 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:38:08.266515 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-00e5ad43-1d7e-4077-8a0a-00fdd6a6c8a7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:38:08.267148 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-00e5ad43-1d7e-4077-8a0a-00fdd6a6c8a7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:38:08.273881 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-00e5ad43-1d7e-4077-8a0a-00fdd6a6c8a7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:08.274322 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-00e5ad43-1d7e-4077-8a0a-00fdd6a6c8a7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:08.275090 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-00e5ad43-1d7e-4077-8a0a-00fdd6a6c8a7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:08.275520 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-00e5ad43-1d7e-4077-8a0a-00fdd6a6c8a7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:08.342084 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-00e5ad43-1d7e-4077-8a0a-00fdd6a6c8a7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:38:08.350828 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-00e5ad43-1d7e-4077-8a0a-00fdd6a6c8a7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.088198 Jun 17 15:38:08.351408 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1314/2213] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:38:08 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:38:09.367957 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-16327b12-0c40-4fd5-ae19-56a234436476 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:38:09.368640 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-16327b12-0c40-4fd5-ae19-56a234436476 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:38:09.375811 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-16327b12-0c40-4fd5-ae19-56a234436476 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:09.376354 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-16327b12-0c40-4fd5-ae19-56a234436476 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:09.377666 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-16327b12-0c40-4fd5-ae19-56a234436476 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:09.378104 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-16327b12-0c40-4fd5-ae19-56a234436476 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:09.446721 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-16327b12-0c40-4fd5-ae19-56a234436476 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:38:09.454741 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-16327b12-0c40-4fd5-ae19-56a234436476 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.090579 Jun 17 15:38:09.455330 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 900/2214] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:38:09 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:38:10.470934 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-56501989-548b-46cb-92f7-c6401b1efc3c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:38:10.471541 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-56501989-548b-46cb-92f7-c6401b1efc3c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:38:10.478404 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-56501989-548b-46cb-92f7-c6401b1efc3c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:10.478866 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-56501989-548b-46cb-92f7-c6401b1efc3c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:10.479832 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-56501989-548b-46cb-92f7-c6401b1efc3c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:10.480052 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-56501989-548b-46cb-92f7-c6401b1efc3c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:10.541428 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-56501989-548b-46cb-92f7-c6401b1efc3c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:38:10.549084 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-56501989-548b-46cb-92f7-c6401b1efc3c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.082054 Jun 17 15:38:10.549651 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1315/2215] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:38:10 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:38:11.565906 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-aadab902-6bf7-45d7-ac27-92c11ad58a75 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:38:11.566516 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-aadab902-6bf7-45d7-ac27-92c11ad58a75 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:38:11.573083 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-aadab902-6bf7-45d7-ac27-92c11ad58a75 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:11.573539 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-aadab902-6bf7-45d7-ac27-92c11ad58a75 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:11.574336 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-aadab902-6bf7-45d7-ac27-92c11ad58a75 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:11.574767 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-aadab902-6bf7-45d7-ac27-92c11ad58a75 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:11.636533 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-aadab902-6bf7-45d7-ac27-92c11ad58a75 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:38:11.644687 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-aadab902-6bf7-45d7-ac27-92c11ad58a75 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.082615 Jun 17 15:38:11.645271 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 901/2216] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:38:11 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:38:12.662071 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-1e22855a-3c54-4001-bff5-8e098e3eaf37 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:38:12.662711 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-1e22855a-3c54-4001-bff5-8e098e3eaf37 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:38:12.665040 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_api:SELECT=44 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:38:12.670828 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1e22855a-3c54-4001-bff5-8e098e3eaf37 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:12.671262 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1e22855a-3c54-4001-bff5-8e098e3eaf37 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:12.672014 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1e22855a-3c54-4001-bff5-8e098e3eaf37 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:12.672481 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1e22855a-3c54-4001-bff5-8e098e3eaf37 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:12.735016 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-1e22855a-3c54-4001-bff5-8e098e3eaf37 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:38:12.742657 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-1e22855a-3c54-4001-bff5-8e098e3eaf37 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.084549 Jun 17 15:38:12.743228 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1316/2217] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:38:12 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:38:13.759188 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-21dd9b5d-eb0d-4032-b68c-e3a9b5a4feff tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:38:13.759790 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-21dd9b5d-eb0d-4032-b68c-e3a9b5a4feff tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:38:13.767344 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-21dd9b5d-eb0d-4032-b68c-e3a9b5a4feff tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:13.767791 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-21dd9b5d-eb0d-4032-b68c-e3a9b5a4feff tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:13.768575 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-21dd9b5d-eb0d-4032-b68c-e3a9b5a4feff tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:13.769005 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-21dd9b5d-eb0d-4032-b68c-e3a9b5a4feff tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:13.841279 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-21dd9b5d-eb0d-4032-b68c-e3a9b5a4feff tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:38:13.850259 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-21dd9b5d-eb0d-4032-b68c-e3a9b5a4feff tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.094699 Jun 17 15:38:13.850857 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 902/2218] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:38:13 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:38:14.867699 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-185986fa-76cc-44ee-a17e-9d84757235cd tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:38:14.868363 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-185986fa-76cc-44ee-a17e-9d84757235cd tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:38:14.874998 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-185986fa-76cc-44ee-a17e-9d84757235cd tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:14.875450 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-185986fa-76cc-44ee-a17e-9d84757235cd tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:14.876802 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-185986fa-76cc-44ee-a17e-9d84757235cd tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:14.877237 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-185986fa-76cc-44ee-a17e-9d84757235cd tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:14.939613 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-185986fa-76cc-44ee-a17e-9d84757235cd tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:38:14.947259 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-185986fa-76cc-44ee-a17e-9d84757235cd tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.083471 Jun 17 15:38:14.947836 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1317/2219] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:38:14 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:38:15.964487 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-097be17b-87f4-4c92-ad4c-9e590d89cb33 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:38:15.965056 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-097be17b-87f4-4c92-ad4c-9e590d89cb33 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:38:15.967089 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_api:SELECT=40 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:38:15.972675 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-097be17b-87f4-4c92-ad4c-9e590d89cb33 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:15.973120 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-097be17b-87f4-4c92-ad4c-9e590d89cb33 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:15.973896 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-097be17b-87f4-4c92-ad4c-9e590d89cb33 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:15.974320 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-097be17b-87f4-4c92-ad4c-9e590d89cb33 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:16.039109 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-097be17b-87f4-4c92-ad4c-9e590d89cb33 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:38:16.047121 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-097be17b-87f4-4c92-ad4c-9e590d89cb33 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.086833 Jun 17 15:38:16.047704 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 903/2220] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:38:15 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:38:17.065162 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-dde2a77e-e272-412e-a9e4-a8d02bde9d27 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:38:17.065814 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-dde2a77e-e272-412e-a9e4-a8d02bde9d27 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:38:17.073334 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-dde2a77e-e272-412e-a9e4-a8d02bde9d27 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:17.073786 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-dde2a77e-e272-412e-a9e4-a8d02bde9d27 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:17.074560 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-dde2a77e-e272-412e-a9e4-a8d02bde9d27 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:17.074995 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-dde2a77e-e272-412e-a9e4-a8d02bde9d27 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:17.144040 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-dde2a77e-e272-412e-a9e4-a8d02bde9d27 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:38:17.151694 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-dde2a77e-e272-412e-a9e4-a8d02bde9d27 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.090859 Jun 17 15:38:17.152261 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1318/2221] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:38:17 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:38:18.168486 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-6250bf8d-7e99-4c03-9790-272653f07be1 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:38:18.169256 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-6250bf8d-7e99-4c03-9790-272653f07be1 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:38:18.176583 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6250bf8d-7e99-4c03-9790-272653f07be1 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:18.177007 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6250bf8d-7e99-4c03-9790-272653f07be1 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:18.177773 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6250bf8d-7e99-4c03-9790-272653f07be1 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:18.178196 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6250bf8d-7e99-4c03-9790-272653f07be1 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:18.196848 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell1:SELECT=100 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:38:18.245583 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-6250bf8d-7e99-4c03-9790-272653f07be1 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:38:18.253423 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-6250bf8d-7e99-4c03-9790-272653f07be1 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.088776 Jun 17 15:38:18.254001 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 904/2222] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:38:18 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:38:18.777236 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 15:38:18.777523 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Fri Jun 17 15:38:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 15:38:19.273783 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-078ee932-d214-46d2-ba05-b571358f9abb tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:38:19.275010 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-078ee932-d214-46d2-ba05-b571358f9abb tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:38:19.286750 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-078ee932-d214-46d2-ba05-b571358f9abb tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:19.287538 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-078ee932-d214-46d2-ba05-b571358f9abb tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:19.289062 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-078ee932-d214-46d2-ba05-b571358f9abb tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:19.289837 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-078ee932-d214-46d2-ba05-b571358f9abb tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:19.367516 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-078ee932-d214-46d2-ba05-b571358f9abb tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:38:19.378049 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-078ee932-d214-46d2-ba05-b571358f9abb tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.111309 Jun 17 15:38:19.378631 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1319/2223] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:38:19 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:38:20.395887 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-c8929b2c-d1ca-4e24-afaf-cdba5bc50425 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:38:20.396565 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-c8929b2c-d1ca-4e24-afaf-cdba5bc50425 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:38:20.404080 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c8929b2c-d1ca-4e24-afaf-cdba5bc50425 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:20.404564 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c8929b2c-d1ca-4e24-afaf-cdba5bc50425 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:20.405342 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c8929b2c-d1ca-4e24-afaf-cdba5bc50425 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:20.405771 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c8929b2c-d1ca-4e24-afaf-cdba5bc50425 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:20.473615 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-c8929b2c-d1ca-4e24-afaf-cdba5bc50425 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:38:20.481895 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-c8929b2c-d1ca-4e24-afaf-cdba5bc50425 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.090441 Jun 17 15:38:20.482486 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 905/2224] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:38:20 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:38:21.502020 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-381dede5-9f9a-42de-8830-11a7cc6ca18c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:38:21.502735 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-381dede5-9f9a-42de-8830-11a7cc6ca18c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:38:21.509565 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-381dede5-9f9a-42de-8830-11a7cc6ca18c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:21.510010 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-381dede5-9f9a-42de-8830-11a7cc6ca18c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:21.510790 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-381dede5-9f9a-42de-8830-11a7cc6ca18c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:21.511225 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-381dede5-9f9a-42de-8830-11a7cc6ca18c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:21.514253 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=97 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:38:21.577815 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-381dede5-9f9a-42de-8830-11a7cc6ca18c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:38:21.586770 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-381dede5-9f9a-42de-8830-11a7cc6ca18c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.088753 Jun 17 15:38:21.587405 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1320/2225] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:38:21 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:38:22.605034 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-da3ea289-356c-4bf8-8a78-afb9b6d6f1a4 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:38:22.605925 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-da3ea289-356c-4bf8-8a78-afb9b6d6f1a4 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:38:22.613174 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-da3ea289-356c-4bf8-8a78-afb9b6d6f1a4 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:22.613628 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-da3ea289-356c-4bf8-8a78-afb9b6d6f1a4 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:22.614446 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-da3ea289-356c-4bf8-8a78-afb9b6d6f1a4 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:22.614882 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-da3ea289-356c-4bf8-8a78-afb9b6d6f1a4 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:22.700601 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-da3ea289-356c-4bf8-8a78-afb9b6d6f1a4 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:38:22.709777 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-da3ea289-356c-4bf8-8a78-afb9b6d6f1a4 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.108636 Jun 17 15:38:22.710381 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 906/2226] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:38:22 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:38:23.727390 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-140ea2d9-0bc7-4847-8b9a-95e77322df38 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:38:23.727948 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-140ea2d9-0bc7-4847-8b9a-95e77322df38 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:38:23.734750 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-140ea2d9-0bc7-4847-8b9a-95e77322df38 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:23.735197 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-140ea2d9-0bc7-4847-8b9a-95e77322df38 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:23.735970 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-140ea2d9-0bc7-4847-8b9a-95e77322df38 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:23.736431 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-140ea2d9-0bc7-4847-8b9a-95e77322df38 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:23.802544 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-140ea2d9-0bc7-4847-8b9a-95e77322df38 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:38:23.816846 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-140ea2d9-0bc7-4847-8b9a-95e77322df38 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.093216 Jun 17 15:38:23.817991 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1321/2227] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:38:23 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:38:24.834303 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-5056d346-d566-4fda-8042-de9b7a6e8d99 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:38:24.834914 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-5056d346-d566-4fda-8042-de9b7a6e8d99 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:38:24.841448 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5056d346-d566-4fda-8042-de9b7a6e8d99 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:24.841891 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5056d346-d566-4fda-8042-de9b7a6e8d99 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:24.842650 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5056d346-d566-4fda-8042-de9b7a6e8d99 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:24.843078 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5056d346-d566-4fda-8042-de9b7a6e8d99 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:24.906831 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-5056d346-d566-4fda-8042-de9b7a6e8d99 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:38:24.915145 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-5056d346-d566-4fda-8042-de9b7a6e8d99 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.084663 Jun 17 15:38:24.915723 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 907/2228] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:38:24 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:38:25.933111 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-c9c4e16e-60a9-4af3-af89-41305f86e824 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:38:25.933924 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-c9c4e16e-60a9-4af3-af89-41305f86e824 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:38:25.941509 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c9c4e16e-60a9-4af3-af89-41305f86e824 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:25.941951 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c9c4e16e-60a9-4af3-af89-41305f86e824 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:25.942710 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c9c4e16e-60a9-4af3-af89-41305f86e824 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:25.943157 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c9c4e16e-60a9-4af3-af89-41305f86e824 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:26.010536 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-c9c4e16e-60a9-4af3-af89-41305f86e824 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:38:26.018365 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-c9c4e16e-60a9-4af3-af89-41305f86e824 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.089288 Jun 17 15:38:26.018969 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1322/2229] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:38:25 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:38:27.035034 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-df564919-b6d2-4148-a2ae-cade287cd273 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:38:27.035633 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-df564919-b6d2-4148-a2ae-cade287cd273 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:38:27.042096 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-df564919-b6d2-4148-a2ae-cade287cd273 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:27.042542 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-df564919-b6d2-4148-a2ae-cade287cd273 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:27.043293 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-df564919-b6d2-4148-a2ae-cade287cd273 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:27.043726 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-df564919-b6d2-4148-a2ae-cade287cd273 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:27.107585 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-df564919-b6d2-4148-a2ae-cade287cd273 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:38:27.116110 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-df564919-b6d2-4148-a2ae-cade287cd273 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.084915 Jun 17 15:38:27.116705 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 908/2230] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:38:27 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:38:28.133448 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-c28a24f6-d91f-4d76-a434-3da549345d22 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:38:28.134250 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-c28a24f6-d91f-4d76-a434-3da549345d22 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:38:28.140895 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c28a24f6-d91f-4d76-a434-3da549345d22 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:28.141337 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c28a24f6-d91f-4d76-a434-3da549345d22 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:28.142648 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c28a24f6-d91f-4d76-a434-3da549345d22 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:28.143079 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c28a24f6-d91f-4d76-a434-3da549345d22 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:28.205866 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-c28a24f6-d91f-4d76-a434-3da549345d22 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:38:28.213344 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-c28a24f6-d91f-4d76-a434-3da549345d22 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.084312 Jun 17 15:38:28.213906 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1323/2231] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:38:28 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:38:29.230858 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-45006038-6178-46de-83ea-aec27bdda18e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:38:29.231471 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-45006038-6178-46de-83ea-aec27bdda18e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:38:29.238813 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-45006038-6178-46de-83ea-aec27bdda18e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:29.239255 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-45006038-6178-46de-83ea-aec27bdda18e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:29.240020 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-45006038-6178-46de-83ea-aec27bdda18e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:29.240492 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-45006038-6178-46de-83ea-aec27bdda18e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:29.302933 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-45006038-6178-46de-83ea-aec27bdda18e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:38:29.311898 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-45006038-6178-46de-83ea-aec27bdda18e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.084801 Jun 17 15:38:29.312870 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 909/2232] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:38:29 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:38:30.329641 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-783f38c0-4c7f-49ed-8c9d-09573583131e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:38:30.330506 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-783f38c0-4c7f-49ed-8c9d-09573583131e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:38:30.338015 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-783f38c0-4c7f-49ed-8c9d-09573583131e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:30.338466 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-783f38c0-4c7f-49ed-8c9d-09573583131e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:30.339230 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-783f38c0-4c7f-49ed-8c9d-09573583131e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:30.339663 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-783f38c0-4c7f-49ed-8c9d-09573583131e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:30.410324 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-783f38c0-4c7f-49ed-8c9d-09573583131e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:38:30.424354 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-783f38c0-4c7f-49ed-8c9d-09573583131e tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.098476 Jun 17 15:38:30.425264 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1324/2233] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:38:30 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:38:31.442795 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-eaa6db91-ac1e-4684-886a-52662658bcc8 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:38:31.443595 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-eaa6db91-ac1e-4684-886a-52662658bcc8 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:38:31.450669 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-eaa6db91-ac1e-4684-886a-52662658bcc8 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:31.451110 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-eaa6db91-ac1e-4684-886a-52662658bcc8 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:31.451871 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-eaa6db91-ac1e-4684-886a-52662658bcc8 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:31.452300 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-eaa6db91-ac1e-4684-886a-52662658bcc8 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:31.515667 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-eaa6db91-ac1e-4684-886a-52662658bcc8 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:38:31.524104 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-eaa6db91-ac1e-4684-886a-52662658bcc8 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.085639 Jun 17 15:38:31.524722 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 910/2234] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:38:31 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:38:32.549280 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-35e3ce5b-7e6e-4f12-bf46-bb1b121b1fa0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:38:32.549927 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-35e3ce5b-7e6e-4f12-bf46-bb1b121b1fa0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:38:32.556470 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-35e3ce5b-7e6e-4f12-bf46-bb1b121b1fa0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:32.556925 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-35e3ce5b-7e6e-4f12-bf46-bb1b121b1fa0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:32.557680 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-35e3ce5b-7e6e-4f12-bf46-bb1b121b1fa0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:32.558113 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-35e3ce5b-7e6e-4f12-bf46-bb1b121b1fa0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:32.624603 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-35e3ce5b-7e6e-4f12-bf46-bb1b121b1fa0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:38:32.632422 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-35e3ce5b-7e6e-4f12-bf46-bb1b121b1fa0 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.086927 Jun 17 15:38:32.633008 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1325/2235] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:38:32 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:38:33.650068 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-8be2347f-9c32-4e88-b6c1-1f5d92cfe98b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:38:33.650666 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-8be2347f-9c32-4e88-b6c1-1f5d92cfe98b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:38:33.658083 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8be2347f-9c32-4e88-b6c1-1f5d92cfe98b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:33.658541 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8be2347f-9c32-4e88-b6c1-1f5d92cfe98b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:33.659363 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8be2347f-9c32-4e88-b6c1-1f5d92cfe98b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:33.659834 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8be2347f-9c32-4e88-b6c1-1f5d92cfe98b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:33.724041 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-8be2347f-9c32-4e88-b6c1-1f5d92cfe98b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:38:33.732390 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-8be2347f-9c32-4e88-b6c1-1f5d92cfe98b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.086196 Jun 17 15:38:33.732984 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 911/2236] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:38:33 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:38:34.750145 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-12129824-a7d1-499f-a102-6de9643e1d6c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:38:34.751248 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-12129824-a7d1-499f-a102-6de9643e1d6c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:38:34.757891 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-12129824-a7d1-499f-a102-6de9643e1d6c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:34.758336 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-12129824-a7d1-499f-a102-6de9643e1d6c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:34.759102 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-12129824-a7d1-499f-a102-6de9643e1d6c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:34.759540 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-12129824-a7d1-499f-a102-6de9643e1d6c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:34.826297 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-12129824-a7d1-499f-a102-6de9643e1d6c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:38:34.834347 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-12129824-a7d1-499f-a102-6de9643e1d6c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.088204 Jun 17 15:38:34.834933 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1326/2237] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:38:34 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:38:35.851804 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-791f67e3-ae6f-43d4-bcaf-b9197afe5d1b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:38:35.852443 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-791f67e3-ae6f-43d4-bcaf-b9197afe5d1b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:38:35.858920 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-791f67e3-ae6f-43d4-bcaf-b9197afe5d1b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:35.859362 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-791f67e3-ae6f-43d4-bcaf-b9197afe5d1b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:35.860183 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-791f67e3-ae6f-43d4-bcaf-b9197afe5d1b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:35.860637 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-791f67e3-ae6f-43d4-bcaf-b9197afe5d1b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:35.935395 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-791f67e3-ae6f-43d4-bcaf-b9197afe5d1b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:38:35.944175 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-791f67e3-ae6f-43d4-bcaf-b9197afe5d1b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.096360 Jun 17 15:38:35.944806 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 912/2238] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:38:35 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:38:36.961359 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-ad42d1e4-a357-4576-9f6d-6d7cb5a27ae7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:38:36.961967 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-ad42d1e4-a357-4576-9f6d-6d7cb5a27ae7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:38:36.968930 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ad42d1e4-a357-4576-9f6d-6d7cb5a27ae7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:36.969993 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ad42d1e4-a357-4576-9f6d-6d7cb5a27ae7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:36.970917 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ad42d1e4-a357-4576-9f6d-6d7cb5a27ae7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:36.971457 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ad42d1e4-a357-4576-9f6d-6d7cb5a27ae7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:37.034943 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-ad42d1e4-a357-4576-9f6d-6d7cb5a27ae7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:38:37.042693 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-ad42d1e4-a357-4576-9f6d-6d7cb5a27ae7 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.085268 Jun 17 15:38:37.043271 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1327/2239] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:38:36 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:38:38.059900 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-badfe06a-b2de-4634-9ef8-8fb7b1806f72 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:38:38.060483 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-badfe06a-b2de-4634-9ef8-8fb7b1806f72 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:38:38.067900 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-badfe06a-b2de-4634-9ef8-8fb7b1806f72 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:38.068362 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-badfe06a-b2de-4634-9ef8-8fb7b1806f72 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:38.069203 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-badfe06a-b2de-4634-9ef8-8fb7b1806f72 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:38.069634 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-badfe06a-b2de-4634-9ef8-8fb7b1806f72 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:38.135282 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-badfe06a-b2de-4634-9ef8-8fb7b1806f72 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:38:38.143112 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-badfe06a-b2de-4634-9ef8-8fb7b1806f72 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.087172 Jun 17 15:38:38.143702 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 913/2240] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:38:38 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:38:39.160286 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-40eefef3-8135-4380-adac-1c4a974b38ad tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:38:39.160907 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-40eefef3-8135-4380-adac-1c4a974b38ad tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:38:39.167335 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-40eefef3-8135-4380-adac-1c4a974b38ad tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:39.167783 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-40eefef3-8135-4380-adac-1c4a974b38ad tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:39.168567 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-40eefef3-8135-4380-adac-1c4a974b38ad tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:39.169002 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-40eefef3-8135-4380-adac-1c4a974b38ad tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:39.230327 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-40eefef3-8135-4380-adac-1c4a974b38ad tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:38:39.238298 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-40eefef3-8135-4380-adac-1c4a974b38ad tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.081900 Jun 17 15:38:39.238848 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1328/2241] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:38:39 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:38:40.254554 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-39a65f65-1dad-4555-8aaa-2ff202f2fa45 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:38:40.255205 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-39a65f65-1dad-4555-8aaa-2ff202f2fa45 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:38:40.261986 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-39a65f65-1dad-4555-8aaa-2ff202f2fa45 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:40.262427 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-39a65f65-1dad-4555-8aaa-2ff202f2fa45 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:40.263197 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-39a65f65-1dad-4555-8aaa-2ff202f2fa45 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:40.263628 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-39a65f65-1dad-4555-8aaa-2ff202f2fa45 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:40.328299 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-39a65f65-1dad-4555-8aaa-2ff202f2fa45 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:38:40.336633 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-39a65f65-1dad-4555-8aaa-2ff202f2fa45 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.085940 Jun 17 15:38:40.337245 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 914/2242] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:38:40 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:38:41.354511 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-da3030d6-2165-4016-a47e-44e4ca73c8f2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:38:41.355138 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-da3030d6-2165-4016-a47e-44e4ca73c8f2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:38:41.362765 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-da3030d6-2165-4016-a47e-44e4ca73c8f2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:41.363210 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-da3030d6-2165-4016-a47e-44e4ca73c8f2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:41.363991 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-da3030d6-2165-4016-a47e-44e4ca73c8f2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:41.364450 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-da3030d6-2165-4016-a47e-44e4ca73c8f2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:41.428219 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-da3030d6-2165-4016-a47e-44e4ca73c8f2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:38:41.435987 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-da3030d6-2165-4016-a47e-44e4ca73c8f2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.085350 Jun 17 15:38:41.436605 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1329/2243] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:38:41 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:38:42.454007 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-2fde3d45-2ffd-47ed-8614-3a2c8daa6833 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:38:42.454642 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-2fde3d45-2ffd-47ed-8614-3a2c8daa6833 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:38:42.461341 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2fde3d45-2ffd-47ed-8614-3a2c8daa6833 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:42.461786 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2fde3d45-2ffd-47ed-8614-3a2c8daa6833 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:42.462551 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2fde3d45-2ffd-47ed-8614-3a2c8daa6833 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:42.462977 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2fde3d45-2ffd-47ed-8614-3a2c8daa6833 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:42.530253 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-2fde3d45-2ffd-47ed-8614-3a2c8daa6833 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:38:42.539388 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-2fde3d45-2ffd-47ed-8614-3a2c8daa6833 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.089662 Jun 17 15:38:42.539981 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 915/2244] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:38:42 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:38:43.556193 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-85d93dca-5c28-460e-87c1-d15153d98913 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:38:43.556833 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-85d93dca-5c28-460e-87c1-d15153d98913 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:38:43.559175 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_api:SELECT=28 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:38:43.564898 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-85d93dca-5c28-460e-87c1-d15153d98913 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:43.565341 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-85d93dca-5c28-460e-87c1-d15153d98913 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:43.566106 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-85d93dca-5c28-460e-87c1-d15153d98913 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:43.566534 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-85d93dca-5c28-460e-87c1-d15153d98913 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:43.633343 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-85d93dca-5c28-460e-87c1-d15153d98913 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:38:43.641399 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-85d93dca-5c28-460e-87c1-d15153d98913 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.088975 Jun 17 15:38:43.641994 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1330/2245] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:38:43 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:38:44.661174 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-2de420c8-af07-478c-8128-434cec28819d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:38:44.661775 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-2de420c8-af07-478c-8128-434cec28819d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:38:44.668126 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2de420c8-af07-478c-8128-434cec28819d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:44.668608 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2de420c8-af07-478c-8128-434cec28819d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:44.669396 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2de420c8-af07-478c-8128-434cec28819d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:44.669839 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2de420c8-af07-478c-8128-434cec28819d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:44.737610 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-2de420c8-af07-478c-8128-434cec28819d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:38:44.745470 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-2de420c8-af07-478c-8128-434cec28819d tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.089680 Jun 17 15:38:44.746043 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 916/2246] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:38:44 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:38:45.763017 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-fd86109c-ad45-4510-9a5c-a5d2927f41eb tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:38:45.763665 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-fd86109c-ad45-4510-9a5c-a5d2927f41eb tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:38:45.770747 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fd86109c-ad45-4510-9a5c-a5d2927f41eb tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:45.771186 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fd86109c-ad45-4510-9a5c-a5d2927f41eb tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:45.771949 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fd86109c-ad45-4510-9a5c-a5d2927f41eb tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:45.772402 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fd86109c-ad45-4510-9a5c-a5d2927f41eb tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:45.833920 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-fd86109c-ad45-4510-9a5c-a5d2927f41eb tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:38:45.841630 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-fd86109c-ad45-4510-9a5c-a5d2927f41eb tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.082492 Jun 17 15:38:45.842203 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1331/2247] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:38:45 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:38:46.858906 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-fabc8cc0-737c-442b-a73e-ada37ba4ef61 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:38:46.859533 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-fabc8cc0-737c-442b-a73e-ada37ba4ef61 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:38:46.861970 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_api:SELECT=28 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:38:46.868024 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fabc8cc0-737c-442b-a73e-ada37ba4ef61 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:46.868502 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fabc8cc0-737c-442b-a73e-ada37ba4ef61 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:46.869295 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fabc8cc0-737c-442b-a73e-ada37ba4ef61 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:46.869734 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fabc8cc0-737c-442b-a73e-ada37ba4ef61 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:46.935106 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-fabc8cc0-737c-442b-a73e-ada37ba4ef61 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:38:46.942871 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-fabc8cc0-737c-442b-a73e-ada37ba4ef61 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.087986 Jun 17 15:38:46.943442 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 917/2248] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:38:46 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:38:47.960611 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-23321f1b-042c-472c-b51f-50e9cc41bfe6 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:38:47.961209 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-23321f1b-042c-472c-b51f-50e9cc41bfe6 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:38:47.967832 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-23321f1b-042c-472c-b51f-50e9cc41bfe6 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:47.968282 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-23321f1b-042c-472c-b51f-50e9cc41bfe6 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:47.969085 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-23321f1b-042c-472c-b51f-50e9cc41bfe6 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:47.969541 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-23321f1b-042c-472c-b51f-50e9cc41bfe6 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:48.038253 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-23321f1b-042c-472c-b51f-50e9cc41bfe6 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:38:48.046152 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-23321f1b-042c-472c-b51f-50e9cc41bfe6 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.089664 Jun 17 15:38:48.046728 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1332/2249] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:38:47 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:38:49.067792 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-1678e830-0151-4411-a9b4-9066ede337f2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:38:49.068362 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-1678e830-0151-4411-a9b4-9066ede337f2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:38:49.075320 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1678e830-0151-4411-a9b4-9066ede337f2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:49.075774 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1678e830-0151-4411-a9b4-9066ede337f2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:49.076577 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1678e830-0151-4411-a9b4-9066ede337f2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:49.077020 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1678e830-0151-4411-a9b4-9066ede337f2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:49.081463 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell1:SELECT=81 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:38:49.142180 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-1678e830-0151-4411-a9b4-9066ede337f2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:38:49.149941 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-1678e830-0151-4411-a9b4-9066ede337f2 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.086102 Jun 17 15:38:49.150508 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 918/2250] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:38:49 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:38:50.167594 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-de2aebbf-27db-4be4-bd89-eda04a81d75b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:38:50.168202 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-de2aebbf-27db-4be4-bd89-eda04a81d75b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:38:50.175378 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-de2aebbf-27db-4be4-bd89-eda04a81d75b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:50.175821 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-de2aebbf-27db-4be4-bd89-eda04a81d75b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:50.176601 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-de2aebbf-27db-4be4-bd89-eda04a81d75b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:50.177042 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-de2aebbf-27db-4be4-bd89-eda04a81d75b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:50.237599 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-de2aebbf-27db-4be4-bd89-eda04a81d75b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:38:50.245313 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-de2aebbf-27db-4be4-bd89-eda04a81d75b tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.081557 Jun 17 15:38:50.245840 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1333/2251] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:38:50 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:38:51.261575 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-4e67a3a6-fa2f-45fc-9cf2-145dccc0583c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:38:51.262136 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-4e67a3a6-fa2f-45fc-9cf2-145dccc0583c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:38:51.269689 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4e67a3a6-fa2f-45fc-9cf2-145dccc0583c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:51.270138 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4e67a3a6-fa2f-45fc-9cf2-145dccc0583c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:51.270901 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4e67a3a6-fa2f-45fc-9cf2-145dccc0583c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:51.271332 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4e67a3a6-fa2f-45fc-9cf2-145dccc0583c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:51.332082 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-4e67a3a6-fa2f-45fc-9cf2-145dccc0583c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:38:51.339599 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-4e67a3a6-fa2f-45fc-9cf2-145dccc0583c tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.081966 Jun 17 15:38:51.340159 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 919/2252] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:38:51 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:38:52.361997 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-2974a1c0-a0e2-4b84-9774-56b80a3ae93f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:38:52.363145 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-2974a1c0-a0e2-4b84-9774-56b80a3ae93f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] [instance: 5b30f80f-8b8c-4c07-8653-4f9fd128ce77] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:38:52.374677 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2974a1c0-a0e2-4b84-9774-56b80a3ae93f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:52.375540 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2974a1c0-a0e2-4b84-9774-56b80a3ae93f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:52.377460 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2974a1c0-a0e2-4b84-9774-56b80a3ae93f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:52.378258 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2974a1c0-a0e2-4b84-9774-56b80a3ae93f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:52.381963 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=84 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:38:52.445017 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-2974a1c0-a0e2-4b84-9774-56b80a3ae93f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '717db70ce2734d169aee71912f18ba8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e2a6034ec6b445cbe590f51bf4e419f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:38:52.452727 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-2974a1c0-a0e2-4b84-9774-56b80a3ae93f tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77" status: 200 len: 1219 microversion: 2.1 time: 0.098313 Jun 17 15:38:52.453519 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1334/2253] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:38:52 2022] GET /compute/v2.1/servers/5b30f80f-8b8c-4c07-8653-4f9fd128ce77 => generated 1219 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:38:52.620337 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-a258d1a5-6b19-4cb9-9618-8a59d7438b60 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] Calling method '.version_select at 0x7faf54bfe040>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:38:52.644903 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-a258d1a5-6b19-4cb9-9618-8a59d7438b60 tempest-TestShelveInstance-1323825481 tempest-TestShelveInstance-1323825481-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1574553842" status: 202 len: 0 microversion: 2.1 time: 0.028450 Jun 17 15:38:52.645495 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 920/2254] 10.222.0.48 () {58 vars in 1253 bytes} [Fri Jun 17 15:38:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1574553842 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 15:38:54.869231 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-a02ae621-f955-4b59-a24d-4a650aa1ac9a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:38:54.869867 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-a02ae621-f955-4b59-a24d-4a650aa1ac9a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:38:54.882320 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a02ae621-f955-4b59-a24d-4a650aa1ac9a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:54.886990 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a02ae621-f955-4b59-a24d-4a650aa1ac9a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:54.892192 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a02ae621-f955-4b59-a24d-4a650aa1ac9a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:54.893050 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a02ae621-f955-4b59-a24d-4a650aa1ac9a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:54.944963 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-5d533533-df13-4dfd-ba42-a4046b49a279 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:38:54.946717 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-5d533533-df13-4dfd-ba42-a4046b49a279 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:38:54.960706 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-a02ae621-f955-4b59-a24d-4a650aa1ac9a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Going to try to terminate instance {{(pid=117650) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 15:38:54.963818 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5d533533-df13-4dfd-ba42-a4046b49a279 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:54.965357 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5d533533-df13-4dfd-ba42-a4046b49a279 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:54.966251 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5d533533-df13-4dfd-ba42-a4046b49a279 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:54.967756 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5d533533-df13-4dfd-ba42-a4046b49a279 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:55.045652 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-5d533533-df13-4dfd-ba42-a4046b49a279 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Going to try to terminate instance {{(pid=117649) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 15:38:55.120659 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-a02ae621-f955-4b59-a24d-4a650aa1ac9a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "DELETE /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 204 len: 0 microversion: 2.1 time: 0.255554 Jun 17 15:38:55.122215 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1335/2255] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jun 17 15:38:54 2022] DELETE /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 15:38:55.132270 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-1964773a-08a9-4efe-8618-99c28a5fbd08 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:38:55.133206 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-1964773a-08a9-4efe-8618-99c28a5fbd08 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:38:55.143011 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1964773a-08a9-4efe-8618-99c28a5fbd08 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:55.143474 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1964773a-08a9-4efe-8618-99c28a5fbd08 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:55.144493 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1964773a-08a9-4efe-8618-99c28a5fbd08 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:55.145098 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1964773a-08a9-4efe-8618-99c28a5fbd08 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:55.177986 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-5d533533-df13-4dfd-ba42-a4046b49a279 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "DELETE /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 204 len: 0 microversion: 2.20 time: 0.236888 Jun 17 15:38:55.179811 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 921/2256] 10.222.0.48 () {60 vars in 1279 bytes} [Fri Jun 17 15:38:54 2022] DELETE /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 17 15:38:55.187201 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-696a36e7-0a7d-428d-84a3-eb51f43f7ede tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] Calling method '.version_select at 0x7faf54c60ee0>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:38:55.211438 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-696a36e7-0a7d-428d-84a3-eb51f43f7ede tempest-TestVolumeBootPattern-1895714660 tempest-TestVolumeBootPattern-1895714660-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-417419175" status: 202 len: 0 microversion: 2.1 time: 0.029848 Jun 17 15:38:55.213058 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 922/2257] 10.222.0.48 () {58 vars in 1259 bytes} [Fri Jun 17 15:38:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-417419175 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 15:38:55.222998 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-1964773a-08a9-4efe-8618-99c28a5fbd08 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Going to try to terminate instance {{(pid=117650) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 15:38:55.224522 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-2705ff19-e13a-4da2-9f4f-ca7321aa70cc tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:38:55.226843 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-2705ff19-e13a-4da2-9f4f-ca7321aa70cc tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:38:55.245579 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2705ff19-e13a-4da2-9f4f-ca7321aa70cc tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:55.246043 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2705ff19-e13a-4da2-9f4f-ca7321aa70cc tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:55.246845 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2705ff19-e13a-4da2-9f4f-ca7321aa70cc tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:55.247287 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2705ff19-e13a-4da2-9f4f-ca7321aa70cc tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:55.425412 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-1964773a-08a9-4efe-8618-99c28a5fbd08 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "DELETE /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 204 len: 0 microversion: 2.1 time: 0.301426 Jun 17 15:38:55.426091 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1336/2258] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jun 17 15:38:55 2022] DELETE /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 15:38:55.432570 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-40663b3e-ca2f-43b1-808e-381d16e136fe tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:38:55.436146 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-40663b3e-ca2f-43b1-808e-381d16e136fe tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:38:55.445025 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-40663b3e-ca2f-43b1-808e-381d16e136fe tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:55.445720 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-40663b3e-ca2f-43b1-808e-381d16e136fe tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:55.446587 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-40663b3e-ca2f-43b1-808e-381d16e136fe tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:55.447100 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-40663b3e-ca2f-43b1-808e-381d16e136fe tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:55.545057 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-2705ff19-e13a-4da2-9f4f-ca7321aa70cc tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:38:55.554068 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-2705ff19-e13a-4da2-9f4f-ca7321aa70cc tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1601 microversion: 2.1 time: 0.339576 Jun 17 15:38:55.554933 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 923/2259] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:38:55 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1601 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:38:55.559513 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-49ab168a-36a6-46b1-95db-e214d6895e42 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:38:55.561167 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-49ab168a-36a6-46b1-95db-e214d6895e42 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:38:55.568496 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-49ab168a-36a6-46b1-95db-e214d6895e42 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:55.569261 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-49ab168a-36a6-46b1-95db-e214d6895e42 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:55.571154 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-49ab168a-36a6-46b1-95db-e214d6895e42 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:55.571426 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-49ab168a-36a6-46b1-95db-e214d6895e42 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:55.692045 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-40663b3e-ca2f-43b1-808e-381d16e136fe tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:38:55.702859 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-40663b3e-ca2f-43b1-808e-381d16e136fe tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:38:55.706765 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-40663b3e-ca2f-43b1-808e-381d16e136fe tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:38:55.711556 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-40663b3e-ca2f-43b1-808e-381d16e136fe tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1799 microversion: 2.20 time: 0.284189 Jun 17 15:38:55.712633 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1337/2260] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:38:55 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1799 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:38:55.912544 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-49ab168a-36a6-46b1-95db-e214d6895e42 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:38:55.931610 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-49ab168a-36a6-46b1-95db-e214d6895e42 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.375725 Jun 17 15:38:55.932934 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 924/2261] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:38:55 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:38:56.571647 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-13ce18ca-56a4-46bd-97cd-9a4e4ac3551d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:38:56.573284 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-13ce18ca-56a4-46bd-97cd-9a4e4ac3551d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:38:56.582403 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-13ce18ca-56a4-46bd-97cd-9a4e4ac3551d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:56.583111 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-13ce18ca-56a4-46bd-97cd-9a4e4ac3551d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:56.584100 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-13ce18ca-56a4-46bd-97cd-9a4e4ac3551d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:56.584952 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-13ce18ca-56a4-46bd-97cd-9a4e4ac3551d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:56.734290 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-593d666e-8ea4-4a82-97ec-68f86d8e442e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:38:56.735031 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-593d666e-8ea4-4a82-97ec-68f86d8e442e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:38:56.744968 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-593d666e-8ea4-4a82-97ec-68f86d8e442e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:56.745668 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-593d666e-8ea4-4a82-97ec-68f86d8e442e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:56.746617 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-593d666e-8ea4-4a82-97ec-68f86d8e442e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:56.747144 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-593d666e-8ea4-4a82-97ec-68f86d8e442e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:56.986501 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-13ce18ca-56a4-46bd-97cd-9a4e4ac3551d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:38:56.995915 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-13ce18ca-56a4-46bd-97cd-9a4e4ac3551d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1601 microversion: 2.1 time: 0.428715 Jun 17 15:38:56.996631 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1338/2262] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:38:56 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1601 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:38:57.016814 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-aaf3faf6-ba81-4026-afba-73f0782851f9 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:38:57.017643 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-aaf3faf6-ba81-4026-afba-73f0782851f9 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:38:57.024703 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-aaf3faf6-ba81-4026-afba-73f0782851f9 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:57.025210 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-aaf3faf6-ba81-4026-afba-73f0782851f9 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:57.026126 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-aaf3faf6-ba81-4026-afba-73f0782851f9 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:57.026619 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-aaf3faf6-ba81-4026-afba-73f0782851f9 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:57.033586 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-593d666e-8ea4-4a82-97ec-68f86d8e442e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:38:57.045303 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-593d666e-8ea4-4a82-97ec-68f86d8e442e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:38:57.047396 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-593d666e-8ea4-4a82-97ec-68f86d8e442e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:38:57.048886 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-593d666e-8ea4-4a82-97ec-68f86d8e442e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1799 microversion: 2.20 time: 0.320078 Jun 17 15:38:57.050066 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 925/2263] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:38:56 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1799 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:38:57.580653 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-aaf3faf6-ba81-4026-afba-73f0782851f9 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:38:57.602848 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-aaf3faf6-ba81-4026-afba-73f0782851f9 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.590991 Jun 17 15:38:57.612766 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1339/2264] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:38:57 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:38:58.021692 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-e77f4cfd-cf1e-4022-a79a-39bc4d293e80 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:38:58.022630 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-e77f4cfd-cf1e-4022-a79a-39bc4d293e80 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:38:58.028986 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e77f4cfd-cf1e-4022-a79a-39bc4d293e80 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:58.029778 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e77f4cfd-cf1e-4022-a79a-39bc4d293e80 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:58.030677 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e77f4cfd-cf1e-4022-a79a-39bc4d293e80 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:58.031179 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e77f4cfd-cf1e-4022-a79a-39bc4d293e80 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:58.068877 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-21483768-12f2-4d32-842c-c12d8416c5be tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:38:58.069770 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-21483768-12f2-4d32-842c-c12d8416c5be tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:38:58.076345 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-21483768-12f2-4d32-842c-c12d8416c5be tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:58.077226 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-21483768-12f2-4d32-842c-c12d8416c5be tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:58.077996 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-21483768-12f2-4d32-842c-c12d8416c5be tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:58.078922 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-21483768-12f2-4d32-842c-c12d8416c5be tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:58.193151 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-21483768-12f2-4d32-842c-c12d8416c5be tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:38:58.218978 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-21483768-12f2-4d32-842c-c12d8416c5be tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:38:58.223016 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-21483768-12f2-4d32-842c-c12d8416c5be tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:38:58.225437 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-21483768-12f2-4d32-842c-c12d8416c5be tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1732 microversion: 2.20 time: 0.161997 Jun 17 15:38:58.226762 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1340/2265] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:38:58 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1732 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:38:58.276468 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-e77f4cfd-cf1e-4022-a79a-39bc4d293e80 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:38:58.289988 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-e77f4cfd-cf1e-4022-a79a-39bc4d293e80 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1601 microversion: 2.1 time: 0.274477 Jun 17 15:38:58.310264 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 926/2266] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:38:58 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1601 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:38:58.541959 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [req-0f739382-bc75-4bf4-9fc9-4b558ac2ffb8 req-91629a1b-3682-4349-9c25-103b94c5b43e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e97df352-5cee-41f7-ae51-f55cd9e85869", "name": "network-vif-deleted", "tag": "ff5c90be-6727-43d1-841f-760f94168fc6"}]} {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:38:58.551458 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [req-0f739382-bc75-4bf4-9fc9-4b558ac2ffb8 req-91629a1b-3682-4349-9c25-103b94c5b43e service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:58.552311 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [req-0f739382-bc75-4bf4-9fc9-4b558ac2ffb8 req-91629a1b-3682-4349-9c25-103b94c5b43e service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:58.566514 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.compute.server_external_events [req-0f739382-bc75-4bf4-9fc9-4b558ac2ffb8 req-91629a1b-3682-4349-9c25-103b94c5b43e service nova] Creating event network-vif-deleted:ff5c90be-6727-43d1-841f-760f94168fc6 for instance e97df352-5cee-41f7-ae51-f55cd9e85869 on hv-cinder-82549 Jun 17 15:38:58.586887 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [req-0f739382-bc75-4bf4-9fc9-4b558ac2ffb8 req-91629a1b-3682-4349-9c25-103b94c5b43e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141719 Jun 17 15:38:58.588854 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1341/2267] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 15:38:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:38:58.620015 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-42445a98-7473-48cc-9ac7-3e1809251eeb tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:38:58.620780 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-42445a98-7473-48cc-9ac7-3e1809251eeb tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:38:58.628179 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-42445a98-7473-48cc-9ac7-3e1809251eeb tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:58.642255 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-42445a98-7473-48cc-9ac7-3e1809251eeb tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:58.646577 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-42445a98-7473-48cc-9ac7-3e1809251eeb tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:58.647242 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-42445a98-7473-48cc-9ac7-3e1809251eeb tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:58.945832 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-42445a98-7473-48cc-9ac7-3e1809251eeb tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:38:58.960969 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-42445a98-7473-48cc-9ac7-3e1809251eeb tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.345154 Jun 17 15:38:58.961904 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 927/2268] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:38:58 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:38:59.251993 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-d734cde8-f6d0-47f9-b1c5-1d0b6c1b1963 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:38:59.253153 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-d734cde8-f6d0-47f9-b1c5-1d0b6c1b1963 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:38:59.271685 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d734cde8-f6d0-47f9-b1c5-1d0b6c1b1963 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:59.272399 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d734cde8-f6d0-47f9-b1c5-1d0b6c1b1963 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:59.274453 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d734cde8-f6d0-47f9-b1c5-1d0b6c1b1963 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:59.276082 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d734cde8-f6d0-47f9-b1c5-1d0b6c1b1963 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:59.321903 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-512d344c-bc10-480d-943a-7d2b55ed5873 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:38:59.323838 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-512d344c-bc10-480d-943a-7d2b55ed5873 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:38:59.344730 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-512d344c-bc10-480d-943a-7d2b55ed5873 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:59.349806 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-512d344c-bc10-480d-943a-7d2b55ed5873 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:59.351367 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-512d344c-bc10-480d-943a-7d2b55ed5873 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:59.352308 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-512d344c-bc10-480d-943a-7d2b55ed5873 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:59.423333 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-d734cde8-f6d0-47f9-b1c5-1d0b6c1b1963 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:38:59.442212 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-d734cde8-f6d0-47f9-b1c5-1d0b6c1b1963 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:38:59.443798 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-d734cde8-f6d0-47f9-b1c5-1d0b6c1b1963 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:38:59.447254 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-d734cde8-f6d0-47f9-b1c5-1d0b6c1b1963 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.200181 Jun 17 15:38:59.460699 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1342/2269] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:38:59 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 15:38:59.596109 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-512d344c-bc10-480d-943a-7d2b55ed5873 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:38:59.606176 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-512d344c-bc10-480d-943a-7d2b55ed5873 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1601 microversion: 2.1 time: 0.294562 Jun 17 15:38:59.607057 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 928/2270] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:38:59 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1601 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:38:59.980022 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-6d8278dc-86c7-402b-becb-3705c8968173 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:38:59.981793 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-6d8278dc-86c7-402b-becb-3705c8968173 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:38:59.990034 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6d8278dc-86c7-402b-becb-3705c8968173 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:59.990700 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6d8278dc-86c7-402b-becb-3705c8968173 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:38:59.991788 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6d8278dc-86c7-402b-becb-3705c8968173 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:38:59.992643 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6d8278dc-86c7-402b-becb-3705c8968173 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:00.246601 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-6d8278dc-86c7-402b-becb-3705c8968173 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:00.278223 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-6d8278dc-86c7-402b-becb-3705c8968173 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.302707 Jun 17 15:39:00.282996 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1343/2271] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:38:59 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:39:00.474457 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-82fefc09-132e-4cda-9990-8c7f1784cd09 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:00.478003 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-82fefc09-132e-4cda-9990-8c7f1784cd09 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:00.493371 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-82fefc09-132e-4cda-9990-8c7f1784cd09 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:00.494296 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-82fefc09-132e-4cda-9990-8c7f1784cd09 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:00.495289 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-82fefc09-132e-4cda-9990-8c7f1784cd09 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:00.496033 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-82fefc09-132e-4cda-9990-8c7f1784cd09 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:00.623011 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-82fefc09-132e-4cda-9990-8c7f1784cd09 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:00.624365 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-8948edaa-8512-43a3-9702-82ede630baa6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:00.625719 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-8948edaa-8512-43a3-9702-82ede630baa6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:00.632445 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8948edaa-8512-43a3-9702-82ede630baa6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:00.633227 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8948edaa-8512-43a3-9702-82ede630baa6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:00.634361 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8948edaa-8512-43a3-9702-82ede630baa6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:00.635016 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8948edaa-8512-43a3-9702-82ede630baa6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:00.643123 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-82fefc09-132e-4cda-9990-8c7f1784cd09 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:00.651598 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-82fefc09-132e-4cda-9990-8c7f1784cd09 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:00.653117 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-82fefc09-132e-4cda-9990-8c7f1784cd09 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.186876 Jun 17 15:39:00.653811 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 929/2272] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:39:00 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:39:01.034782 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-8948edaa-8512-43a3-9702-82ede630baa6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:01.046632 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-8948edaa-8512-43a3-9702-82ede630baa6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1601 microversion: 2.1 time: 0.425613 Jun 17 15:39:01.047952 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1344/2273] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:39:00 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1601 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:39:01.306479 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-6325d7ee-ce40-45de-804d-0d85f6a70297 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:01.306479 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-6325d7ee-ce40-45de-804d-0d85f6a70297 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:01.309608 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6325d7ee-ce40-45de-804d-0d85f6a70297 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:01.310103 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6325d7ee-ce40-45de-804d-0d85f6a70297 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:01.310956 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6325d7ee-ce40-45de-804d-0d85f6a70297 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:01.311435 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6325d7ee-ce40-45de-804d-0d85f6a70297 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:01.543065 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-6325d7ee-ce40-45de-804d-0d85f6a70297 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:01.562071 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-6325d7ee-ce40-45de-804d-0d85f6a70297 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.265410 Jun 17 15:39:01.562968 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 930/2274] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:39:01 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:39:01.681056 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-7686adae-8d68-434d-a442-fa1e52a67327 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:01.681928 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-7686adae-8d68-434d-a442-fa1e52a67327 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:01.689860 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7686adae-8d68-434d-a442-fa1e52a67327 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:01.691254 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7686adae-8d68-434d-a442-fa1e52a67327 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:01.692477 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7686adae-8d68-434d-a442-fa1e52a67327 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:01.693169 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7686adae-8d68-434d-a442-fa1e52a67327 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:01.902391 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-7686adae-8d68-434d-a442-fa1e52a67327 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:01.926577 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-7686adae-8d68-434d-a442-fa1e52a67327 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:01.929110 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-7686adae-8d68-434d-a442-fa1e52a67327 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:01.930342 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-7686adae-8d68-434d-a442-fa1e52a67327 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.253664 Jun 17 15:39:01.930926 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1345/2275] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:39:01 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 15:39:02.071564 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-dbdb1573-c0c9-477a-8657-0386579e81da tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:02.072562 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-dbdb1573-c0c9-477a-8657-0386579e81da tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:02.082976 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-dbdb1573-c0c9-477a-8657-0386579e81da tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:02.084937 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-dbdb1573-c0c9-477a-8657-0386579e81da tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:02.088451 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-dbdb1573-c0c9-477a-8657-0386579e81da tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:02.089908 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-dbdb1573-c0c9-477a-8657-0386579e81da tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:02.382433 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-dbdb1573-c0c9-477a-8657-0386579e81da tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:02.392412 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-dbdb1573-c0c9-477a-8657-0386579e81da tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1601 microversion: 2.1 time: 0.327268 Jun 17 15:39:02.403876 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 931/2276] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:39:02 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1601 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:39:02.588877 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-46cbd156-2a6f-44b0-8fd8-d7e3f144e757 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:02.592179 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-46cbd156-2a6f-44b0-8fd8-d7e3f144e757 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:02.605747 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-46cbd156-2a6f-44b0-8fd8-d7e3f144e757 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:02.607021 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-46cbd156-2a6f-44b0-8fd8-d7e3f144e757 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:02.608778 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-46cbd156-2a6f-44b0-8fd8-d7e3f144e757 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:02.609867 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-46cbd156-2a6f-44b0-8fd8-d7e3f144e757 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:02.890142 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-46cbd156-2a6f-44b0-8fd8-d7e3f144e757 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:02.903956 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-46cbd156-2a6f-44b0-8fd8-d7e3f144e757 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.321072 Jun 17 15:39:02.905415 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1346/2277] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:39:02 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:39:02.957045 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-523bdf53-394d-42d6-aae5-33dec0206610 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:02.958333 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-523bdf53-394d-42d6-aae5-33dec0206610 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:02.965561 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-523bdf53-394d-42d6-aae5-33dec0206610 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:02.966390 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-523bdf53-394d-42d6-aae5-33dec0206610 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:02.967193 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-523bdf53-394d-42d6-aae5-33dec0206610 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:02.967854 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-523bdf53-394d-42d6-aae5-33dec0206610 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:03.087497 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-523bdf53-394d-42d6-aae5-33dec0206610 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:03.105469 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-523bdf53-394d-42d6-aae5-33dec0206610 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:03.108901 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-523bdf53-394d-42d6-aae5-33dec0206610 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:03.111195 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-523bdf53-394d-42d6-aae5-33dec0206610 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.158879 Jun 17 15:39:03.112249 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 932/2278] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:39:02 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:39:03.410788 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-e5f72c2d-8861-405c-b1b5-2721673a585d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:03.411828 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-e5f72c2d-8861-405c-b1b5-2721673a585d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:03.418700 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e5f72c2d-8861-405c-b1b5-2721673a585d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:03.419522 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e5f72c2d-8861-405c-b1b5-2721673a585d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:03.421486 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e5f72c2d-8861-405c-b1b5-2721673a585d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:03.422687 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e5f72c2d-8861-405c-b1b5-2721673a585d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:03.666103 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-e5f72c2d-8861-405c-b1b5-2721673a585d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:03.688569 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-e5f72c2d-8861-405c-b1b5-2721673a585d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1601 microversion: 2.1 time: 0.282107 Jun 17 15:39:03.689774 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1347/2279] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:39:03 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1601 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:39:03.923724 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-4a143b82-2fa9-43e7-b2ff-87828c1b401e tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:03.924692 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-4a143b82-2fa9-43e7-b2ff-87828c1b401e tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:03.935363 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4a143b82-2fa9-43e7-b2ff-87828c1b401e tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:03.936036 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4a143b82-2fa9-43e7-b2ff-87828c1b401e tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:03.937520 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4a143b82-2fa9-43e7-b2ff-87828c1b401e tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:03.938445 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4a143b82-2fa9-43e7-b2ff-87828c1b401e tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:04.131446 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-094a1e53-b424-4012-bd5b-211da9c59daf tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:04.132610 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-094a1e53-b424-4012-bd5b-211da9c59daf tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:04.139528 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-094a1e53-b424-4012-bd5b-211da9c59daf tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:04.139968 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-094a1e53-b424-4012-bd5b-211da9c59daf tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:04.141526 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-094a1e53-b424-4012-bd5b-211da9c59daf tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:04.142120 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-094a1e53-b424-4012-bd5b-211da9c59daf tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:04.145346 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:39:04.218766 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-094a1e53-b424-4012-bd5b-211da9c59daf tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:04.229560 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-094a1e53-b424-4012-bd5b-211da9c59daf tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:04.231075 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-094a1e53-b424-4012-bd5b-211da9c59daf tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:04.232399 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-094a1e53-b424-4012-bd5b-211da9c59daf tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.105747 Jun 17 15:39:04.233341 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1348/2280] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:39:04 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:39:04.706980 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-4a143b82-2fa9-43e7-b2ff-87828c1b401e tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:04.707572 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-3ad7a71d-a463-475c-845f-ed1a148e5a4d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:04.708046 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-3ad7a71d-a463-475c-845f-ed1a148e5a4d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:04.714504 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3ad7a71d-a463-475c-845f-ed1a148e5a4d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:04.715331 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3ad7a71d-a463-475c-845f-ed1a148e5a4d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:04.716279 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3ad7a71d-a463-475c-845f-ed1a148e5a4d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:04.716899 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3ad7a71d-a463-475c-845f-ed1a148e5a4d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:04.719159 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-4a143b82-2fa9-43e7-b2ff-87828c1b401e tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.800920 Jun 17 15:39:04.730442 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 933/2281] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:39:03 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:39:04.880312 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-3ad7a71d-a463-475c-845f-ed1a148e5a4d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:04.890149 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-3ad7a71d-a463-475c-845f-ed1a148e5a4d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1601 microversion: 2.1 time: 0.186984 Jun 17 15:39:04.890776 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1349/2282] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:39:04 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1601 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:39:05.250465 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-f81a5060-7f91-4341-97d6-89137d089f18 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:05.251080 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-f81a5060-7f91-4341-97d6-89137d089f18 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:05.258184 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f81a5060-7f91-4341-97d6-89137d089f18 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:05.258705 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f81a5060-7f91-4341-97d6-89137d089f18 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:05.259488 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f81a5060-7f91-4341-97d6-89137d089f18 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:05.259914 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f81a5060-7f91-4341-97d6-89137d089f18 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:05.350732 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-f81a5060-7f91-4341-97d6-89137d089f18 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:05.365066 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-f81a5060-7f91-4341-97d6-89137d089f18 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:05.367159 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-f81a5060-7f91-4341-97d6-89137d089f18 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:05.369210 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-f81a5060-7f91-4341-97d6-89137d089f18 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.122656 Jun 17 15:39:05.369872 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 934/2283] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:39:05 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 15:39:05.736466 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-e0f2bed4-7fa0-4644-8843-9d0f820e8523 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:05.737191 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-e0f2bed4-7fa0-4644-8843-9d0f820e8523 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:05.744575 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e0f2bed4-7fa0-4644-8843-9d0f820e8523 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:05.745144 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e0f2bed4-7fa0-4644-8843-9d0f820e8523 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:05.746003 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e0f2bed4-7fa0-4644-8843-9d0f820e8523 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:05.746533 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e0f2bed4-7fa0-4644-8843-9d0f820e8523 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:05.906714 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-e0f2bed4-7fa0-4644-8843-9d0f820e8523 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:05.907303 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-670dcd90-7296-439d-953d-11c70392fd48 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:05.908608 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-670dcd90-7296-439d-953d-11c70392fd48 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:05.918440 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-e0f2bed4-7fa0-4644-8843-9d0f820e8523 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.185949 Jun 17 15:39:05.919464 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1350/2284] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:39:05 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:39:05.930203 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-670dcd90-7296-439d-953d-11c70392fd48 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:05.932451 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-670dcd90-7296-439d-953d-11c70392fd48 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:05.933617 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-670dcd90-7296-439d-953d-11c70392fd48 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:05.934079 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-670dcd90-7296-439d-953d-11c70392fd48 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:05.944065 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:39:06.195689 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-670dcd90-7296-439d-953d-11c70392fd48 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:06.206413 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-670dcd90-7296-439d-953d-11c70392fd48 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1601 microversion: 2.1 time: 0.303020 Jun 17 15:39:06.216832 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 935/2285] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:39:05 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1601 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:39:06.387438 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-02e333fe-7e32-40f2-83c5-e57d4ed01098 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:06.388068 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-02e333fe-7e32-40f2-83c5-e57d4ed01098 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:06.394656 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-02e333fe-7e32-40f2-83c5-e57d4ed01098 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:06.395378 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-02e333fe-7e32-40f2-83c5-e57d4ed01098 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:06.396165 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-02e333fe-7e32-40f2-83c5-e57d4ed01098 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:06.396794 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-02e333fe-7e32-40f2-83c5-e57d4ed01098 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:06.474295 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-02e333fe-7e32-40f2-83c5-e57d4ed01098 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:06.486777 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-02e333fe-7e32-40f2-83c5-e57d4ed01098 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:06.488667 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-02e333fe-7e32-40f2-83c5-e57d4ed01098 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:06.489852 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-02e333fe-7e32-40f2-83c5-e57d4ed01098 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.106648 Jun 17 15:39:06.490414 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1351/2286] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:39:06 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:39:06.939569 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-0dcc4cbe-7b27-4e5a-8e79-c372a6b3848b tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:06.940317 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-0dcc4cbe-7b27-4e5a-8e79-c372a6b3848b tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:06.946884 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0dcc4cbe-7b27-4e5a-8e79-c372a6b3848b tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:06.947436 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0dcc4cbe-7b27-4e5a-8e79-c372a6b3848b tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:06.948093 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0dcc4cbe-7b27-4e5a-8e79-c372a6b3848b tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:06.948561 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0dcc4cbe-7b27-4e5a-8e79-c372a6b3848b tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:07.088295 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-0dcc4cbe-7b27-4e5a-8e79-c372a6b3848b tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:07.097436 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-0dcc4cbe-7b27-4e5a-8e79-c372a6b3848b tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.161707 Jun 17 15:39:07.098023 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 936/2287] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:39:06 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:39:07.223669 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-86fcc877-acd7-4bde-93b9-4b9bed171166 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:07.224425 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-86fcc877-acd7-4bde-93b9-4b9bed171166 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:07.232152 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-86fcc877-acd7-4bde-93b9-4b9bed171166 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:07.232654 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-86fcc877-acd7-4bde-93b9-4b9bed171166 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:07.233499 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-86fcc877-acd7-4bde-93b9-4b9bed171166 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:07.233937 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-86fcc877-acd7-4bde-93b9-4b9bed171166 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:07.381553 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-86fcc877-acd7-4bde-93b9-4b9bed171166 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:07.389817 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-86fcc877-acd7-4bde-93b9-4b9bed171166 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1601 microversion: 2.1 time: 0.170555 Jun 17 15:39:07.390409 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1352/2288] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:39:07 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1601 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:39:07.508725 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-5d55437b-0c32-4a2a-92e6-fe4822be4e16 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:07.509440 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-5d55437b-0c32-4a2a-92e6-fe4822be4e16 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:07.515773 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5d55437b-0c32-4a2a-92e6-fe4822be4e16 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:07.516792 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5d55437b-0c32-4a2a-92e6-fe4822be4e16 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:07.517650 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5d55437b-0c32-4a2a-92e6-fe4822be4e16 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:07.518195 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5d55437b-0c32-4a2a-92e6-fe4822be4e16 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:07.583572 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-5d55437b-0c32-4a2a-92e6-fe4822be4e16 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:07.592546 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-5d55437b-0c32-4a2a-92e6-fe4822be4e16 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:07.594419 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-5d55437b-0c32-4a2a-92e6-fe4822be4e16 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:07.595777 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-5d55437b-0c32-4a2a-92e6-fe4822be4e16 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.091034 Jun 17 15:39:07.596361 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 937/2289] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:39:07 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:39:08.116124 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-593c6f79-9816-4bae-8ca7-84fce027f65b tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:08.116780 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-593c6f79-9816-4bae-8ca7-84fce027f65b tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:08.123577 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-593c6f79-9816-4bae-8ca7-84fce027f65b tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:08.124030 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-593c6f79-9816-4bae-8ca7-84fce027f65b tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:08.124861 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-593c6f79-9816-4bae-8ca7-84fce027f65b tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:08.125981 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-593c6f79-9816-4bae-8ca7-84fce027f65b tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:08.266664 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-593c6f79-9816-4bae-8ca7-84fce027f65b tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:08.274979 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-593c6f79-9816-4bae-8ca7-84fce027f65b tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.162937 Jun 17 15:39:08.275565 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1353/2290] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:39:08 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:39:08.407686 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-197c8835-7744-4a15-aec8-cb2b0b98e27f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:08.408299 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-197c8835-7744-4a15-aec8-cb2b0b98e27f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:08.414945 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-197c8835-7744-4a15-aec8-cb2b0b98e27f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:08.415390 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-197c8835-7744-4a15-aec8-cb2b0b98e27f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:08.416153 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-197c8835-7744-4a15-aec8-cb2b0b98e27f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:08.416609 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-197c8835-7744-4a15-aec8-cb2b0b98e27f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:08.555064 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-197c8835-7744-4a15-aec8-cb2b0b98e27f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:08.563444 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-197c8835-7744-4a15-aec8-cb2b0b98e27f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1601 microversion: 2.1 time: 0.160029 Jun 17 15:39:08.564028 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 938/2291] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:39:08 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1601 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:39:08.614974 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-da3964be-88ec-465d-9cd4-4e358e715e0a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:08.615586 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-da3964be-88ec-465d-9cd4-4e358e715e0a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:08.621900 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-da3964be-88ec-465d-9cd4-4e358e715e0a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:08.622339 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-da3964be-88ec-465d-9cd4-4e358e715e0a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:08.623103 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-da3964be-88ec-465d-9cd4-4e358e715e0a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:08.623534 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-da3964be-88ec-465d-9cd4-4e358e715e0a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:08.689503 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-da3964be-88ec-465d-9cd4-4e358e715e0a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:08.698527 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-da3964be-88ec-465d-9cd4-4e358e715e0a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:08.700065 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-da3964be-88ec-465d-9cd4-4e358e715e0a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:08.701253 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-da3964be-88ec-465d-9cd4-4e358e715e0a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.090434 Jun 17 15:39:08.701813 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1354/2292] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:39:08 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:39:09.292946 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-a4b7a7c6-4388-496a-a9ed-f7e66e40645f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:09.293641 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-a4b7a7c6-4388-496a-a9ed-f7e66e40645f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:09.300582 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a4b7a7c6-4388-496a-a9ed-f7e66e40645f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:09.301041 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a4b7a7c6-4388-496a-a9ed-f7e66e40645f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:09.301797 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a4b7a7c6-4388-496a-a9ed-f7e66e40645f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:09.302227 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a4b7a7c6-4388-496a-a9ed-f7e66e40645f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:09.460024 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-a4b7a7c6-4388-496a-a9ed-f7e66e40645f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:09.468670 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-a4b7a7c6-4388-496a-a9ed-f7e66e40645f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.179564 Jun 17 15:39:09.469966 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 939/2293] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:39:09 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:39:09.581475 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-48d52a9f-4c68-4026-9d35-a85012c9ea01 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:09.582180 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-48d52a9f-4c68-4026-9d35-a85012c9ea01 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:09.589083 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-48d52a9f-4c68-4026-9d35-a85012c9ea01 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:09.589530 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-48d52a9f-4c68-4026-9d35-a85012c9ea01 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:09.590318 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-48d52a9f-4c68-4026-9d35-a85012c9ea01 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:09.590753 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-48d52a9f-4c68-4026-9d35-a85012c9ea01 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:09.721082 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-9b287dff-3b5e-4b3a-b92c-74b453c007b2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:09.721693 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-9b287dff-3b5e-4b3a-b92c-74b453c007b2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:09.728231 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9b287dff-3b5e-4b3a-b92c-74b453c007b2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:09.728717 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9b287dff-3b5e-4b3a-b92c-74b453c007b2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:09.730151 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9b287dff-3b5e-4b3a-b92c-74b453c007b2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:09.730151 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9b287dff-3b5e-4b3a-b92c-74b453c007b2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:09.776671 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-48d52a9f-4c68-4026-9d35-a85012c9ea01 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:09.791846 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-48d52a9f-4c68-4026-9d35-a85012c9ea01 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1601 microversion: 2.1 time: 0.214496 Jun 17 15:39:09.792911 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1355/2294] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:39:09 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1601 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:39:09.799768 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-9b287dff-3b5e-4b3a-b92c-74b453c007b2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:09.809314 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-9b287dff-3b5e-4b3a-b92c-74b453c007b2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:09.810848 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-9b287dff-3b5e-4b3a-b92c-74b453c007b2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:09.812068 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-9b287dff-3b5e-4b3a-b92c-74b453c007b2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.095927 Jun 17 15:39:09.813237 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 940/2295] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:39:09 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:39:10.487473 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-e86f0b63-7de2-4a76-8404-99bb83fe3c39 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:10.488101 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-e86f0b63-7de2-4a76-8404-99bb83fe3c39 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:10.494765 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e86f0b63-7de2-4a76-8404-99bb83fe3c39 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:10.495216 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e86f0b63-7de2-4a76-8404-99bb83fe3c39 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:10.496022 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e86f0b63-7de2-4a76-8404-99bb83fe3c39 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:10.496499 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e86f0b63-7de2-4a76-8404-99bb83fe3c39 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:10.647804 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-e86f0b63-7de2-4a76-8404-99bb83fe3c39 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:10.657293 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-e86f0b63-7de2-4a76-8404-99bb83fe3c39 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.174334 Jun 17 15:39:10.657890 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1356/2296] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:39:10 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:39:10.810287 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-29da3384-616c-4aed-b882-cbeaf0c55556 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:10.811007 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-29da3384-616c-4aed-b882-cbeaf0c55556 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:10.817903 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-29da3384-616c-4aed-b882-cbeaf0c55556 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:10.818345 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-29da3384-616c-4aed-b882-cbeaf0c55556 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:10.819106 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-29da3384-616c-4aed-b882-cbeaf0c55556 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:10.819537 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-29da3384-616c-4aed-b882-cbeaf0c55556 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:10.832841 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-5f8c779d-23be-4564-aa8a-4e683a205f8d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:10.833892 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-5f8c779d-23be-4564-aa8a-4e683a205f8d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:10.840689 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5f8c779d-23be-4564-aa8a-4e683a205f8d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:10.841144 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5f8c779d-23be-4564-aa8a-4e683a205f8d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:10.841954 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5f8c779d-23be-4564-aa8a-4e683a205f8d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:10.842388 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5f8c779d-23be-4564-aa8a-4e683a205f8d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:10.910190 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-5f8c779d-23be-4564-aa8a-4e683a205f8d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:10.920132 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-5f8c779d-23be-4564-aa8a-4e683a205f8d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:10.921767 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-5f8c779d-23be-4564-aa8a-4e683a205f8d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:10.923061 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-5f8c779d-23be-4564-aa8a-4e683a205f8d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.096088 Jun 17 15:39:10.923657 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1357/2297] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:39:10 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:39:10.962300 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-29da3384-616c-4aed-b882-cbeaf0c55556 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:10.971407 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-29da3384-616c-4aed-b882-cbeaf0c55556 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1601 microversion: 2.1 time: 0.164917 Jun 17 15:39:10.971997 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 941/2298] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:39:10 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1601 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:39:11.674915 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-fcd376e8-5417-41d3-9de7-bb76c77836b0 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:11.675563 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-fcd376e8-5417-41d3-9de7-bb76c77836b0 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:11.682576 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fcd376e8-5417-41d3-9de7-bb76c77836b0 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:11.683038 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fcd376e8-5417-41d3-9de7-bb76c77836b0 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:11.683817 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fcd376e8-5417-41d3-9de7-bb76c77836b0 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:11.684252 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fcd376e8-5417-41d3-9de7-bb76c77836b0 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:11.834267 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-fcd376e8-5417-41d3-9de7-bb76c77836b0 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:11.843852 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-fcd376e8-5417-41d3-9de7-bb76c77836b0 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.173429 Jun 17 15:39:11.844491 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1358/2299] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:39:11 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:39:11.942489 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-6d3d354f-9366-4ff1-8182-616da29ae39f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:11.943070 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-6d3d354f-9366-4ff1-8182-616da29ae39f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:11.949800 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6d3d354f-9366-4ff1-8182-616da29ae39f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:11.950231 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6d3d354f-9366-4ff1-8182-616da29ae39f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:11.951003 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6d3d354f-9366-4ff1-8182-616da29ae39f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:11.951730 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6d3d354f-9366-4ff1-8182-616da29ae39f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:11.990185 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-da610a68-6fd1-4d8a-80ca-fcd68d154ec4 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:11.990707 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-da610a68-6fd1-4d8a-80ca-fcd68d154ec4 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:11.997638 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-da610a68-6fd1-4d8a-80ca-fcd68d154ec4 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:11.997898 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-da610a68-6fd1-4d8a-80ca-fcd68d154ec4 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:11.998730 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-da610a68-6fd1-4d8a-80ca-fcd68d154ec4 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:11.999183 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-da610a68-6fd1-4d8a-80ca-fcd68d154ec4 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:12.022997 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-6d3d354f-9366-4ff1-8182-616da29ae39f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:12.036935 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-6d3d354f-9366-4ff1-8182-616da29ae39f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:12.039382 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-6d3d354f-9366-4ff1-8182-616da29ae39f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:12.041195 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-6d3d354f-9366-4ff1-8182-616da29ae39f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.102669 Jun 17 15:39:12.041815 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 942/2300] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:39:11 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 15:39:12.145326 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-da610a68-6fd1-4d8a-80ca-fcd68d154ec4 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:12.159914 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-da610a68-6fd1-4d8a-80ca-fcd68d154ec4 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1601 microversion: 2.1 time: 0.173501 Jun 17 15:39:12.160609 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1359/2301] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:39:11 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1601 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:39:12.862189 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-576b297f-f9c4-4195-9251-4b6b5579dac8 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:12.862820 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-576b297f-f9c4-4195-9251-4b6b5579dac8 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:12.869967 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-576b297f-f9c4-4195-9251-4b6b5579dac8 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:12.870608 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-576b297f-f9c4-4195-9251-4b6b5579dac8 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:12.871743 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-576b297f-f9c4-4195-9251-4b6b5579dac8 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:12.872394 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-576b297f-f9c4-4195-9251-4b6b5579dac8 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:13.024755 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-576b297f-f9c4-4195-9251-4b6b5579dac8 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:13.033844 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-576b297f-f9c4-4195-9251-4b6b5579dac8 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.175682 Jun 17 15:39:13.034446 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 943/2302] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:39:12 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:39:13.060170 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-623375c5-e165-4fa8-8438-400723522150 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:13.060975 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-623375c5-e165-4fa8-8438-400723522150 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:13.068274 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-623375c5-e165-4fa8-8438-400723522150 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:13.068779 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-623375c5-e165-4fa8-8438-400723522150 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:13.069589 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-623375c5-e165-4fa8-8438-400723522150 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:13.070020 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-623375c5-e165-4fa8-8438-400723522150 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:13.137848 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-623375c5-e165-4fa8-8438-400723522150 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:13.147080 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-623375c5-e165-4fa8-8438-400723522150 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:13.148729 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-623375c5-e165-4fa8-8438-400723522150 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:13.150064 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-623375c5-e165-4fa8-8438-400723522150 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.093876 Jun 17 15:39:13.150695 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1360/2303] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:39:13 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:39:13.178604 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-0ee5aaea-6269-42ca-9122-1be5ab0838d9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:13.179547 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-0ee5aaea-6269-42ca-9122-1be5ab0838d9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:13.189637 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0ee5aaea-6269-42ca-9122-1be5ab0838d9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:13.190314 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0ee5aaea-6269-42ca-9122-1be5ab0838d9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:13.191486 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0ee5aaea-6269-42ca-9122-1be5ab0838d9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:13.192142 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0ee5aaea-6269-42ca-9122-1be5ab0838d9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:13.344896 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-0ee5aaea-6269-42ca-9122-1be5ab0838d9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:13.355021 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-0ee5aaea-6269-42ca-9122-1be5ab0838d9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1601 microversion: 2.1 time: 0.181126 Jun 17 15:39:13.355801 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 944/2304] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:39:13 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1601 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:39:14.051533 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-bf851e52-eb91-498c-b83d-deb1785fe0e6 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:14.052064 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-bf851e52-eb91-498c-b83d-deb1785fe0e6 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:14.054138 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=2 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:39:14.059876 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bf851e52-eb91-498c-b83d-deb1785fe0e6 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:14.060316 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bf851e52-eb91-498c-b83d-deb1785fe0e6 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:14.061099 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bf851e52-eb91-498c-b83d-deb1785fe0e6 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:14.061533 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bf851e52-eb91-498c-b83d-deb1785fe0e6 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:14.171952 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-8e6b01cb-1af2-4d67-a9ad-6f07d740afd4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:14.173283 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-8e6b01cb-1af2-4d67-a9ad-6f07d740afd4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:14.182780 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8e6b01cb-1af2-4d67-a9ad-6f07d740afd4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:14.183227 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8e6b01cb-1af2-4d67-a9ad-6f07d740afd4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:14.184000 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8e6b01cb-1af2-4d67-a9ad-6f07d740afd4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:14.184472 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8e6b01cb-1af2-4d67-a9ad-6f07d740afd4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:14.224182 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-bf851e52-eb91-498c-b83d-deb1785fe0e6 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:14.234256 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-bf851e52-eb91-498c-b83d-deb1785fe0e6 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.186709 Jun 17 15:39:14.235137 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1361/2305] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:39:14 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:39:14.262406 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-8e6b01cb-1af2-4d67-a9ad-6f07d740afd4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:14.271874 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-8e6b01cb-1af2-4d67-a9ad-6f07d740afd4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:14.273418 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-8e6b01cb-1af2-4d67-a9ad-6f07d740afd4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:14.274601 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-8e6b01cb-1af2-4d67-a9ad-6f07d740afd4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.109298 Jun 17 15:39:14.275176 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 945/2306] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:39:14 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:39:14.373596 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-d23ddf3e-25be-49a0-9264-8c61b8b34b1c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:14.374396 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-d23ddf3e-25be-49a0-9264-8c61b8b34b1c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:14.383542 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d23ddf3e-25be-49a0-9264-8c61b8b34b1c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:14.384153 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d23ddf3e-25be-49a0-9264-8c61b8b34b1c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:14.385130 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d23ddf3e-25be-49a0-9264-8c61b8b34b1c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:14.385713 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d23ddf3e-25be-49a0-9264-8c61b8b34b1c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:14.544430 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-d23ddf3e-25be-49a0-9264-8c61b8b34b1c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:14.553058 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-d23ddf3e-25be-49a0-9264-8c61b8b34b1c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1601 microversion: 2.1 time: 0.183691 Jun 17 15:39:14.553547 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1362/2307] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:39:14 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1601 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:39:15.251423 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-94469469-5ef8-4e11-a2d0-439854c09bd0 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:15.252150 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-94469469-5ef8-4e11-a2d0-439854c09bd0 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:15.259138 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-94469469-5ef8-4e11-a2d0-439854c09bd0 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:15.259581 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-94469469-5ef8-4e11-a2d0-439854c09bd0 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:15.260378 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-94469469-5ef8-4e11-a2d0-439854c09bd0 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:15.260811 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-94469469-5ef8-4e11-a2d0-439854c09bd0 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:15.293926 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-4cab79b2-0905-403e-be9d-0f2139a8e39e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:15.295039 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-4cab79b2-0905-403e-be9d-0f2139a8e39e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:15.302286 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4cab79b2-0905-403e-be9d-0f2139a8e39e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:15.302830 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4cab79b2-0905-403e-be9d-0f2139a8e39e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:15.303688 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4cab79b2-0905-403e-be9d-0f2139a8e39e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:15.304124 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4cab79b2-0905-403e-be9d-0f2139a8e39e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:15.380859 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-4cab79b2-0905-403e-be9d-0f2139a8e39e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:15.389877 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-4cab79b2-0905-403e-be9d-0f2139a8e39e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:15.392021 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-4cab79b2-0905-403e-be9d-0f2139a8e39e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:15.393150 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-4cab79b2-0905-403e-be9d-0f2139a8e39e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.103746 Jun 17 15:39:15.393710 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1363/2308] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:39:15 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 15:39:15.415283 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-94469469-5ef8-4e11-a2d0-439854c09bd0 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:15.423560 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-94469469-5ef8-4e11-a2d0-439854c09bd0 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.176241 Jun 17 15:39:15.424137 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 946/2309] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:39:15 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:39:15.570522 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-fced3bcf-4551-40a9-8bbf-7d11574057b5 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:15.571083 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-fced3bcf-4551-40a9-8bbf-7d11574057b5 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:15.579369 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fced3bcf-4551-40a9-8bbf-7d11574057b5 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:15.579819 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fced3bcf-4551-40a9-8bbf-7d11574057b5 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:15.580635 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fced3bcf-4551-40a9-8bbf-7d11574057b5 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:15.581111 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fced3bcf-4551-40a9-8bbf-7d11574057b5 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:15.731793 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-fced3bcf-4551-40a9-8bbf-7d11574057b5 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:15.734161 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=100 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:39:15.741660 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-fced3bcf-4551-40a9-8bbf-7d11574057b5 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1601 microversion: 2.1 time: 0.175142 Jun 17 15:39:15.742255 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1364/2310] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:39:15 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1601 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:39:16.411901 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-ee5104bf-e6a7-4367-a5c3-a048b03482e6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:16.412539 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-ee5104bf-e6a7-4367-a5c3-a048b03482e6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:16.419019 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ee5104bf-e6a7-4367-a5c3-a048b03482e6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:16.419460 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ee5104bf-e6a7-4367-a5c3-a048b03482e6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:16.420251 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ee5104bf-e6a7-4367-a5c3-a048b03482e6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:16.420708 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ee5104bf-e6a7-4367-a5c3-a048b03482e6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:16.442804 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-9b3e6d06-81a9-4a3f-a241-e524f9f92f26 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:16.444233 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-9b3e6d06-81a9-4a3f-a241-e524f9f92f26 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:16.451933 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9b3e6d06-81a9-4a3f-a241-e524f9f92f26 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:16.452280 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9b3e6d06-81a9-4a3f-a241-e524f9f92f26 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:16.453369 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9b3e6d06-81a9-4a3f-a241-e524f9f92f26 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:16.454359 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9b3e6d06-81a9-4a3f-a241-e524f9f92f26 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:16.491745 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-ee5104bf-e6a7-4367-a5c3-a048b03482e6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:16.503137 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-ee5104bf-e6a7-4367-a5c3-a048b03482e6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:16.504680 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-ee5104bf-e6a7-4367-a5c3-a048b03482e6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:16.505905 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-ee5104bf-e6a7-4367-a5c3-a048b03482e6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.098132 Jun 17 15:39:16.506469 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 947/2311] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:39:16 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:39:16.599775 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-9b3e6d06-81a9-4a3f-a241-e524f9f92f26 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:16.608056 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-9b3e6d06-81a9-4a3f-a241-e524f9f92f26 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.170987 Jun 17 15:39:16.608652 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1365/2312] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:39:16 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:39:16.759471 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-a270103e-fcf9-4e2e-934a-4daffb30ada0 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:16.759995 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-a270103e-fcf9-4e2e-934a-4daffb30ada0 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:16.766694 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a270103e-fcf9-4e2e-934a-4daffb30ada0 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:16.767141 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a270103e-fcf9-4e2e-934a-4daffb30ada0 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:16.767891 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a270103e-fcf9-4e2e-934a-4daffb30ada0 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:16.768320 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a270103e-fcf9-4e2e-934a-4daffb30ada0 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:16.912946 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-a270103e-fcf9-4e2e-934a-4daffb30ada0 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:16.921052 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-a270103e-fcf9-4e2e-934a-4daffb30ada0 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1601 microversion: 2.1 time: 0.165675 Jun 17 15:39:16.921625 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 948/2313] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:39:16 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1601 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:39:17.524018 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-5b6cf005-3ac2-4bee-8783-86f5465b8d8a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:17.524646 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-5b6cf005-3ac2-4bee-8783-86f5465b8d8a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:17.531125 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5b6cf005-3ac2-4bee-8783-86f5465b8d8a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:17.531562 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5b6cf005-3ac2-4bee-8783-86f5465b8d8a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:17.532337 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5b6cf005-3ac2-4bee-8783-86f5465b8d8a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:17.532780 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5b6cf005-3ac2-4bee-8783-86f5465b8d8a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:17.599486 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-5b6cf005-3ac2-4bee-8783-86f5465b8d8a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:17.609031 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-5b6cf005-3ac2-4bee-8783-86f5465b8d8a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:17.611032 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-5b6cf005-3ac2-4bee-8783-86f5465b8d8a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:17.612180 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-5b6cf005-3ac2-4bee-8783-86f5465b8d8a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.092222 Jun 17 15:39:17.612782 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1366/2314] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:39:17 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:39:17.627077 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-0848e29d-c4bc-4aab-afb0-e15f7bdddb83 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:17.627672 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-0848e29d-c4bc-4aab-afb0-e15f7bdddb83 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:17.630209 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_api:SELECT=71,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:39:17.635935 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0848e29d-c4bc-4aab-afb0-e15f7bdddb83 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:17.636413 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0848e29d-c4bc-4aab-afb0-e15f7bdddb83 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:17.637195 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0848e29d-c4bc-4aab-afb0-e15f7bdddb83 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:17.637623 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0848e29d-c4bc-4aab-afb0-e15f7bdddb83 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:17.770973 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-0848e29d-c4bc-4aab-afb0-e15f7bdddb83 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:17.779185 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-0848e29d-c4bc-4aab-afb0-e15f7bdddb83 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.156483 Jun 17 15:39:17.779682 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 949/2315] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:39:17 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:39:17.939411 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-3f6ec5bf-e870-4fbc-be2a-e4cb91ffac16 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:17.940021 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-3f6ec5bf-e870-4fbc-be2a-e4cb91ffac16 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:17.947264 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3f6ec5bf-e870-4fbc-be2a-e4cb91ffac16 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:17.947705 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3f6ec5bf-e870-4fbc-be2a-e4cb91ffac16 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:17.948500 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3f6ec5bf-e870-4fbc-be2a-e4cb91ffac16 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:17.948933 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3f6ec5bf-e870-4fbc-be2a-e4cb91ffac16 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:18.085933 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-3f6ec5bf-e870-4fbc-be2a-e4cb91ffac16 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:18.094789 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-3f6ec5bf-e870-4fbc-be2a-e4cb91ffac16 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1601 microversion: 2.1 time: 0.159706 Jun 17 15:39:18.095406 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1367/2316] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:39:17 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1601 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:39:18.631759 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-95d9624d-526f-4323-88ab-e9a9ead39044 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:18.632295 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-95d9624d-526f-4323-88ab-e9a9ead39044 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:18.638884 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-95d9624d-526f-4323-88ab-e9a9ead39044 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:18.639322 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-95d9624d-526f-4323-88ab-e9a9ead39044 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:18.640103 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-95d9624d-526f-4323-88ab-e9a9ead39044 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:18.640555 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-95d9624d-526f-4323-88ab-e9a9ead39044 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:18.703896 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-95d9624d-526f-4323-88ab-e9a9ead39044 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:18.712185 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-95d9624d-526f-4323-88ab-e9a9ead39044 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:18.713702 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-95d9624d-526f-4323-88ab-e9a9ead39044 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:18.714821 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-95d9624d-526f-4323-88ab-e9a9ead39044 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.087107 Jun 17 15:39:18.715377 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 950/2317] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:39:18 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:39:18.795160 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-ab587b2b-ae8e-41c4-ba2a-65b7e8e72cf2 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:18.795775 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-ab587b2b-ae8e-41c4-ba2a-65b7e8e72cf2 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:18.802455 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ab587b2b-ae8e-41c4-ba2a-65b7e8e72cf2 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:18.802908 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ab587b2b-ae8e-41c4-ba2a-65b7e8e72cf2 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:18.803664 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ab587b2b-ae8e-41c4-ba2a-65b7e8e72cf2 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:18.804095 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ab587b2b-ae8e-41c4-ba2a-65b7e8e72cf2 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:18.935476 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-ab587b2b-ae8e-41c4-ba2a-65b7e8e72cf2 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:18.944264 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-ab587b2b-ae8e-41c4-ba2a-65b7e8e72cf2 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.152966 Jun 17 15:39:18.944880 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1368/2318] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:39:18 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:39:19.113166 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-ba8fd3b9-6fb4-47d3-9266-ed5bc0701123 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:19.113793 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-ba8fd3b9-6fb4-47d3-9266-ed5bc0701123 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:19.119930 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ba8fd3b9-6fb4-47d3-9266-ed5bc0701123 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:19.120411 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ba8fd3b9-6fb4-47d3-9266-ed5bc0701123 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:19.121186 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ba8fd3b9-6fb4-47d3-9266-ed5bc0701123 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:19.121621 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ba8fd3b9-6fb4-47d3-9266-ed5bc0701123 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:19.260233 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-ba8fd3b9-6fb4-47d3-9266-ed5bc0701123 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:19.262463 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell1:SELECT=100 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:39:19.272108 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-ba8fd3b9-6fb4-47d3-9266-ed5bc0701123 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1601 microversion: 2.1 time: 0.163291 Jun 17 15:39:19.273074 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 951/2319] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:39:19 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1601 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:39:19.732586 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-e2437741-6a10-4f79-a9f3-db29865af387 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:19.733205 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-e2437741-6a10-4f79-a9f3-db29865af387 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:19.739907 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e2437741-6a10-4f79-a9f3-db29865af387 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:19.740385 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e2437741-6a10-4f79-a9f3-db29865af387 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:19.741164 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e2437741-6a10-4f79-a9f3-db29865af387 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:19.741594 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e2437741-6a10-4f79-a9f3-db29865af387 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:19.806801 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-e2437741-6a10-4f79-a9f3-db29865af387 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:19.815909 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-e2437741-6a10-4f79-a9f3-db29865af387 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:19.817435 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-e2437741-6a10-4f79-a9f3-db29865af387 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:19.818567 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-e2437741-6a10-4f79-a9f3-db29865af387 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.089936 Jun 17 15:39:19.819123 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1369/2320] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:39:19 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:39:19.963920 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-9b8ddb89-becf-41ab-a4f9-3dea64d11ae4 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:19.964524 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-9b8ddb89-becf-41ab-a4f9-3dea64d11ae4 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:19.970953 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9b8ddb89-becf-41ab-a4f9-3dea64d11ae4 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:19.971394 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9b8ddb89-becf-41ab-a4f9-3dea64d11ae4 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:19.972152 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9b8ddb89-becf-41ab-a4f9-3dea64d11ae4 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:19.972616 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9b8ddb89-becf-41ab-a4f9-3dea64d11ae4 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:20.111529 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-9b8ddb89-becf-41ab-a4f9-3dea64d11ae4 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:20.120055 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-9b8ddb89-becf-41ab-a4f9-3dea64d11ae4 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.160189 Jun 17 15:39:20.120672 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 952/2321] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:39:19 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:39:20.289747 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-43fd3980-dddd-4b6e-a431-81467ddeab04 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:20.290266 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-43fd3980-dddd-4b6e-a431-81467ddeab04 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:20.296590 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-43fd3980-dddd-4b6e-a431-81467ddeab04 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:20.297758 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-43fd3980-dddd-4b6e-a431-81467ddeab04 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:20.298542 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-43fd3980-dddd-4b6e-a431-81467ddeab04 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:20.298975 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-43fd3980-dddd-4b6e-a431-81467ddeab04 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:20.431284 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-43fd3980-dddd-4b6e-a431-81467ddeab04 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:20.440146 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-43fd3980-dddd-4b6e-a431-81467ddeab04 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1601 microversion: 2.1 time: 0.154369 Jun 17 15:39:20.440768 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1370/2322] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:39:20 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1601 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:39:20.836719 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-4d5938db-92a3-4404-9030-f8a02753840f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:20.837492 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-4d5938db-92a3-4404-9030-f8a02753840f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:20.843535 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4d5938db-92a3-4404-9030-f8a02753840f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:20.844647 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4d5938db-92a3-4404-9030-f8a02753840f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:20.845408 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4d5938db-92a3-4404-9030-f8a02753840f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:20.845839 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4d5938db-92a3-4404-9030-f8a02753840f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:20.907159 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-4d5938db-92a3-4404-9030-f8a02753840f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:20.915862 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-4d5938db-92a3-4404-9030-f8a02753840f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:20.917379 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-4d5938db-92a3-4404-9030-f8a02753840f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:20.918522 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-4d5938db-92a3-4404-9030-f8a02753840f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.085726 Jun 17 15:39:20.919076 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 953/2323] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:39:20 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:39:21.139109 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-4ea2d198-ee5f-4d7c-b367-8526be9a8670 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:21.139726 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-4ea2d198-ee5f-4d7c-b367-8526be9a8670 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:21.147001 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4ea2d198-ee5f-4d7c-b367-8526be9a8670 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:21.147444 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4ea2d198-ee5f-4d7c-b367-8526be9a8670 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:21.148198 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4ea2d198-ee5f-4d7c-b367-8526be9a8670 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:21.148650 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4ea2d198-ee5f-4d7c-b367-8526be9a8670 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:21.278860 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-4ea2d198-ee5f-4d7c-b367-8526be9a8670 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:21.286767 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-4ea2d198-ee5f-4d7c-b367-8526be9a8670 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.151598 Jun 17 15:39:21.287324 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1371/2324] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:39:21 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:39:21.456946 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-9682bdbb-4bcf-4cd9-a14c-64ada9986c61 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:21.457482 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-9682bdbb-4bcf-4cd9-a14c-64ada9986c61 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:21.464052 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9682bdbb-4bcf-4cd9-a14c-64ada9986c61 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:21.464545 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9682bdbb-4bcf-4cd9-a14c-64ada9986c61 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:21.465299 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9682bdbb-4bcf-4cd9-a14c-64ada9986c61 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:21.465730 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9682bdbb-4bcf-4cd9-a14c-64ada9986c61 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:21.596938 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-9682bdbb-4bcf-4cd9-a14c-64ada9986c61 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:21.605217 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-9682bdbb-4bcf-4cd9-a14c-64ada9986c61 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1601 microversion: 2.1 time: 0.152192 Jun 17 15:39:21.605794 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 954/2325] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:39:21 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1601 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:39:21.936812 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-8cad597a-56f5-46a8-8087-423723724ba5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:21.937438 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-8cad597a-56f5-46a8-8087-423723724ba5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:21.943633 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8cad597a-56f5-46a8-8087-423723724ba5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:21.944074 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8cad597a-56f5-46a8-8087-423723724ba5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:21.944871 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8cad597a-56f5-46a8-8087-423723724ba5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:21.945333 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8cad597a-56f5-46a8-8087-423723724ba5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:22.012534 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-8cad597a-56f5-46a8-8087-423723724ba5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:22.022262 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-8cad597a-56f5-46a8-8087-423723724ba5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:22.023866 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-8cad597a-56f5-46a8-8087-423723724ba5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:22.025009 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-8cad597a-56f5-46a8-8087-423723724ba5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.092341 Jun 17 15:39:22.025568 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1372/2326] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:39:21 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:39:22.304250 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-14e3924e-f7cd-4d90-9cd0-e9c2bb01e26d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:22.304805 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-14e3924e-f7cd-4d90-9cd0-e9c2bb01e26d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:22.311048 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-14e3924e-f7cd-4d90-9cd0-e9c2bb01e26d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:22.311533 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-14e3924e-f7cd-4d90-9cd0-e9c2bb01e26d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:22.312508 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-14e3924e-f7cd-4d90-9cd0-e9c2bb01e26d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:22.313043 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-14e3924e-f7cd-4d90-9cd0-e9c2bb01e26d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:22.449586 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-14e3924e-f7cd-4d90-9cd0-e9c2bb01e26d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:22.458229 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-14e3924e-f7cd-4d90-9cd0-e9c2bb01e26d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.157915 Jun 17 15:39:22.458855 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 955/2327] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:39:22 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:39:22.622391 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-b35607b6-2b5b-4e2d-9270-74e46a5e9093 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:22.623015 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-b35607b6-2b5b-4e2d-9270-74e46a5e9093 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:22.630233 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b35607b6-2b5b-4e2d-9270-74e46a5e9093 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:22.630698 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b35607b6-2b5b-4e2d-9270-74e46a5e9093 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:22.631488 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b35607b6-2b5b-4e2d-9270-74e46a5e9093 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:22.631917 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b35607b6-2b5b-4e2d-9270-74e46a5e9093 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:22.782067 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-b35607b6-2b5b-4e2d-9270-74e46a5e9093 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:22.790246 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-b35607b6-2b5b-4e2d-9270-74e46a5e9093 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1601 microversion: 2.1 time: 0.171757 Jun 17 15:39:22.790826 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1373/2328] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:39:22 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1601 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:39:23.043715 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-8028c6a0-3f9c-46f8-89db-7bde80c7e9ff tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:23.044267 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-8028c6a0-3f9c-46f8-89db-7bde80c7e9ff tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:23.051281 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8028c6a0-3f9c-46f8-89db-7bde80c7e9ff tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:23.051744 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8028c6a0-3f9c-46f8-89db-7bde80c7e9ff tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:23.052514 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8028c6a0-3f9c-46f8-89db-7bde80c7e9ff tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:23.052945 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8028c6a0-3f9c-46f8-89db-7bde80c7e9ff tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:23.116182 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-8028c6a0-3f9c-46f8-89db-7bde80c7e9ff tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:23.124877 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-8028c6a0-3f9c-46f8-89db-7bde80c7e9ff tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:23.126366 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-8028c6a0-3f9c-46f8-89db-7bde80c7e9ff tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:23.127491 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-8028c6a0-3f9c-46f8-89db-7bde80c7e9ff tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.087779 Jun 17 15:39:23.128042 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 956/2329] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:39:23 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:39:23.477176 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-b21a8be9-44a1-4b82-a12b-68ef68f308f6 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:23.478093 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-b21a8be9-44a1-4b82-a12b-68ef68f308f6 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:23.484571 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b21a8be9-44a1-4b82-a12b-68ef68f308f6 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:23.485018 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b21a8be9-44a1-4b82-a12b-68ef68f308f6 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:23.485781 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b21a8be9-44a1-4b82-a12b-68ef68f308f6 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:23.486217 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b21a8be9-44a1-4b82-a12b-68ef68f308f6 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:23.617013 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-b21a8be9-44a1-4b82-a12b-68ef68f308f6 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:23.626008 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-b21a8be9-44a1-4b82-a12b-68ef68f308f6 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.153183 Jun 17 15:39:23.626751 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1374/2330] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:39:23 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:39:23.808020 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-1fc9b6ed-0b75-40f4-8d30-afd38dc711d6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:23.808649 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-1fc9b6ed-0b75-40f4-8d30-afd38dc711d6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:23.815923 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1fc9b6ed-0b75-40f4-8d30-afd38dc711d6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:23.816405 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1fc9b6ed-0b75-40f4-8d30-afd38dc711d6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:23.817172 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1fc9b6ed-0b75-40f4-8d30-afd38dc711d6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:23.817635 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1fc9b6ed-0b75-40f4-8d30-afd38dc711d6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:23.965196 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-1fc9b6ed-0b75-40f4-8d30-afd38dc711d6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:23.975931 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-1fc9b6ed-0b75-40f4-8d30-afd38dc711d6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1601 microversion: 2.1 time: 0.171276 Jun 17 15:39:23.976830 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 957/2331] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:39:23 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1601 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:39:24.146044 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-d8125aad-a8ea-42b4-b3da-767f83e0d1ed tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:24.146658 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-d8125aad-a8ea-42b4-b3da-767f83e0d1ed tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:24.153281 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d8125aad-a8ea-42b4-b3da-767f83e0d1ed tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:24.153732 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d8125aad-a8ea-42b4-b3da-767f83e0d1ed tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:24.154498 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d8125aad-a8ea-42b4-b3da-767f83e0d1ed tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:24.154982 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d8125aad-a8ea-42b4-b3da-767f83e0d1ed tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:24.223736 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-d8125aad-a8ea-42b4-b3da-767f83e0d1ed tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:24.233084 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-d8125aad-a8ea-42b4-b3da-767f83e0d1ed tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:24.235581 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-d8125aad-a8ea-42b4-b3da-767f83e0d1ed tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:24.237283 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-d8125aad-a8ea-42b4-b3da-767f83e0d1ed tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.095845 Jun 17 15:39:24.237844 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1375/2332] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:39:24 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:39:24.643281 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-45003b53-2ccc-4b9a-b7b7-2c205a9882f9 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:24.643898 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-45003b53-2ccc-4b9a-b7b7-2c205a9882f9 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:24.650666 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-45003b53-2ccc-4b9a-b7b7-2c205a9882f9 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:24.651272 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-45003b53-2ccc-4b9a-b7b7-2c205a9882f9 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:24.652044 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-45003b53-2ccc-4b9a-b7b7-2c205a9882f9 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:24.652512 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-45003b53-2ccc-4b9a-b7b7-2c205a9882f9 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:24.785641 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-45003b53-2ccc-4b9a-b7b7-2c205a9882f9 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:24.793816 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-45003b53-2ccc-4b9a-b7b7-2c205a9882f9 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.154386 Jun 17 15:39:24.794399 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 958/2333] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:39:24 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:39:24.996746 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-8c96887e-45c5-43cc-afc8-3777f65f05c8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:24.997336 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-8c96887e-45c5-43cc-afc8-3777f65f05c8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:25.003492 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8c96887e-45c5-43cc-afc8-3777f65f05c8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:25.003935 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8c96887e-45c5-43cc-afc8-3777f65f05c8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:25.004731 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8c96887e-45c5-43cc-afc8-3777f65f05c8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:25.005158 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8c96887e-45c5-43cc-afc8-3777f65f05c8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:25.138549 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-8c96887e-45c5-43cc-afc8-3777f65f05c8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:25.147466 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-8c96887e-45c5-43cc-afc8-3777f65f05c8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1601 microversion: 2.1 time: 0.154874 Jun 17 15:39:25.148079 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1376/2334] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:39:24 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1601 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:39:25.256087 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-0f0fb28c-912e-455e-a5a5-cbe65f261817 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:25.256656 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-0f0fb28c-912e-455e-a5a5-cbe65f261817 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:25.262892 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0f0fb28c-912e-455e-a5a5-cbe65f261817 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:25.263344 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0f0fb28c-912e-455e-a5a5-cbe65f261817 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:25.264108 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0f0fb28c-912e-455e-a5a5-cbe65f261817 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:25.264576 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0f0fb28c-912e-455e-a5a5-cbe65f261817 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:25.332030 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-0f0fb28c-912e-455e-a5a5-cbe65f261817 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:25.344798 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-0f0fb28c-912e-455e-a5a5-cbe65f261817 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:25.346308 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-0f0fb28c-912e-455e-a5a5-cbe65f261817 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:25.347477 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-0f0fb28c-912e-455e-a5a5-cbe65f261817 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.095713 Jun 17 15:39:25.348039 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 959/2335] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:39:25 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:39:25.811675 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-a61c5b8b-20b4-43b9-b244-1f6233a5cfe3 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:25.812287 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-a61c5b8b-20b4-43b9-b244-1f6233a5cfe3 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:25.819129 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a61c5b8b-20b4-43b9-b244-1f6233a5cfe3 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:25.819572 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a61c5b8b-20b4-43b9-b244-1f6233a5cfe3 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:25.820344 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a61c5b8b-20b4-43b9-b244-1f6233a5cfe3 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:25.820777 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a61c5b8b-20b4-43b9-b244-1f6233a5cfe3 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:25.960621 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-a61c5b8b-20b4-43b9-b244-1f6233a5cfe3 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:25.969130 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-a61c5b8b-20b4-43b9-b244-1f6233a5cfe3 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.161756 Jun 17 15:39:25.969780 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1377/2336] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:39:25 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:39:26.165053 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-6299ca06-5663-46d5-ad49-491214f6a0fc tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:26.165585 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-6299ca06-5663-46d5-ad49-491214f6a0fc tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:26.172296 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6299ca06-5663-46d5-ad49-491214f6a0fc tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:26.172296 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6299ca06-5663-46d5-ad49-491214f6a0fc tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:26.174606 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6299ca06-5663-46d5-ad49-491214f6a0fc tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:26.174606 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6299ca06-5663-46d5-ad49-491214f6a0fc tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:26.308583 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-6299ca06-5663-46d5-ad49-491214f6a0fc tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:26.318651 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-6299ca06-5663-46d5-ad49-491214f6a0fc tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1601 microversion: 2.1 time: 0.157583 Jun 17 15:39:26.319227 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 960/2337] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:39:26 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1601 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:39:26.366764 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-e1368370-802b-40a8-8568-06fcbbc5061f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:26.367372 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-e1368370-802b-40a8-8568-06fcbbc5061f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:26.373660 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e1368370-802b-40a8-8568-06fcbbc5061f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:26.374111 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e1368370-802b-40a8-8568-06fcbbc5061f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:26.374898 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e1368370-802b-40a8-8568-06fcbbc5061f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:26.375325 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e1368370-802b-40a8-8568-06fcbbc5061f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:26.442756 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-e1368370-802b-40a8-8568-06fcbbc5061f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:26.451478 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-e1368370-802b-40a8-8568-06fcbbc5061f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:26.453036 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-e1368370-802b-40a8-8568-06fcbbc5061f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:26.454421 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-e1368370-802b-40a8-8568-06fcbbc5061f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.091545 Jun 17 15:39:26.455490 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1378/2338] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:39:26 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:39:26.987356 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-0b7c2b80-c9ec-4ad7-96de-0a6c11836625 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:26.987964 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-0b7c2b80-c9ec-4ad7-96de-0a6c11836625 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:26.993989 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0b7c2b80-c9ec-4ad7-96de-0a6c11836625 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:26.994435 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0b7c2b80-c9ec-4ad7-96de-0a6c11836625 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:26.995190 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0b7c2b80-c9ec-4ad7-96de-0a6c11836625 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:26.995623 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0b7c2b80-c9ec-4ad7-96de-0a6c11836625 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:27.122651 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-0b7c2b80-c9ec-4ad7-96de-0a6c11836625 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:27.131223 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-0b7c2b80-c9ec-4ad7-96de-0a6c11836625 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.147793 Jun 17 15:39:27.131802 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 961/2339] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:39:26 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:39:27.340298 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-8b4e9c8b-c371-47eb-b54c-866b8b6df34b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:27.340964 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-8b4e9c8b-c371-47eb-b54c-866b8b6df34b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:27.347420 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8b4e9c8b-c371-47eb-b54c-866b8b6df34b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:27.347868 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8b4e9c8b-c371-47eb-b54c-866b8b6df34b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:27.348654 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8b4e9c8b-c371-47eb-b54c-866b8b6df34b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:27.349087 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8b4e9c8b-c371-47eb-b54c-866b8b6df34b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:27.473483 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-ee92e062-713b-4894-9ee5-2dadc02075bd tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:27.474090 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-ee92e062-713b-4894-9ee5-2dadc02075bd tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:27.474515 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-8b4e9c8b-c371-47eb-b54c-866b8b6df34b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:27.481124 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ee92e062-713b-4894-9ee5-2dadc02075bd tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:27.481569 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ee92e062-713b-4894-9ee5-2dadc02075bd tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:27.482331 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ee92e062-713b-4894-9ee5-2dadc02075bd tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:27.482762 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-8b4e9c8b-c371-47eb-b54c-866b8b6df34b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1601 microversion: 2.1 time: 0.146313 Jun 17 15:39:27.482903 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ee92e062-713b-4894-9ee5-2dadc02075bd tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:27.483350 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1379/2340] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:39:27 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1601 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:39:27.547035 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-ee92e062-713b-4894-9ee5-2dadc02075bd tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:27.555737 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-ee92e062-713b-4894-9ee5-2dadc02075bd tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:27.557252 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-ee92e062-713b-4894-9ee5-2dadc02075bd tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:27.558374 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-ee92e062-713b-4894-9ee5-2dadc02075bd tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.088939 Jun 17 15:39:27.558926 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 962/2341] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:39:27 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:39:28.149201 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-7663358b-ff2f-4001-bde0-a75738eb09b5 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:28.149834 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-7663358b-ff2f-4001-bde0-a75738eb09b5 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:28.155807 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7663358b-ff2f-4001-bde0-a75738eb09b5 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:28.157040 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7663358b-ff2f-4001-bde0-a75738eb09b5 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:28.158515 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7663358b-ff2f-4001-bde0-a75738eb09b5 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:28.158945 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7663358b-ff2f-4001-bde0-a75738eb09b5 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:28.289847 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-7663358b-ff2f-4001-bde0-a75738eb09b5 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:28.297844 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-7663358b-ff2f-4001-bde0-a75738eb09b5 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.152718 Jun 17 15:39:28.298522 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1380/2342] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:39:28 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:39:28.500089 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-8dceb7bb-d046-4f58-8114-2836268a3b66 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:28.500855 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-8dceb7bb-d046-4f58-8114-2836268a3b66 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:28.508119 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8dceb7bb-d046-4f58-8114-2836268a3b66 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:28.508600 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8dceb7bb-d046-4f58-8114-2836268a3b66 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:28.509362 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8dceb7bb-d046-4f58-8114-2836268a3b66 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:28.509822 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8dceb7bb-d046-4f58-8114-2836268a3b66 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:28.576842 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-38eb2de4-49dd-44a7-9222-88b2403a80ab tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:28.577449 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-38eb2de4-49dd-44a7-9222-88b2403a80ab tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:28.584606 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-38eb2de4-49dd-44a7-9222-88b2403a80ab tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:28.585060 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-38eb2de4-49dd-44a7-9222-88b2403a80ab tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:28.585819 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-38eb2de4-49dd-44a7-9222-88b2403a80ab tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:28.586251 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-38eb2de4-49dd-44a7-9222-88b2403a80ab tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:28.601908 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=100 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:39:28.641676 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-8dceb7bb-d046-4f58-8114-2836268a3b66 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:28.650326 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-8dceb7bb-d046-4f58-8114-2836268a3b66 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1601 microversion: 2.1 time: 0.154087 Jun 17 15:39:28.651029 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 963/2343] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:39:28 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1601 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:39:28.653319 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-38eb2de4-49dd-44a7-9222-88b2403a80ab tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:28.661730 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-38eb2de4-49dd-44a7-9222-88b2403a80ab tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:28.663213 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-38eb2de4-49dd-44a7-9222-88b2403a80ab tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:28.664353 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-38eb2de4-49dd-44a7-9222-88b2403a80ab tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.091444 Jun 17 15:39:28.664894 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1381/2344] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:39:28 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 15:39:29.315325 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-f12eb1c6-d93f-499f-a520-8868882d8467 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:29.316031 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-f12eb1c6-d93f-499f-a520-8868882d8467 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:29.322294 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f12eb1c6-d93f-499f-a520-8868882d8467 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:29.322737 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f12eb1c6-d93f-499f-a520-8868882d8467 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:29.323478 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f12eb1c6-d93f-499f-a520-8868882d8467 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:29.323908 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f12eb1c6-d93f-499f-a520-8868882d8467 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:29.455742 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-f12eb1c6-d93f-499f-a520-8868882d8467 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:29.463585 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-f12eb1c6-d93f-499f-a520-8868882d8467 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.152199 Jun 17 15:39:29.464139 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 964/2345] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:39:29 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:39:29.666913 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-e5655768-4a31-421d-9190-041587366f50 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:29.667563 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-e5655768-4a31-421d-9190-041587366f50 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:29.689265 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e5655768-4a31-421d-9190-041587366f50 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:29.689787 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e5655768-4a31-421d-9190-041587366f50 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:29.690804 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e5655768-4a31-421d-9190-041587366f50 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:29.691005 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e5655768-4a31-421d-9190-041587366f50 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:29.695739 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-aabeeca5-4ae1-41cb-b4b7-0950bceb6bc3 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:29.696390 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-aabeeca5-4ae1-41cb-b4b7-0950bceb6bc3 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:29.706721 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-aabeeca5-4ae1-41cb-b4b7-0950bceb6bc3 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:29.707166 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-aabeeca5-4ae1-41cb-b4b7-0950bceb6bc3 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:29.707930 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-aabeeca5-4ae1-41cb-b4b7-0950bceb6bc3 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:29.708396 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-aabeeca5-4ae1-41cb-b4b7-0950bceb6bc3 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:29.777007 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-aabeeca5-4ae1-41cb-b4b7-0950bceb6bc3 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:29.786485 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-aabeeca5-4ae1-41cb-b4b7-0950bceb6bc3 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:29.787992 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-aabeeca5-4ae1-41cb-b4b7-0950bceb6bc3 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:29.789239 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-aabeeca5-4ae1-41cb-b4b7-0950bceb6bc3 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.097379 Jun 17 15:39:29.789862 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 965/2346] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:39:29 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 15:39:29.830671 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-e5655768-4a31-421d-9190-041587366f50 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:29.838622 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-e5655768-4a31-421d-9190-041587366f50 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1601 microversion: 2.1 time: 0.175559 Jun 17 15:39:29.839182 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1382/2347] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:39:29 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1601 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:39:30.481909 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-660ff698-ec32-4a82-bb85-1e0887a996d2 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:30.482440 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-660ff698-ec32-4a82-bb85-1e0887a996d2 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:30.489595 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-660ff698-ec32-4a82-bb85-1e0887a996d2 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:30.490040 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-660ff698-ec32-4a82-bb85-1e0887a996d2 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:30.490799 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-660ff698-ec32-4a82-bb85-1e0887a996d2 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:30.491227 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-660ff698-ec32-4a82-bb85-1e0887a996d2 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:30.628072 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-660ff698-ec32-4a82-bb85-1e0887a996d2 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:30.636161 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-660ff698-ec32-4a82-bb85-1e0887a996d2 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.158171 Jun 17 15:39:30.637057 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 966/2348] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:39:30 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:39:30.806569 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-cf8a113d-df97-4f0b-b018-0c31f49dc1a5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:30.807126 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-cf8a113d-df97-4f0b-b018-0c31f49dc1a5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:30.813682 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cf8a113d-df97-4f0b-b018-0c31f49dc1a5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:30.814123 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cf8a113d-df97-4f0b-b018-0c31f49dc1a5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:30.814906 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cf8a113d-df97-4f0b-b018-0c31f49dc1a5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:30.815339 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cf8a113d-df97-4f0b-b018-0c31f49dc1a5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:30.855398 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-e4cf50cc-ca0e-45a2-811f-fd8a3bc794fb tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:30.856041 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-e4cf50cc-ca0e-45a2-811f-fd8a3bc794fb tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:30.863333 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e4cf50cc-ca0e-45a2-811f-fd8a3bc794fb tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:30.863779 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e4cf50cc-ca0e-45a2-811f-fd8a3bc794fb tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:30.864576 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e4cf50cc-ca0e-45a2-811f-fd8a3bc794fb tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:30.865006 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e4cf50cc-ca0e-45a2-811f-fd8a3bc794fb tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:30.880506 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-cf8a113d-df97-4f0b-b018-0c31f49dc1a5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:30.888931 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-cf8a113d-df97-4f0b-b018-0c31f49dc1a5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:30.890426 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-cf8a113d-df97-4f0b-b018-0c31f49dc1a5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:30.891559 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-cf8a113d-df97-4f0b-b018-0c31f49dc1a5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.089106 Jun 17 15:39:30.892107 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1383/2349] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:39:30 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:39:30.994400 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-e4cf50cc-ca0e-45a2-811f-fd8a3bc794fb tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:31.002366 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-e4cf50cc-ca0e-45a2-811f-fd8a3bc794fb tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1601 microversion: 2.1 time: 0.150899 Jun 17 15:39:31.002933 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 967/2350] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:39:30 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1601 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:39:31.654421 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-2bed987d-f835-4397-b6ad-a33b45e75f06 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:31.654984 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-2bed987d-f835-4397-b6ad-a33b45e75f06 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:31.661164 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2bed987d-f835-4397-b6ad-a33b45e75f06 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:31.661608 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2bed987d-f835-4397-b6ad-a33b45e75f06 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:31.662360 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2bed987d-f835-4397-b6ad-a33b45e75f06 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:31.662788 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2bed987d-f835-4397-b6ad-a33b45e75f06 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:31.793848 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-2bed987d-f835-4397-b6ad-a33b45e75f06 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:31.802593 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-2bed987d-f835-4397-b6ad-a33b45e75f06 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.152075 Jun 17 15:39:31.803156 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1384/2351] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:39:31 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:39:31.909912 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-f05c691a-3e02-4b1a-9926-d1639f359859 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:31.910476 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-f05c691a-3e02-4b1a-9926-d1639f359859 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:31.916994 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f05c691a-3e02-4b1a-9926-d1639f359859 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:31.917442 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f05c691a-3e02-4b1a-9926-d1639f359859 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:31.918205 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f05c691a-3e02-4b1a-9926-d1639f359859 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:31.918642 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f05c691a-3e02-4b1a-9926-d1639f359859 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:31.933738 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell1:SELECT=100 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:39:31.984392 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-f05c691a-3e02-4b1a-9926-d1639f359859 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:31.993281 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-f05c691a-3e02-4b1a-9926-d1639f359859 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:31.994765 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-f05c691a-3e02-4b1a-9926-d1639f359859 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:31.995891 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-f05c691a-3e02-4b1a-9926-d1639f359859 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.090176 Jun 17 15:39:31.996476 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 968/2352] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:39:31 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:39:32.018939 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-4890da43-16cc-4a1c-ba39-24eac0df5fbe tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:32.019548 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-4890da43-16cc-4a1c-ba39-24eac0df5fbe tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:32.026030 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4890da43-16cc-4a1c-ba39-24eac0df5fbe tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:32.026478 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4890da43-16cc-4a1c-ba39-24eac0df5fbe tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:32.027231 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4890da43-16cc-4a1c-ba39-24eac0df5fbe tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:32.027669 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4890da43-16cc-4a1c-ba39-24eac0df5fbe tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:32.155703 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-4890da43-16cc-4a1c-ba39-24eac0df5fbe tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:32.164267 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-4890da43-16cc-4a1c-ba39-24eac0df5fbe tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1601 microversion: 2.1 time: 0.149073 Jun 17 15:39:32.164776 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1385/2353] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:39:32 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1601 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:39:32.819522 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-d193ec7f-2490-46bd-897d-a8e9ee4f64fc tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:32.820153 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-d193ec7f-2490-46bd-897d-a8e9ee4f64fc tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:32.826461 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d193ec7f-2490-46bd-897d-a8e9ee4f64fc tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:32.826910 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d193ec7f-2490-46bd-897d-a8e9ee4f64fc tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:32.827666 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d193ec7f-2490-46bd-897d-a8e9ee4f64fc tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:32.828101 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d193ec7f-2490-46bd-897d-a8e9ee4f64fc tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:32.957403 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-d193ec7f-2490-46bd-897d-a8e9ee4f64fc tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:32.965267 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-d193ec7f-2490-46bd-897d-a8e9ee4f64fc tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.149583 Jun 17 15:39:32.965894 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 969/2354] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:39:32 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:39:33.014055 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-4d2c9110-60d1-4ec3-a3c1-4af72d7befe1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:33.014656 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-4d2c9110-60d1-4ec3-a3c1-4af72d7befe1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:33.021358 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4d2c9110-60d1-4ec3-a3c1-4af72d7befe1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:33.022017 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4d2c9110-60d1-4ec3-a3c1-4af72d7befe1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:33.022541 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4d2c9110-60d1-4ec3-a3c1-4af72d7befe1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:33.022970 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4d2c9110-60d1-4ec3-a3c1-4af72d7befe1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:33.087990 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-4d2c9110-60d1-4ec3-a3c1-4af72d7befe1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:33.096446 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-4d2c9110-60d1-4ec3-a3c1-4af72d7befe1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:33.097946 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-4d2c9110-60d1-4ec3-a3c1-4af72d7befe1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:33.099065 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-4d2c9110-60d1-4ec3-a3c1-4af72d7befe1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.088939 Jun 17 15:39:33.099647 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1386/2355] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:39:33 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 15:39:33.181740 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-f2ad8439-eb8b-4ea5-b39e-9f680a02db69 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:33.182369 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-f2ad8439-eb8b-4ea5-b39e-9f680a02db69 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:33.188493 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f2ad8439-eb8b-4ea5-b39e-9f680a02db69 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:33.189444 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f2ad8439-eb8b-4ea5-b39e-9f680a02db69 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:33.190200 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f2ad8439-eb8b-4ea5-b39e-9f680a02db69 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:33.190636 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f2ad8439-eb8b-4ea5-b39e-9f680a02db69 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:33.317200 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-f2ad8439-eb8b-4ea5-b39e-9f680a02db69 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:33.325148 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-f2ad8439-eb8b-4ea5-b39e-9f680a02db69 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1601 microversion: 2.1 time: 0.147373 Jun 17 15:39:33.325712 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 970/2356] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:39:33 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1601 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:39:33.982017 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-03ca4958-6b4a-4f4a-a625-52e061e54132 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:33.982540 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-03ca4958-6b4a-4f4a-a625-52e061e54132 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:33.989864 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-03ca4958-6b4a-4f4a-a625-52e061e54132 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:33.990317 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-03ca4958-6b4a-4f4a-a625-52e061e54132 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:33.991098 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-03ca4958-6b4a-4f4a-a625-52e061e54132 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:33.991540 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-03ca4958-6b4a-4f4a-a625-52e061e54132 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:34.117748 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-a26ea912-29dd-4d93-98c8-f6d6463587ec tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:34.118373 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-a26ea912-29dd-4d93-98c8-f6d6463587ec tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:34.125009 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a26ea912-29dd-4d93-98c8-f6d6463587ec tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:34.125468 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a26ea912-29dd-4d93-98c8-f6d6463587ec tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:34.126241 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a26ea912-29dd-4d93-98c8-f6d6463587ec tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:34.126680 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a26ea912-29dd-4d93-98c8-f6d6463587ec tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:34.128272 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-03ca4958-6b4a-4f4a-a625-52e061e54132 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:34.136170 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-03ca4958-6b4a-4f4a-a625-52e061e54132 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.158067 Jun 17 15:39:34.136772 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1387/2357] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:39:33 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:39:34.191487 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-a26ea912-29dd-4d93-98c8-f6d6463587ec tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:34.199916 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-a26ea912-29dd-4d93-98c8-f6d6463587ec tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:34.201445 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-a26ea912-29dd-4d93-98c8-f6d6463587ec tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:34.202668 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-a26ea912-29dd-4d93-98c8-f6d6463587ec tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.088839 Jun 17 15:39:34.203189 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 971/2358] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:39:34 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 15:39:34.342338 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-4b759ae2-d753-47b5-92db-5e1098e41d08 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:34.342953 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-4b759ae2-d753-47b5-92db-5e1098e41d08 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:34.349027 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4b759ae2-d753-47b5-92db-5e1098e41d08 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:34.349474 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4b759ae2-d753-47b5-92db-5e1098e41d08 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:34.350487 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4b759ae2-d753-47b5-92db-5e1098e41d08 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:34.350919 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4b759ae2-d753-47b5-92db-5e1098e41d08 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:34.481029 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-4b759ae2-d753-47b5-92db-5e1098e41d08 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:34.489456 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-4b759ae2-d753-47b5-92db-5e1098e41d08 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1601 microversion: 2.1 time: 0.150892 Jun 17 15:39:34.490061 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1388/2359] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:39:34 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1601 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:39:35.154487 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-de8ca551-087f-48d5-938f-a5807c8da3ea tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:35.155096 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-de8ca551-087f-48d5-938f-a5807c8da3ea tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:35.162139 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-de8ca551-087f-48d5-938f-a5807c8da3ea tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:35.162580 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-de8ca551-087f-48d5-938f-a5807c8da3ea tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:35.163332 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-de8ca551-087f-48d5-938f-a5807c8da3ea tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:35.163763 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-de8ca551-087f-48d5-938f-a5807c8da3ea tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:35.221899 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-e35e0640-ea35-4199-b91a-bcd8c3e86031 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:35.222493 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-e35e0640-ea35-4199-b91a-bcd8c3e86031 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:35.229219 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e35e0640-ea35-4199-b91a-bcd8c3e86031 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:35.229686 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e35e0640-ea35-4199-b91a-bcd8c3e86031 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:35.230450 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e35e0640-ea35-4199-b91a-bcd8c3e86031 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:35.230882 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e35e0640-ea35-4199-b91a-bcd8c3e86031 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:35.296005 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-e35e0640-ea35-4199-b91a-bcd8c3e86031 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:35.296827 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-de8ca551-087f-48d5-938f-a5807c8da3ea tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:35.305201 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-e35e0640-ea35-4199-b91a-bcd8c3e86031 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:35.305385 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-de8ca551-087f-48d5-938f-a5807c8da3ea tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.154656 Jun 17 15:39:35.305807 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 972/2360] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:39:35 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:39:35.306789 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-e35e0640-ea35-4199-b91a-bcd8c3e86031 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:35.307930 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-e35e0640-ea35-4199-b91a-bcd8c3e86031 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.090669 Jun 17 15:39:35.308502 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1389/2361] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:39:35 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 15:39:35.419158 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 15:39:35.419322 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Fri Jun 17 15:39:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 15:39:35.506519 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-2d5e8276-0c55-4607-8a12-a0dd57595a70 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:35.507128 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-2d5e8276-0c55-4607-8a12-a0dd57595a70 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:35.514906 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2d5e8276-0c55-4607-8a12-a0dd57595a70 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:35.515639 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2d5e8276-0c55-4607-8a12-a0dd57595a70 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:35.517416 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2d5e8276-0c55-4607-8a12-a0dd57595a70 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:35.518120 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2d5e8276-0c55-4607-8a12-a0dd57595a70 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:35.646345 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-2d5e8276-0c55-4607-8a12-a0dd57595a70 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:35.654178 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-2d5e8276-0c55-4607-8a12-a0dd57595a70 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1601 microversion: 2.1 time: 0.151690 Jun 17 15:39:35.654733 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 973/2362] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:39:35 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1601 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:39:36.322813 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-5767bfab-1347-4dde-85f0-465767850040 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:36.323474 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-5767bfab-1347-4dde-85f0-465767850040 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:36.325647 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-a9212584-ef33-49a5-901d-45b10dfd83ce tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:36.326264 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-a9212584-ef33-49a5-901d-45b10dfd83ce tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:36.330078 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5767bfab-1347-4dde-85f0-465767850040 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:36.330542 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5767bfab-1347-4dde-85f0-465767850040 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:36.331299 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5767bfab-1347-4dde-85f0-465767850040 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:36.331788 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5767bfab-1347-4dde-85f0-465767850040 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:36.332733 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a9212584-ef33-49a5-901d-45b10dfd83ce tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:36.333185 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a9212584-ef33-49a5-901d-45b10dfd83ce tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:36.333947 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a9212584-ef33-49a5-901d-45b10dfd83ce tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:36.334379 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a9212584-ef33-49a5-901d-45b10dfd83ce tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:36.403707 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-a9212584-ef33-49a5-901d-45b10dfd83ce tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:36.412438 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-a9212584-ef33-49a5-901d-45b10dfd83ce tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:36.414061 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-a9212584-ef33-49a5-901d-45b10dfd83ce tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:36.415201 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-a9212584-ef33-49a5-901d-45b10dfd83ce tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.093496 Jun 17 15:39:36.415757 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 974/2363] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:39:36 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 15:39:36.470874 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-5767bfab-1347-4dde-85f0-465767850040 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:36.479085 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-5767bfab-1347-4dde-85f0-465767850040 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.160161 Jun 17 15:39:36.479686 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1390/2364] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:39:36 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:39:36.671494 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-c5f8190e-2dfe-4a12-bca3-35c4f81d908c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:36.672111 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-c5f8190e-2dfe-4a12-bca3-35c4f81d908c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:36.678754 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c5f8190e-2dfe-4a12-bca3-35c4f81d908c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:36.679201 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c5f8190e-2dfe-4a12-bca3-35c4f81d908c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:36.679951 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c5f8190e-2dfe-4a12-bca3-35c4f81d908c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:36.680406 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c5f8190e-2dfe-4a12-bca3-35c4f81d908c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:36.807449 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-c5f8190e-2dfe-4a12-bca3-35c4f81d908c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:36.810672 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 15:39:36.810849 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Fri Jun 17 15:39:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 15:39:36.819830 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-c5f8190e-2dfe-4a12-bca3-35c4f81d908c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1601 microversion: 2.1 time: 0.152121 Jun 17 15:39:36.820569 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 975/2365] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:39:36 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1601 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:39:37.433940 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-fae0f7cf-75f0-4ff4-bf70-540405dcc95d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:37.434550 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-fae0f7cf-75f0-4ff4-bf70-540405dcc95d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:37.441719 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fae0f7cf-75f0-4ff4-bf70-540405dcc95d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:37.442169 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fae0f7cf-75f0-4ff4-bf70-540405dcc95d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:37.442921 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fae0f7cf-75f0-4ff4-bf70-540405dcc95d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:37.443356 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fae0f7cf-75f0-4ff4-bf70-540405dcc95d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:37.496783 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-e0bcf0bc-3d31-43c0-ac09-bb2b264115d0 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:37.497385 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-e0bcf0bc-3d31-43c0-ac09-bb2b264115d0 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:37.504444 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e0bcf0bc-3d31-43c0-ac09-bb2b264115d0 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:37.504896 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e0bcf0bc-3d31-43c0-ac09-bb2b264115d0 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:37.505662 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e0bcf0bc-3d31-43c0-ac09-bb2b264115d0 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:37.505897 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-fae0f7cf-75f0-4ff4-bf70-540405dcc95d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:37.506089 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e0bcf0bc-3d31-43c0-ac09-bb2b264115d0 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:37.514311 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-fae0f7cf-75f0-4ff4-bf70-540405dcc95d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:37.515822 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-fae0f7cf-75f0-4ff4-bf70-540405dcc95d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:37.517568 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-fae0f7cf-75f0-4ff4-bf70-540405dcc95d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.086974 Jun 17 15:39:37.518118 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1391/2366] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:39:37 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:39:37.636389 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-e0bcf0bc-3d31-43c0-ac09-bb2b264115d0 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:37.645078 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-e0bcf0bc-3d31-43c0-ac09-bb2b264115d0 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.152178 Jun 17 15:39:37.645968 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 976/2367] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:39:37 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:39:37.836883 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-f420cd10-0280-47fe-b68a-5b86863f6b44 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:37.837488 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-f420cd10-0280-47fe-b68a-5b86863f6b44 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:37.843484 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f420cd10-0280-47fe-b68a-5b86863f6b44 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:37.843922 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f420cd10-0280-47fe-b68a-5b86863f6b44 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:37.844702 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f420cd10-0280-47fe-b68a-5b86863f6b44 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:37.845131 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f420cd10-0280-47fe-b68a-5b86863f6b44 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:37.978136 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-f420cd10-0280-47fe-b68a-5b86863f6b44 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:37.986823 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-f420cd10-0280-47fe-b68a-5b86863f6b44 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1601 microversion: 2.1 time: 0.153751 Jun 17 15:39:37.987586 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1392/2368] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:39:37 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1601 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:39:38.535192 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-fe199704-6c2b-4ed8-85fb-e40317d85540 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:38.535747 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-fe199704-6c2b-4ed8-85fb-e40317d85540 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:38.542279 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fe199704-6c2b-4ed8-85fb-e40317d85540 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:38.542729 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fe199704-6c2b-4ed8-85fb-e40317d85540 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:38.543487 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fe199704-6c2b-4ed8-85fb-e40317d85540 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:38.543923 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fe199704-6c2b-4ed8-85fb-e40317d85540 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:38.607882 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-fe199704-6c2b-4ed8-85fb-e40317d85540 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:38.616256 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-fe199704-6c2b-4ed8-85fb-e40317d85540 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:38.617785 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-fe199704-6c2b-4ed8-85fb-e40317d85540 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:38.618914 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-fe199704-6c2b-4ed8-85fb-e40317d85540 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.088421 Jun 17 15:39:38.619474 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 977/2369] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:39:38 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:39:38.662357 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-a70e5f56-2675-4700-a92a-f866848ad439 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:38.662958 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-a70e5f56-2675-4700-a92a-f866848ad439 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:38.669268 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a70e5f56-2675-4700-a92a-f866848ad439 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:38.669712 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a70e5f56-2675-4700-a92a-f866848ad439 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:38.670459 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a70e5f56-2675-4700-a92a-f866848ad439 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:38.670884 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a70e5f56-2675-4700-a92a-f866848ad439 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:38.796856 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-a70e5f56-2675-4700-a92a-f866848ad439 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:38.804958 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-a70e5f56-2675-4700-a92a-f866848ad439 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.146356 Jun 17 15:39:38.805540 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1393/2370] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:39:38 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:39:38.890047 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 15:39:38.890219 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Fri Jun 17 15:39:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 15:39:39.004232 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-d491bec9-00ec-4691-a1e3-61c2cfdf61df tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:39.004870 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-d491bec9-00ec-4691-a1e3-61c2cfdf61df tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:39.010827 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d491bec9-00ec-4691-a1e3-61c2cfdf61df tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:39.011269 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d491bec9-00ec-4691-a1e3-61c2cfdf61df tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:39.012014 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d491bec9-00ec-4691-a1e3-61c2cfdf61df tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:39.012472 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d491bec9-00ec-4691-a1e3-61c2cfdf61df tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:39.143192 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-d491bec9-00ec-4691-a1e3-61c2cfdf61df tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:39.152098 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-d491bec9-00ec-4691-a1e3-61c2cfdf61df tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1601 microversion: 2.1 time: 0.152141 Jun 17 15:39:39.152699 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 978/2371] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:39:38 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1601 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:39:39.636843 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-4138b4f9-a660-4d1a-bdda-7784c8285fbc tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:39.637406 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-4138b4f9-a660-4d1a-bdda-7784c8285fbc tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:39.643382 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4138b4f9-a660-4d1a-bdda-7784c8285fbc tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:39.643827 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4138b4f9-a660-4d1a-bdda-7784c8285fbc tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:39.644605 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4138b4f9-a660-4d1a-bdda-7784c8285fbc tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:39.645044 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4138b4f9-a660-4d1a-bdda-7784c8285fbc tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:39.706313 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-4138b4f9-a660-4d1a-bdda-7784c8285fbc tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:39.714816 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-4138b4f9-a660-4d1a-bdda-7784c8285fbc tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:39.716354 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-4138b4f9-a660-4d1a-bdda-7784c8285fbc tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:39.717475 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-4138b4f9-a660-4d1a-bdda-7784c8285fbc tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.084600 Jun 17 15:39:39.718024 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1394/2372] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:39:39 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:39:39.822183 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-3b5ca32f-7e6f-4510-84de-dbcfe6dfe860 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:39.822793 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-3b5ca32f-7e6f-4510-84de-dbcfe6dfe860 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:39.829347 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3b5ca32f-7e6f-4510-84de-dbcfe6dfe860 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:39.829795 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3b5ca32f-7e6f-4510-84de-dbcfe6dfe860 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:39.830548 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3b5ca32f-7e6f-4510-84de-dbcfe6dfe860 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:39.830981 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3b5ca32f-7e6f-4510-84de-dbcfe6dfe860 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:39.960941 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-3b5ca32f-7e6f-4510-84de-dbcfe6dfe860 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:39.968849 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-3b5ca32f-7e6f-4510-84de-dbcfe6dfe860 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.150484 Jun 17 15:39:39.969419 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 979/2373] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:39:39 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:39:40.169235 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-ba3907e4-1f41-4dcc-80a1-3ab6f13dc828 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:40.169766 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-ba3907e4-1f41-4dcc-80a1-3ab6f13dc828 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:40.175770 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ba3907e4-1f41-4dcc-80a1-3ab6f13dc828 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:40.176211 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ba3907e4-1f41-4dcc-80a1-3ab6f13dc828 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:40.176993 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ba3907e4-1f41-4dcc-80a1-3ab6f13dc828 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:40.177424 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ba3907e4-1f41-4dcc-80a1-3ab6f13dc828 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:40.308152 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-ba3907e4-1f41-4dcc-80a1-3ab6f13dc828 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:40.321405 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-ba3907e4-1f41-4dcc-80a1-3ab6f13dc828 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1601 microversion: 2.1 time: 0.156006 Jun 17 15:39:40.321977 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1395/2374] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:39:40 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1601 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:39:40.736939 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-aaf09764-de4b-4499-b6aa-26dbcea5dc3e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:40.737688 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-aaf09764-de4b-4499-b6aa-26dbcea5dc3e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:40.743652 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-aaf09764-de4b-4499-b6aa-26dbcea5dc3e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:40.744097 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-aaf09764-de4b-4499-b6aa-26dbcea5dc3e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:40.744983 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-aaf09764-de4b-4499-b6aa-26dbcea5dc3e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:40.745491 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-aaf09764-de4b-4499-b6aa-26dbcea5dc3e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:40.809225 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-aaf09764-de4b-4499-b6aa-26dbcea5dc3e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:40.818192 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-aaf09764-de4b-4499-b6aa-26dbcea5dc3e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:40.819700 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-aaf09764-de4b-4499-b6aa-26dbcea5dc3e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:40.820881 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-aaf09764-de4b-4499-b6aa-26dbcea5dc3e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.088525 Jun 17 15:39:40.821470 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 980/2375] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:39:40 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:39:40.987317 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-c71eb96d-80f2-4eb8-b39c-9ae195d45e63 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:40.987843 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-c71eb96d-80f2-4eb8-b39c-9ae195d45e63 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:40.994268 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c71eb96d-80f2-4eb8-b39c-9ae195d45e63 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:40.994713 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c71eb96d-80f2-4eb8-b39c-9ae195d45e63 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:40.995461 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c71eb96d-80f2-4eb8-b39c-9ae195d45e63 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:40.995888 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c71eb96d-80f2-4eb8-b39c-9ae195d45e63 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:41.127667 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-c71eb96d-80f2-4eb8-b39c-9ae195d45e63 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:41.135638 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-c71eb96d-80f2-4eb8-b39c-9ae195d45e63 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.152728 Jun 17 15:39:41.136197 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1396/2376] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:39:40 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:39:41.339012 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-ad7d3343-0656-479d-a7b6-ac9f568f306f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:41.339617 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-ad7d3343-0656-479d-a7b6-ac9f568f306f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:41.346684 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ad7d3343-0656-479d-a7b6-ac9f568f306f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:41.347140 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ad7d3343-0656-479d-a7b6-ac9f568f306f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:41.347904 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ad7d3343-0656-479d-a7b6-ac9f568f306f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:41.348350 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ad7d3343-0656-479d-a7b6-ac9f568f306f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:41.476846 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-ad7d3343-0656-479d-a7b6-ac9f568f306f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:41.484772 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-ad7d3343-0656-479d-a7b6-ac9f568f306f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1601 microversion: 2.1 time: 0.149567 Jun 17 15:39:41.485337 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 981/2377] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:39:41 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1601 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:39:41.838875 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-2b13a180-3386-462c-a872-174df7ca6b32 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:41.839473 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-2b13a180-3386-462c-a872-174df7ca6b32 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:41.845544 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2b13a180-3386-462c-a872-174df7ca6b32 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:41.845985 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2b13a180-3386-462c-a872-174df7ca6b32 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:41.846728 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2b13a180-3386-462c-a872-174df7ca6b32 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:41.847155 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2b13a180-3386-462c-a872-174df7ca6b32 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:41.907752 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-2b13a180-3386-462c-a872-174df7ca6b32 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:41.916216 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-2b13a180-3386-462c-a872-174df7ca6b32 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:41.917671 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-2b13a180-3386-462c-a872-174df7ca6b32 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:41.918789 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-2b13a180-3386-462c-a872-174df7ca6b32 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.083786 Jun 17 15:39:41.919336 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1397/2378] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:39:41 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:39:42.152992 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-778e23c1-7878-4819-a7b0-dfe2aae3ca58 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:42.153631 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-778e23c1-7878-4819-a7b0-dfe2aae3ca58 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:42.159611 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-778e23c1-7878-4819-a7b0-dfe2aae3ca58 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:42.160061 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-778e23c1-7878-4819-a7b0-dfe2aae3ca58 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:42.160842 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-778e23c1-7878-4819-a7b0-dfe2aae3ca58 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:42.161284 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-778e23c1-7878-4819-a7b0-dfe2aae3ca58 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:42.285749 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-778e23c1-7878-4819-a7b0-dfe2aae3ca58 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:42.293573 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-778e23c1-7878-4819-a7b0-dfe2aae3ca58 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.144509 Jun 17 15:39:42.294134 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 982/2379] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:39:42 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:39:42.503216 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-977ceb3e-b05a-4fec-a352-49aeeeccf112 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:42.503839 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-977ceb3e-b05a-4fec-a352-49aeeeccf112 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:42.510299 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-977ceb3e-b05a-4fec-a352-49aeeeccf112 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:42.510747 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-977ceb3e-b05a-4fec-a352-49aeeeccf112 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:42.511506 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-977ceb3e-b05a-4fec-a352-49aeeeccf112 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:42.511940 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-977ceb3e-b05a-4fec-a352-49aeeeccf112 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:42.514468 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=100 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:39:42.643159 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-977ceb3e-b05a-4fec-a352-49aeeeccf112 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:42.650975 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-977ceb3e-b05a-4fec-a352-49aeeeccf112 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1601 microversion: 2.1 time: 0.152415 Jun 17 15:39:42.651533 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1398/2380] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:39:42 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1601 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:39:42.936601 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-429f39ed-b77e-4576-a026-616cbaeeadd8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:42.937240 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-429f39ed-b77e-4576-a026-616cbaeeadd8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:42.943703 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-429f39ed-b77e-4576-a026-616cbaeeadd8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:42.944144 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-429f39ed-b77e-4576-a026-616cbaeeadd8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:42.944943 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-429f39ed-b77e-4576-a026-616cbaeeadd8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:42.945382 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-429f39ed-b77e-4576-a026-616cbaeeadd8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:43.009772 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-429f39ed-b77e-4576-a026-616cbaeeadd8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:43.018602 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-429f39ed-b77e-4576-a026-616cbaeeadd8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:43.020106 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-429f39ed-b77e-4576-a026-616cbaeeadd8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:43.021262 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-429f39ed-b77e-4576-a026-616cbaeeadd8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.088682 Jun 17 15:39:43.021813 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 983/2381] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:39:42 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:39:43.310702 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-8e4f8c85-6055-44df-8151-ba86b2a51865 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:43.311318 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-8e4f8c85-6055-44df-8151-ba86b2a51865 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:43.318432 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8e4f8c85-6055-44df-8151-ba86b2a51865 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:43.318889 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8e4f8c85-6055-44df-8151-ba86b2a51865 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:43.319654 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8e4f8c85-6055-44df-8151-ba86b2a51865 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:43.320113 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8e4f8c85-6055-44df-8151-ba86b2a51865 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:43.447850 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-8e4f8c85-6055-44df-8151-ba86b2a51865 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:43.455736 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-8e4f8c85-6055-44df-8151-ba86b2a51865 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.148940 Jun 17 15:39:43.456303 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1399/2382] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:39:43 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:39:43.668895 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-13dab52e-9dfd-49f7-911d-39f5b3e26ef2 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:43.669534 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-13dab52e-9dfd-49f7-911d-39f5b3e26ef2 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:43.676222 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-13dab52e-9dfd-49f7-911d-39f5b3e26ef2 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:43.676686 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-13dab52e-9dfd-49f7-911d-39f5b3e26ef2 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:43.677432 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-13dab52e-9dfd-49f7-911d-39f5b3e26ef2 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:43.677859 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-13dab52e-9dfd-49f7-911d-39f5b3e26ef2 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:43.804422 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-13dab52e-9dfd-49f7-911d-39f5b3e26ef2 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:43.812205 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-13dab52e-9dfd-49f7-911d-39f5b3e26ef2 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1601 microversion: 2.1 time: 0.147123 Jun 17 15:39:43.812820 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 984/2383] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:39:43 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1601 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:39:44.039852 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-8b2d9ef8-80b8-473a-9653-6d799c048bf4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:44.040676 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-8b2d9ef8-80b8-473a-9653-6d799c048bf4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:44.047195 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8b2d9ef8-80b8-473a-9653-6d799c048bf4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:44.047649 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8b2d9ef8-80b8-473a-9653-6d799c048bf4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:44.048420 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8b2d9ef8-80b8-473a-9653-6d799c048bf4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:44.048847 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8b2d9ef8-80b8-473a-9653-6d799c048bf4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:44.110939 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-8b2d9ef8-80b8-473a-9653-6d799c048bf4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:44.119345 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-8b2d9ef8-80b8-473a-9653-6d799c048bf4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:44.120868 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-8b2d9ef8-80b8-473a-9653-6d799c048bf4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:44.121978 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-8b2d9ef8-80b8-473a-9653-6d799c048bf4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.086179 Jun 17 15:39:44.122519 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1400/2384] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:39:44 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:39:44.473456 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-ef5168d7-56cb-4718-8ff8-314914ed052c tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:44.474067 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-ef5168d7-56cb-4718-8ff8-314914ed052c tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:44.480583 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ef5168d7-56cb-4718-8ff8-314914ed052c tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:44.481039 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ef5168d7-56cb-4718-8ff8-314914ed052c tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:44.481793 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ef5168d7-56cb-4718-8ff8-314914ed052c tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:44.482229 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ef5168d7-56cb-4718-8ff8-314914ed052c tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:44.484743 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell1:SELECT=100 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:39:44.611222 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-ef5168d7-56cb-4718-8ff8-314914ed052c tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:44.619010 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-ef5168d7-56cb-4718-8ff8-314914ed052c tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.150118 Jun 17 15:39:44.619574 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 985/2385] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:39:44 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:39:44.829204 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-51207d90-fc3d-4d2d-a0d7-ea6ec29fea3b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:44.830397 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-51207d90-fc3d-4d2d-a0d7-ea6ec29fea3b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:44.832681 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_api:SELECT=80 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:39:44.838912 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-51207d90-fc3d-4d2d-a0d7-ea6ec29fea3b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:44.839350 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-51207d90-fc3d-4d2d-a0d7-ea6ec29fea3b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:44.840113 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-51207d90-fc3d-4d2d-a0d7-ea6ec29fea3b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:44.840572 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-51207d90-fc3d-4d2d-a0d7-ea6ec29fea3b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:44.974828 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-51207d90-fc3d-4d2d-a0d7-ea6ec29fea3b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:44.982991 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-51207d90-fc3d-4d2d-a0d7-ea6ec29fea3b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1601 microversion: 2.1 time: 0.157766 Jun 17 15:39:44.983557 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1401/2386] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:39:44 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1601 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:39:45.140710 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-b7a189a5-b00d-43bc-bf6f-ae35754643ee tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:45.141318 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-b7a189a5-b00d-43bc-bf6f-ae35754643ee tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:45.149121 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b7a189a5-b00d-43bc-bf6f-ae35754643ee tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:45.149565 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b7a189a5-b00d-43bc-bf6f-ae35754643ee tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:45.150326 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b7a189a5-b00d-43bc-bf6f-ae35754643ee tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:45.150762 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b7a189a5-b00d-43bc-bf6f-ae35754643ee tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:45.221441 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-b7a189a5-b00d-43bc-bf6f-ae35754643ee tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:45.230110 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-b7a189a5-b00d-43bc-bf6f-ae35754643ee tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:45.231621 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-b7a189a5-b00d-43bc-bf6f-ae35754643ee tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:45.232800 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-b7a189a5-b00d-43bc-bf6f-ae35754643ee tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.096290 Jun 17 15:39:45.233354 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 986/2387] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:39:45 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:39:45.635858 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-bb7e9251-1b8b-4cea-b9d5-2ecc600ac52d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:45.636540 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-bb7e9251-1b8b-4cea-b9d5-2ecc600ac52d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:45.643002 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bb7e9251-1b8b-4cea-b9d5-2ecc600ac52d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:45.643448 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bb7e9251-1b8b-4cea-b9d5-2ecc600ac52d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:45.644192 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bb7e9251-1b8b-4cea-b9d5-2ecc600ac52d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:45.644653 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bb7e9251-1b8b-4cea-b9d5-2ecc600ac52d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:45.772564 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-bb7e9251-1b8b-4cea-b9d5-2ecc600ac52d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:45.780478 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-bb7e9251-1b8b-4cea-b9d5-2ecc600ac52d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.148461 Jun 17 15:39:45.781034 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1402/2388] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:39:45 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:39:45.999089 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-100e4b69-c356-4cd0-bd37-e609ac9efb98 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:45.999664 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-100e4b69-c356-4cd0-bd37-e609ac9efb98 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:46.006071 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-100e4b69-c356-4cd0-bd37-e609ac9efb98 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:46.006518 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-100e4b69-c356-4cd0-bd37-e609ac9efb98 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:46.007274 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-100e4b69-c356-4cd0-bd37-e609ac9efb98 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:46.007709 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-100e4b69-c356-4cd0-bd37-e609ac9efb98 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:46.135257 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-100e4b69-c356-4cd0-bd37-e609ac9efb98 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:46.143669 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-100e4b69-c356-4cd0-bd37-e609ac9efb98 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1601 microversion: 2.1 time: 0.148526 Jun 17 15:39:46.144231 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 987/2389] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:39:45 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1601 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:39:46.251174 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-40b44a3c-7803-4583-8ddd-49abdd877925 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:46.251728 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-40b44a3c-7803-4583-8ddd-49abdd877925 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:46.257729 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-40b44a3c-7803-4583-8ddd-49abdd877925 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:46.258171 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-40b44a3c-7803-4583-8ddd-49abdd877925 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:46.258945 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-40b44a3c-7803-4583-8ddd-49abdd877925 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:46.259378 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-40b44a3c-7803-4583-8ddd-49abdd877925 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:46.331126 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-40b44a3c-7803-4583-8ddd-49abdd877925 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:46.339903 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-40b44a3c-7803-4583-8ddd-49abdd877925 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:46.341431 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-40b44a3c-7803-4583-8ddd-49abdd877925 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:46.342559 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-40b44a3c-7803-4583-8ddd-49abdd877925 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.095455 Jun 17 15:39:46.343112 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1403/2390] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:39:46 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:39:46.797405 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-c3393238-bf45-44e1-83c9-720193c3126a tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:46.798528 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-c3393238-bf45-44e1-83c9-720193c3126a tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:46.804620 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c3393238-bf45-44e1-83c9-720193c3126a tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:46.805068 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c3393238-bf45-44e1-83c9-720193c3126a tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:46.805854 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c3393238-bf45-44e1-83c9-720193c3126a tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:46.806288 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c3393238-bf45-44e1-83c9-720193c3126a tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:46.935055 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-c3393238-bf45-44e1-83c9-720193c3126a tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:46.943966 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-c3393238-bf45-44e1-83c9-720193c3126a tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.150459 Jun 17 15:39:46.944605 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 988/2391] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:39:46 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:39:47.161345 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-cc86af18-256c-4397-96e3-282af3a1df6a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:47.161974 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-cc86af18-256c-4397-96e3-282af3a1df6a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:47.168465 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cc86af18-256c-4397-96e3-282af3a1df6a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:47.168942 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cc86af18-256c-4397-96e3-282af3a1df6a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:47.169693 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cc86af18-256c-4397-96e3-282af3a1df6a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:47.170127 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cc86af18-256c-4397-96e3-282af3a1df6a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:47.295192 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-cc86af18-256c-4397-96e3-282af3a1df6a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:47.303784 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-cc86af18-256c-4397-96e3-282af3a1df6a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1601 microversion: 2.1 time: 0.146855 Jun 17 15:39:47.304363 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1404/2392] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:39:47 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1601 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:39:47.361502 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-d2319e00-46e8-456a-862e-941d3fcae0a8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:47.362179 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-d2319e00-46e8-456a-862e-941d3fcae0a8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:47.368686 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d2319e00-46e8-456a-862e-941d3fcae0a8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:47.369131 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d2319e00-46e8-456a-862e-941d3fcae0a8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:47.369886 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d2319e00-46e8-456a-862e-941d3fcae0a8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:47.370321 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d2319e00-46e8-456a-862e-941d3fcae0a8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:47.434931 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-d2319e00-46e8-456a-862e-941d3fcae0a8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:47.443321 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-d2319e00-46e8-456a-862e-941d3fcae0a8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:47.444970 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-d2319e00-46e8-456a-862e-941d3fcae0a8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:47.446104 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-d2319e00-46e8-456a-862e-941d3fcae0a8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.089219 Jun 17 15:39:47.446657 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 989/2393] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:39:47 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:39:47.961978 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-c197d763-9c77-4ead-b58b-8b4602062bc2 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:47.962578 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-c197d763-9c77-4ead-b58b-8b4602062bc2 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:47.968577 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c197d763-9c77-4ead-b58b-8b4602062bc2 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:47.969020 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c197d763-9c77-4ead-b58b-8b4602062bc2 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:47.969772 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c197d763-9c77-4ead-b58b-8b4602062bc2 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:47.970227 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c197d763-9c77-4ead-b58b-8b4602062bc2 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:48.100631 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-c197d763-9c77-4ead-b58b-8b4602062bc2 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:48.108739 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-c197d763-9c77-4ead-b58b-8b4602062bc2 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.150658 Jun 17 15:39:48.109423 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1405/2394] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:39:47 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:39:48.321321 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-aaca5bfa-6453-40d2-bcac-b1f33ff9ee6a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:48.321858 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-aaca5bfa-6453-40d2-bcac-b1f33ff9ee6a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:48.323700 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_api:SELECT=82 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:39:48.328998 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-aaca5bfa-6453-40d2-bcac-b1f33ff9ee6a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:48.329461 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-aaca5bfa-6453-40d2-bcac-b1f33ff9ee6a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:48.330338 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-aaca5bfa-6453-40d2-bcac-b1f33ff9ee6a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:48.330778 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-aaca5bfa-6453-40d2-bcac-b1f33ff9ee6a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:48.458825 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-aaca5bfa-6453-40d2-bcac-b1f33ff9ee6a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:48.464574 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-d35b6dd7-b51a-427b-b736-e4cf503cd0fa tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:48.465191 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-d35b6dd7-b51a-427b-b736-e4cf503cd0fa tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:48.466910 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-aaca5bfa-6453-40d2-bcac-b1f33ff9ee6a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1601 microversion: 2.1 time: 0.149757 Jun 17 15:39:48.467688 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 990/2395] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:39:48 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1601 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:39:48.471770 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d35b6dd7-b51a-427b-b736-e4cf503cd0fa tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:48.472217 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d35b6dd7-b51a-427b-b736-e4cf503cd0fa tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:48.473023 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d35b6dd7-b51a-427b-b736-e4cf503cd0fa tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:48.473451 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d35b6dd7-b51a-427b-b736-e4cf503cd0fa tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:48.539041 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-d35b6dd7-b51a-427b-b736-e4cf503cd0fa tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:48.547324 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-d35b6dd7-b51a-427b-b736-e4cf503cd0fa tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:48.549428 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-d35b6dd7-b51a-427b-b736-e4cf503cd0fa tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:48.550559 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-d35b6dd7-b51a-427b-b736-e4cf503cd0fa tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.089914 Jun 17 15:39:48.551109 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1406/2396] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:39:48 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 15:39:49.125887 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-a0d642b6-30c9-469b-9702-cfa365ec04e7 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:49.126507 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-a0d642b6-30c9-469b-9702-cfa365ec04e7 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:49.132810 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a0d642b6-30c9-469b-9702-cfa365ec04e7 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:49.133251 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a0d642b6-30c9-469b-9702-cfa365ec04e7 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:49.134047 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a0d642b6-30c9-469b-9702-cfa365ec04e7 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:49.134476 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a0d642b6-30c9-469b-9702-cfa365ec04e7 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:49.268986 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-a0d642b6-30c9-469b-9702-cfa365ec04e7 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:49.277025 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-a0d642b6-30c9-469b-9702-cfa365ec04e7 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.155055 Jun 17 15:39:49.277598 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 991/2397] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:39:49 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:39:49.484425 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-39271355-6a8e-4411-a372-3439144d2e28 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:49.485031 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-39271355-6a8e-4411-a372-3439144d2e28 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:49.491687 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-39271355-6a8e-4411-a372-3439144d2e28 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:49.492131 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-39271355-6a8e-4411-a372-3439144d2e28 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:49.493075 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-39271355-6a8e-4411-a372-3439144d2e28 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:49.493503 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-39271355-6a8e-4411-a372-3439144d2e28 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:49.568585 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-e259a66e-cfef-4c4f-b50c-abcaad4a7752 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:49.569228 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-e259a66e-cfef-4c4f-b50c-abcaad4a7752 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:49.575378 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e259a66e-cfef-4c4f-b50c-abcaad4a7752 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:49.575846 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e259a66e-cfef-4c4f-b50c-abcaad4a7752 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:49.576633 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e259a66e-cfef-4c4f-b50c-abcaad4a7752 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:49.577061 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e259a66e-cfef-4c4f-b50c-abcaad4a7752 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:49.625256 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-39271355-6a8e-4411-a372-3439144d2e28 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:49.633941 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-39271355-6a8e-4411-a372-3439144d2e28 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1601 microversion: 2.1 time: 0.153456 Jun 17 15:39:49.634466 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1407/2398] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:39:49 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1601 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:39:49.641457 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-e259a66e-cfef-4c4f-b50c-abcaad4a7752 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:49.650658 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-e259a66e-cfef-4c4f-b50c-abcaad4a7752 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:49.652156 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-e259a66e-cfef-4c4f-b50c-abcaad4a7752 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:49.653411 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-e259a66e-cfef-4c4f-b50c-abcaad4a7752 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.089448 Jun 17 15:39:49.653962 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 992/2399] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:39:49 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 15:39:50.295183 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-0d33dbf2-b6bf-4c8c-9c15-cdd489b48905 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:50.295783 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-0d33dbf2-b6bf-4c8c-9c15-cdd489b48905 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:50.302675 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0d33dbf2-b6bf-4c8c-9c15-cdd489b48905 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:50.303119 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0d33dbf2-b6bf-4c8c-9c15-cdd489b48905 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:50.303867 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0d33dbf2-b6bf-4c8c-9c15-cdd489b48905 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:50.304500 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0d33dbf2-b6bf-4c8c-9c15-cdd489b48905 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:50.439551 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-0d33dbf2-b6bf-4c8c-9c15-cdd489b48905 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:50.447645 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-0d33dbf2-b6bf-4c8c-9c15-cdd489b48905 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.156571 Jun 17 15:39:50.448285 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1408/2400] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:39:50 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:39:50.652962 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-9d7a6868-f6b1-4fef-8ced-6a2485a85b19 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:50.653559 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-9d7a6868-f6b1-4fef-8ced-6a2485a85b19 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:50.660707 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9d7a6868-f6b1-4fef-8ced-6a2485a85b19 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:50.661157 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9d7a6868-f6b1-4fef-8ced-6a2485a85b19 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:50.661945 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9d7a6868-f6b1-4fef-8ced-6a2485a85b19 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:50.662382 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9d7a6868-f6b1-4fef-8ced-6a2485a85b19 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:50.671165 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-50c19379-d19f-43a5-870f-26851017cba9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:50.671775 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-50c19379-d19f-43a5-870f-26851017cba9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:50.678494 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-50c19379-d19f-43a5-870f-26851017cba9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:50.678945 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-50c19379-d19f-43a5-870f-26851017cba9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:50.679708 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-50c19379-d19f-43a5-870f-26851017cba9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:50.680148 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-50c19379-d19f-43a5-870f-26851017cba9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:50.754149 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-50c19379-d19f-43a5-870f-26851017cba9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:50.762848 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-50c19379-d19f-43a5-870f-26851017cba9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:50.764282 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-50c19379-d19f-43a5-870f-26851017cba9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:50.765444 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-50c19379-d19f-43a5-870f-26851017cba9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.098114 Jun 17 15:39:50.766008 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1409/2401] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:39:50 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 15:39:50.797109 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-9d7a6868-f6b1-4fef-8ced-6a2485a85b19 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:50.805273 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-9d7a6868-f6b1-4fef-8ced-6a2485a85b19 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1601 microversion: 2.1 time: 0.156595 Jun 17 15:39:50.805838 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 993/2402] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:39:50 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1601 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:39:51.465031 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-e9e89505-c5e7-4abe-9c3b-57091cb769b1 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:51.465555 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-e9e89505-c5e7-4abe-9c3b-57091cb769b1 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:51.471547 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e9e89505-c5e7-4abe-9c3b-57091cb769b1 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:51.471992 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e9e89505-c5e7-4abe-9c3b-57091cb769b1 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:51.472799 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e9e89505-c5e7-4abe-9c3b-57091cb769b1 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:51.473232 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e9e89505-c5e7-4abe-9c3b-57091cb769b1 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:51.602707 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-e9e89505-c5e7-4abe-9c3b-57091cb769b1 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:51.610503 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-e9e89505-c5e7-4abe-9c3b-57091cb769b1 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.149457 Jun 17 15:39:51.611063 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1410/2403] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:39:51 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:39:51.785289 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-6500d4ca-c137-4cfa-85bb-63a325469070 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:51.785827 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-6500d4ca-c137-4cfa-85bb-63a325469070 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:51.792351 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6500d4ca-c137-4cfa-85bb-63a325469070 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:51.792822 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6500d4ca-c137-4cfa-85bb-63a325469070 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:51.793580 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6500d4ca-c137-4cfa-85bb-63a325469070 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:51.794010 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6500d4ca-c137-4cfa-85bb-63a325469070 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:51.823438 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-f2a8e4e0-49b4-4173-a1de-c47b79774a70 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:51.824139 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-f2a8e4e0-49b4-4173-a1de-c47b79774a70 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:51.831268 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f2a8e4e0-49b4-4173-a1de-c47b79774a70 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:51.831711 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f2a8e4e0-49b4-4173-a1de-c47b79774a70 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:51.832510 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f2a8e4e0-49b4-4173-a1de-c47b79774a70 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:51.832941 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f2a8e4e0-49b4-4173-a1de-c47b79774a70 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:51.856406 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-6500d4ca-c137-4cfa-85bb-63a325469070 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:51.866026 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-6500d4ca-c137-4cfa-85bb-63a325469070 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:51.867544 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-6500d4ca-c137-4cfa-85bb-63a325469070 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:51.868696 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-6500d4ca-c137-4cfa-85bb-63a325469070 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.088029 Jun 17 15:39:51.869248 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 994/2404] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:39:51 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:39:51.964710 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-f2a8e4e0-49b4-4173-a1de-c47b79774a70 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:51.973291 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-f2a8e4e0-49b4-4173-a1de-c47b79774a70 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1601 microversion: 2.1 time: 0.154047 Jun 17 15:39:51.973853 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1411/2405] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:39:51 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1601 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:39:52.629130 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-cacae465-58b7-4487-9158-a2c297864c3a tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:52.629684 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-cacae465-58b7-4487-9158-a2c297864c3a tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:52.635721 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cacae465-58b7-4487-9158-a2c297864c3a tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:52.636157 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cacae465-58b7-4487-9158-a2c297864c3a tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:52.636937 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cacae465-58b7-4487-9158-a2c297864c3a tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:52.637365 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cacae465-58b7-4487-9158-a2c297864c3a tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:52.767340 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-cacae465-58b7-4487-9158-a2c297864c3a tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:52.775206 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-cacae465-58b7-4487-9158-a2c297864c3a tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.150576 Jun 17 15:39:52.775774 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 995/2406] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:39:52 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:39:52.887283 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-b7a19920-0abb-4ff0-a8ba-da1830038b8b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:52.887836 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-b7a19920-0abb-4ff0-a8ba-da1830038b8b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:52.894380 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b7a19920-0abb-4ff0-a8ba-da1830038b8b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:52.894834 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b7a19920-0abb-4ff0-a8ba-da1830038b8b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:52.895595 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b7a19920-0abb-4ff0-a8ba-da1830038b8b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:52.896038 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b7a19920-0abb-4ff0-a8ba-da1830038b8b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:52.960753 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-b7a19920-0abb-4ff0-a8ba-da1830038b8b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:52.969094 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-b7a19920-0abb-4ff0-a8ba-da1830038b8b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:52.970581 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-b7a19920-0abb-4ff0-a8ba-da1830038b8b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:52.971704 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-b7a19920-0abb-4ff0-a8ba-da1830038b8b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.088446 Jun 17 15:39:52.972253 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1412/2407] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:39:52 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:39:52.990512 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-31b6dfcc-3099-4f28-a73b-a838c5c382f2 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:52.991126 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-31b6dfcc-3099-4f28-a73b-a838c5c382f2 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:52.997662 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-31b6dfcc-3099-4f28-a73b-a838c5c382f2 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:52.998116 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-31b6dfcc-3099-4f28-a73b-a838c5c382f2 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:52.998874 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-31b6dfcc-3099-4f28-a73b-a838c5c382f2 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:52.999309 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-31b6dfcc-3099-4f28-a73b-a838c5c382f2 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:53.127716 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-31b6dfcc-3099-4f28-a73b-a838c5c382f2 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:53.135755 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-31b6dfcc-3099-4f28-a73b-a838c5c382f2 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1601 microversion: 2.1 time: 0.149631 Jun 17 15:39:53.136318 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 996/2408] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:39:52 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1601 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:39:53.792663 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-017097c1-7a96-4e13-ab00-50970b618587 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:53.793337 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-017097c1-7a96-4e13-ab00-50970b618587 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:53.799389 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-017097c1-7a96-4e13-ab00-50970b618587 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:53.799838 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-017097c1-7a96-4e13-ab00-50970b618587 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:53.800922 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-017097c1-7a96-4e13-ab00-50970b618587 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:53.801372 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-017097c1-7a96-4e13-ab00-50970b618587 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:53.928926 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-017097c1-7a96-4e13-ab00-50970b618587 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:53.936985 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-017097c1-7a96-4e13-ab00-50970b618587 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.148146 Jun 17 15:39:53.937557 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1413/2409] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:39:53 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:39:53.989903 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-d2c5505d-1047-436f-a646-daa279aaf7f4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:53.990511 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-d2c5505d-1047-436f-a646-daa279aaf7f4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:53.996776 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d2c5505d-1047-436f-a646-daa279aaf7f4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:53.997348 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d2c5505d-1047-436f-a646-daa279aaf7f4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:53.997951 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d2c5505d-1047-436f-a646-daa279aaf7f4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:53.998379 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d2c5505d-1047-436f-a646-daa279aaf7f4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:54.064636 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-d2c5505d-1047-436f-a646-daa279aaf7f4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:54.073606 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-d2c5505d-1047-436f-a646-daa279aaf7f4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:54.075115 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-d2c5505d-1047-436f-a646-daa279aaf7f4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:54.076262 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-d2c5505d-1047-436f-a646-daa279aaf7f4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.090312 Jun 17 15:39:54.076862 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 997/2410] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:39:53 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:39:54.152650 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-425a0310-8066-496a-88da-3340af287822 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:54.153265 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-425a0310-8066-496a-88da-3340af287822 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:54.159662 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-425a0310-8066-496a-88da-3340af287822 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:54.160114 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-425a0310-8066-496a-88da-3340af287822 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:54.160903 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-425a0310-8066-496a-88da-3340af287822 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:54.161343 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-425a0310-8066-496a-88da-3340af287822 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:54.286271 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-425a0310-8066-496a-88da-3340af287822 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:54.288469 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=100 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:39:54.295532 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-425a0310-8066-496a-88da-3340af287822 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1601 microversion: 2.1 time: 0.146770 Jun 17 15:39:54.296136 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1414/2411] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:39:54 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1601 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:39:54.954919 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-53a68fef-48dc-44cc-94f4-4c9459e9ec7b tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:54.955565 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-53a68fef-48dc-44cc-94f4-4c9459e9ec7b tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:54.962141 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-53a68fef-48dc-44cc-94f4-4c9459e9ec7b tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:54.962583 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-53a68fef-48dc-44cc-94f4-4c9459e9ec7b tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:54.963334 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-53a68fef-48dc-44cc-94f4-4c9459e9ec7b tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:54.963756 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-53a68fef-48dc-44cc-94f4-4c9459e9ec7b tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:55.093016 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-53a68fef-48dc-44cc-94f4-4c9459e9ec7b tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:55.094996 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-546b8cad-a913-4a82-b7a2-4d083ec96f48 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:55.095611 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-546b8cad-a913-4a82-b7a2-4d083ec96f48 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:55.101973 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-53a68fef-48dc-44cc-94f4-4c9459e9ec7b tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.151109 Jun 17 15:39:55.102636 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 998/2412] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:39:54 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:39:55.102979 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-546b8cad-a913-4a82-b7a2-4d083ec96f48 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:55.103531 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-546b8cad-a913-4a82-b7a2-4d083ec96f48 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:55.104303 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-546b8cad-a913-4a82-b7a2-4d083ec96f48 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:55.104785 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-546b8cad-a913-4a82-b7a2-4d083ec96f48 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:55.169098 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-546b8cad-a913-4a82-b7a2-4d083ec96f48 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:55.178219 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-546b8cad-a913-4a82-b7a2-4d083ec96f48 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:55.179764 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-546b8cad-a913-4a82-b7a2-4d083ec96f48 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:55.180947 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-546b8cad-a913-4a82-b7a2-4d083ec96f48 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.090034 Jun 17 15:39:55.181526 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1415/2413] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:39:55 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 15:39:55.313520 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-423462bc-0417-49e7-9393-223453a71b00 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:55.314183 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-423462bc-0417-49e7-9393-223453a71b00 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:55.320675 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-423462bc-0417-49e7-9393-223453a71b00 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:55.321120 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-423462bc-0417-49e7-9393-223453a71b00 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:55.321864 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-423462bc-0417-49e7-9393-223453a71b00 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:55.322293 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-423462bc-0417-49e7-9393-223453a71b00 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:55.447867 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-423462bc-0417-49e7-9393-223453a71b00 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:55.455977 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-423462bc-0417-49e7-9393-223453a71b00 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1601 microversion: 2.1 time: 0.146759 Jun 17 15:39:55.457131 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 999/2414] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:39:55 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1601 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:39:56.119467 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-6c71a172-f895-4ea6-8092-0089536f30fb tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:56.120090 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-6c71a172-f895-4ea6-8092-0089536f30fb tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:56.126361 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6c71a172-f895-4ea6-8092-0089536f30fb tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:56.126807 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6c71a172-f895-4ea6-8092-0089536f30fb tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:56.127564 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6c71a172-f895-4ea6-8092-0089536f30fb tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:56.128044 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6c71a172-f895-4ea6-8092-0089536f30fb tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:56.198745 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-826c9844-ed9d-4e9a-b9c1-fc5562d50e15 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:56.199472 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-826c9844-ed9d-4e9a-b9c1-fc5562d50e15 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:56.206408 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-826c9844-ed9d-4e9a-b9c1-fc5562d50e15 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:56.206851 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-826c9844-ed9d-4e9a-b9c1-fc5562d50e15 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:56.207613 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-826c9844-ed9d-4e9a-b9c1-fc5562d50e15 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:56.208042 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-826c9844-ed9d-4e9a-b9c1-fc5562d50e15 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:56.266580 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-6c71a172-f895-4ea6-8092-0089536f30fb tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:56.278921 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-6c71a172-f895-4ea6-8092-0089536f30fb tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.162764 Jun 17 15:39:56.280847 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1416/2415] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:39:56 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:39:56.282889 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-826c9844-ed9d-4e9a-b9c1-fc5562d50e15 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:56.292093 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-826c9844-ed9d-4e9a-b9c1-fc5562d50e15 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:56.293844 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-826c9844-ed9d-4e9a-b9c1-fc5562d50e15 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:56.294813 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-826c9844-ed9d-4e9a-b9c1-fc5562d50e15 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.099967 Jun 17 15:39:56.295369 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1000/2416] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:39:56 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 15:39:56.473228 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-ef552eb0-7063-4651-be3d-8297b1251eab tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:56.473846 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-ef552eb0-7063-4651-be3d-8297b1251eab tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:56.480662 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ef552eb0-7063-4651-be3d-8297b1251eab tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:56.481107 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ef552eb0-7063-4651-be3d-8297b1251eab tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:56.481879 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ef552eb0-7063-4651-be3d-8297b1251eab tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:56.482311 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ef552eb0-7063-4651-be3d-8297b1251eab tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:56.611763 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-ef552eb0-7063-4651-be3d-8297b1251eab tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:56.619797 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-ef552eb0-7063-4651-be3d-8297b1251eab tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1601 microversion: 2.1 time: 0.151091 Jun 17 15:39:56.620383 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1417/2417] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:39:56 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1601 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:39:57.297918 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-ab66ea66-b47c-473d-b4e0-819f545d9781 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:57.298612 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-ab66ea66-b47c-473d-b4e0-819f545d9781 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:57.305557 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ab66ea66-b47c-473d-b4e0-819f545d9781 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:57.306026 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ab66ea66-b47c-473d-b4e0-819f545d9781 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:57.306778 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ab66ea66-b47c-473d-b4e0-819f545d9781 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:57.307210 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ab66ea66-b47c-473d-b4e0-819f545d9781 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:57.313195 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-7f6e3c9f-2bd3-4503-b334-4f884690e192 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:57.313810 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-7f6e3c9f-2bd3-4503-b334-4f884690e192 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:57.321054 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7f6e3c9f-2bd3-4503-b334-4f884690e192 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:57.321500 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7f6e3c9f-2bd3-4503-b334-4f884690e192 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:57.322266 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7f6e3c9f-2bd3-4503-b334-4f884690e192 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:57.322704 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7f6e3c9f-2bd3-4503-b334-4f884690e192 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:57.393986 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-7f6e3c9f-2bd3-4503-b334-4f884690e192 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:57.402593 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-7f6e3c9f-2bd3-4503-b334-4f884690e192 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:57.404098 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-7f6e3c9f-2bd3-4503-b334-4f884690e192 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:57.405267 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-7f6e3c9f-2bd3-4503-b334-4f884690e192 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.095972 Jun 17 15:39:57.405957 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1418/2418] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:39:57 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 15:39:57.442939 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-ab66ea66-b47c-473d-b4e0-819f545d9781 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:57.445160 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell1:SELECT=100 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:39:57.452238 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-ab66ea66-b47c-473d-b4e0-819f545d9781 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.158248 Jun 17 15:39:57.452838 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1001/2419] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:39:57 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:39:57.636065 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-3aa7a188-e000-4b17-8547-14089c05ca24 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:57.636702 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-3aa7a188-e000-4b17-8547-14089c05ca24 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:57.642728 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3aa7a188-e000-4b17-8547-14089c05ca24 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:57.643173 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3aa7a188-e000-4b17-8547-14089c05ca24 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:57.643931 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3aa7a188-e000-4b17-8547-14089c05ca24 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:57.644387 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3aa7a188-e000-4b17-8547-14089c05ca24 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:57.774166 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-3aa7a188-e000-4b17-8547-14089c05ca24 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:57.782182 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-3aa7a188-e000-4b17-8547-14089c05ca24 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1601 microversion: 2.1 time: 0.150037 Jun 17 15:39:57.782746 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1419/2420] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:39:57 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1601 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:39:58.423134 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-ba0d634d-0323-4edf-9bab-5dbfa8831d94 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:58.423751 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-ba0d634d-0323-4edf-9bab-5dbfa8831d94 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:58.430243 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ba0d634d-0323-4edf-9bab-5dbfa8831d94 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:58.430685 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ba0d634d-0323-4edf-9bab-5dbfa8831d94 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:58.431434 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ba0d634d-0323-4edf-9bab-5dbfa8831d94 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:58.431860 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ba0d634d-0323-4edf-9bab-5dbfa8831d94 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:58.469272 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-0626b65e-498e-450e-9366-1fc60e884a94 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:58.469880 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-0626b65e-498e-450e-9366-1fc60e884a94 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:58.476852 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0626b65e-498e-450e-9366-1fc60e884a94 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:58.477300 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0626b65e-498e-450e-9366-1fc60e884a94 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:58.478064 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0626b65e-498e-450e-9366-1fc60e884a94 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:58.478488 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0626b65e-498e-450e-9366-1fc60e884a94 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:58.494043 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-ba0d634d-0323-4edf-9bab-5dbfa8831d94 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:58.502668 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-ba0d634d-0323-4edf-9bab-5dbfa8831d94 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:58.504933 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-ba0d634d-0323-4edf-9bab-5dbfa8831d94 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:58.506288 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-ba0d634d-0323-4edf-9bab-5dbfa8831d94 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.087051 Jun 17 15:39:58.507036 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1002/2421] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:39:58 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:39:58.610918 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-0626b65e-498e-450e-9366-1fc60e884a94 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:58.618823 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-0626b65e-498e-450e-9366-1fc60e884a94 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.153491 Jun 17 15:39:58.619389 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1420/2422] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:39:58 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:39:58.799010 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-674bc182-6639-46a1-b0cb-16487e4f8256 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:58.799537 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-674bc182-6639-46a1-b0cb-16487e4f8256 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:58.806265 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-674bc182-6639-46a1-b0cb-16487e4f8256 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:58.806708 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-674bc182-6639-46a1-b0cb-16487e4f8256 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:58.807456 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-674bc182-6639-46a1-b0cb-16487e4f8256 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:58.807883 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-674bc182-6639-46a1-b0cb-16487e4f8256 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:58.942494 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-674bc182-6639-46a1-b0cb-16487e4f8256 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:58.950606 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-674bc182-6639-46a1-b0cb-16487e4f8256 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1601 microversion: 2.1 time: 0.155419 Jun 17 15:39:58.951171 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1003/2423] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:39:58 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1601 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:39:59.528581 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-d146a672-e434-42d2-82a8-1bed2df0cd7d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:59.529192 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-d146a672-e434-42d2-82a8-1bed2df0cd7d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:59.536457 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d146a672-e434-42d2-82a8-1bed2df0cd7d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:59.536894 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d146a672-e434-42d2-82a8-1bed2df0cd7d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:59.537654 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d146a672-e434-42d2-82a8-1bed2df0cd7d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:59.538092 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d146a672-e434-42d2-82a8-1bed2df0cd7d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:59.602971 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-d146a672-e434-42d2-82a8-1bed2df0cd7d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:59.611509 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-d146a672-e434-42d2-82a8-1bed2df0cd7d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:59.613039 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-d146a672-e434-42d2-82a8-1bed2df0cd7d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:59.614173 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-d146a672-e434-42d2-82a8-1bed2df0cd7d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.089550 Jun 17 15:39:59.614725 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1421/2424] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:39:59 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:39:59.634936 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-4cbfe617-49d2-4482-ba3c-7d073a3b3e6d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:59.635461 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-4cbfe617-49d2-4482-ba3c-7d073a3b3e6d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:59.641832 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4cbfe617-49d2-4482-ba3c-7d073a3b3e6d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:59.642278 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4cbfe617-49d2-4482-ba3c-7d073a3b3e6d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:59.643024 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4cbfe617-49d2-4482-ba3c-7d073a3b3e6d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:59.643450 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4cbfe617-49d2-4482-ba3c-7d073a3b3e6d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:59.773579 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-4cbfe617-49d2-4482-ba3c-7d073a3b3e6d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:39:59.781452 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-4cbfe617-49d2-4482-ba3c-7d073a3b3e6d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.150390 Jun 17 15:39:59.782010 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1004/2425] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:39:59 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:39:59.968253 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-cf2352c9-b4c2-4539-8dab-c431cfd1e24f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:39:59.968812 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-cf2352c9-b4c2-4539-8dab-c431cfd1e24f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:39:59.974985 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cf2352c9-b4c2-4539-8dab-c431cfd1e24f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:59.975683 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cf2352c9-b4c2-4539-8dab-c431cfd1e24f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:39:59.976475 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cf2352c9-b4c2-4539-8dab-c431cfd1e24f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:39:59.976923 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cf2352c9-b4c2-4539-8dab-c431cfd1e24f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:00.106711 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-cf2352c9-b4c2-4539-8dab-c431cfd1e24f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:00.115542 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-cf2352c9-b4c2-4539-8dab-c431cfd1e24f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1601 microversion: 2.1 time: 0.151469 Jun 17 15:40:00.116116 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1422/2426] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:39:59 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1601 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:40:00.632162 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-3568a8cb-1b63-4e1f-82e7-7db0961d0941 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:00.632913 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-3568a8cb-1b63-4e1f-82e7-7db0961d0941 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:00.639815 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3568a8cb-1b63-4e1f-82e7-7db0961d0941 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:00.640408 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3568a8cb-1b63-4e1f-82e7-7db0961d0941 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:00.641022 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3568a8cb-1b63-4e1f-82e7-7db0961d0941 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:00.641453 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3568a8cb-1b63-4e1f-82e7-7db0961d0941 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:00.703948 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-3568a8cb-1b63-4e1f-82e7-7db0961d0941 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:00.713282 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-3568a8cb-1b63-4e1f-82e7-7db0961d0941 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:00.714840 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-3568a8cb-1b63-4e1f-82e7-7db0961d0941 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:00.715993 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-3568a8cb-1b63-4e1f-82e7-7db0961d0941 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.088617 Jun 17 15:40:00.716833 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1005/2427] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:40:00 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:40:00.798536 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-4a3599fc-769d-4a0c-83ad-0538d3b54657 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:00.799146 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-4a3599fc-769d-4a0c-83ad-0538d3b54657 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:00.806808 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4a3599fc-769d-4a0c-83ad-0538d3b54657 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:00.807362 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4a3599fc-769d-4a0c-83ad-0538d3b54657 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:00.808120 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4a3599fc-769d-4a0c-83ad-0538d3b54657 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:00.808591 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4a3599fc-769d-4a0c-83ad-0538d3b54657 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:00.948576 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-4a3599fc-769d-4a0c-83ad-0538d3b54657 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:00.956790 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-4a3599fc-769d-4a0c-83ad-0538d3b54657 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.162091 Jun 17 15:40:00.957363 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1423/2428] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:40:00 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:40:01.132817 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-599b9a72-6708-4a44-b03d-aea1b2df7180 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:01.133421 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-599b9a72-6708-4a44-b03d-aea1b2df7180 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:01.139446 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-599b9a72-6708-4a44-b03d-aea1b2df7180 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:01.139887 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-599b9a72-6708-4a44-b03d-aea1b2df7180 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:01.140663 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-599b9a72-6708-4a44-b03d-aea1b2df7180 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:01.141094 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-599b9a72-6708-4a44-b03d-aea1b2df7180 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:01.277485 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-599b9a72-6708-4a44-b03d-aea1b2df7180 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:01.285377 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-599b9a72-6708-4a44-b03d-aea1b2df7180 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1601 microversion: 2.1 time: 0.156436 Jun 17 15:40:01.285955 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1006/2429] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:40:01 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1601 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:40:01.736208 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-d372834c-920f-408d-a005-800a11a7fd8a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:01.736845 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-d372834c-920f-408d-a005-800a11a7fd8a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:01.743302 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d372834c-920f-408d-a005-800a11a7fd8a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:01.743749 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d372834c-920f-408d-a005-800a11a7fd8a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:01.744535 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d372834c-920f-408d-a005-800a11a7fd8a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:01.744973 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d372834c-920f-408d-a005-800a11a7fd8a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:01.808030 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-d372834c-920f-408d-a005-800a11a7fd8a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:01.816429 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-d372834c-920f-408d-a005-800a11a7fd8a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:01.817922 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-d372834c-920f-408d-a005-800a11a7fd8a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:01.819706 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-d372834c-920f-408d-a005-800a11a7fd8a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.087442 Jun 17 15:40:01.820265 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1424/2430] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:40:01 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:40:01.977272 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-25108e07-7910-49f4-9ad0-1d0ed0c2a228 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:01.977803 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-25108e07-7910-49f4-9ad0-1d0ed0c2a228 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:01.984398 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-25108e07-7910-49f4-9ad0-1d0ed0c2a228 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:01.984862 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-25108e07-7910-49f4-9ad0-1d0ed0c2a228 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:01.985635 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-25108e07-7910-49f4-9ad0-1d0ed0c2a228 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:01.986075 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-25108e07-7910-49f4-9ad0-1d0ed0c2a228 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:02.114644 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-25108e07-7910-49f4-9ad0-1d0ed0c2a228 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:02.123240 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-25108e07-7910-49f4-9ad0-1d0ed0c2a228 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.150743 Jun 17 15:40:02.123812 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1007/2431] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:40:01 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:40:02.302888 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-7c9f3137-6dc2-4476-8374-749779e38ff7 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:02.304032 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-7c9f3137-6dc2-4476-8374-749779e38ff7 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:02.310018 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7c9f3137-6dc2-4476-8374-749779e38ff7 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:02.310460 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7c9f3137-6dc2-4476-8374-749779e38ff7 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:02.311203 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7c9f3137-6dc2-4476-8374-749779e38ff7 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:02.311628 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7c9f3137-6dc2-4476-8374-749779e38ff7 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:02.446555 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-7c9f3137-6dc2-4476-8374-749779e38ff7 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:02.454731 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-7c9f3137-6dc2-4476-8374-749779e38ff7 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1601 microversion: 2.1 time: 0.155754 Jun 17 15:40:02.455306 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1425/2432] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:40:02 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1601 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:40:02.837982 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-2ba6e800-b895-423d-a877-f4adaa55d46f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:02.838614 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-2ba6e800-b895-423d-a877-f4adaa55d46f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:02.844624 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2ba6e800-b895-423d-a877-f4adaa55d46f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:02.845067 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2ba6e800-b895-423d-a877-f4adaa55d46f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:02.845809 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2ba6e800-b895-423d-a877-f4adaa55d46f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:02.846235 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2ba6e800-b895-423d-a877-f4adaa55d46f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:02.906518 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-2ba6e800-b895-423d-a877-f4adaa55d46f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:02.914776 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-2ba6e800-b895-423d-a877-f4adaa55d46f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:02.916273 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-2ba6e800-b895-423d-a877-f4adaa55d46f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:02.917444 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-2ba6e800-b895-423d-a877-f4adaa55d46f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.084019 Jun 17 15:40:02.918002 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1008/2433] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:40:02 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:40:03.140668 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-0e990a21-3d3e-47f6-86d5-5812052c0e33 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:03.141221 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-0e990a21-3d3e-47f6-86d5-5812052c0e33 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:03.147811 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0e990a21-3d3e-47f6-86d5-5812052c0e33 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:03.148262 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0e990a21-3d3e-47f6-86d5-5812052c0e33 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:03.149056 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0e990a21-3d3e-47f6-86d5-5812052c0e33 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:03.149492 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0e990a21-3d3e-47f6-86d5-5812052c0e33 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:03.275999 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-0e990a21-3d3e-47f6-86d5-5812052c0e33 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:03.283902 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-0e990a21-3d3e-47f6-86d5-5812052c0e33 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.147278 Jun 17 15:40:03.284497 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1426/2434] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:40:03 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:40:03.472450 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-091b83a2-9bb7-4933-abfd-859eab3a8559 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:03.473017 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-091b83a2-9bb7-4933-abfd-859eab3a8559 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:03.480383 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-091b83a2-9bb7-4933-abfd-859eab3a8559 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:03.480826 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-091b83a2-9bb7-4933-abfd-859eab3a8559 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:03.481582 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-091b83a2-9bb7-4933-abfd-859eab3a8559 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:03.482008 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-091b83a2-9bb7-4933-abfd-859eab3a8559 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:03.617681 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-091b83a2-9bb7-4933-abfd-859eab3a8559 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:03.625608 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-091b83a2-9bb7-4933-abfd-859eab3a8559 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1601 microversion: 2.1 time: 0.157113 Jun 17 15:40:03.626175 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1009/2435] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:40:03 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1601 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:40:03.935218 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-842b3296-6ba7-4190-ba7e-a2bde42c0f1b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:03.935826 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-842b3296-6ba7-4190-ba7e-a2bde42c0f1b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:03.942033 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-842b3296-6ba7-4190-ba7e-a2bde42c0f1b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:03.942479 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-842b3296-6ba7-4190-ba7e-a2bde42c0f1b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:03.943232 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-842b3296-6ba7-4190-ba7e-a2bde42c0f1b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:03.943662 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-842b3296-6ba7-4190-ba7e-a2bde42c0f1b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:04.009931 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-842b3296-6ba7-4190-ba7e-a2bde42c0f1b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:04.018497 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-842b3296-6ba7-4190-ba7e-a2bde42c0f1b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:04.019987 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-842b3296-6ba7-4190-ba7e-a2bde42c0f1b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:04.021143 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-842b3296-6ba7-4190-ba7e-a2bde42c0f1b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.089949 Jun 17 15:40:04.022183 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1427/2436] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:40:03 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:40:04.303601 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-eb1e3544-ca69-425d-b409-4b9387e7fd43 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:04.304463 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-eb1e3544-ca69-425d-b409-4b9387e7fd43 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:04.314385 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-eb1e3544-ca69-425d-b409-4b9387e7fd43 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:04.315063 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-eb1e3544-ca69-425d-b409-4b9387e7fd43 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:04.316256 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-eb1e3544-ca69-425d-b409-4b9387e7fd43 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:04.316866 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-eb1e3544-ca69-425d-b409-4b9387e7fd43 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:04.463475 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-eb1e3544-ca69-425d-b409-4b9387e7fd43 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:04.471821 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-eb1e3544-ca69-425d-b409-4b9387e7fd43 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.174726 Jun 17 15:40:04.472399 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1010/2437] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:40:04 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:40:04.642712 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-2aff995e-bc90-4c75-a041-59030289236c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:04.643343 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-2aff995e-bc90-4c75-a041-59030289236c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:04.649965 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2aff995e-bc90-4c75-a041-59030289236c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:04.650410 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2aff995e-bc90-4c75-a041-59030289236c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:04.651162 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2aff995e-bc90-4c75-a041-59030289236c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:04.651601 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2aff995e-bc90-4c75-a041-59030289236c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:04.777429 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-2aff995e-bc90-4c75-a041-59030289236c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:04.785253 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-2aff995e-bc90-4c75-a041-59030289236c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1601 microversion: 2.1 time: 0.146423 Jun 17 15:40:04.785810 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1428/2438] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:40:04 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1601 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:40:05.040607 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-6bdf85b4-ed25-43f6-9b4f-550acf4b7369 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:05.041199 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-6bdf85b4-ed25-43f6-9b4f-550acf4b7369 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:05.047784 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6bdf85b4-ed25-43f6-9b4f-550acf4b7369 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:05.048226 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6bdf85b4-ed25-43f6-9b4f-550acf4b7369 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:05.049028 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6bdf85b4-ed25-43f6-9b4f-550acf4b7369 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:05.049451 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6bdf85b4-ed25-43f6-9b4f-550acf4b7369 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:05.117772 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-6bdf85b4-ed25-43f6-9b4f-550acf4b7369 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:05.126792 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-6bdf85b4-ed25-43f6-9b4f-550acf4b7369 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:05.128268 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-6bdf85b4-ed25-43f6-9b4f-550acf4b7369 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:05.129447 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-6bdf85b4-ed25-43f6-9b4f-550acf4b7369 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.094157 Jun 17 15:40:05.130008 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1011/2439] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:40:05 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:40:05.489025 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-51679ca1-6b63-46c8-8875-5621c4822bdd tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:05.489634 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-51679ca1-6b63-46c8-8875-5621c4822bdd tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:05.495975 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-51679ca1-6b63-46c8-8875-5621c4822bdd tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:05.496460 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-51679ca1-6b63-46c8-8875-5621c4822bdd tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:05.497226 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-51679ca1-6b63-46c8-8875-5621c4822bdd tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:05.497660 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-51679ca1-6b63-46c8-8875-5621c4822bdd tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:05.631116 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-51679ca1-6b63-46c8-8875-5621c4822bdd tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:05.639436 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-51679ca1-6b63-46c8-8875-5621c4822bdd tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.154200 Jun 17 15:40:05.640016 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1429/2440] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:40:05 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:40:05.802403 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-9bebcbb9-933b-471a-8f0e-1ce96bd49bae tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:05.803008 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-9bebcbb9-933b-471a-8f0e-1ce96bd49bae tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:05.809122 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9bebcbb9-933b-471a-8f0e-1ce96bd49bae tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:05.809562 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9bebcbb9-933b-471a-8f0e-1ce96bd49bae tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:05.810317 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9bebcbb9-933b-471a-8f0e-1ce96bd49bae tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:05.810748 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9bebcbb9-933b-471a-8f0e-1ce96bd49bae tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:05.968495 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-9bebcbb9-933b-471a-8f0e-1ce96bd49bae tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:05.976698 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-9bebcbb9-933b-471a-8f0e-1ce96bd49bae tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1601 microversion: 2.1 time: 0.178203 Jun 17 15:40:05.977268 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1012/2441] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:40:05 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1601 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:40:06.147939 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-c6b7f357-6078-42d6-aabc-7e47fdcdba00 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:06.149387 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-c6b7f357-6078-42d6-aabc-7e47fdcdba00 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:06.156276 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c6b7f357-6078-42d6-aabc-7e47fdcdba00 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:06.156759 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c6b7f357-6078-42d6-aabc-7e47fdcdba00 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:06.157541 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c6b7f357-6078-42d6-aabc-7e47fdcdba00 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:06.157980 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c6b7f357-6078-42d6-aabc-7e47fdcdba00 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:06.226508 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-c6b7f357-6078-42d6-aabc-7e47fdcdba00 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:06.236279 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-c6b7f357-6078-42d6-aabc-7e47fdcdba00 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:06.237870 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-c6b7f357-6078-42d6-aabc-7e47fdcdba00 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:06.239105 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-c6b7f357-6078-42d6-aabc-7e47fdcdba00 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.095406 Jun 17 15:40:06.239679 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1430/2442] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:40:06 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:40:06.661061 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-37a31023-4334-4729-86c1-8eb56fd0c860 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:06.661675 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-37a31023-4334-4729-86c1-8eb56fd0c860 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:06.668897 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-37a31023-4334-4729-86c1-8eb56fd0c860 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:06.669345 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-37a31023-4334-4729-86c1-8eb56fd0c860 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:06.670112 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-37a31023-4334-4729-86c1-8eb56fd0c860 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:06.670547 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-37a31023-4334-4729-86c1-8eb56fd0c860 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:06.806695 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-37a31023-4334-4729-86c1-8eb56fd0c860 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:06.815112 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-37a31023-4334-4729-86c1-8eb56fd0c860 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.157679 Jun 17 15:40:06.815704 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1013/2443] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:40:06 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:40:06.993898 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-006d5082-d098-40c9-ac6b-3b1d6ccb1396 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:06.994458 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-006d5082-d098-40c9-ac6b-3b1d6ccb1396 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:07.000688 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-006d5082-d098-40c9-ac6b-3b1d6ccb1396 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:07.001132 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-006d5082-d098-40c9-ac6b-3b1d6ccb1396 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:07.001893 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-006d5082-d098-40c9-ac6b-3b1d6ccb1396 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:07.002325 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-006d5082-d098-40c9-ac6b-3b1d6ccb1396 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:07.017424 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=100 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:40:07.134774 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-006d5082-d098-40c9-ac6b-3b1d6ccb1396 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:07.142789 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-006d5082-d098-40c9-ac6b-3b1d6ccb1396 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1601 microversion: 2.1 time: 0.152910 Jun 17 15:40:07.143363 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1431/2444] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:40:06 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1601 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:40:07.258416 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-dcb807c7-418c-428d-a921-4dbd9a4a6783 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:07.258943 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-dcb807c7-418c-428d-a921-4dbd9a4a6783 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:07.265040 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-dcb807c7-418c-428d-a921-4dbd9a4a6783 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:07.265488 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-dcb807c7-418c-428d-a921-4dbd9a4a6783 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:07.266251 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-dcb807c7-418c-428d-a921-4dbd9a4a6783 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:07.266678 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-dcb807c7-418c-428d-a921-4dbd9a4a6783 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:07.483002 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-dcb807c7-418c-428d-a921-4dbd9a4a6783 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:07.492455 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-dcb807c7-418c-428d-a921-4dbd9a4a6783 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:07.493938 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-dcb807c7-418c-428d-a921-4dbd9a4a6783 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:07.495078 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-dcb807c7-418c-428d-a921-4dbd9a4a6783 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.241161 Jun 17 15:40:07.495627 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1014/2445] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:40:07 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:40:07.832076 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-1dd5d5fb-61f6-415f-92c5-325c989d7824 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:07.832717 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-1dd5d5fb-61f6-415f-92c5-325c989d7824 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:07.839847 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1dd5d5fb-61f6-415f-92c5-325c989d7824 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:07.840294 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1dd5d5fb-61f6-415f-92c5-325c989d7824 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:07.841093 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1dd5d5fb-61f6-415f-92c5-325c989d7824 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:07.841533 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1dd5d5fb-61f6-415f-92c5-325c989d7824 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:07.971854 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-1dd5d5fb-61f6-415f-92c5-325c989d7824 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:07.980059 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-1dd5d5fb-61f6-415f-92c5-325c989d7824 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.152164 Jun 17 15:40:07.980656 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1432/2446] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:40:07 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:40:08.160457 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-78a27ce6-f496-44e5-abb3-280aba35966e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:08.161050 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-78a27ce6-f496-44e5-abb3-280aba35966e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:08.168411 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-78a27ce6-f496-44e5-abb3-280aba35966e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:08.168858 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-78a27ce6-f496-44e5-abb3-280aba35966e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:08.169662 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-78a27ce6-f496-44e5-abb3-280aba35966e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:08.170042 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-78a27ce6-f496-44e5-abb3-280aba35966e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:08.301527 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-78a27ce6-f496-44e5-abb3-280aba35966e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:08.310207 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-78a27ce6-f496-44e5-abb3-280aba35966e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1601 microversion: 2.1 time: 0.153559 Jun 17 15:40:08.310762 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1015/2447] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:40:08 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1601 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:40:08.513737 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-d565254c-2bdc-4cdb-a12d-889d31f6e3f4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:08.514265 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-d565254c-2bdc-4cdb-a12d-889d31f6e3f4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:08.520654 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d565254c-2bdc-4cdb-a12d-889d31f6e3f4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:08.521100 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d565254c-2bdc-4cdb-a12d-889d31f6e3f4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:08.521921 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d565254c-2bdc-4cdb-a12d-889d31f6e3f4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:08.522357 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d565254c-2bdc-4cdb-a12d-889d31f6e3f4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:08.589707 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-d565254c-2bdc-4cdb-a12d-889d31f6e3f4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:08.598883 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-d565254c-2bdc-4cdb-a12d-889d31f6e3f4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:08.601036 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-d565254c-2bdc-4cdb-a12d-889d31f6e3f4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:08.602383 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-d565254c-2bdc-4cdb-a12d-889d31f6e3f4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.092741 Jun 17 15:40:08.602996 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1433/2448] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:40:08 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:40:08.997093 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-2b169109-4fc5-49d9-a34b-6d6c424b47d3 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:08.997708 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-2b169109-4fc5-49d9-a34b-6d6c424b47d3 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:09.003738 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2b169109-4fc5-49d9-a34b-6d6c424b47d3 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:09.004185 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2b169109-4fc5-49d9-a34b-6d6c424b47d3 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:09.004985 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2b169109-4fc5-49d9-a34b-6d6c424b47d3 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:09.005416 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2b169109-4fc5-49d9-a34b-6d6c424b47d3 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:09.138251 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-2b169109-4fc5-49d9-a34b-6d6c424b47d3 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:09.146281 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-2b169109-4fc5-49d9-a34b-6d6c424b47d3 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.153049 Jun 17 15:40:09.146890 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1016/2449] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:40:08 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:40:09.328263 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-0d5add78-1ea5-4dec-b308-63df25149adb tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:09.328858 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-0d5add78-1ea5-4dec-b308-63df25149adb tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:09.335409 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0d5add78-1ea5-4dec-b308-63df25149adb tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:09.335851 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0d5add78-1ea5-4dec-b308-63df25149adb tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:09.336642 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0d5add78-1ea5-4dec-b308-63df25149adb tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:09.337094 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0d5add78-1ea5-4dec-b308-63df25149adb tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:09.468128 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-0d5add78-1ea5-4dec-b308-63df25149adb tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:09.476902 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-0d5add78-1ea5-4dec-b308-63df25149adb tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1601 microversion: 2.1 time: 0.152534 Jun 17 15:40:09.477477 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1434/2450] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:40:09 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1601 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:40:09.621344 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-5ae6ea5c-4fd4-4481-a935-8001b46b75cc tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:09.621951 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-5ae6ea5c-4fd4-4481-a935-8001b46b75cc tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:09.628512 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5ae6ea5c-4fd4-4481-a935-8001b46b75cc tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:09.628951 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5ae6ea5c-4fd4-4481-a935-8001b46b75cc tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:09.629705 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5ae6ea5c-4fd4-4481-a935-8001b46b75cc tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:09.630128 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5ae6ea5c-4fd4-4481-a935-8001b46b75cc tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:09.699959 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-5ae6ea5c-4fd4-4481-a935-8001b46b75cc tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:09.708434 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-5ae6ea5c-4fd4-4481-a935-8001b46b75cc tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:09.709903 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-5ae6ea5c-4fd4-4481-a935-8001b46b75cc tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:09.711026 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-5ae6ea5c-4fd4-4481-a935-8001b46b75cc tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.093607 Jun 17 15:40:09.711568 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1017/2451] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:40:09 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:40:10.164787 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-f53e4183-4b9d-4d5c-81d4-7a2969e15b1d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:10.165518 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-f53e4183-4b9d-4d5c-81d4-7a2969e15b1d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:10.172505 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f53e4183-4b9d-4d5c-81d4-7a2969e15b1d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:10.172950 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f53e4183-4b9d-4d5c-81d4-7a2969e15b1d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:10.173726 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f53e4183-4b9d-4d5c-81d4-7a2969e15b1d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:10.174156 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f53e4183-4b9d-4d5c-81d4-7a2969e15b1d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:10.321682 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-f53e4183-4b9d-4d5c-81d4-7a2969e15b1d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:10.330397 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-f53e4183-4b9d-4d5c-81d4-7a2969e15b1d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.170412 Jun 17 15:40:10.331062 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1435/2452] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:40:10 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:40:10.493763 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-a51f9798-22ea-42f7-a5c2-0cd7bc22b6f6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:10.494297 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-a51f9798-22ea-42f7-a5c2-0cd7bc22b6f6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:10.500385 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a51f9798-22ea-42f7-a5c2-0cd7bc22b6f6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:10.500844 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a51f9798-22ea-42f7-a5c2-0cd7bc22b6f6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:10.501606 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a51f9798-22ea-42f7-a5c2-0cd7bc22b6f6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:10.502041 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a51f9798-22ea-42f7-a5c2-0cd7bc22b6f6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:10.517392 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell1:SELECT=100 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:40:10.729689 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-b06998fe-4a03-42cc-902e-d20a256deaa8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:10.732254 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-b06998fe-4a03-42cc-902e-d20a256deaa8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:10.739207 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b06998fe-4a03-42cc-902e-d20a256deaa8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:10.739654 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b06998fe-4a03-42cc-902e-d20a256deaa8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:10.741047 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b06998fe-4a03-42cc-902e-d20a256deaa8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:10.741485 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b06998fe-4a03-42cc-902e-d20a256deaa8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:10.812113 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-b06998fe-4a03-42cc-902e-d20a256deaa8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:10.822094 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-b06998fe-4a03-42cc-902e-d20a256deaa8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:10.823603 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-b06998fe-4a03-42cc-902e-d20a256deaa8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:10.824783 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-b06998fe-4a03-42cc-902e-d20a256deaa8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.099626 Jun 17 15:40:10.825340 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1436/2453] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:40:10 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 15:40:10.875286 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-a51f9798-22ea-42f7-a5c2-0cd7bc22b6f6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:10.883941 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-a51f9798-22ea-42f7-a5c2-0cd7bc22b6f6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1601 microversion: 2.1 time: 0.394044 Jun 17 15:40:10.884541 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1018/2454] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:40:10 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1601 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:40:11.348186 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-a2256dcb-1972-47ee-8abf-20b2e1ef69b7 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:11.348820 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-a2256dcb-1972-47ee-8abf-20b2e1ef69b7 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:11.355598 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a2256dcb-1972-47ee-8abf-20b2e1ef69b7 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:11.356032 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a2256dcb-1972-47ee-8abf-20b2e1ef69b7 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:11.356815 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a2256dcb-1972-47ee-8abf-20b2e1ef69b7 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:11.357242 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a2256dcb-1972-47ee-8abf-20b2e1ef69b7 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:11.495917 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-a2256dcb-1972-47ee-8abf-20b2e1ef69b7 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:11.504618 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-a2256dcb-1972-47ee-8abf-20b2e1ef69b7 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.160155 Jun 17 15:40:11.505206 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1437/2455] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:40:11 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:40:11.843042 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-d5ad38bb-338c-4ac3-a2e2-05866f238027 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:11.843643 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-d5ad38bb-338c-4ac3-a2e2-05866f238027 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:11.851178 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d5ad38bb-338c-4ac3-a2e2-05866f238027 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:11.851617 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d5ad38bb-338c-4ac3-a2e2-05866f238027 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:11.852397 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d5ad38bb-338c-4ac3-a2e2-05866f238027 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:11.852826 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d5ad38bb-338c-4ac3-a2e2-05866f238027 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:11.901496 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-04044e84-25f2-4147-bd91-90cb0e238ff3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:11.902223 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-04044e84-25f2-4147-bd91-90cb0e238ff3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:11.909227 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-04044e84-25f2-4147-bd91-90cb0e238ff3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:11.910088 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-04044e84-25f2-4147-bd91-90cb0e238ff3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:11.910619 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-04044e84-25f2-4147-bd91-90cb0e238ff3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:11.911483 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-04044e84-25f2-4147-bd91-90cb0e238ff3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:11.914379 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-d5ad38bb-338c-4ac3-a2e2-05866f238027 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:11.923368 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-d5ad38bb-338c-4ac3-a2e2-05866f238027 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:11.924863 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-d5ad38bb-338c-4ac3-a2e2-05866f238027 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:11.925955 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-d5ad38bb-338c-4ac3-a2e2-05866f238027 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.086795 Jun 17 15:40:11.926504 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1019/2456] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:40:11 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:40:12.058214 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-04044e84-25f2-4147-bd91-90cb0e238ff3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:12.066332 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-04044e84-25f2-4147-bd91-90cb0e238ff3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1601 microversion: 2.1 time: 0.169298 Jun 17 15:40:12.066915 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1438/2457] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:40:11 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1601 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:40:12.522625 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-621be3f8-299b-40d9-a259-9930790ee53c tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:12.523232 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-621be3f8-299b-40d9-a259-9930790ee53c tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:12.530181 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-621be3f8-299b-40d9-a259-9930790ee53c tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:12.530621 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-621be3f8-299b-40d9-a259-9930790ee53c tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:12.531372 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-621be3f8-299b-40d9-a259-9930790ee53c tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:12.531799 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-621be3f8-299b-40d9-a259-9930790ee53c tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:12.667987 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-621be3f8-299b-40d9-a259-9930790ee53c tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:12.676417 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-621be3f8-299b-40d9-a259-9930790ee53c tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.157476 Jun 17 15:40:12.677003 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1020/2458] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:40:12 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:40:12.943177 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-f99e6451-c37a-43d0-b2c9-fe89191675de tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:12.944276 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-f99e6451-c37a-43d0-b2c9-fe89191675de tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:12.951738 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f99e6451-c37a-43d0-b2c9-fe89191675de tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:12.952184 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f99e6451-c37a-43d0-b2c9-fe89191675de tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:12.953051 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f99e6451-c37a-43d0-b2c9-fe89191675de tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:12.953483 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f99e6451-c37a-43d0-b2c9-fe89191675de tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:13.015598 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-f99e6451-c37a-43d0-b2c9-fe89191675de tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:13.024791 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-f99e6451-c37a-43d0-b2c9-fe89191675de tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:13.026286 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-f99e6451-c37a-43d0-b2c9-fe89191675de tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:13.027417 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-f99e6451-c37a-43d0-b2c9-fe89191675de tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.088285 Jun 17 15:40:13.027971 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1439/2459] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:40:12 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:40:13.083126 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-3f77dad2-07d6-45eb-8578-f4229a12600c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:13.083745 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-3f77dad2-07d6-45eb-8578-f4229a12600c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:13.091168 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3f77dad2-07d6-45eb-8578-f4229a12600c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:13.091615 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3f77dad2-07d6-45eb-8578-f4229a12600c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:13.092414 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3f77dad2-07d6-45eb-8578-f4229a12600c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:13.092850 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3f77dad2-07d6-45eb-8578-f4229a12600c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:13.222263 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-3f77dad2-07d6-45eb-8578-f4229a12600c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:13.230913 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-3f77dad2-07d6-45eb-8578-f4229a12600c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1601 microversion: 2.1 time: 0.151589 Jun 17 15:40:13.231500 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1021/2460] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:40:13 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1601 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:40:13.695517 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-37749426-6bd7-4ce9-a590-e3697cb9e991 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:13.697869 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-37749426-6bd7-4ce9-a590-e3697cb9e991 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:13.702303 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-37749426-6bd7-4ce9-a590-e3697cb9e991 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:13.702752 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-37749426-6bd7-4ce9-a590-e3697cb9e991 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:13.703518 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-37749426-6bd7-4ce9-a590-e3697cb9e991 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:13.703955 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-37749426-6bd7-4ce9-a590-e3697cb9e991 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:13.854570 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-37749426-6bd7-4ce9-a590-e3697cb9e991 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:13.863280 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-37749426-6bd7-4ce9-a590-e3697cb9e991 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.172114 Jun 17 15:40:13.863864 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1440/2461] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:40:13 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:40:14.045716 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-a23c6e2f-1ef8-444a-abc7-1c91c9e30cf0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:14.046245 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-a23c6e2f-1ef8-444a-abc7-1c91c9e30cf0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:14.052348 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a23c6e2f-1ef8-444a-abc7-1c91c9e30cf0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:14.053289 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a23c6e2f-1ef8-444a-abc7-1c91c9e30cf0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:14.054064 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a23c6e2f-1ef8-444a-abc7-1c91c9e30cf0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:14.054501 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a23c6e2f-1ef8-444a-abc7-1c91c9e30cf0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:14.117527 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-a23c6e2f-1ef8-444a-abc7-1c91c9e30cf0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:14.126282 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-a23c6e2f-1ef8-444a-abc7-1c91c9e30cf0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:14.127777 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-a23c6e2f-1ef8-444a-abc7-1c91c9e30cf0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:14.128947 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-a23c6e2f-1ef8-444a-abc7-1c91c9e30cf0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.087234 Jun 17 15:40:14.129506 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1022/2462] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:40:14 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:40:14.247867 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-b416397d-72f7-4c75-b45e-fe44c017a697 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:14.248719 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-b416397d-72f7-4c75-b45e-fe44c017a697 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:14.255560 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b416397d-72f7-4c75-b45e-fe44c017a697 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:14.256056 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b416397d-72f7-4c75-b45e-fe44c017a697 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:14.257355 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b416397d-72f7-4c75-b45e-fe44c017a697 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:14.257790 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b416397d-72f7-4c75-b45e-fe44c017a697 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:14.393574 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-b416397d-72f7-4c75-b45e-fe44c017a697 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:14.401619 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-b416397d-72f7-4c75-b45e-fe44c017a697 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1601 microversion: 2.1 time: 0.157578 Jun 17 15:40:14.402187 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1441/2463] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:40:14 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1601 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:40:14.880289 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-bb947775-e227-4726-bd4d-f050733827aa tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:14.880925 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-bb947775-e227-4726-bd4d-f050733827aa tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:14.887574 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bb947775-e227-4726-bd4d-f050733827aa tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:14.888020 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bb947775-e227-4726-bd4d-f050733827aa tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:14.888839 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bb947775-e227-4726-bd4d-f050733827aa tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:14.889270 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bb947775-e227-4726-bd4d-f050733827aa tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:15.031461 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-bb947775-e227-4726-bd4d-f050733827aa tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:15.042585 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-bb947775-e227-4726-bd4d-f050733827aa tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.166052 Jun 17 15:40:15.043187 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1023/2464] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:40:14 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:40:15.148239 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-455c3260-158f-4843-86e4-03d2a064f6d1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:15.148782 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-455c3260-158f-4843-86e4-03d2a064f6d1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:15.150879 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_api:SELECT=82 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:40:15.156425 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-455c3260-158f-4843-86e4-03d2a064f6d1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:15.156870 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-455c3260-158f-4843-86e4-03d2a064f6d1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:15.157649 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-455c3260-158f-4843-86e4-03d2a064f6d1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:15.158072 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-455c3260-158f-4843-86e4-03d2a064f6d1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:15.224055 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-455c3260-158f-4843-86e4-03d2a064f6d1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:15.233778 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-455c3260-158f-4843-86e4-03d2a064f6d1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:15.235273 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-455c3260-158f-4843-86e4-03d2a064f6d1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:15.236475 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-455c3260-158f-4843-86e4-03d2a064f6d1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.092791 Jun 17 15:40:15.237030 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1442/2465] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:40:15 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:40:15.424345 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-082ce0e0-4f1e-4c63-b635-80d616dd666c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:15.425400 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-082ce0e0-4f1e-4c63-b635-80d616dd666c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:15.436043 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-082ce0e0-4f1e-4c63-b635-80d616dd666c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:15.436941 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-082ce0e0-4f1e-4c63-b635-80d616dd666c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:15.438359 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-082ce0e0-4f1e-4c63-b635-80d616dd666c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:15.439169 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-082ce0e0-4f1e-4c63-b635-80d616dd666c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:15.594497 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-082ce0e0-4f1e-4c63-b635-80d616dd666c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:15.602771 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-082ce0e0-4f1e-4c63-b635-80d616dd666c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1601 microversion: 2.1 time: 0.185857 Jun 17 15:40:15.603405 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1024/2466] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:40:15 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1601 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:40:16.065117 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-19059d4e-2840-47c9-95ad-fcd7bcc6cbe7 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:16.065926 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-19059d4e-2840-47c9-95ad-fcd7bcc6cbe7 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:16.073631 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-19059d4e-2840-47c9-95ad-fcd7bcc6cbe7 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:16.074126 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-19059d4e-2840-47c9-95ad-fcd7bcc6cbe7 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:16.075039 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-19059d4e-2840-47c9-95ad-fcd7bcc6cbe7 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:16.075516 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-19059d4e-2840-47c9-95ad-fcd7bcc6cbe7 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:16.228166 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-19059d4e-2840-47c9-95ad-fcd7bcc6cbe7 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:16.243009 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-19059d4e-2840-47c9-95ad-fcd7bcc6cbe7 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.181362 Jun 17 15:40:16.244082 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1443/2467] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:40:16 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:40:16.254601 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-70e4315b-2c9f-4a1b-8f03-cb3695d732ff tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:16.255338 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-70e4315b-2c9f-4a1b-8f03-cb3695d732ff tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:16.262374 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-70e4315b-2c9f-4a1b-8f03-cb3695d732ff tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:16.262917 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-70e4315b-2c9f-4a1b-8f03-cb3695d732ff tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:16.263769 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-70e4315b-2c9f-4a1b-8f03-cb3695d732ff tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:16.264309 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-70e4315b-2c9f-4a1b-8f03-cb3695d732ff tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:16.352302 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-70e4315b-2c9f-4a1b-8f03-cb3695d732ff tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:16.362215 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-70e4315b-2c9f-4a1b-8f03-cb3695d732ff tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:16.363751 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-70e4315b-2c9f-4a1b-8f03-cb3695d732ff tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:16.364950 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-70e4315b-2c9f-4a1b-8f03-cb3695d732ff tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.114357 Jun 17 15:40:16.366113 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1025/2468] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:40:16 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:40:16.619208 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-4620acc7-c0fd-4056-809a-4afea2c6434c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:16.619741 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-4620acc7-c0fd-4056-809a-4afea2c6434c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:16.626828 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4620acc7-c0fd-4056-809a-4afea2c6434c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:16.627279 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4620acc7-c0fd-4056-809a-4afea2c6434c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:16.628051 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4620acc7-c0fd-4056-809a-4afea2c6434c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:16.628524 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4620acc7-c0fd-4056-809a-4afea2c6434c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:16.772193 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-4620acc7-c0fd-4056-809a-4afea2c6434c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:16.780275 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-4620acc7-c0fd-4056-809a-4afea2c6434c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1601 microversion: 2.1 time: 0.165055 Jun 17 15:40:16.780870 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1444/2469] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:40:16 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1601 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:40:17.261430 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-885dacbe-38a1-4ab1-bb39-0f9715ae3649 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:17.262029 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-885dacbe-38a1-4ab1-bb39-0f9715ae3649 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:17.268929 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-885dacbe-38a1-4ab1-bb39-0f9715ae3649 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:17.269376 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-885dacbe-38a1-4ab1-bb39-0f9715ae3649 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:17.270145 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-885dacbe-38a1-4ab1-bb39-0f9715ae3649 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:17.270573 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-885dacbe-38a1-4ab1-bb39-0f9715ae3649 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:17.383807 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-84a17ca4-5cad-4bbe-bf61-35bb83507ca1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:17.384716 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-84a17ca4-5cad-4bbe-bf61-35bb83507ca1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:17.391442 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-84a17ca4-5cad-4bbe-bf61-35bb83507ca1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:17.391888 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-84a17ca4-5cad-4bbe-bf61-35bb83507ca1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:17.392681 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-84a17ca4-5cad-4bbe-bf61-35bb83507ca1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:17.393117 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-84a17ca4-5cad-4bbe-bf61-35bb83507ca1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:17.414283 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-885dacbe-38a1-4ab1-bb39-0f9715ae3649 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:17.422527 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-885dacbe-38a1-4ab1-bb39-0f9715ae3649 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.164919 Jun 17 15:40:17.423103 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1026/2470] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:40:17 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:40:17.461914 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-84a17ca4-5cad-4bbe-bf61-35bb83507ca1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:17.471178 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-84a17ca4-5cad-4bbe-bf61-35bb83507ca1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:17.472732 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-84a17ca4-5cad-4bbe-bf61-35bb83507ca1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:17.474040 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-84a17ca4-5cad-4bbe-bf61-35bb83507ca1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.094161 Jun 17 15:40:17.474669 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1445/2471] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:40:17 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:40:17.797680 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-ffbf3b4f-3f61-478b-b0c4-89dd24c168f3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:17.798289 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-ffbf3b4f-3f61-478b-b0c4-89dd24c168f3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:17.804354 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ffbf3b4f-3f61-478b-b0c4-89dd24c168f3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:17.804816 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ffbf3b4f-3f61-478b-b0c4-89dd24c168f3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:17.805577 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ffbf3b4f-3f61-478b-b0c4-89dd24c168f3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:17.806056 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ffbf3b4f-3f61-478b-b0c4-89dd24c168f3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:17.937637 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-ffbf3b4f-3f61-478b-b0c4-89dd24c168f3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:17.946367 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-ffbf3b4f-3f61-478b-b0c4-89dd24c168f3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1601 microversion: 2.1 time: 0.152530 Jun 17 15:40:17.946934 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1027/2472] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:40:17 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1601 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:40:18.440301 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-2a93c89e-26e6-4eff-920d-823b7d173143 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:18.440926 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-2a93c89e-26e6-4eff-920d-823b7d173143 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:18.448032 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2a93c89e-26e6-4eff-920d-823b7d173143 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:18.448511 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2a93c89e-26e6-4eff-920d-823b7d173143 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:18.449268 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2a93c89e-26e6-4eff-920d-823b7d173143 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:18.449693 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2a93c89e-26e6-4eff-920d-823b7d173143 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:18.493508 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-09f2bbae-6925-4459-9c6d-56bb81b25c1b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:18.494175 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-09f2bbae-6925-4459-9c6d-56bb81b25c1b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:18.496595 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_api:SELECT=76 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:40:18.502075 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-09f2bbae-6925-4459-9c6d-56bb81b25c1b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:18.502515 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-09f2bbae-6925-4459-9c6d-56bb81b25c1b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:18.503286 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-09f2bbae-6925-4459-9c6d-56bb81b25c1b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:18.503714 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-09f2bbae-6925-4459-9c6d-56bb81b25c1b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:18.571644 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-09f2bbae-6925-4459-9c6d-56bb81b25c1b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:18.580486 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-09f2bbae-6925-4459-9c6d-56bb81b25c1b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:18.581977 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-09f2bbae-6925-4459-9c6d-56bb81b25c1b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:18.583115 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-09f2bbae-6925-4459-9c6d-56bb81b25c1b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.094145 Jun 17 15:40:18.583656 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1028/2473] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:40:18 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:40:18.586715 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-2a93c89e-26e6-4eff-920d-823b7d173143 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:18.594758 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-2a93c89e-26e6-4eff-920d-823b7d173143 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.158472 Jun 17 15:40:18.595339 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1446/2474] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:40:18 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:40:18.963461 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-295a40e7-47c0-4ce3-9b31-254126e51457 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:18.964075 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-295a40e7-47c0-4ce3-9b31-254126e51457 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:18.970344 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-295a40e7-47c0-4ce3-9b31-254126e51457 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:18.970796 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-295a40e7-47c0-4ce3-9b31-254126e51457 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:18.971569 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-295a40e7-47c0-4ce3-9b31-254126e51457 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:18.972004 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-295a40e7-47c0-4ce3-9b31-254126e51457 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:19.111597 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-295a40e7-47c0-4ce3-9b31-254126e51457 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:19.121448 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-295a40e7-47c0-4ce3-9b31-254126e51457 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1601 microversion: 2.1 time: 0.162160 Jun 17 15:40:19.122034 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1029/2475] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:40:18 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1601 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:40:19.601757 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-5310140b-459f-442f-ada1-3448f12430a1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:19.602484 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-5310140b-459f-442f-ada1-3448f12430a1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:19.611414 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5310140b-459f-442f-ada1-3448f12430a1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:19.612122 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5310140b-459f-442f-ada1-3448f12430a1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:19.613430 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5310140b-459f-442f-ada1-3448f12430a1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:19.614124 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5310140b-459f-442f-ada1-3448f12430a1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:19.616780 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-5dd194bf-c5da-4594-8421-8eba752147f9 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:19.617841 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-5dd194bf-c5da-4594-8421-8eba752147f9 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:19.628003 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5dd194bf-c5da-4594-8421-8eba752147f9 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:19.629045 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5dd194bf-c5da-4594-8421-8eba752147f9 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:19.630273 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5dd194bf-c5da-4594-8421-8eba752147f9 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:19.631547 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5dd194bf-c5da-4594-8421-8eba752147f9 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:19.707896 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-5310140b-459f-442f-ada1-3448f12430a1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:19.720700 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-5310140b-459f-442f-ada1-3448f12430a1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:19.723725 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-5310140b-459f-442f-ada1-3448f12430a1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:19.726073 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-5310140b-459f-442f-ada1-3448f12430a1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.128545 Jun 17 15:40:19.726715 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1447/2476] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:40:19 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:40:19.806796 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-5dd194bf-c5da-4594-8421-8eba752147f9 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:19.820876 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-5dd194bf-c5da-4594-8421-8eba752147f9 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.211233 Jun 17 15:40:19.821594 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1030/2477] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:40:19 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:40:20.139324 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-dd662646-b846-4828-ac59-8d5ef882cea5 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:20.140011 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-dd662646-b846-4828-ac59-8d5ef882cea5 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:20.146607 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-dd662646-b846-4828-ac59-8d5ef882cea5 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:20.147052 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-dd662646-b846-4828-ac59-8d5ef882cea5 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:20.147836 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-dd662646-b846-4828-ac59-8d5ef882cea5 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:20.148275 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-dd662646-b846-4828-ac59-8d5ef882cea5 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:20.151323 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=100 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:40:20.290134 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-dd662646-b846-4828-ac59-8d5ef882cea5 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:20.298388 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-dd662646-b846-4828-ac59-8d5ef882cea5 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1601 microversion: 2.1 time: 0.163023 Jun 17 15:40:20.298978 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1448/2478] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:40:20 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1601 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:40:20.752798 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-0ec1095e-fa96-46d5-b324-1486b58d5353 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:20.753439 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-0ec1095e-fa96-46d5-b324-1486b58d5353 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:20.761215 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0ec1095e-fa96-46d5-b324-1486b58d5353 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:20.761659 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0ec1095e-fa96-46d5-b324-1486b58d5353 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:20.762430 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0ec1095e-fa96-46d5-b324-1486b58d5353 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:20.762859 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0ec1095e-fa96-46d5-b324-1486b58d5353 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:20.837874 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-0ec1095e-fa96-46d5-b324-1486b58d5353 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:20.843634 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-bd62507d-4374-4fb2-b610-ee34e885e54d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:20.844723 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-bd62507d-4374-4fb2-b610-ee34e885e54d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:20.853213 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-0ec1095e-fa96-46d5-b324-1486b58d5353 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:20.856032 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bd62507d-4374-4fb2-b610-ee34e885e54d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:20.856262 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-0ec1095e-fa96-46d5-b324-1486b58d5353 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:20.856792 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bd62507d-4374-4fb2-b610-ee34e885e54d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:20.858057 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bd62507d-4374-4fb2-b610-ee34e885e54d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:20.858267 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-0ec1095e-fa96-46d5-b324-1486b58d5353 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.109384 Jun 17 15:40:20.858774 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bd62507d-4374-4fb2-b610-ee34e885e54d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:20.859205 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1031/2479] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:40:20 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:40:21.010143 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-bd62507d-4374-4fb2-b610-ee34e885e54d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:21.019394 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-bd62507d-4374-4fb2-b610-ee34e885e54d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.182409 Jun 17 15:40:21.019990 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1449/2480] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:40:20 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:40:21.317042 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-d368bda3-ecd3-44a4-904d-ab0332bd3318 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:21.317623 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-d368bda3-ecd3-44a4-904d-ab0332bd3318 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:21.324692 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d368bda3-ecd3-44a4-904d-ab0332bd3318 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:21.325150 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d368bda3-ecd3-44a4-904d-ab0332bd3318 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:21.325932 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d368bda3-ecd3-44a4-904d-ab0332bd3318 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:21.326363 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d368bda3-ecd3-44a4-904d-ab0332bd3318 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:21.465874 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-d368bda3-ecd3-44a4-904d-ab0332bd3318 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:21.474275 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-d368bda3-ecd3-44a4-904d-ab0332bd3318 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1601 microversion: 2.1 time: 0.161271 Jun 17 15:40:21.477198 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1032/2481] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:40:21 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1601 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:40:21.884448 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-47e8a9e7-5420-4658-8642-1f2695c9f637 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:21.885055 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-47e8a9e7-5420-4658-8642-1f2695c9f637 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:21.891833 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-47e8a9e7-5420-4658-8642-1f2695c9f637 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:21.892286 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-47e8a9e7-5420-4658-8642-1f2695c9f637 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:21.893092 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-47e8a9e7-5420-4658-8642-1f2695c9f637 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:21.893532 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-47e8a9e7-5420-4658-8642-1f2695c9f637 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:21.965327 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-47e8a9e7-5420-4658-8642-1f2695c9f637 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:21.974260 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-47e8a9e7-5420-4658-8642-1f2695c9f637 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:21.976677 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-47e8a9e7-5420-4658-8642-1f2695c9f637 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:21.977852 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-47e8a9e7-5420-4658-8642-1f2695c9f637 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.097499 Jun 17 15:40:21.978418 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1450/2482] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:40:21 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:40:22.037983 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-f524536c-adad-4dd5-ad6b-62a557c61c98 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:22.038593 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-f524536c-adad-4dd5-ad6b-62a557c61c98 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:22.045783 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f524536c-adad-4dd5-ad6b-62a557c61c98 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:22.046238 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f524536c-adad-4dd5-ad6b-62a557c61c98 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:22.047040 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f524536c-adad-4dd5-ad6b-62a557c61c98 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:22.047479 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f524536c-adad-4dd5-ad6b-62a557c61c98 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:22.197860 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-f524536c-adad-4dd5-ad6b-62a557c61c98 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:22.206884 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-f524536c-adad-4dd5-ad6b-62a557c61c98 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.173238 Jun 17 15:40:22.207473 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1033/2483] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:40:22 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:40:22.493078 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-deda9b98-9b56-4286-b75d-6670c34a0cdd tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:22.493719 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-deda9b98-9b56-4286-b75d-6670c34a0cdd tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:22.500394 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-deda9b98-9b56-4286-b75d-6670c34a0cdd tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:22.500855 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-deda9b98-9b56-4286-b75d-6670c34a0cdd tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:22.501634 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-deda9b98-9b56-4286-b75d-6670c34a0cdd tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:22.502059 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-deda9b98-9b56-4286-b75d-6670c34a0cdd tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:22.715493 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-deda9b98-9b56-4286-b75d-6670c34a0cdd tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:22.724429 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-deda9b98-9b56-4286-b75d-6670c34a0cdd tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1601 microversion: 2.1 time: 0.235605 Jun 17 15:40:22.725029 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1451/2484] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:40:22 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1601 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:40:22.996455 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-e28f8b8a-521f-4883-8808-651b4972bfea tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:22.997002 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-e28f8b8a-521f-4883-8808-651b4972bfea tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:23.003579 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e28f8b8a-521f-4883-8808-651b4972bfea tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:23.004027 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e28f8b8a-521f-4883-8808-651b4972bfea tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:23.004847 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e28f8b8a-521f-4883-8808-651b4972bfea tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:23.005286 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e28f8b8a-521f-4883-8808-651b4972bfea tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:23.074886 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-e28f8b8a-521f-4883-8808-651b4972bfea tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:23.084734 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-e28f8b8a-521f-4883-8808-651b4972bfea tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:23.086248 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-e28f8b8a-521f-4883-8808-651b4972bfea tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:23.087423 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-e28f8b8a-521f-4883-8808-651b4972bfea tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.095144 Jun 17 15:40:23.087990 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1034/2485] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:40:22 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:40:23.224467 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-b34b108f-19ef-4f10-ae28-dc01c8e1af1f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:23.225155 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-b34b108f-19ef-4f10-ae28-dc01c8e1af1f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:23.232041 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b34b108f-19ef-4f10-ae28-dc01c8e1af1f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:23.232537 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b34b108f-19ef-4f10-ae28-dc01c8e1af1f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:23.233306 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b34b108f-19ef-4f10-ae28-dc01c8e1af1f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:23.233736 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b34b108f-19ef-4f10-ae28-dc01c8e1af1f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:23.376356 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-b34b108f-19ef-4f10-ae28-dc01c8e1af1f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:23.385753 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-b34b108f-19ef-4f10-ae28-dc01c8e1af1f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.165152 Jun 17 15:40:23.386364 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1452/2486] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:40:23 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:40:23.742664 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-91e5c93f-1d6b-45e9-9f99-fe8dd76ac104 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:23.743368 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-91e5c93f-1d6b-45e9-9f99-fe8dd76ac104 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:23.750626 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-91e5c93f-1d6b-45e9-9f99-fe8dd76ac104 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:23.751132 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-91e5c93f-1d6b-45e9-9f99-fe8dd76ac104 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:23.751988 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-91e5c93f-1d6b-45e9-9f99-fe8dd76ac104 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:23.752631 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-91e5c93f-1d6b-45e9-9f99-fe8dd76ac104 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:23.756409 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell1:SELECT=100 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:40:23.909747 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-91e5c93f-1d6b-45e9-9f99-fe8dd76ac104 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:23.919883 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-91e5c93f-1d6b-45e9-9f99-fe8dd76ac104 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1601 microversion: 2.1 time: 0.181311 Jun 17 15:40:23.920486 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1035/2487] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:40:23 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1601 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:40:24.109297 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-0f0395e3-a5cf-450f-b3e0-5adc36200e41 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:24.110359 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-0f0395e3-a5cf-450f-b3e0-5adc36200e41 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:24.118096 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0f0395e3-a5cf-450f-b3e0-5adc36200e41 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:24.118545 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0f0395e3-a5cf-450f-b3e0-5adc36200e41 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:24.119338 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0f0395e3-a5cf-450f-b3e0-5adc36200e41 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:24.119775 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0f0395e3-a5cf-450f-b3e0-5adc36200e41 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:24.188455 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-0f0395e3-a5cf-450f-b3e0-5adc36200e41 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:24.198130 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-0f0395e3-a5cf-450f-b3e0-5adc36200e41 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:24.199639 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-0f0395e3-a5cf-450f-b3e0-5adc36200e41 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:24.200850 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-0f0395e3-a5cf-450f-b3e0-5adc36200e41 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.098729 Jun 17 15:40:24.201429 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1453/2488] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:40:24 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:40:24.403349 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-6b2b210a-a04f-492d-ade1-5c17f7f5779d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:24.403955 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-6b2b210a-a04f-492d-ade1-5c17f7f5779d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:24.411061 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6b2b210a-a04f-492d-ade1-5c17f7f5779d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:24.411517 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6b2b210a-a04f-492d-ade1-5c17f7f5779d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:24.412305 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6b2b210a-a04f-492d-ade1-5c17f7f5779d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:24.412772 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6b2b210a-a04f-492d-ade1-5c17f7f5779d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:24.557384 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-6b2b210a-a04f-492d-ade1-5c17f7f5779d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:24.566343 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-6b2b210a-a04f-492d-ade1-5c17f7f5779d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.166842 Jun 17 15:40:24.567472 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1036/2489] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:40:24 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:40:24.939146 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-fdf7215a-8f6f-45c0-9612-fe64e6ef5887 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:24.939801 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-fdf7215a-8f6f-45c0-9612-fe64e6ef5887 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:24.946849 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fdf7215a-8f6f-45c0-9612-fe64e6ef5887 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:24.947303 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fdf7215a-8f6f-45c0-9612-fe64e6ef5887 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:24.948210 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fdf7215a-8f6f-45c0-9612-fe64e6ef5887 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:24.948795 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fdf7215a-8f6f-45c0-9612-fe64e6ef5887 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:25.089113 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-fdf7215a-8f6f-45c0-9612-fe64e6ef5887 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:25.097449 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-fdf7215a-8f6f-45c0-9612-fe64e6ef5887 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1601 microversion: 2.1 time: 0.162094 Jun 17 15:40:25.098065 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1454/2490] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:40:24 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1601 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:40:25.222988 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-66a5df57-1f95-4129-8633-a1363d9c7f4f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:25.223515 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-66a5df57-1f95-4129-8633-a1363d9c7f4f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:25.232455 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-66a5df57-1f95-4129-8633-a1363d9c7f4f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:25.232900 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-66a5df57-1f95-4129-8633-a1363d9c7f4f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:25.233672 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-66a5df57-1f95-4129-8633-a1363d9c7f4f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:25.234098 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-66a5df57-1f95-4129-8633-a1363d9c7f4f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:25.300544 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-66a5df57-1f95-4129-8633-a1363d9c7f4f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:25.309110 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-66a5df57-1f95-4129-8633-a1363d9c7f4f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:25.310605 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-66a5df57-1f95-4129-8633-a1363d9c7f4f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:25.311722 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-66a5df57-1f95-4129-8633-a1363d9c7f4f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.092789 Jun 17 15:40:25.312272 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1037/2491] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:40:25 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:40:25.585105 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-5cf2e11c-3af8-4acb-a50d-70c2a02f784e tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:25.586120 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-5cf2e11c-3af8-4acb-a50d-70c2a02f784e tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:25.594380 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5cf2e11c-3af8-4acb-a50d-70c2a02f784e tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:25.594834 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5cf2e11c-3af8-4acb-a50d-70c2a02f784e tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:25.595592 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5cf2e11c-3af8-4acb-a50d-70c2a02f784e tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:25.596017 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5cf2e11c-3af8-4acb-a50d-70c2a02f784e tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:25.730825 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-5cf2e11c-3af8-4acb-a50d-70c2a02f784e tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:25.739260 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-5cf2e11c-3af8-4acb-a50d-70c2a02f784e tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.158558 Jun 17 15:40:25.739847 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1455/2492] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:40:25 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:40:26.115425 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-01354742-325a-487f-b9b0-09706bc51bc7 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:26.116098 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-01354742-325a-487f-b9b0-09706bc51bc7 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:26.122843 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-01354742-325a-487f-b9b0-09706bc51bc7 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:26.123287 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-01354742-325a-487f-b9b0-09706bc51bc7 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:26.124225 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-01354742-325a-487f-b9b0-09706bc51bc7 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:26.124683 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-01354742-325a-487f-b9b0-09706bc51bc7 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:26.261470 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-01354742-325a-487f-b9b0-09706bc51bc7 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:26.272273 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-01354742-325a-487f-b9b0-09706bc51bc7 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1601 microversion: 2.1 time: 0.160089 Jun 17 15:40:26.272882 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1038/2493] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:40:26 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1601 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:40:26.330755 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-d9b9a0f9-fee8-4562-898a-e6aa4115610e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:26.331426 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-d9b9a0f9-fee8-4562-898a-e6aa4115610e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:26.338284 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d9b9a0f9-fee8-4562-898a-e6aa4115610e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:26.338735 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d9b9a0f9-fee8-4562-898a-e6aa4115610e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:26.339501 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d9b9a0f9-fee8-4562-898a-e6aa4115610e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:26.339940 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d9b9a0f9-fee8-4562-898a-e6aa4115610e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:26.415260 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-d9b9a0f9-fee8-4562-898a-e6aa4115610e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:26.425395 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-d9b9a0f9-fee8-4562-898a-e6aa4115610e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:26.426886 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-d9b9a0f9-fee8-4562-898a-e6aa4115610e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:26.428550 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-d9b9a0f9-fee8-4562-898a-e6aa4115610e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.102026 Jun 17 15:40:26.429105 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1456/2494] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:40:26 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:40:26.756733 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-5fc9b055-86fa-4a88-b4db-b9aaed19b6dc tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:26.757263 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-5fc9b055-86fa-4a88-b4db-b9aaed19b6dc tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:26.763410 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5fc9b055-86fa-4a88-b4db-b9aaed19b6dc tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:26.763855 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5fc9b055-86fa-4a88-b4db-b9aaed19b6dc tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:26.764654 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5fc9b055-86fa-4a88-b4db-b9aaed19b6dc tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:26.765096 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5fc9b055-86fa-4a88-b4db-b9aaed19b6dc tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:26.904186 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-5fc9b055-86fa-4a88-b4db-b9aaed19b6dc tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:26.912918 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-5fc9b055-86fa-4a88-b4db-b9aaed19b6dc tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.160223 Jun 17 15:40:26.913495 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1039/2495] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:40:26 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:40:27.289821 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-429316f7-6c19-491a-a5c4-fd253ce11518 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:27.290483 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-429316f7-6c19-491a-a5c4-fd253ce11518 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:27.296915 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-429316f7-6c19-491a-a5c4-fd253ce11518 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:27.297356 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-429316f7-6c19-491a-a5c4-fd253ce11518 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:27.298119 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-429316f7-6c19-491a-a5c4-fd253ce11518 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:27.298546 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-429316f7-6c19-491a-a5c4-fd253ce11518 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:27.436160 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-429316f7-6c19-491a-a5c4-fd253ce11518 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:27.445150 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-429316f7-6c19-491a-a5c4-fd253ce11518 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1601 microversion: 2.1 time: 0.159216 Jun 17 15:40:27.445723 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1457/2496] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:40:27 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1601 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:40:27.447025 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-c4cb2b7f-fdb7-4a58-81a9-6af530583dd4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:27.447732 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-c4cb2b7f-fdb7-4a58-81a9-6af530583dd4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:27.454376 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c4cb2b7f-fdb7-4a58-81a9-6af530583dd4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:27.454816 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c4cb2b7f-fdb7-4a58-81a9-6af530583dd4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:27.455569 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c4cb2b7f-fdb7-4a58-81a9-6af530583dd4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:27.455994 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c4cb2b7f-fdb7-4a58-81a9-6af530583dd4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:27.523842 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-c4cb2b7f-fdb7-4a58-81a9-6af530583dd4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:27.532412 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-c4cb2b7f-fdb7-4a58-81a9-6af530583dd4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:27.533896 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-c4cb2b7f-fdb7-4a58-81a9-6af530583dd4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:27.535045 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-c4cb2b7f-fdb7-4a58-81a9-6af530583dd4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.092867 Jun 17 15:40:27.535596 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1040/2497] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:40:27 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 15:40:27.929751 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-a937d6bb-eec8-499b-ae91-02ca2df5c2e1 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:27.930362 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-a937d6bb-eec8-499b-ae91-02ca2df5c2e1 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:27.936437 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a937d6bb-eec8-499b-ae91-02ca2df5c2e1 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:27.936827 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a937d6bb-eec8-499b-ae91-02ca2df5c2e1 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:27.937579 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a937d6bb-eec8-499b-ae91-02ca2df5c2e1 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:27.938009 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a937d6bb-eec8-499b-ae91-02ca2df5c2e1 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:28.066131 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-a937d6bb-eec8-499b-ae91-02ca2df5c2e1 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:28.080104 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-a937d6bb-eec8-499b-ae91-02ca2df5c2e1 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.154498 Jun 17 15:40:28.080937 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1458/2498] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:40:27 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:40:28.462606 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-b58efca8-cddd-4b68-a630-b8f12782ab64 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:28.463276 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-b58efca8-cddd-4b68-a630-b8f12782ab64 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:28.469713 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b58efca8-cddd-4b68-a630-b8f12782ab64 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:28.470162 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b58efca8-cddd-4b68-a630-b8f12782ab64 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:28.470912 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b58efca8-cddd-4b68-a630-b8f12782ab64 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:28.471345 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b58efca8-cddd-4b68-a630-b8f12782ab64 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:28.553005 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-cbdb36e1-5387-4177-ade6-568201a02175 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:28.553620 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-cbdb36e1-5387-4177-ade6-568201a02175 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:28.560080 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cbdb36e1-5387-4177-ade6-568201a02175 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:28.560582 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cbdb36e1-5387-4177-ade6-568201a02175 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:28.561331 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cbdb36e1-5387-4177-ade6-568201a02175 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:28.561761 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cbdb36e1-5387-4177-ade6-568201a02175 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:28.605453 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-b58efca8-cddd-4b68-a630-b8f12782ab64 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:28.613690 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-b58efca8-cddd-4b68-a630-b8f12782ab64 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1601 microversion: 2.1 time: 0.155531 Jun 17 15:40:28.614279 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1041/2499] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:40:28 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1601 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:40:28.633538 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-cbdb36e1-5387-4177-ade6-568201a02175 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:28.642186 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-cbdb36e1-5387-4177-ade6-568201a02175 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:28.643719 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-cbdb36e1-5387-4177-ade6-568201a02175 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:28.644902 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-cbdb36e1-5387-4177-ade6-568201a02175 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.095765 Jun 17 15:40:28.645456 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1459/2500] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:40:28 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 15:40:29.108195 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-c140b134-1958-47c2-9a8c-bc91e5f4f2a5 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:29.108911 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-c140b134-1958-47c2-9a8c-bc91e5f4f2a5 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:29.115825 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c140b134-1958-47c2-9a8c-bc91e5f4f2a5 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:29.116267 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c140b134-1958-47c2-9a8c-bc91e5f4f2a5 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:29.117091 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c140b134-1958-47c2-9a8c-bc91e5f4f2a5 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:29.117521 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c140b134-1958-47c2-9a8c-bc91e5f4f2a5 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:29.247460 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-c140b134-1958-47c2-9a8c-bc91e5f4f2a5 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:29.255753 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-c140b134-1958-47c2-9a8c-bc91e5f4f2a5 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.153166 Jun 17 15:40:29.256342 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1042/2501] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:40:29 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:40:29.640277 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-a16c3bcd-9b31-4d99-91c3-d803e0f754bc tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:29.640855 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-a16c3bcd-9b31-4d99-91c3-d803e0f754bc tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:29.647566 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a16c3bcd-9b31-4d99-91c3-d803e0f754bc tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:29.648015 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a16c3bcd-9b31-4d99-91c3-d803e0f754bc tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:29.648823 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a16c3bcd-9b31-4d99-91c3-d803e0f754bc tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:29.649262 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a16c3bcd-9b31-4d99-91c3-d803e0f754bc tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:29.662976 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-075cad1b-5f89-40ee-9f8f-1035130cfd20 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:29.663585 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-075cad1b-5f89-40ee-9f8f-1035130cfd20 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:29.670061 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-075cad1b-5f89-40ee-9f8f-1035130cfd20 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:29.670513 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-075cad1b-5f89-40ee-9f8f-1035130cfd20 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:29.671282 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-075cad1b-5f89-40ee-9f8f-1035130cfd20 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:29.671726 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-075cad1b-5f89-40ee-9f8f-1035130cfd20 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:29.737666 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-075cad1b-5f89-40ee-9f8f-1035130cfd20 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:29.747026 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-075cad1b-5f89-40ee-9f8f-1035130cfd20 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:29.749206 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-075cad1b-5f89-40ee-9f8f-1035130cfd20 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:29.749732 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-075cad1b-5f89-40ee-9f8f-1035130cfd20 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.090648 Jun 17 15:40:29.750293 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1043/2502] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:40:29 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 15:40:29.780127 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-a16c3bcd-9b31-4d99-91c3-d803e0f754bc tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:29.788573 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-a16c3bcd-9b31-4d99-91c3-d803e0f754bc tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1601 microversion: 2.1 time: 0.152216 Jun 17 15:40:29.789141 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1460/2503] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:40:29 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1601 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:40:30.272383 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-19e77303-c819-4bb3-9225-b475fda745df tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:30.272996 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-19e77303-c819-4bb3-9225-b475fda745df tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:30.278973 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-19e77303-c819-4bb3-9225-b475fda745df tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:30.279422 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-19e77303-c819-4bb3-9225-b475fda745df tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:30.280176 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-19e77303-c819-4bb3-9225-b475fda745df tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:30.280644 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-19e77303-c819-4bb3-9225-b475fda745df tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:30.413441 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-19e77303-c819-4bb3-9225-b475fda745df tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:30.422370 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-19e77303-c819-4bb3-9225-b475fda745df tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.154303 Jun 17 15:40:30.423052 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1044/2504] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:40:30 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:40:30.767581 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-b35615f4-b2a4-49f3-ba4f-9c114b022447 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:30.768182 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-b35615f4-b2a4-49f3-ba4f-9c114b022447 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:30.775368 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b35615f4-b2a4-49f3-ba4f-9c114b022447 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:30.775816 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b35615f4-b2a4-49f3-ba4f-9c114b022447 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:30.776681 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b35615f4-b2a4-49f3-ba4f-9c114b022447 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:30.777119 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b35615f4-b2a4-49f3-ba4f-9c114b022447 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:30.805361 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-f302e796-a565-4160-b2f8-5bb5999972ef tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:30.806638 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-f302e796-a565-4160-b2f8-5bb5999972ef tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:30.814288 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f302e796-a565-4160-b2f8-5bb5999972ef tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:30.814776 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f302e796-a565-4160-b2f8-5bb5999972ef tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:30.815544 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f302e796-a565-4160-b2f8-5bb5999972ef tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:30.816286 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f302e796-a565-4160-b2f8-5bb5999972ef tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:30.842720 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-b35615f4-b2a4-49f3-ba4f-9c114b022447 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:30.854052 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-b35615f4-b2a4-49f3-ba4f-9c114b022447 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:30.855572 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-b35615f4-b2a4-49f3-ba4f-9c114b022447 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:30.856765 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-b35615f4-b2a4-49f3-ba4f-9c114b022447 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.093159 Jun 17 15:40:30.857351 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1461/2505] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:40:30 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:40:30.953043 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-f302e796-a565-4160-b2f8-5bb5999972ef tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:30.961062 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-f302e796-a565-4160-b2f8-5bb5999972ef tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1601 microversion: 2.1 time: 0.159479 Jun 17 15:40:30.961628 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1045/2506] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:40:30 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1601 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:40:31.440544 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-de001614-b650-421c-86e1-3f9d48a7e295 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:31.441161 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-de001614-b650-421c-86e1-3f9d48a7e295 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:31.447261 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-de001614-b650-421c-86e1-3f9d48a7e295 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:31.447691 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-de001614-b650-421c-86e1-3f9d48a7e295 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:31.448468 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-de001614-b650-421c-86e1-3f9d48a7e295 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:31.448896 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-de001614-b650-421c-86e1-3f9d48a7e295 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:31.589757 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-de001614-b650-421c-86e1-3f9d48a7e295 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:31.598034 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-de001614-b650-421c-86e1-3f9d48a7e295 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.161429 Jun 17 15:40:31.598609 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1462/2507] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:40:31 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:40:31.876554 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-5bb390ea-9221-4b10-aad3-0581db7d21dd tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:31.877146 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-5bb390ea-9221-4b10-aad3-0581db7d21dd tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:31.885158 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5bb390ea-9221-4b10-aad3-0581db7d21dd tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:31.885158 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5bb390ea-9221-4b10-aad3-0581db7d21dd tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:31.885158 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5bb390ea-9221-4b10-aad3-0581db7d21dd tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:31.885521 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5bb390ea-9221-4b10-aad3-0581db7d21dd tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:31.951669 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-5bb390ea-9221-4b10-aad3-0581db7d21dd tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:31.960882 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-5bb390ea-9221-4b10-aad3-0581db7d21dd tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:31.962380 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-5bb390ea-9221-4b10-aad3-0581db7d21dd tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:31.963514 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-5bb390ea-9221-4b10-aad3-0581db7d21dd tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.090869 Jun 17 15:40:31.964054 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1046/2508] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:40:31 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:40:31.978219 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-1a7bae52-060b-4e3b-a3d0-6e2b1c659a0f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:31.978830 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-1a7bae52-060b-4e3b-a3d0-6e2b1c659a0f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:31.985405 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1a7bae52-060b-4e3b-a3d0-6e2b1c659a0f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:31.985849 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1a7bae52-060b-4e3b-a3d0-6e2b1c659a0f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:31.986597 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1a7bae52-060b-4e3b-a3d0-6e2b1c659a0f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:31.987021 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1a7bae52-060b-4e3b-a3d0-6e2b1c659a0f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:32.116278 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-1a7bae52-060b-4e3b-a3d0-6e2b1c659a0f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:32.124209 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-1a7bae52-060b-4e3b-a3d0-6e2b1c659a0f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1601 microversion: 2.1 time: 0.150061 Jun 17 15:40:32.124816 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1463/2509] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:40:31 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1601 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:40:32.616610 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-94840544-a269-488b-9c0d-49c0c900c0a8 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:32.617216 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-94840544-a269-488b-9c0d-49c0c900c0a8 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:32.623499 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-94840544-a269-488b-9c0d-49c0c900c0a8 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:32.623943 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-94840544-a269-488b-9c0d-49c0c900c0a8 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:32.624732 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-94840544-a269-488b-9c0d-49c0c900c0a8 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:32.625166 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-94840544-a269-488b-9c0d-49c0c900c0a8 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:32.761068 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-94840544-a269-488b-9c0d-49c0c900c0a8 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:32.769248 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-94840544-a269-488b-9c0d-49c0c900c0a8 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.156989 Jun 17 15:40:32.769848 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1047/2510] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:40:32 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:40:32.981895 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-e62dbbf9-2dbe-4fd4-a7da-15d0ae2dfd49 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:32.982556 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-e62dbbf9-2dbe-4fd4-a7da-15d0ae2dfd49 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:32.988953 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e62dbbf9-2dbe-4fd4-a7da-15d0ae2dfd49 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:32.989401 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e62dbbf9-2dbe-4fd4-a7da-15d0ae2dfd49 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:32.990157 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e62dbbf9-2dbe-4fd4-a7da-15d0ae2dfd49 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:32.991237 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e62dbbf9-2dbe-4fd4-a7da-15d0ae2dfd49 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:33.051400 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-e62dbbf9-2dbe-4fd4-a7da-15d0ae2dfd49 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:33.054252 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=100 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:40:33.062036 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-e62dbbf9-2dbe-4fd4-a7da-15d0ae2dfd49 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:33.063535 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-e62dbbf9-2dbe-4fd4-a7da-15d0ae2dfd49 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:33.064701 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-e62dbbf9-2dbe-4fd4-a7da-15d0ae2dfd49 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.086778 Jun 17 15:40:33.065262 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1464/2511] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:40:32 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:40:33.142075 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-e890f7ca-142b-41de-9dcb-b448be29f6bc tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:33.142689 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-e890f7ca-142b-41de-9dcb-b448be29f6bc tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:33.149736 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e890f7ca-142b-41de-9dcb-b448be29f6bc tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:33.150188 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e890f7ca-142b-41de-9dcb-b448be29f6bc tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:33.150946 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e890f7ca-142b-41de-9dcb-b448be29f6bc tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:33.151383 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e890f7ca-142b-41de-9dcb-b448be29f6bc tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:33.277794 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-e890f7ca-142b-41de-9dcb-b448be29f6bc tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:33.285716 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-e890f7ca-142b-41de-9dcb-b448be29f6bc tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1601 microversion: 2.1 time: 0.147612 Jun 17 15:40:33.286318 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1048/2512] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:40:33 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1601 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:40:33.786615 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-6133ee07-0a66-4edb-b055-3e4ce2ac964f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:33.787286 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-6133ee07-0a66-4edb-b055-3e4ce2ac964f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:33.793286 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6133ee07-0a66-4edb-b055-3e4ce2ac964f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:33.793828 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6133ee07-0a66-4edb-b055-3e4ce2ac964f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:33.794583 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6133ee07-0a66-4edb-b055-3e4ce2ac964f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:33.794906 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6133ee07-0a66-4edb-b055-3e4ce2ac964f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:33.927686 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-6133ee07-0a66-4edb-b055-3e4ce2ac964f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:33.936453 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-6133ee07-0a66-4edb-b055-3e4ce2ac964f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.153794 Jun 17 15:40:33.937125 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1465/2513] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:40:33 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:40:34.082682 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-65ad7680-b7ef-4d6a-9422-971f6ebb1d25 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:34.083298 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-65ad7680-b7ef-4d6a-9422-971f6ebb1d25 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:34.089632 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-65ad7680-b7ef-4d6a-9422-971f6ebb1d25 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:34.090083 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-65ad7680-b7ef-4d6a-9422-971f6ebb1d25 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:34.090848 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-65ad7680-b7ef-4d6a-9422-971f6ebb1d25 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:34.091284 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-65ad7680-b7ef-4d6a-9422-971f6ebb1d25 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:34.157053 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-65ad7680-b7ef-4d6a-9422-971f6ebb1d25 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:34.165348 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-65ad7680-b7ef-4d6a-9422-971f6ebb1d25 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:34.166839 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-65ad7680-b7ef-4d6a-9422-971f6ebb1d25 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:34.167957 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-65ad7680-b7ef-4d6a-9422-971f6ebb1d25 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.089288 Jun 17 15:40:34.168543 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1049/2514] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:40:34 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:40:34.302738 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-3d9b48c4-f890-488d-a171-d305a3268d4c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:34.303977 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-3d9b48c4-f890-488d-a171-d305a3268d4c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:34.310521 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3d9b48c4-f890-488d-a171-d305a3268d4c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:34.310978 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3d9b48c4-f890-488d-a171-d305a3268d4c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:34.311751 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3d9b48c4-f890-488d-a171-d305a3268d4c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:34.312185 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3d9b48c4-f890-488d-a171-d305a3268d4c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:34.451256 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-3d9b48c4-f890-488d-a171-d305a3268d4c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:34.459011 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-3d9b48c4-f890-488d-a171-d305a3268d4c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1601 microversion: 2.1 time: 0.160192 Jun 17 15:40:34.459572 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1466/2515] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:40:34 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1601 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:40:34.953368 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-ffa5f962-4f53-43f4-a4ed-1049be4262a3 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:34.953982 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-ffa5f962-4f53-43f4-a4ed-1049be4262a3 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:34.960674 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ffa5f962-4f53-43f4-a4ed-1049be4262a3 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:34.961123 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ffa5f962-4f53-43f4-a4ed-1049be4262a3 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:34.961875 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ffa5f962-4f53-43f4-a4ed-1049be4262a3 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:34.962308 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ffa5f962-4f53-43f4-a4ed-1049be4262a3 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:35.093919 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-ffa5f962-4f53-43f4-a4ed-1049be4262a3 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:35.102467 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-ffa5f962-4f53-43f4-a4ed-1049be4262a3 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.152921 Jun 17 15:40:35.103049 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1050/2516] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:40:34 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:40:35.186165 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-46a7d6af-df71-46c8-9e64-d1fad4d741ca tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:35.186794 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-46a7d6af-df71-46c8-9e64-d1fad4d741ca tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:35.192853 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-46a7d6af-df71-46c8-9e64-d1fad4d741ca tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:35.193299 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-46a7d6af-df71-46c8-9e64-d1fad4d741ca tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:35.194555 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-46a7d6af-df71-46c8-9e64-d1fad4d741ca tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:35.194990 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-46a7d6af-df71-46c8-9e64-d1fad4d741ca tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:35.258694 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-46a7d6af-df71-46c8-9e64-d1fad4d741ca tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:35.267207 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-46a7d6af-df71-46c8-9e64-d1fad4d741ca tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:35.268725 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-46a7d6af-df71-46c8-9e64-d1fad4d741ca tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:35.269868 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-46a7d6af-df71-46c8-9e64-d1fad4d741ca tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.087822 Jun 17 15:40:35.270520 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1467/2517] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:40:35 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:40:35.476079 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-c057994c-edc3-4f67-80a7-eaf5f40ba792 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:35.476808 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-c057994c-edc3-4f67-80a7-eaf5f40ba792 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:35.483484 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c057994c-edc3-4f67-80a7-eaf5f40ba792 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:35.483930 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c057994c-edc3-4f67-80a7-eaf5f40ba792 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:35.484716 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c057994c-edc3-4f67-80a7-eaf5f40ba792 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:35.485158 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c057994c-edc3-4f67-80a7-eaf5f40ba792 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:35.618549 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-c057994c-edc3-4f67-80a7-eaf5f40ba792 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:35.620770 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell1:SELECT=100 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:40:35.627693 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-c057994c-edc3-4f67-80a7-eaf5f40ba792 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1601 microversion: 2.1 time: 0.155750 Jun 17 15:40:35.628261 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1051/2518] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:40:35 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1601 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:40:36.121599 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-51183ab6-7e18-4268-9133-87f4ee3f152a tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:36.122202 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-51183ab6-7e18-4268-9133-87f4ee3f152a tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:36.128870 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-51183ab6-7e18-4268-9133-87f4ee3f152a tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:36.129326 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-51183ab6-7e18-4268-9133-87f4ee3f152a tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:36.130094 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-51183ab6-7e18-4268-9133-87f4ee3f152a tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:36.130531 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-51183ab6-7e18-4268-9133-87f4ee3f152a tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:36.266811 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-51183ab6-7e18-4268-9133-87f4ee3f152a tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:36.275917 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-51183ab6-7e18-4268-9133-87f4ee3f152a tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.160032 Jun 17 15:40:36.276524 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1468/2519] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:40:36 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:40:36.288997 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-cabba651-bc9c-4cd5-8645-ea25edc9bc3f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:36.289699 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-cabba651-bc9c-4cd5-8645-ea25edc9bc3f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:36.295916 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cabba651-bc9c-4cd5-8645-ea25edc9bc3f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:36.296394 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cabba651-bc9c-4cd5-8645-ea25edc9bc3f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:36.297158 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cabba651-bc9c-4cd5-8645-ea25edc9bc3f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:36.297596 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cabba651-bc9c-4cd5-8645-ea25edc9bc3f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:36.363470 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-cabba651-bc9c-4cd5-8645-ea25edc9bc3f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:36.372739 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-cabba651-bc9c-4cd5-8645-ea25edc9bc3f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:36.374167 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-cabba651-bc9c-4cd5-8645-ea25edc9bc3f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:36.375315 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-cabba651-bc9c-4cd5-8645-ea25edc9bc3f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.090932 Jun 17 15:40:36.375875 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1052/2520] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:40:36 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:40:36.645658 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-4cff6ffe-ff5a-4e74-9365-f19ea2ca75f0 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:36.646162 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-4cff6ffe-ff5a-4e74-9365-f19ea2ca75f0 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:36.652256 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4cff6ffe-ff5a-4e74-9365-f19ea2ca75f0 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:36.652844 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4cff6ffe-ff5a-4e74-9365-f19ea2ca75f0 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:36.653681 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4cff6ffe-ff5a-4e74-9365-f19ea2ca75f0 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:36.654121 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4cff6ffe-ff5a-4e74-9365-f19ea2ca75f0 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:36.788149 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-4cff6ffe-ff5a-4e74-9365-f19ea2ca75f0 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:36.796479 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-4cff6ffe-ff5a-4e74-9365-f19ea2ca75f0 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1601 microversion: 2.1 time: 0.154798 Jun 17 15:40:36.797063 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1469/2521] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:40:36 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1601 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:40:37.292907 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-1a977b80-d792-4606-a768-b570469ffd07 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:37.293540 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-1a977b80-d792-4606-a768-b570469ffd07 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:37.300174 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1a977b80-d792-4606-a768-b570469ffd07 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:37.300653 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1a977b80-d792-4606-a768-b570469ffd07 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:37.301419 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1a977b80-d792-4606-a768-b570469ffd07 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:37.301855 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1a977b80-d792-4606-a768-b570469ffd07 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:37.393713 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-2851f684-c459-4bf4-bb18-8ef94b3668e5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:37.394424 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-2851f684-c459-4bf4-bb18-8ef94b3668e5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:37.401903 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2851f684-c459-4bf4-bb18-8ef94b3668e5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:37.402354 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2851f684-c459-4bf4-bb18-8ef94b3668e5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:37.403120 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2851f684-c459-4bf4-bb18-8ef94b3668e5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:37.403549 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2851f684-c459-4bf4-bb18-8ef94b3668e5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:37.439595 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-1a977b80-d792-4606-a768-b570469ffd07 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:37.450591 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-1a977b80-d792-4606-a768-b570469ffd07 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.161504 Jun 17 15:40:37.451355 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1053/2522] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:40:37 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:40:37.472638 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-2851f684-c459-4bf4-bb18-8ef94b3668e5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:37.483447 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-2851f684-c459-4bf4-bb18-8ef94b3668e5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:37.484990 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-2851f684-c459-4bf4-bb18-8ef94b3668e5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:37.486150 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-2851f684-c459-4bf4-bb18-8ef94b3668e5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.096257 Jun 17 15:40:37.486709 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1470/2523] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:40:37 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 15:40:37.814341 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-af324146-252d-42a0-a202-5ba32ff08181 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:37.814962 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-af324146-252d-42a0-a202-5ba32ff08181 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:37.822175 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-af324146-252d-42a0-a202-5ba32ff08181 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:37.822627 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-af324146-252d-42a0-a202-5ba32ff08181 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:37.823389 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-af324146-252d-42a0-a202-5ba32ff08181 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:37.823822 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-af324146-252d-42a0-a202-5ba32ff08181 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:37.958532 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-af324146-252d-42a0-a202-5ba32ff08181 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:37.966773 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-af324146-252d-42a0-a202-5ba32ff08181 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1601 microversion: 2.1 time: 0.156256 Jun 17 15:40:37.967354 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1054/2524] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:40:37 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1601 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:40:38.468259 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-e80bb10b-6b3f-4663-9036-cfdef22fa8f1 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:38.468887 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-e80bb10b-6b3f-4663-9036-cfdef22fa8f1 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:38.476183 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e80bb10b-6b3f-4663-9036-cfdef22fa8f1 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:38.476656 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e80bb10b-6b3f-4663-9036-cfdef22fa8f1 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:38.477414 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e80bb10b-6b3f-4663-9036-cfdef22fa8f1 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:38.477848 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e80bb10b-6b3f-4663-9036-cfdef22fa8f1 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:38.504597 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-85c800d9-1a1e-49c7-86ce-afe7a46accef tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:38.505203 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-85c800d9-1a1e-49c7-86ce-afe7a46accef tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:38.511655 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-85c800d9-1a1e-49c7-86ce-afe7a46accef tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:38.512098 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-85c800d9-1a1e-49c7-86ce-afe7a46accef tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:38.512882 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-85c800d9-1a1e-49c7-86ce-afe7a46accef tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:38.513314 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-85c800d9-1a1e-49c7-86ce-afe7a46accef tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:38.581206 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-85c800d9-1a1e-49c7-86ce-afe7a46accef tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:38.590273 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-85c800d9-1a1e-49c7-86ce-afe7a46accef tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:38.591760 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-85c800d9-1a1e-49c7-86ce-afe7a46accef tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:38.592922 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-85c800d9-1a1e-49c7-86ce-afe7a46accef tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.092392 Jun 17 15:40:38.593482 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1055/2525] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:40:38 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 15:40:38.613477 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-e80bb10b-6b3f-4663-9036-cfdef22fa8f1 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:38.621397 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-e80bb10b-6b3f-4663-9036-cfdef22fa8f1 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.157001 Jun 17 15:40:38.621953 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1471/2526] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:40:38 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:40:38.984733 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-f02b69ec-bf23-4c51-95f1-64645dccba99 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:38.985350 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-f02b69ec-bf23-4c51-95f1-64645dccba99 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:38.991439 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f02b69ec-bf23-4c51-95f1-64645dccba99 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:38.991881 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f02b69ec-bf23-4c51-95f1-64645dccba99 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:38.992672 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f02b69ec-bf23-4c51-95f1-64645dccba99 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:38.993101 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f02b69ec-bf23-4c51-95f1-64645dccba99 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:39.123341 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-f02b69ec-bf23-4c51-95f1-64645dccba99 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:39.132944 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-f02b69ec-bf23-4c51-95f1-64645dccba99 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1601 microversion: 2.1 time: 0.151871 Jun 17 15:40:39.133538 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1056/2527] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:40:38 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1601 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:40:39.611754 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-2462c763-7b82-4d1d-88dd-2b9282b2a6ee tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:39.612356 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-2462c763-7b82-4d1d-88dd-2b9282b2a6ee tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:39.619616 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2462c763-7b82-4d1d-88dd-2b9282b2a6ee tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:39.620070 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2462c763-7b82-4d1d-88dd-2b9282b2a6ee tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:39.620891 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2462c763-7b82-4d1d-88dd-2b9282b2a6ee tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:39.621332 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2462c763-7b82-4d1d-88dd-2b9282b2a6ee tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:39.638196 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-86e31ff4-bb36-49f9-b0a8-76dea9f90431 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:39.638732 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-86e31ff4-bb36-49f9-b0a8-76dea9f90431 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:39.645152 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-86e31ff4-bb36-49f9-b0a8-76dea9f90431 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:39.645601 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-86e31ff4-bb36-49f9-b0a8-76dea9f90431 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:39.646351 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-86e31ff4-bb36-49f9-b0a8-76dea9f90431 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:39.646785 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-86e31ff4-bb36-49f9-b0a8-76dea9f90431 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:39.682635 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-2462c763-7b82-4d1d-88dd-2b9282b2a6ee tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:39.691375 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-2462c763-7b82-4d1d-88dd-2b9282b2a6ee tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:39.692910 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-2462c763-7b82-4d1d-88dd-2b9282b2a6ee tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:39.694101 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-2462c763-7b82-4d1d-88dd-2b9282b2a6ee tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.086230 Jun 17 15:40:39.694597 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1472/2528] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:40:39 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:40:39.775940 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-86e31ff4-bb36-49f9-b0a8-76dea9f90431 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:39.783775 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-86e31ff4-bb36-49f9-b0a8-76dea9f90431 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.149516 Jun 17 15:40:39.784348 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1057/2529] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:40:39 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:40:40.151603 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-ff0f9391-13d6-4efe-ae8d-73792b11cf91 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:40.152211 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-ff0f9391-13d6-4efe-ae8d-73792b11cf91 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:40.158204 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ff0f9391-13d6-4efe-ae8d-73792b11cf91 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:40.158653 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ff0f9391-13d6-4efe-ae8d-73792b11cf91 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:40.159397 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ff0f9391-13d6-4efe-ae8d-73792b11cf91 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:40.159829 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ff0f9391-13d6-4efe-ae8d-73792b11cf91 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:40.288297 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-ff0f9391-13d6-4efe-ae8d-73792b11cf91 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:40.296267 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-ff0f9391-13d6-4efe-ae8d-73792b11cf91 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1601 microversion: 2.1 time: 0.148527 Jun 17 15:40:40.296931 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1473/2530] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:40:40 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1601 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:40:40.711658 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-594f2301-c0c8-444c-aacc-98aa5940842d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:40.712383 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-594f2301-c0c8-444c-aacc-98aa5940842d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:40.718892 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-594f2301-c0c8-444c-aacc-98aa5940842d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:40.719329 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-594f2301-c0c8-444c-aacc-98aa5940842d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:40.720261 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-594f2301-c0c8-444c-aacc-98aa5940842d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:40.720576 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-594f2301-c0c8-444c-aacc-98aa5940842d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:40.785344 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-594f2301-c0c8-444c-aacc-98aa5940842d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:40.793640 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-594f2301-c0c8-444c-aacc-98aa5940842d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:40.795164 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-594f2301-c0c8-444c-aacc-98aa5940842d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:40.796315 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-594f2301-c0c8-444c-aacc-98aa5940842d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.088585 Jun 17 15:40:40.796876 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1058/2531] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:40:40 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:40:40.801077 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-fbbb37bc-0428-4c36-b5dd-d7605d1a436f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:40.801695 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-fbbb37bc-0428-4c36-b5dd-d7605d1a436f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:40.808926 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fbbb37bc-0428-4c36-b5dd-d7605d1a436f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:40.809375 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fbbb37bc-0428-4c36-b5dd-d7605d1a436f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:40.810139 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fbbb37bc-0428-4c36-b5dd-d7605d1a436f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:40.810568 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fbbb37bc-0428-4c36-b5dd-d7605d1a436f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:40.939254 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-fbbb37bc-0428-4c36-b5dd-d7605d1a436f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:40.947845 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-fbbb37bc-0428-4c36-b5dd-d7605d1a436f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.150671 Jun 17 15:40:40.948447 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1474/2532] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:40:40 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:40:41.313513 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-9f41a048-4017-4894-bb6c-1dc9ae7185cf tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:41.314118 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-9f41a048-4017-4894-bb6c-1dc9ae7185cf tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:41.320242 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9f41a048-4017-4894-bb6c-1dc9ae7185cf tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:41.320718 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9f41a048-4017-4894-bb6c-1dc9ae7185cf tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:41.321472 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9f41a048-4017-4894-bb6c-1dc9ae7185cf tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:41.321900 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9f41a048-4017-4894-bb6c-1dc9ae7185cf tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:41.458487 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-9f41a048-4017-4894-bb6c-1dc9ae7185cf tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:41.467304 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-9f41a048-4017-4894-bb6c-1dc9ae7185cf tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1601 microversion: 2.1 time: 0.157950 Jun 17 15:40:41.467864 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1059/2533] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:40:41 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1601 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:40:41.814410 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-e9a98878-80bd-4a90-8a86-835ee3640001 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:41.814999 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-e9a98878-80bd-4a90-8a86-835ee3640001 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:41.822063 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e9a98878-80bd-4a90-8a86-835ee3640001 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:41.822513 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e9a98878-80bd-4a90-8a86-835ee3640001 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:41.823270 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e9a98878-80bd-4a90-8a86-835ee3640001 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:41.823708 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e9a98878-80bd-4a90-8a86-835ee3640001 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:41.885314 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-e9a98878-80bd-4a90-8a86-835ee3640001 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:41.893917 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-e9a98878-80bd-4a90-8a86-835ee3640001 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:41.895411 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-e9a98878-80bd-4a90-8a86-835ee3640001 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:41.897145 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-e9a98878-80bd-4a90-8a86-835ee3640001 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.086116 Jun 17 15:40:41.897703 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1475/2534] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:40:41 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:40:41.965772 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-0a1a7808-63ae-41ca-aa09-95f7f86503ac tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:41.966297 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-0a1a7808-63ae-41ca-aa09-95f7f86503ac tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:41.972831 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0a1a7808-63ae-41ca-aa09-95f7f86503ac tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:41.973277 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0a1a7808-63ae-41ca-aa09-95f7f86503ac tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:41.974036 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0a1a7808-63ae-41ca-aa09-95f7f86503ac tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:41.974469 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0a1a7808-63ae-41ca-aa09-95f7f86503ac tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:42.103413 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-0a1a7808-63ae-41ca-aa09-95f7f86503ac tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:42.111477 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-0a1a7808-63ae-41ca-aa09-95f7f86503ac tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.149644 Jun 17 15:40:42.112055 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1060/2535] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:40:41 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:40:42.485282 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-88ee100a-f79c-459a-b459-33e3719c8d0c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:42.485921 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-88ee100a-f79c-459a-b459-33e3719c8d0c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:42.492719 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-88ee100a-f79c-459a-b459-33e3719c8d0c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:42.493118 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-88ee100a-f79c-459a-b459-33e3719c8d0c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:42.493882 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-88ee100a-f79c-459a-b459-33e3719c8d0c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:42.494314 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-88ee100a-f79c-459a-b459-33e3719c8d0c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:42.637276 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-88ee100a-f79c-459a-b459-33e3719c8d0c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:42.645676 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-88ee100a-f79c-459a-b459-33e3719c8d0c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1601 microversion: 2.1 time: 0.164450 Jun 17 15:40:42.646259 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1476/2536] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:40:42 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1601 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:40:42.914865 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-4707a578-06bc-4bae-96f3-b9b504b85c07 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:42.915388 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-4707a578-06bc-4bae-96f3-b9b504b85c07 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:42.922686 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4707a578-06bc-4bae-96f3-b9b504b85c07 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:42.923136 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4707a578-06bc-4bae-96f3-b9b504b85c07 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:42.923922 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4707a578-06bc-4bae-96f3-b9b504b85c07 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:42.924369 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4707a578-06bc-4bae-96f3-b9b504b85c07 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:42.990661 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-4707a578-06bc-4bae-96f3-b9b504b85c07 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:42.999537 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-4707a578-06bc-4bae-96f3-b9b504b85c07 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:43.001077 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-4707a578-06bc-4bae-96f3-b9b504b85c07 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:43.002219 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-4707a578-06bc-4bae-96f3-b9b504b85c07 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.091412 Jun 17 15:40:43.002788 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1061/2537] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:40:42 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:40:43.129865 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-b8357765-7fad-418d-bb81-9da2a3c4f206 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:43.130490 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-b8357765-7fad-418d-bb81-9da2a3c4f206 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:43.137242 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b8357765-7fad-418d-bb81-9da2a3c4f206 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:43.137698 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b8357765-7fad-418d-bb81-9da2a3c4f206 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:43.138464 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b8357765-7fad-418d-bb81-9da2a3c4f206 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:43.138906 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b8357765-7fad-418d-bb81-9da2a3c4f206 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:43.272554 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-b8357765-7fad-418d-bb81-9da2a3c4f206 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:43.280592 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-b8357765-7fad-418d-bb81-9da2a3c4f206 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.155047 Jun 17 15:40:43.281163 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1477/2538] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:40:43 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:40:43.662846 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-1cfcb2e4-c446-4a3a-b024-43d0a5286a58 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:43.663454 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-1cfcb2e4-c446-4a3a-b024-43d0a5286a58 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:43.669552 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1cfcb2e4-c446-4a3a-b024-43d0a5286a58 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:43.669995 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1cfcb2e4-c446-4a3a-b024-43d0a5286a58 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:43.670759 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1cfcb2e4-c446-4a3a-b024-43d0a5286a58 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:43.671185 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1cfcb2e4-c446-4a3a-b024-43d0a5286a58 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:43.802011 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-1cfcb2e4-c446-4a3a-b024-43d0a5286a58 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:43.810461 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-1cfcb2e4-c446-4a3a-b024-43d0a5286a58 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1601 microversion: 2.1 time: 0.151405 Jun 17 15:40:43.811018 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1062/2539] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:40:43 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1601 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:40:44.019833 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-cd1afdf6-c6e6-4f52-af1e-1a953a002e2b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:44.020485 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-cd1afdf6-c6e6-4f52-af1e-1a953a002e2b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:44.026720 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cd1afdf6-c6e6-4f52-af1e-1a953a002e2b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:44.027162 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cd1afdf6-c6e6-4f52-af1e-1a953a002e2b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:44.027931 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cd1afdf6-c6e6-4f52-af1e-1a953a002e2b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:44.028394 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cd1afdf6-c6e6-4f52-af1e-1a953a002e2b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:44.092927 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-cd1afdf6-c6e6-4f52-af1e-1a953a002e2b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:44.102659 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-cd1afdf6-c6e6-4f52-af1e-1a953a002e2b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:44.104165 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-cd1afdf6-c6e6-4f52-af1e-1a953a002e2b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:44.105337 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-cd1afdf6-c6e6-4f52-af1e-1a953a002e2b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.089596 Jun 17 15:40:44.106186 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1478/2540] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:40:44 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 15:40:44.297049 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-6ec7729e-08ea-4c06-920e-a4ae49de052f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:44.297617 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-6ec7729e-08ea-4c06-920e-a4ae49de052f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:44.304782 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6ec7729e-08ea-4c06-920e-a4ae49de052f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:44.305222 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6ec7729e-08ea-4c06-920e-a4ae49de052f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:44.305977 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6ec7729e-08ea-4c06-920e-a4ae49de052f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:44.306405 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6ec7729e-08ea-4c06-920e-a4ae49de052f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:44.437695 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-6ec7729e-08ea-4c06-920e-a4ae49de052f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:44.445812 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-6ec7729e-08ea-4c06-920e-a4ae49de052f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.152695 Jun 17 15:40:44.446373 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1063/2541] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:40:44 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:40:44.827664 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-f67e2c2a-a6dd-48da-8c23-2dc896f7082f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:44.828268 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-f67e2c2a-a6dd-48da-8c23-2dc896f7082f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:44.835588 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f67e2c2a-a6dd-48da-8c23-2dc896f7082f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:44.836030 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f67e2c2a-a6dd-48da-8c23-2dc896f7082f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:44.836828 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f67e2c2a-a6dd-48da-8c23-2dc896f7082f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:44.837280 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f67e2c2a-a6dd-48da-8c23-2dc896f7082f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:44.972776 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-f67e2c2a-a6dd-48da-8c23-2dc896f7082f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:44.981191 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-f67e2c2a-a6dd-48da-8c23-2dc896f7082f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1601 microversion: 2.1 time: 0.157410 Jun 17 15:40:44.981763 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1479/2542] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:40:44 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1601 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:40:45.124415 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-db598803-14df-46a3-afd6-08e3411d90ed tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:45.125026 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-db598803-14df-46a3-afd6-08e3411d90ed tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:45.131693 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-db598803-14df-46a3-afd6-08e3411d90ed tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:45.132137 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-db598803-14df-46a3-afd6-08e3411d90ed tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:45.132968 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-db598803-14df-46a3-afd6-08e3411d90ed tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:45.133400 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-db598803-14df-46a3-afd6-08e3411d90ed tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:45.198915 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-db598803-14df-46a3-afd6-08e3411d90ed tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:45.207370 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-db598803-14df-46a3-afd6-08e3411d90ed tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:45.208921 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-db598803-14df-46a3-afd6-08e3411d90ed tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:45.210094 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-db598803-14df-46a3-afd6-08e3411d90ed tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.089675 Jun 17 15:40:45.210657 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1064/2543] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:40:45 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:40:45.462952 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-16b430d9-a977-472b-94f9-0d7cf0b79b6e tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:45.463560 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-16b430d9-a977-472b-94f9-0d7cf0b79b6e tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:45.465460 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_api:SELECT=76 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:40:45.470813 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-16b430d9-a977-472b-94f9-0d7cf0b79b6e tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:45.471253 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-16b430d9-a977-472b-94f9-0d7cf0b79b6e tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:45.472007 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-16b430d9-a977-472b-94f9-0d7cf0b79b6e tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:45.472466 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-16b430d9-a977-472b-94f9-0d7cf0b79b6e tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:45.610164 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-16b430d9-a977-472b-94f9-0d7cf0b79b6e tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:45.619300 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-16b430d9-a977-472b-94f9-0d7cf0b79b6e tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.160204 Jun 17 15:40:45.619885 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1480/2544] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:40:45 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:40:45.998503 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-a919867a-f732-40f2-9df8-cc63e9d0446c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:45.999055 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-a919867a-f732-40f2-9df8-cc63e9d0446c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:46.007283 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a919867a-f732-40f2-9df8-cc63e9d0446c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:46.007835 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a919867a-f732-40f2-9df8-cc63e9d0446c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:46.008960 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a919867a-f732-40f2-9df8-cc63e9d0446c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:46.009580 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a919867a-f732-40f2-9df8-cc63e9d0446c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:46.145091 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-a919867a-f732-40f2-9df8-cc63e9d0446c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:46.153754 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-a919867a-f732-40f2-9df8-cc63e9d0446c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1601 microversion: 2.1 time: 0.159276 Jun 17 15:40:46.154319 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1065/2545] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:40:45 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1601 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:40:46.228593 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-14f01154-85ee-4a44-bf5a-d0e3673dc028 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:46.229215 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-14f01154-85ee-4a44-bf5a-d0e3673dc028 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:46.235916 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-14f01154-85ee-4a44-bf5a-d0e3673dc028 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:46.236389 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-14f01154-85ee-4a44-bf5a-d0e3673dc028 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:46.237147 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-14f01154-85ee-4a44-bf5a-d0e3673dc028 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:46.237574 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-14f01154-85ee-4a44-bf5a-d0e3673dc028 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:46.252733 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=100 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:40:46.302804 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-14f01154-85ee-4a44-bf5a-d0e3673dc028 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:46.311734 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-14f01154-85ee-4a44-bf5a-d0e3673dc028 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:46.313303 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-14f01154-85ee-4a44-bf5a-d0e3673dc028 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:46.314423 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-14f01154-85ee-4a44-bf5a-d0e3673dc028 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.090168 Jun 17 15:40:46.314975 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1481/2546] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:40:46 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 15:40:46.637432 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-479c9c89-c7c3-4a5f-bfb1-8027b037a7a9 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:46.638076 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-479c9c89-c7c3-4a5f-bfb1-8027b037a7a9 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:46.644201 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-479c9c89-c7c3-4a5f-bfb1-8027b037a7a9 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:46.645474 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-479c9c89-c7c3-4a5f-bfb1-8027b037a7a9 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:46.646256 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-479c9c89-c7c3-4a5f-bfb1-8027b037a7a9 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:46.646690 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-479c9c89-c7c3-4a5f-bfb1-8027b037a7a9 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:46.779121 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-479c9c89-c7c3-4a5f-bfb1-8027b037a7a9 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:46.787061 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-479c9c89-c7c3-4a5f-bfb1-8027b037a7a9 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.153648 Jun 17 15:40:46.787617 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1066/2547] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:40:46 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:40:47.172800 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-99fd609d-8a18-4f95-98cb-9550bfff988e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:47.173763 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-99fd609d-8a18-4f95-98cb-9550bfff988e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:47.180115 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-99fd609d-8a18-4f95-98cb-9550bfff988e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:47.180593 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-99fd609d-8a18-4f95-98cb-9550bfff988e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:47.181887 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-99fd609d-8a18-4f95-98cb-9550bfff988e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:47.182556 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-99fd609d-8a18-4f95-98cb-9550bfff988e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:47.328525 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-99fd609d-8a18-4f95-98cb-9550bfff988e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:47.333039 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-8c111268-7d6f-49d5-8b53-aed39b37b19e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:47.333662 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-8c111268-7d6f-49d5-8b53-aed39b37b19e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:47.337153 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-99fd609d-8a18-4f95-98cb-9550bfff988e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1601 microversion: 2.1 time: 0.169284 Jun 17 15:40:47.337718 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1482/2548] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:40:47 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1601 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:40:47.340904 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8c111268-7d6f-49d5-8b53-aed39b37b19e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:47.341346 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8c111268-7d6f-49d5-8b53-aed39b37b19e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:47.342121 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8c111268-7d6f-49d5-8b53-aed39b37b19e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:47.342556 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8c111268-7d6f-49d5-8b53-aed39b37b19e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:47.418096 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-8c111268-7d6f-49d5-8b53-aed39b37b19e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:47.429275 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-8c111268-7d6f-49d5-8b53-aed39b37b19e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:47.430904 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-8c111268-7d6f-49d5-8b53-aed39b37b19e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:47.432031 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-8c111268-7d6f-49d5-8b53-aed39b37b19e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.102937 Jun 17 15:40:47.432610 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1067/2549] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:40:47 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 15:40:47.805681 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-e6611e92-2bad-4582-b229-3cfec91ce0f0 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:47.806321 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-e6611e92-2bad-4582-b229-3cfec91ce0f0 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:47.812406 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e6611e92-2bad-4582-b229-3cfec91ce0f0 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:47.812994 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e6611e92-2bad-4582-b229-3cfec91ce0f0 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:47.813687 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e6611e92-2bad-4582-b229-3cfec91ce0f0 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:47.814164 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e6611e92-2bad-4582-b229-3cfec91ce0f0 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:47.980805 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-e6611e92-2bad-4582-b229-3cfec91ce0f0 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:47.989629 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-e6611e92-2bad-4582-b229-3cfec91ce0f0 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.189355 Jun 17 15:40:47.990756 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1483/2550] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:40:47 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:40:48.356433 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-19b05e1b-efe1-44aa-a57a-7ab50923176d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:48.357038 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-19b05e1b-efe1-44aa-a57a-7ab50923176d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:48.364940 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-19b05e1b-efe1-44aa-a57a-7ab50923176d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:48.365385 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-19b05e1b-efe1-44aa-a57a-7ab50923176d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:48.366141 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-19b05e1b-efe1-44aa-a57a-7ab50923176d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:48.366585 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-19b05e1b-efe1-44aa-a57a-7ab50923176d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:48.385035 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell1:SELECT=100 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:40:48.454711 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-aa45203a-241f-40de-bb5c-09b90f8029bd tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:48.455790 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-aa45203a-241f-40de-bb5c-09b90f8029bd tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:48.464848 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-aa45203a-241f-40de-bb5c-09b90f8029bd tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:48.465043 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-aa45203a-241f-40de-bb5c-09b90f8029bd tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:48.465804 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-aa45203a-241f-40de-bb5c-09b90f8029bd tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:48.466371 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-aa45203a-241f-40de-bb5c-09b90f8029bd tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:48.530308 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-19b05e1b-efe1-44aa-a57a-7ab50923176d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:48.542524 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-19b05e1b-efe1-44aa-a57a-7ab50923176d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1601 microversion: 2.1 time: 0.191906 Jun 17 15:40:48.545594 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1068/2551] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:40:48 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1601 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:40:48.545754 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-aa45203a-241f-40de-bb5c-09b90f8029bd tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:48.555731 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-aa45203a-241f-40de-bb5c-09b90f8029bd tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:48.557637 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-aa45203a-241f-40de-bb5c-09b90f8029bd tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:48.558812 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-aa45203a-241f-40de-bb5c-09b90f8029bd tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.108346 Jun 17 15:40:48.559368 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1484/2552] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:40:48 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 15:40:49.010930 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-5f4a1bbf-201e-48c5-87d0-e12e8cf6b739 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:49.011466 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-5f4a1bbf-201e-48c5-87d0-e12e8cf6b739 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:49.014113 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_api:SELECT=82 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:40:49.020712 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5f4a1bbf-201e-48c5-87d0-e12e8cf6b739 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:49.021194 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5f4a1bbf-201e-48c5-87d0-e12e8cf6b739 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:49.021959 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5f4a1bbf-201e-48c5-87d0-e12e8cf6b739 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:49.022389 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5f4a1bbf-201e-48c5-87d0-e12e8cf6b739 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:49.184784 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-5f4a1bbf-201e-48c5-87d0-e12e8cf6b739 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:49.197106 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-5f4a1bbf-201e-48c5-87d0-e12e8cf6b739 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.192615 Jun 17 15:40:49.197675 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1069/2553] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:40:49 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:40:49.566605 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-8808ef79-6e7a-4f4c-b6df-589639c1194a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:49.567600 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-8808ef79-6e7a-4f4c-b6df-589639c1194a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:49.576967 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8808ef79-6e7a-4f4c-b6df-589639c1194a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:49.577653 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8808ef79-6e7a-4f4c-b6df-589639c1194a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:49.578819 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8808ef79-6e7a-4f4c-b6df-589639c1194a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:49.579449 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8808ef79-6e7a-4f4c-b6df-589639c1194a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:49.587265 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-9c3774bd-43cf-4029-bd01-8625022e8e10 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:49.587919 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-9c3774bd-43cf-4029-bd01-8625022e8e10 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:49.597218 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9c3774bd-43cf-4029-bd01-8625022e8e10 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:49.597218 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9c3774bd-43cf-4029-bd01-8625022e8e10 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:49.598046 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9c3774bd-43cf-4029-bd01-8625022e8e10 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:49.599338 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9c3774bd-43cf-4029-bd01-8625022e8e10 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:49.667379 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-9c3774bd-43cf-4029-bd01-8625022e8e10 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:49.677234 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-9c3774bd-43cf-4029-bd01-8625022e8e10 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:49.679644 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-9c3774bd-43cf-4029-bd01-8625022e8e10 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:49.681292 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-9c3774bd-43cf-4029-bd01-8625022e8e10 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.099354 Jun 17 15:40:49.682229 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1070/2554] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:40:49 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 15:40:49.737284 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-8808ef79-6e7a-4f4c-b6df-589639c1194a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:49.745337 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-8808ef79-6e7a-4f4c-b6df-589639c1194a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1601 microversion: 2.1 time: 0.185333 Jun 17 15:40:49.745911 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1485/2555] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:40:49 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1601 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:40:50.219217 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-ec42695a-895a-486a-b0fb-e29bea07aa96 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:50.219828 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-ec42695a-895a-486a-b0fb-e29bea07aa96 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:50.226543 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ec42695a-895a-486a-b0fb-e29bea07aa96 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:50.226985 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ec42695a-895a-486a-b0fb-e29bea07aa96 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:50.227728 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ec42695a-895a-486a-b0fb-e29bea07aa96 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:50.228156 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ec42695a-895a-486a-b0fb-e29bea07aa96 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:50.369606 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-ec42695a-895a-486a-b0fb-e29bea07aa96 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:50.379843 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-ec42695a-895a-486a-b0fb-e29bea07aa96 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.164597 Jun 17 15:40:50.379843 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1071/2556] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:40:50 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:40:50.703679 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-2fb91bf6-3e6a-4465-beca-805fbf63135d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:50.704441 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-2fb91bf6-3e6a-4465-beca-805fbf63135d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:50.710931 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2fb91bf6-3e6a-4465-beca-805fbf63135d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:50.711375 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2fb91bf6-3e6a-4465-beca-805fbf63135d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:50.712138 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2fb91bf6-3e6a-4465-beca-805fbf63135d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:50.712603 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2fb91bf6-3e6a-4465-beca-805fbf63135d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:50.765929 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-7dfff6bd-a2f1-4937-a9eb-b639737b109c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:50.766791 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-7dfff6bd-a2f1-4937-a9eb-b639737b109c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:50.773428 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7dfff6bd-a2f1-4937-a9eb-b639737b109c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:50.773868 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7dfff6bd-a2f1-4937-a9eb-b639737b109c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:50.774619 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7dfff6bd-a2f1-4937-a9eb-b639737b109c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:50.775047 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7dfff6bd-a2f1-4937-a9eb-b639737b109c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:50.782501 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-2fb91bf6-3e6a-4465-beca-805fbf63135d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:50.791999 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-2fb91bf6-3e6a-4465-beca-805fbf63135d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:50.793541 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-2fb91bf6-3e6a-4465-beca-805fbf63135d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:50.794686 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-2fb91bf6-3e6a-4465-beca-805fbf63135d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.094975 Jun 17 15:40:50.795246 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1486/2557] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:40:50 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:40:50.942769 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-7dfff6bd-a2f1-4937-a9eb-b639737b109c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:50.950810 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-7dfff6bd-a2f1-4937-a9eb-b639737b109c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1601 microversion: 2.1 time: 0.188737 Jun 17 15:40:50.951342 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1072/2558] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:40:50 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1601 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:40:51.398603 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-3a580227-0e68-4703-b6ee-63d218376196 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:51.399226 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-3a580227-0e68-4703-b6ee-63d218376196 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:51.405347 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3a580227-0e68-4703-b6ee-63d218376196 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:51.405802 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3a580227-0e68-4703-b6ee-63d218376196 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:51.406564 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3a580227-0e68-4703-b6ee-63d218376196 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:51.407005 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3a580227-0e68-4703-b6ee-63d218376196 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:51.544921 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-3a580227-0e68-4703-b6ee-63d218376196 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:51.553078 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-3a580227-0e68-4703-b6ee-63d218376196 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.159590 Jun 17 15:40:51.553652 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1487/2559] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:40:51 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:40:51.813016 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-d397f31a-5970-4c30-a313-98bd207f5ad9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:51.813762 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-d397f31a-5970-4c30-a313-98bd207f5ad9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:51.824137 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d397f31a-5970-4c30-a313-98bd207f5ad9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:51.824904 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d397f31a-5970-4c30-a313-98bd207f5ad9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:51.826029 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d397f31a-5970-4c30-a313-98bd207f5ad9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:51.826723 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d397f31a-5970-4c30-a313-98bd207f5ad9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:51.898683 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-d397f31a-5970-4c30-a313-98bd207f5ad9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:51.907156 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-d397f31a-5970-4c30-a313-98bd207f5ad9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:51.908698 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-d397f31a-5970-4c30-a313-98bd207f5ad9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:51.909852 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-d397f31a-5970-4c30-a313-98bd207f5ad9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.100766 Jun 17 15:40:51.910421 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1073/2560] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:40:51 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:40:51.968282 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-0d6d9c27-df20-4927-902e-c4b9bf22a95c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:51.968895 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-0d6d9c27-df20-4927-902e-c4b9bf22a95c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:51.975646 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0d6d9c27-df20-4927-902e-c4b9bf22a95c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:51.976086 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0d6d9c27-df20-4927-902e-c4b9bf22a95c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:51.976870 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0d6d9c27-df20-4927-902e-c4b9bf22a95c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:51.977298 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0d6d9c27-df20-4927-902e-c4b9bf22a95c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:52.108169 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-0d6d9c27-df20-4927-902e-c4b9bf22a95c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:52.116680 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-0d6d9c27-df20-4927-902e-c4b9bf22a95c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1601 microversion: 2.1 time: 0.152412 Jun 17 15:40:52.117257 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1488/2561] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:40:51 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1601 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:40:52.570044 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-3d6c9c68-82f8-4c89-8d8c-d7a111d5c4b2 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:52.570684 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-3d6c9c68-82f8-4c89-8d8c-d7a111d5c4b2 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:52.577368 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3d6c9c68-82f8-4c89-8d8c-d7a111d5c4b2 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:52.577810 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3d6c9c68-82f8-4c89-8d8c-d7a111d5c4b2 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:52.578579 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3d6c9c68-82f8-4c89-8d8c-d7a111d5c4b2 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:52.579009 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3d6c9c68-82f8-4c89-8d8c-d7a111d5c4b2 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:52.713987 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-3d6c9c68-82f8-4c89-8d8c-d7a111d5c4b2 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:52.722343 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-3d6c9c68-82f8-4c89-8d8c-d7a111d5c4b2 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.156096 Jun 17 15:40:52.722927 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1074/2562] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:40:52 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:40:52.927641 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-29315791-9913-44b1-8bad-263c7831bcba tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:52.928160 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-29315791-9913-44b1-8bad-263c7831bcba tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:52.934547 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-29315791-9913-44b1-8bad-263c7831bcba tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:52.934998 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-29315791-9913-44b1-8bad-263c7831bcba tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:52.935763 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-29315791-9913-44b1-8bad-263c7831bcba tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:52.936184 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-29315791-9913-44b1-8bad-263c7831bcba tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:52.998935 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-29315791-9913-44b1-8bad-263c7831bcba tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:53.008256 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-29315791-9913-44b1-8bad-263c7831bcba tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:53.009785 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-29315791-9913-44b1-8bad-263c7831bcba tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:53.010926 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-29315791-9913-44b1-8bad-263c7831bcba tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.087316 Jun 17 15:40:53.011475 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1489/2563] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:40:52 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:40:53.134264 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-02780b04-eff9-4f1c-b796-bb5344b329c0 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:53.134887 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-02780b04-eff9-4f1c-b796-bb5344b329c0 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:53.141535 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-02780b04-eff9-4f1c-b796-bb5344b329c0 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:53.142020 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-02780b04-eff9-4f1c-b796-bb5344b329c0 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:53.142818 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-02780b04-eff9-4f1c-b796-bb5344b329c0 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:53.143258 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-02780b04-eff9-4f1c-b796-bb5344b329c0 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:53.273139 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-02780b04-eff9-4f1c-b796-bb5344b329c0 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:53.281120 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-02780b04-eff9-4f1c-b796-bb5344b329c0 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1601 microversion: 2.1 time: 0.151198 Jun 17 15:40:53.281692 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1075/2564] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:40:53 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1601 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:40:53.741438 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-825cca95-423c-4022-8c3a-0c86a5710f22 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:53.742438 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-825cca95-423c-4022-8c3a-0c86a5710f22 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:53.749181 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-825cca95-423c-4022-8c3a-0c86a5710f22 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:53.749624 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-825cca95-423c-4022-8c3a-0c86a5710f22 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:53.750385 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-825cca95-423c-4022-8c3a-0c86a5710f22 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:53.750806 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-825cca95-423c-4022-8c3a-0c86a5710f22 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:53.885413 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-825cca95-423c-4022-8c3a-0c86a5710f22 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:53.893540 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-825cca95-423c-4022-8c3a-0c86a5710f22 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.157006 Jun 17 15:40:53.894112 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1490/2565] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:40:53 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:40:54.029026 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-409660e5-e361-47fa-9443-c2185531fee8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:54.029550 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-409660e5-e361-47fa-9443-c2185531fee8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:54.035620 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-409660e5-e361-47fa-9443-c2185531fee8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:54.036050 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-409660e5-e361-47fa-9443-c2185531fee8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:54.036966 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-409660e5-e361-47fa-9443-c2185531fee8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:54.037397 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-409660e5-e361-47fa-9443-c2185531fee8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:54.102060 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-409660e5-e361-47fa-9443-c2185531fee8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:54.110608 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-409660e5-e361-47fa-9443-c2185531fee8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:54.112098 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-409660e5-e361-47fa-9443-c2185531fee8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:54.113261 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-409660e5-e361-47fa-9443-c2185531fee8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.088267 Jun 17 15:40:54.113813 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1076/2566] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:40:54 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:40:54.298493 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-99057643-482c-4d66-87e9-37a72da82320 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:54.299042 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-99057643-482c-4d66-87e9-37a72da82320 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:54.306279 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-99057643-482c-4d66-87e9-37a72da82320 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:54.306719 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-99057643-482c-4d66-87e9-37a72da82320 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:54.307481 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-99057643-482c-4d66-87e9-37a72da82320 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:54.307909 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-99057643-482c-4d66-87e9-37a72da82320 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:54.443754 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-99057643-482c-4d66-87e9-37a72da82320 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:54.452452 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-99057643-482c-4d66-87e9-37a72da82320 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1601 microversion: 2.1 time: 0.157924 Jun 17 15:40:54.453040 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1491/2567] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:40:54 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1601 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:40:54.911279 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-cf46e936-0ae2-47e8-abd9-78886d31040a tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:54.912477 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-cf46e936-0ae2-47e8-abd9-78886d31040a tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:54.919420 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cf46e936-0ae2-47e8-abd9-78886d31040a tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:54.919879 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cf46e936-0ae2-47e8-abd9-78886d31040a tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:54.920678 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cf46e936-0ae2-47e8-abd9-78886d31040a tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:54.921117 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cf46e936-0ae2-47e8-abd9-78886d31040a tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:55.058354 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-cf46e936-0ae2-47e8-abd9-78886d31040a tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:55.066629 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-cf46e936-0ae2-47e8-abd9-78886d31040a tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.159228 Jun 17 15:40:55.067208 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1077/2568] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:40:54 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:40:55.134142 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-b1294022-49c7-4407-b80d-ef5c3e519d8a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:55.134937 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-b1294022-49c7-4407-b80d-ef5c3e519d8a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:55.141765 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b1294022-49c7-4407-b80d-ef5c3e519d8a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:55.142226 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b1294022-49c7-4407-b80d-ef5c3e519d8a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:55.143054 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b1294022-49c7-4407-b80d-ef5c3e519d8a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:55.143488 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b1294022-49c7-4407-b80d-ef5c3e519d8a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:55.227130 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-b1294022-49c7-4407-b80d-ef5c3e519d8a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:55.237025 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-b1294022-49c7-4407-b80d-ef5c3e519d8a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:55.238576 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-b1294022-49c7-4407-b80d-ef5c3e519d8a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:55.239791 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-b1294022-49c7-4407-b80d-ef5c3e519d8a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.111936 Jun 17 15:40:55.240363 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1492/2569] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:40:55 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:40:55.469369 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-cc2a3ee8-8de1-4702-9c9c-7df63adaefbc tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:55.469990 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-cc2a3ee8-8de1-4702-9c9c-7df63adaefbc tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:55.476542 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cc2a3ee8-8de1-4702-9c9c-7df63adaefbc tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:55.476931 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cc2a3ee8-8de1-4702-9c9c-7df63adaefbc tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:55.477701 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cc2a3ee8-8de1-4702-9c9c-7df63adaefbc tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:55.478141 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cc2a3ee8-8de1-4702-9c9c-7df63adaefbc tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:55.616849 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-cc2a3ee8-8de1-4702-9c9c-7df63adaefbc tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:55.625310 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-cc2a3ee8-8de1-4702-9c9c-7df63adaefbc tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1601 microversion: 2.1 time: 0.159783 Jun 17 15:40:55.625911 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1078/2570] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:40:55 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1601 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:40:56.083204 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-28203117-715a-4ebb-a754-37b6bcbc4fed tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:56.083910 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-28203117-715a-4ebb-a754-37b6bcbc4fed tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:56.090432 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-28203117-715a-4ebb-a754-37b6bcbc4fed tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:56.090877 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-28203117-715a-4ebb-a754-37b6bcbc4fed tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:56.091656 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-28203117-715a-4ebb-a754-37b6bcbc4fed tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:56.092087 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-28203117-715a-4ebb-a754-37b6bcbc4fed tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:56.230523 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-28203117-715a-4ebb-a754-37b6bcbc4fed tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:56.238684 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-28203117-715a-4ebb-a754-37b6bcbc4fed tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.159373 Jun 17 15:40:56.239282 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1493/2571] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:40:56 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:40:56.259184 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-a14219ba-6c96-435e-a741-69b229791f3b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:56.259858 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-a14219ba-6c96-435e-a741-69b229791f3b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:56.267424 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a14219ba-6c96-435e-a741-69b229791f3b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:56.267870 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a14219ba-6c96-435e-a741-69b229791f3b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:56.268703 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a14219ba-6c96-435e-a741-69b229791f3b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:56.269139 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a14219ba-6c96-435e-a741-69b229791f3b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:56.339076 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-a14219ba-6c96-435e-a741-69b229791f3b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:56.348007 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-a14219ba-6c96-435e-a741-69b229791f3b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:56.350160 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-a14219ba-6c96-435e-a741-69b229791f3b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:56.351578 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-a14219ba-6c96-435e-a741-69b229791f3b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.097275 Jun 17 15:40:56.352135 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1079/2572] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:40:56 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:40:56.642793 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-dba7d731-ae3c-4ac9-84d5-fdad3145e12d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:56.643492 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-dba7d731-ae3c-4ac9-84d5-fdad3145e12d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:56.650851 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-dba7d731-ae3c-4ac9-84d5-fdad3145e12d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:56.651385 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-dba7d731-ae3c-4ac9-84d5-fdad3145e12d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:56.652254 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-dba7d731-ae3c-4ac9-84d5-fdad3145e12d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:56.652791 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-dba7d731-ae3c-4ac9-84d5-fdad3145e12d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:56.795641 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-dba7d731-ae3c-4ac9-84d5-fdad3145e12d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:56.804727 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-dba7d731-ae3c-4ac9-84d5-fdad3145e12d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1601 microversion: 2.1 time: 0.165841 Jun 17 15:40:56.805319 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1494/2573] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:40:56 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1601 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:40:57.257150 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-310de728-bba0-48a1-b203-8e169d7646fd tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:57.257770 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-310de728-bba0-48a1-b203-8e169d7646fd tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:57.264299 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-310de728-bba0-48a1-b203-8e169d7646fd tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:57.264914 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-310de728-bba0-48a1-b203-8e169d7646fd tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:57.265523 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-310de728-bba0-48a1-b203-8e169d7646fd tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:57.265958 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-310de728-bba0-48a1-b203-8e169d7646fd tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:57.369959 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-351c5a8f-ead5-4c79-88b2-5308488bb748 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:57.370553 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-351c5a8f-ead5-4c79-88b2-5308488bb748 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:57.379078 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-351c5a8f-ead5-4c79-88b2-5308488bb748 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:57.379528 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-351c5a8f-ead5-4c79-88b2-5308488bb748 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:57.380297 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-351c5a8f-ead5-4c79-88b2-5308488bb748 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:57.381338 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-351c5a8f-ead5-4c79-88b2-5308488bb748 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:57.400369 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-310de728-bba0-48a1-b203-8e169d7646fd tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:57.408574 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-310de728-bba0-48a1-b203-8e169d7646fd tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.155883 Jun 17 15:40:57.409251 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1080/2574] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:40:57 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:40:57.443529 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-351c5a8f-ead5-4c79-88b2-5308488bb748 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:57.451998 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-351c5a8f-ead5-4c79-88b2-5308488bb748 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:57.453519 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-351c5a8f-ead5-4c79-88b2-5308488bb748 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:57.454652 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-351c5a8f-ead5-4c79-88b2-5308488bb748 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.088605 Jun 17 15:40:57.455212 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1495/2575] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:40:57 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 15:40:57.821999 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-93ef381f-2634-4414-99d8-e07cf72648fa tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:57.822606 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-93ef381f-2634-4414-99d8-e07cf72648fa tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:57.828618 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-93ef381f-2634-4414-99d8-e07cf72648fa tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:57.829061 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-93ef381f-2634-4414-99d8-e07cf72648fa tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:57.829807 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-93ef381f-2634-4414-99d8-e07cf72648fa tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:57.830235 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-93ef381f-2634-4414-99d8-e07cf72648fa tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:57.962772 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-93ef381f-2634-4414-99d8-e07cf72648fa tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:57.971128 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-93ef381f-2634-4414-99d8-e07cf72648fa tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1601 microversion: 2.1 time: 0.152982 Jun 17 15:40:57.971690 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1081/2576] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:40:57 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1601 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:40:58.425991 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-e23f98b1-c189-4e88-9174-0dc1ea69bc3a tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:58.426638 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-e23f98b1-c189-4e88-9174-0dc1ea69bc3a tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:58.433430 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e23f98b1-c189-4e88-9174-0dc1ea69bc3a tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:58.433873 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e23f98b1-c189-4e88-9174-0dc1ea69bc3a tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:58.434646 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e23f98b1-c189-4e88-9174-0dc1ea69bc3a tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:58.435073 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e23f98b1-c189-4e88-9174-0dc1ea69bc3a tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:58.473209 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-8bcdefe4-f8df-4bea-bee1-5d946ccc1f13 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:58.474050 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-8bcdefe4-f8df-4bea-bee1-5d946ccc1f13 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:58.481694 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8bcdefe4-f8df-4bea-bee1-5d946ccc1f13 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:58.482130 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8bcdefe4-f8df-4bea-bee1-5d946ccc1f13 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:58.482946 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8bcdefe4-f8df-4bea-bee1-5d946ccc1f13 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:58.483657 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8bcdefe4-f8df-4bea-bee1-5d946ccc1f13 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:58.562277 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-8bcdefe4-f8df-4bea-bee1-5d946ccc1f13 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:58.572691 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-8bcdefe4-f8df-4bea-bee1-5d946ccc1f13 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:58.574849 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-8bcdefe4-f8df-4bea-bee1-5d946ccc1f13 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:58.576205 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-8bcdefe4-f8df-4bea-bee1-5d946ccc1f13 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.107048 Jun 17 15:40:58.576893 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1082/2577] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:40:58 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 15:40:58.736971 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-e23f98b1-c189-4e88-9174-0dc1ea69bc3a tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:58.745622 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-e23f98b1-c189-4e88-9174-0dc1ea69bc3a tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.323501 Jun 17 15:40:58.746187 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1496/2578] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:40:58 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:40:59.043041 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-53728979-f5c9-4f78-8afc-80086c125ac4 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:59.043561 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-53728979-f5c9-4f78-8afc-80086c125ac4 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:59.049750 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-53728979-f5c9-4f78-8afc-80086c125ac4 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:59.050201 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-53728979-f5c9-4f78-8afc-80086c125ac4 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:59.050959 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-53728979-f5c9-4f78-8afc-80086c125ac4 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:59.051391 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-53728979-f5c9-4f78-8afc-80086c125ac4 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:59.186480 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-53728979-f5c9-4f78-8afc-80086c125ac4 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:59.194613 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-53728979-f5c9-4f78-8afc-80086c125ac4 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1601 microversion: 2.1 time: 0.155556 Jun 17 15:40:59.195183 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1083/2579] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:40:59 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1601 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:40:59.594978 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-7a9674e2-a084-459e-b96e-c2b551ca3289 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:59.595593 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-7a9674e2-a084-459e-b96e-c2b551ca3289 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:59.602812 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7a9674e2-a084-459e-b96e-c2b551ca3289 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:59.603258 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7a9674e2-a084-459e-b96e-c2b551ca3289 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:59.604012 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7a9674e2-a084-459e-b96e-c2b551ca3289 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:59.604472 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7a9674e2-a084-459e-b96e-c2b551ca3289 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:59.685867 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-7a9674e2-a084-459e-b96e-c2b551ca3289 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:59.694741 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-7a9674e2-a084-459e-b96e-c2b551ca3289 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:59.696222 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-7a9674e2-a084-459e-b96e-c2b551ca3289 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:59.697368 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-7a9674e2-a084-459e-b96e-c2b551ca3289 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.106370 Jun 17 15:40:59.697907 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1497/2580] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:40:59 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:40:59.762114 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-3ec350b7-937d-427d-80c9-939d88901615 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:40:59.762732 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-3ec350b7-937d-427d-80c9-939d88901615 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:40:59.769430 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3ec350b7-937d-427d-80c9-939d88901615 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:59.769883 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3ec350b7-937d-427d-80c9-939d88901615 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:59.770649 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3ec350b7-937d-427d-80c9-939d88901615 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:40:59.771644 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3ec350b7-937d-427d-80c9-939d88901615 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:40:59.904610 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-3ec350b7-937d-427d-80c9-939d88901615 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:40:59.912894 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-3ec350b7-937d-427d-80c9-939d88901615 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.154611 Jun 17 15:40:59.913569 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1084/2581] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:40:59 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:41:00.124972 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [req-a202c6b2-bd45-4bd3-aa67-0f40f4498363 req-b0cc71a9-c521-4a35-b92c-1a79a76e8d7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91408900-da01-4985-b392-111577935284", "name": "network-vif-deleted", "tag": "06c1246f-1c4b-48df-98b1-2028fa5b27e5"}]} {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:41:00.133865 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [req-a202c6b2-bd45-4bd3-aa67-0f40f4498363 req-b0cc71a9-c521-4a35-b92c-1a79a76e8d7a service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:00.134302 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [req-a202c6b2-bd45-4bd3-aa67-0f40f4498363 req-b0cc71a9-c521-4a35-b92c-1a79a76e8d7a service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:00.137011 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=100 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:41:00.146250 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.compute.server_external_events [req-a202c6b2-bd45-4bd3-aa67-0f40f4498363 req-b0cc71a9-c521-4a35-b92c-1a79a76e8d7a service nova] Creating event network-vif-deleted:06c1246f-1c4b-48df-98b1-2028fa5b27e5 for instance 91408900-da01-4985-b392-111577935284 on hv-cinder-82549 Jun 17 15:41:00.151504 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [req-a202c6b2-bd45-4bd3-aa67-0f40f4498363 req-b0cc71a9-c521-4a35-b92c-1a79a76e8d7a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030477 Jun 17 15:41:00.152081 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1498/2582] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 15:41:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:41:00.211545 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-78e988eb-a1ad-4d10-ba88-141cd50779d7 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:00.212148 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-78e988eb-a1ad-4d10-ba88-141cd50779d7 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:00.218121 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-78e988eb-a1ad-4d10-ba88-141cd50779d7 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:00.218558 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-78e988eb-a1ad-4d10-ba88-141cd50779d7 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:00.219299 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-78e988eb-a1ad-4d10-ba88-141cd50779d7 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:00.219728 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-78e988eb-a1ad-4d10-ba88-141cd50779d7 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:00.223565 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell1:SELECT=100 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:41:00.280118 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-78e988eb-a1ad-4d10-ba88-141cd50779d7 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:00.288052 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-78e988eb-a1ad-4d10-ba88-141cd50779d7 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.080433 Jun 17 15:41:00.288652 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1085/2583] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:41:00 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:41:00.716933 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-58cf4984-6303-483f-af0e-aa3d69b51afb tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:00.717617 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-58cf4984-6303-483f-af0e-aa3d69b51afb tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:00.723890 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-58cf4984-6303-483f-af0e-aa3d69b51afb tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:00.724933 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-58cf4984-6303-483f-af0e-aa3d69b51afb tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:00.726032 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-58cf4984-6303-483f-af0e-aa3d69b51afb tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:00.726472 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-58cf4984-6303-483f-af0e-aa3d69b51afb tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:00.789602 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-58cf4984-6303-483f-af0e-aa3d69b51afb tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:00.797926 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-58cf4984-6303-483f-af0e-aa3d69b51afb tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:00.799426 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-58cf4984-6303-483f-af0e-aa3d69b51afb tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:00.800572 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-58cf4984-6303-483f-af0e-aa3d69b51afb tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.088814 Jun 17 15:41:00.801116 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1499/2584] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:41:00 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:41:00.930090 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-a4ee89b6-e65a-49ce-a7e3-7fd0188d5cbd tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:00.930697 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-a4ee89b6-e65a-49ce-a7e3-7fd0188d5cbd tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:00.937238 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a4ee89b6-e65a-49ce-a7e3-7fd0188d5cbd tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:00.937678 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a4ee89b6-e65a-49ce-a7e3-7fd0188d5cbd tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:00.938451 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a4ee89b6-e65a-49ce-a7e3-7fd0188d5cbd tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:00.938879 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a4ee89b6-e65a-49ce-a7e3-7fd0188d5cbd tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:01.074240 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-a4ee89b6-e65a-49ce-a7e3-7fd0188d5cbd tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:01.082164 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-a4ee89b6-e65a-49ce-a7e3-7fd0188d5cbd tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.155987 Jun 17 15:41:01.082735 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1086/2585] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:41:00 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:41:01.304518 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-3b2e691b-459d-49f4-8444-3419559fa6de tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:01.305176 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-3b2e691b-459d-49f4-8444-3419559fa6de tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:01.311099 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3b2e691b-459d-49f4-8444-3419559fa6de tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:01.311539 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3b2e691b-459d-49f4-8444-3419559fa6de tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:01.312288 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3b2e691b-459d-49f4-8444-3419559fa6de tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:01.312741 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3b2e691b-459d-49f4-8444-3419559fa6de tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:01.374728 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-3b2e691b-459d-49f4-8444-3419559fa6de tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:01.383404 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-3b2e691b-459d-49f4-8444-3419559fa6de tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.082713 Jun 17 15:41:01.383976 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1500/2586] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:41:01 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:41:01.820012 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-6e7ba422-0dee-423b-9f42-5ed9d6639c7c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:01.820652 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-6e7ba422-0dee-423b-9f42-5ed9d6639c7c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:01.826615 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6e7ba422-0dee-423b-9f42-5ed9d6639c7c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:01.827053 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6e7ba422-0dee-423b-9f42-5ed9d6639c7c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:01.827829 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6e7ba422-0dee-423b-9f42-5ed9d6639c7c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:01.828252 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6e7ba422-0dee-423b-9f42-5ed9d6639c7c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:01.896554 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-6e7ba422-0dee-423b-9f42-5ed9d6639c7c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:01.905620 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-6e7ba422-0dee-423b-9f42-5ed9d6639c7c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:01.907176 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-6e7ba422-0dee-423b-9f42-5ed9d6639c7c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:01.908414 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-6e7ba422-0dee-423b-9f42-5ed9d6639c7c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.092877 Jun 17 15:41:01.908938 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1087/2587] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:41:01 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:41:02.104386 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-2e3b430d-9259-4860-8ea9-c520ed32939c tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:02.104993 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-2e3b430d-9259-4860-8ea9-c520ed32939c tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:02.115454 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2e3b430d-9259-4860-8ea9-c520ed32939c tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:02.115995 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2e3b430d-9259-4860-8ea9-c520ed32939c tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:02.117002 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2e3b430d-9259-4860-8ea9-c520ed32939c tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:02.117539 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2e3b430d-9259-4860-8ea9-c520ed32939c tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:02.255939 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-2e3b430d-9259-4860-8ea9-c520ed32939c tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:02.265357 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-2e3b430d-9259-4860-8ea9-c520ed32939c tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.168481 Jun 17 15:41:02.265967 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1501/2588] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:41:02 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:41:02.399921 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-130f2d38-0ddc-4d70-8d20-2b07625f570a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:02.400555 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-130f2d38-0ddc-4d70-8d20-2b07625f570a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:02.411601 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-130f2d38-0ddc-4d70-8d20-2b07625f570a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:02.412044 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-130f2d38-0ddc-4d70-8d20-2b07625f570a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:02.412918 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-130f2d38-0ddc-4d70-8d20-2b07625f570a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:02.413369 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-130f2d38-0ddc-4d70-8d20-2b07625f570a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:02.476354 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-130f2d38-0ddc-4d70-8d20-2b07625f570a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:02.484487 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-130f2d38-0ddc-4d70-8d20-2b07625f570a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.088350 Jun 17 15:41:02.485035 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1088/2589] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:41:02 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:41:02.927985 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-cfeef97e-c758-4406-bc86-9767f8c99be9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:02.928630 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-cfeef97e-c758-4406-bc86-9767f8c99be9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:02.934689 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cfeef97e-c758-4406-bc86-9767f8c99be9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:02.935134 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cfeef97e-c758-4406-bc86-9767f8c99be9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:02.935890 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cfeef97e-c758-4406-bc86-9767f8c99be9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:02.936318 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cfeef97e-c758-4406-bc86-9767f8c99be9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:02.997065 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-cfeef97e-c758-4406-bc86-9767f8c99be9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:03.005772 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-cfeef97e-c758-4406-bc86-9767f8c99be9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:03.007267 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-cfeef97e-c758-4406-bc86-9767f8c99be9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:03.008434 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-cfeef97e-c758-4406-bc86-9767f8c99be9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.085196 Jun 17 15:41:03.008994 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1502/2590] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:41:02 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:41:03.284831 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-f2525d63-8bd6-4937-bc50-332c723fb189 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:03.285381 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-f2525d63-8bd6-4937-bc50-332c723fb189 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:03.292206 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f2525d63-8bd6-4937-bc50-332c723fb189 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:03.292700 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f2525d63-8bd6-4937-bc50-332c723fb189 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:03.293468 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f2525d63-8bd6-4937-bc50-332c723fb189 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:03.293899 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f2525d63-8bd6-4937-bc50-332c723fb189 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:03.428380 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-f2525d63-8bd6-4937-bc50-332c723fb189 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:03.436978 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-f2525d63-8bd6-4937-bc50-332c723fb189 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.156193 Jun 17 15:41:03.437548 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1089/2591] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:41:03 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:41:03.501912 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-590bc379-53bc-47eb-9702-1026e2ef47bc tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:03.502620 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-590bc379-53bc-47eb-9702-1026e2ef47bc tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:03.510987 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-590bc379-53bc-47eb-9702-1026e2ef47bc tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:03.511440 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-590bc379-53bc-47eb-9702-1026e2ef47bc tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:03.512451 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-590bc379-53bc-47eb-9702-1026e2ef47bc tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:03.513070 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-590bc379-53bc-47eb-9702-1026e2ef47bc tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:03.579465 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-590bc379-53bc-47eb-9702-1026e2ef47bc tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:03.588010 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-590bc379-53bc-47eb-9702-1026e2ef47bc tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.090756 Jun 17 15:41:03.588635 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1503/2592] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:41:03 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:41:04.027055 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-0645c8bf-46a1-4a50-9c1b-f48865f5fe50 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:04.027802 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-0645c8bf-46a1-4a50-9c1b-f48865f5fe50 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:04.034258 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0645c8bf-46a1-4a50-9c1b-f48865f5fe50 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:04.034737 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0645c8bf-46a1-4a50-9c1b-f48865f5fe50 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:04.035582 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0645c8bf-46a1-4a50-9c1b-f48865f5fe50 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:04.036089 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0645c8bf-46a1-4a50-9c1b-f48865f5fe50 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:04.104717 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-0645c8bf-46a1-4a50-9c1b-f48865f5fe50 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:04.114184 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-0645c8bf-46a1-4a50-9c1b-f48865f5fe50 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:04.116272 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-0645c8bf-46a1-4a50-9c1b-f48865f5fe50 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:04.117718 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-0645c8bf-46a1-4a50-9c1b-f48865f5fe50 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.094620 Jun 17 15:41:04.118217 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1090/2593] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:41:04 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:41:04.455073 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-6b03b48b-938c-4560-bc39-4336a4ee8f59 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:04.455672 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-6b03b48b-938c-4560-bc39-4336a4ee8f59 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:04.461984 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6b03b48b-938c-4560-bc39-4336a4ee8f59 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:04.462422 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6b03b48b-938c-4560-bc39-4336a4ee8f59 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:04.463177 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6b03b48b-938c-4560-bc39-4336a4ee8f59 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:04.463600 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6b03b48b-938c-4560-bc39-4336a4ee8f59 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:04.594710 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-6b03b48b-938c-4560-bc39-4336a4ee8f59 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:04.603581 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-6b03b48b-938c-4560-bc39-4336a4ee8f59 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.152451 Jun 17 15:41:04.612940 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1504/2594] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:41:04 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:41:04.613145 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-8840a2f2-472b-4a1a-b888-7fb21975d47d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:04.613145 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-8840a2f2-472b-4a1a-b888-7fb21975d47d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:04.613693 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8840a2f2-472b-4a1a-b888-7fb21975d47d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:04.613907 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8840a2f2-472b-4a1a-b888-7fb21975d47d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:04.614934 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8840a2f2-472b-4a1a-b888-7fb21975d47d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:04.615700 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8840a2f2-472b-4a1a-b888-7fb21975d47d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:04.678861 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-8840a2f2-472b-4a1a-b888-7fb21975d47d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:04.686796 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-8840a2f2-472b-4a1a-b888-7fb21975d47d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.084113 Jun 17 15:41:04.687345 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1091/2595] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:41:04 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:41:05.136825 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-1498c41e-08b2-466f-9208-d3d51f286393 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:05.137533 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-1498c41e-08b2-466f-9208-d3d51f286393 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:05.145320 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1498c41e-08b2-466f-9208-d3d51f286393 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:05.145893 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1498c41e-08b2-466f-9208-d3d51f286393 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:05.146841 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1498c41e-08b2-466f-9208-d3d51f286393 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:05.147437 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1498c41e-08b2-466f-9208-d3d51f286393 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:05.215427 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-1498c41e-08b2-466f-9208-d3d51f286393 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:05.224662 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-1498c41e-08b2-466f-9208-d3d51f286393 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:05.226763 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-1498c41e-08b2-466f-9208-d3d51f286393 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:05.227915 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-1498c41e-08b2-466f-9208-d3d51f286393 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.095854 Jun 17 15:41:05.228493 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1505/2596] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:41:05 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:41:05.620513 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-9eb2edb3-d942-4c03-a731-4bb8bd5ef13b tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:05.621123 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-9eb2edb3-d942-4c03-a731-4bb8bd5ef13b tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:05.627524 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9eb2edb3-d942-4c03-a731-4bb8bd5ef13b tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:05.627962 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9eb2edb3-d942-4c03-a731-4bb8bd5ef13b tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:05.628733 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9eb2edb3-d942-4c03-a731-4bb8bd5ef13b tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:05.629161 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9eb2edb3-d942-4c03-a731-4bb8bd5ef13b tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:05.703017 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-e0c0a5e8-8c7f-4445-9166-c339d4caea2d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:05.703605 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-e0c0a5e8-8c7f-4445-9166-c339d4caea2d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:05.711053 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e0c0a5e8-8c7f-4445-9166-c339d4caea2d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:05.711506 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e0c0a5e8-8c7f-4445-9166-c339d4caea2d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:05.712283 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e0c0a5e8-8c7f-4445-9166-c339d4caea2d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:05.712756 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e0c0a5e8-8c7f-4445-9166-c339d4caea2d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:05.756860 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-9eb2edb3-d942-4c03-a731-4bb8bd5ef13b tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:05.764693 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-9eb2edb3-d942-4c03-a731-4bb8bd5ef13b tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.148465 Jun 17 15:41:05.765244 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1092/2597] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:41:05 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:41:05.774183 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-e0c0a5e8-8c7f-4445-9166-c339d4caea2d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:05.782307 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-e0c0a5e8-8c7f-4445-9166-c339d4caea2d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.083186 Jun 17 15:41:05.782870 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1506/2598] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:41:05 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:41:06.245553 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-440d80af-4797-4501-9b5f-9bf6a8da67af tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:06.246165 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-440d80af-4797-4501-9b5f-9bf6a8da67af tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:06.252187 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-440d80af-4797-4501-9b5f-9bf6a8da67af tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:06.252664 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-440d80af-4797-4501-9b5f-9bf6a8da67af tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:06.253419 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-440d80af-4797-4501-9b5f-9bf6a8da67af tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:06.253854 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-440d80af-4797-4501-9b5f-9bf6a8da67af tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:06.314521 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-440d80af-4797-4501-9b5f-9bf6a8da67af tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:06.323585 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-440d80af-4797-4501-9b5f-9bf6a8da67af tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:06.325125 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-440d80af-4797-4501-9b5f-9bf6a8da67af tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:06.326263 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-440d80af-4797-4501-9b5f-9bf6a8da67af tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.084665 Jun 17 15:41:06.326816 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1093/2599] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:41:06 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:41:06.781780 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-cc03cf7f-d0d8-4517-91e5-d7510b39bba3 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:06.782380 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-cc03cf7f-d0d8-4517-91e5-d7510b39bba3 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:06.788949 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cc03cf7f-d0d8-4517-91e5-d7510b39bba3 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:06.789394 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cc03cf7f-d0d8-4517-91e5-d7510b39bba3 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:06.790152 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cc03cf7f-d0d8-4517-91e5-d7510b39bba3 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:06.790580 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cc03cf7f-d0d8-4517-91e5-d7510b39bba3 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:06.798747 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-3208f20e-6e17-434e-bd11-2ffdf04bb33f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:06.799350 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-3208f20e-6e17-434e-bd11-2ffdf04bb33f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:06.807782 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3208f20e-6e17-434e-bd11-2ffdf04bb33f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:06.808226 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3208f20e-6e17-434e-bd11-2ffdf04bb33f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:06.809016 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3208f20e-6e17-434e-bd11-2ffdf04bb33f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:06.809448 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3208f20e-6e17-434e-bd11-2ffdf04bb33f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:06.875172 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-3208f20e-6e17-434e-bd11-2ffdf04bb33f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:06.883777 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-3208f20e-6e17-434e-bd11-2ffdf04bb33f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.088748 Jun 17 15:41:06.884570 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1094/2600] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:41:06 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:41:06.925185 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-cc03cf7f-d0d8-4517-91e5-d7510b39bba3 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:06.933577 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-cc03cf7f-d0d8-4517-91e5-d7510b39bba3 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.155645 Jun 17 15:41:06.934131 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1507/2601] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:41:06 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:41:07.344829 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-2f238c70-42ba-4748-a9a9-3c21c1830097 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:07.345438 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-2f238c70-42ba-4748-a9a9-3c21c1830097 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:07.352385 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2f238c70-42ba-4748-a9a9-3c21c1830097 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:07.352897 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2f238c70-42ba-4748-a9a9-3c21c1830097 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:07.353732 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2f238c70-42ba-4748-a9a9-3c21c1830097 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:07.354100 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2f238c70-42ba-4748-a9a9-3c21c1830097 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:07.414813 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-2f238c70-42ba-4748-a9a9-3c21c1830097 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:07.423236 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-2f238c70-42ba-4748-a9a9-3c21c1830097 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:07.424776 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-2f238c70-42ba-4748-a9a9-3c21c1830097 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:07.425892 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-2f238c70-42ba-4748-a9a9-3c21c1830097 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.084977 Jun 17 15:41:07.426443 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1095/2602] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:41:07 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:41:07.900447 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-5dddd345-2257-477c-8ab8-e487809c50b8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:07.901048 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-5dddd345-2257-477c-8ab8-e487809c50b8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:07.907509 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5dddd345-2257-477c-8ab8-e487809c50b8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:07.907954 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5dddd345-2257-477c-8ab8-e487809c50b8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:07.908740 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5dddd345-2257-477c-8ab8-e487809c50b8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:07.909173 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5dddd345-2257-477c-8ab8-e487809c50b8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:07.951007 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-c8f8a9bd-ebc1-45fc-b10e-88701f20a85d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:07.951560 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-c8f8a9bd-ebc1-45fc-b10e-88701f20a85d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:07.958081 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c8f8a9bd-ebc1-45fc-b10e-88701f20a85d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:07.958533 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c8f8a9bd-ebc1-45fc-b10e-88701f20a85d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:07.959305 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c8f8a9bd-ebc1-45fc-b10e-88701f20a85d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:07.959733 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c8f8a9bd-ebc1-45fc-b10e-88701f20a85d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:07.973539 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-5dddd345-2257-477c-8ab8-e487809c50b8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:07.981875 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-5dddd345-2257-477c-8ab8-e487809c50b8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.085788 Jun 17 15:41:07.982438 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1508/2603] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:41:07 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:41:08.091005 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-c8f8a9bd-ebc1-45fc-b10e-88701f20a85d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:08.098848 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-c8f8a9bd-ebc1-45fc-b10e-88701f20a85d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.151766 Jun 17 15:41:08.099412 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1096/2604] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:41:07 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:41:08.444203 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-5383047f-0a36-4eaf-8c53-ac27976d798b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:08.445501 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-5383047f-0a36-4eaf-8c53-ac27976d798b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:08.451429 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5383047f-0a36-4eaf-8c53-ac27976d798b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:08.451874 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5383047f-0a36-4eaf-8c53-ac27976d798b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:08.452661 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5383047f-0a36-4eaf-8c53-ac27976d798b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:08.453089 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5383047f-0a36-4eaf-8c53-ac27976d798b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:08.513417 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-5383047f-0a36-4eaf-8c53-ac27976d798b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:08.521843 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-5383047f-0a36-4eaf-8c53-ac27976d798b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:08.523392 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-5383047f-0a36-4eaf-8c53-ac27976d798b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:08.524543 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-5383047f-0a36-4eaf-8c53-ac27976d798b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.084237 Jun 17 15:41:08.525092 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1509/2605] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:41:08 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:41:08.999446 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-49ba27c2-938f-41ae-b5be-432ce4f1b015 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:09.000087 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-49ba27c2-938f-41ae-b5be-432ce4f1b015 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:09.006464 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-49ba27c2-938f-41ae-b5be-432ce4f1b015 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:09.006907 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-49ba27c2-938f-41ae-b5be-432ce4f1b015 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:09.007644 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-49ba27c2-938f-41ae-b5be-432ce4f1b015 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:09.009163 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-49ba27c2-938f-41ae-b5be-432ce4f1b015 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:09.069333 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-49ba27c2-938f-41ae-b5be-432ce4f1b015 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:09.077301 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-49ba27c2-938f-41ae-b5be-432ce4f1b015 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.081668 Jun 17 15:41:09.077865 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1097/2606] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:41:08 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:41:09.117818 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-947b1927-f22e-475e-b37b-0862e2bda19d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:09.118940 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-947b1927-f22e-475e-b37b-0862e2bda19d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:09.127154 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-947b1927-f22e-475e-b37b-0862e2bda19d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:09.127935 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-947b1927-f22e-475e-b37b-0862e2bda19d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:09.128935 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-947b1927-f22e-475e-b37b-0862e2bda19d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:09.129520 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-947b1927-f22e-475e-b37b-0862e2bda19d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:09.262824 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-947b1927-f22e-475e-b37b-0862e2bda19d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:09.270781 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-947b1927-f22e-475e-b37b-0862e2bda19d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.158298 Jun 17 15:41:09.271351 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1510/2607] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:41:09 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:41:09.541901 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-a6514966-7f5e-4d43-88d5-43b06f7d7418 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:09.542416 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-a6514966-7f5e-4d43-88d5-43b06f7d7418 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:09.548411 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a6514966-7f5e-4d43-88d5-43b06f7d7418 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:09.548855 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a6514966-7f5e-4d43-88d5-43b06f7d7418 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:09.549602 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a6514966-7f5e-4d43-88d5-43b06f7d7418 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:09.550032 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a6514966-7f5e-4d43-88d5-43b06f7d7418 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:09.613874 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-a6514966-7f5e-4d43-88d5-43b06f7d7418 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:09.622165 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-a6514966-7f5e-4d43-88d5-43b06f7d7418 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:09.623648 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-a6514966-7f5e-4d43-88d5-43b06f7d7418 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:09.624800 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-a6514966-7f5e-4d43-88d5-43b06f7d7418 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.086949 Jun 17 15:41:09.625353 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1098/2608] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:41:09 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:41:10.094823 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-435e32a8-9af6-4655-8de2-62816d3172f9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:10.095434 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-435e32a8-9af6-4655-8de2-62816d3172f9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:10.101833 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-435e32a8-9af6-4655-8de2-62816d3172f9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:10.102281 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-435e32a8-9af6-4655-8de2-62816d3172f9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:10.103068 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-435e32a8-9af6-4655-8de2-62816d3172f9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:10.103487 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-435e32a8-9af6-4655-8de2-62816d3172f9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:10.170261 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-435e32a8-9af6-4655-8de2-62816d3172f9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:10.178238 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-435e32a8-9af6-4655-8de2-62816d3172f9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.087314 Jun 17 15:41:10.179406 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1511/2609] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:41:10 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:41:10.288661 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-3061255f-97be-481b-99b9-08b982aced91 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:10.289276 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-3061255f-97be-481b-99b9-08b982aced91 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:10.295659 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3061255f-97be-481b-99b9-08b982aced91 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:10.296107 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3061255f-97be-481b-99b9-08b982aced91 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:10.296886 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3061255f-97be-481b-99b9-08b982aced91 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:10.297321 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3061255f-97be-481b-99b9-08b982aced91 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:10.578680 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-3061255f-97be-481b-99b9-08b982aced91 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:10.587713 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-3061255f-97be-481b-99b9-08b982aced91 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.303461 Jun 17 15:41:10.588285 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1099/2610] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:41:10 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:41:10.643829 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-f424fa27-456a-4967-bd66-58df65bf5db8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:10.644371 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-f424fa27-456a-4967-bd66-58df65bf5db8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:10.650939 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f424fa27-456a-4967-bd66-58df65bf5db8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:10.651387 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f424fa27-456a-4967-bd66-58df65bf5db8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:10.652143 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f424fa27-456a-4967-bd66-58df65bf5db8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:10.652601 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f424fa27-456a-4967-bd66-58df65bf5db8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:10.952623 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-f424fa27-456a-4967-bd66-58df65bf5db8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:10.962020 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-f424fa27-456a-4967-bd66-58df65bf5db8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:10.963520 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-f424fa27-456a-4967-bd66-58df65bf5db8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:10.964737 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-f424fa27-456a-4967-bd66-58df65bf5db8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.325006 Jun 17 15:41:10.965317 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1512/2611] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:41:10 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:41:11.195534 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-98002db8-1bd8-4cbd-9c88-4893bab7b6db tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:11.196162 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-98002db8-1bd8-4cbd-9c88-4893bab7b6db tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:11.202269 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-98002db8-1bd8-4cbd-9c88-4893bab7b6db tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:11.202657 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-98002db8-1bd8-4cbd-9c88-4893bab7b6db tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:11.203407 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-98002db8-1bd8-4cbd-9c88-4893bab7b6db tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:11.203840 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-98002db8-1bd8-4cbd-9c88-4893bab7b6db tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:11.264157 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-98002db8-1bd8-4cbd-9c88-4893bab7b6db tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:11.271873 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-98002db8-1bd8-4cbd-9c88-4893bab7b6db tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.080748 Jun 17 15:41:11.273000 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1100/2612] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:41:11 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:41:11.605091 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-234bfeb9-625a-4ec3-ba77-3aec872381b2 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:11.605696 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-234bfeb9-625a-4ec3-ba77-3aec872381b2 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:11.609330 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 15:41:11.609803 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Fri Jun 17 15:41:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 15:41:11.612992 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-234bfeb9-625a-4ec3-ba77-3aec872381b2 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:11.613446 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-234bfeb9-625a-4ec3-ba77-3aec872381b2 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:11.614218 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-234bfeb9-625a-4ec3-ba77-3aec872381b2 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:11.614657 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-234bfeb9-625a-4ec3-ba77-3aec872381b2 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:11.741074 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-234bfeb9-625a-4ec3-ba77-3aec872381b2 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:11.749494 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-234bfeb9-625a-4ec3-ba77-3aec872381b2 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.148365 Jun 17 15:41:11.750088 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1513/2613] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:41:11 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:41:11.982999 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-16380a28-f3b5-43d4-b799-5178a5f7f021 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:11.983520 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-16380a28-f3b5-43d4-b799-5178a5f7f021 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:11.990136 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-16380a28-f3b5-43d4-b799-5178a5f7f021 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:11.990583 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-16380a28-f3b5-43d4-b799-5178a5f7f021 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:11.991995 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-16380a28-f3b5-43d4-b799-5178a5f7f021 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:11.992468 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-16380a28-f3b5-43d4-b799-5178a5f7f021 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:12.058993 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-16380a28-f3b5-43d4-b799-5178a5f7f021 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:12.062388 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell1:SELECT=100 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:41:12.069868 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-16380a28-f3b5-43d4-b799-5178a5f7f021 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:12.071385 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-16380a28-f3b5-43d4-b799-5178a5f7f021 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:12.072562 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-16380a28-f3b5-43d4-b799-5178a5f7f021 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.093534 Jun 17 15:41:12.073117 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1101/2614] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:41:11 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:41:12.290095 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-9a306b18-582e-4a86-85ee-bb67b87767e1 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:12.290620 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-9a306b18-582e-4a86-85ee-bb67b87767e1 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:12.296784 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9a306b18-582e-4a86-85ee-bb67b87767e1 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:12.297230 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9a306b18-582e-4a86-85ee-bb67b87767e1 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:12.297989 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9a306b18-582e-4a86-85ee-bb67b87767e1 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:12.298415 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9a306b18-582e-4a86-85ee-bb67b87767e1 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:12.360156 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-9a306b18-582e-4a86-85ee-bb67b87767e1 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:12.368241 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-9a306b18-582e-4a86-85ee-bb67b87767e1 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.082623 Jun 17 15:41:12.368850 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1514/2615] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:41:12 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:41:12.767034 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-8e528600-a1b3-4e2b-b5f0-57177c83830d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:12.767648 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-8e528600-a1b3-4e2b-b5f0-57177c83830d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:12.775130 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8e528600-a1b3-4e2b-b5f0-57177c83830d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:12.775577 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8e528600-a1b3-4e2b-b5f0-57177c83830d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:12.776359 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8e528600-a1b3-4e2b-b5f0-57177c83830d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:12.776801 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8e528600-a1b3-4e2b-b5f0-57177c83830d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:12.918594 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-8e528600-a1b3-4e2b-b5f0-57177c83830d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:12.926788 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-8e528600-a1b3-4e2b-b5f0-57177c83830d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.163616 Jun 17 15:41:12.927373 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1102/2616] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:41:12 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:41:13.090968 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-c8317074-9011-4c49-b2ab-6aa4f48c7f32 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:13.091627 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-c8317074-9011-4c49-b2ab-6aa4f48c7f32 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:13.098265 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c8317074-9011-4c49-b2ab-6aa4f48c7f32 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:13.098714 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c8317074-9011-4c49-b2ab-6aa4f48c7f32 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:13.099481 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c8317074-9011-4c49-b2ab-6aa4f48c7f32 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:13.099909 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c8317074-9011-4c49-b2ab-6aa4f48c7f32 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:13.115741 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=100 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:41:13.168158 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-c8317074-9011-4c49-b2ab-6aa4f48c7f32 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:13.177072 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-c8317074-9011-4c49-b2ab-6aa4f48c7f32 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:13.179253 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-c8317074-9011-4c49-b2ab-6aa4f48c7f32 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:13.180446 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-c8317074-9011-4c49-b2ab-6aa4f48c7f32 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.093608 Jun 17 15:41:13.181041 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1515/2617] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:41:13 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:41:13.385394 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-254ecda2-6849-41ee-aef7-fca60c649d8c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:13.386035 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-254ecda2-6849-41ee-aef7-fca60c649d8c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:13.392939 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-254ecda2-6849-41ee-aef7-fca60c649d8c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:13.393394 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-254ecda2-6849-41ee-aef7-fca60c649d8c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:13.394166 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-254ecda2-6849-41ee-aef7-fca60c649d8c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:13.394602 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-254ecda2-6849-41ee-aef7-fca60c649d8c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:13.458936 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-254ecda2-6849-41ee-aef7-fca60c649d8c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:13.473649 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-254ecda2-6849-41ee-aef7-fca60c649d8c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.091968 Jun 17 15:41:13.474257 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1103/2618] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:41:13 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:41:13.945287 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-4d75ad90-17bc-4ba0-8baa-4c7f077b82f8 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:13.945903 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-4d75ad90-17bc-4ba0-8baa-4c7f077b82f8 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:13.952462 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4d75ad90-17bc-4ba0-8baa-4c7f077b82f8 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:13.952910 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4d75ad90-17bc-4ba0-8baa-4c7f077b82f8 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:13.953694 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4d75ad90-17bc-4ba0-8baa-4c7f077b82f8 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:13.954126 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4d75ad90-17bc-4ba0-8baa-4c7f077b82f8 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:14.095808 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-4d75ad90-17bc-4ba0-8baa-4c7f077b82f8 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:14.104951 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-4d75ad90-17bc-4ba0-8baa-4c7f077b82f8 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.164204 Jun 17 15:41:14.105534 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1516/2619] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:41:13 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:41:14.199425 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-5677e2ed-79e9-4d24-961f-85e6cecf65da tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:14.200056 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-5677e2ed-79e9-4d24-961f-85e6cecf65da tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:14.206149 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5677e2ed-79e9-4d24-961f-85e6cecf65da tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:14.206590 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5677e2ed-79e9-4d24-961f-85e6cecf65da tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:14.207332 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5677e2ed-79e9-4d24-961f-85e6cecf65da tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:14.207759 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5677e2ed-79e9-4d24-961f-85e6cecf65da tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:14.271966 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-5677e2ed-79e9-4d24-961f-85e6cecf65da tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:14.281069 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-5677e2ed-79e9-4d24-961f-85e6cecf65da tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:14.282560 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-5677e2ed-79e9-4d24-961f-85e6cecf65da tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:14.283688 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-5677e2ed-79e9-4d24-961f-85e6cecf65da tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.088231 Jun 17 15:41:14.284235 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1104/2620] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:41:14 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:41:14.491733 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-31febf4e-5060-46ca-8229-2835ef499fa2 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:14.492369 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-31febf4e-5060-46ca-8229-2835ef499fa2 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:14.498487 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-31febf4e-5060-46ca-8229-2835ef499fa2 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:14.498929 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-31febf4e-5060-46ca-8229-2835ef499fa2 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:14.499691 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-31febf4e-5060-46ca-8229-2835ef499fa2 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:14.500115 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-31febf4e-5060-46ca-8229-2835ef499fa2 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:14.564755 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-31febf4e-5060-46ca-8229-2835ef499fa2 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:14.573501 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-31febf4e-5060-46ca-8229-2835ef499fa2 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.085645 Jun 17 15:41:14.573723 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1517/2621] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:41:14 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:41:15.125697 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-01f9d91b-7d0b-4acc-8c92-2d1bfeedc61f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:15.126315 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-01f9d91b-7d0b-4acc-8c92-2d1bfeedc61f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:15.132546 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-01f9d91b-7d0b-4acc-8c92-2d1bfeedc61f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:15.132987 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-01f9d91b-7d0b-4acc-8c92-2d1bfeedc61f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:15.133746 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-01f9d91b-7d0b-4acc-8c92-2d1bfeedc61f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:15.134174 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-01f9d91b-7d0b-4acc-8c92-2d1bfeedc61f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:15.267649 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-01f9d91b-7d0b-4acc-8c92-2d1bfeedc61f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:15.276785 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-01f9d91b-7d0b-4acc-8c92-2d1bfeedc61f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.155078 Jun 17 15:41:15.277384 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1105/2622] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:41:15 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:41:15.301119 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-3245a5f9-ac98-4174-b38b-067a7dbccd42 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:15.301638 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-3245a5f9-ac98-4174-b38b-067a7dbccd42 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:15.308261 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3245a5f9-ac98-4174-b38b-067a7dbccd42 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:15.308744 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3245a5f9-ac98-4174-b38b-067a7dbccd42 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:15.309514 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3245a5f9-ac98-4174-b38b-067a7dbccd42 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:15.309968 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3245a5f9-ac98-4174-b38b-067a7dbccd42 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:15.376213 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-3245a5f9-ac98-4174-b38b-067a7dbccd42 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:15.384993 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-3245a5f9-ac98-4174-b38b-067a7dbccd42 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:15.386507 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-3245a5f9-ac98-4174-b38b-067a7dbccd42 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:15.387647 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-3245a5f9-ac98-4174-b38b-067a7dbccd42 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.090557 Jun 17 15:41:15.388203 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1518/2623] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:41:15 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:41:15.590596 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-df9ef88f-3a5c-44b5-b061-21f48300d680 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:15.591238 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-df9ef88f-3a5c-44b5-b061-21f48300d680 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:15.597449 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-df9ef88f-3a5c-44b5-b061-21f48300d680 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:15.597939 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-df9ef88f-3a5c-44b5-b061-21f48300d680 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:15.598697 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-df9ef88f-3a5c-44b5-b061-21f48300d680 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:15.599135 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-df9ef88f-3a5c-44b5-b061-21f48300d680 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:15.660455 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-df9ef88f-3a5c-44b5-b061-21f48300d680 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:15.668784 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-df9ef88f-3a5c-44b5-b061-21f48300d680 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.081980 Jun 17 15:41:15.669341 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1106/2624] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:41:15 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:41:16.295408 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-f03b9d17-b393-4c6d-b907-82da2d568c71 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:16.296017 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-f03b9d17-b393-4c6d-b907-82da2d568c71 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:16.297960 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_api:SELECT=78 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:41:16.303429 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f03b9d17-b393-4c6d-b907-82da2d568c71 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:16.304663 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f03b9d17-b393-4c6d-b907-82da2d568c71 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:16.305309 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f03b9d17-b393-4c6d-b907-82da2d568c71 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:16.305739 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f03b9d17-b393-4c6d-b907-82da2d568c71 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:16.406228 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-32d6a4a7-ed6f-4b49-aca3-1e0bc4188e90 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:16.406849 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-32d6a4a7-ed6f-4b49-aca3-1e0bc4188e90 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:16.413869 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-32d6a4a7-ed6f-4b49-aca3-1e0bc4188e90 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:16.414311 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-32d6a4a7-ed6f-4b49-aca3-1e0bc4188e90 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:16.415132 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-32d6a4a7-ed6f-4b49-aca3-1e0bc4188e90 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:16.415568 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-32d6a4a7-ed6f-4b49-aca3-1e0bc4188e90 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:16.447281 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-f03b9d17-b393-4c6d-b907-82da2d568c71 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:16.455746 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-f03b9d17-b393-4c6d-b907-82da2d568c71 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.164131 Jun 17 15:41:16.456727 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1519/2625] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:41:16 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:41:16.493814 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-32d6a4a7-ed6f-4b49-aca3-1e0bc4188e90 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:16.503048 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-32d6a4a7-ed6f-4b49-aca3-1e0bc4188e90 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:16.504585 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-32d6a4a7-ed6f-4b49-aca3-1e0bc4188e90 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:16.505718 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-32d6a4a7-ed6f-4b49-aca3-1e0bc4188e90 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.103492 Jun 17 15:41:16.506280 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1107/2626] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:41:16 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 15:41:16.685184 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-9a8df63e-a82e-4cc0-a8bf-d78ff6ac2ffe tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:16.685795 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-9a8df63e-a82e-4cc0-a8bf-d78ff6ac2ffe tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:16.691817 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9a8df63e-a82e-4cc0-a8bf-d78ff6ac2ffe tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:16.692260 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9a8df63e-a82e-4cc0-a8bf-d78ff6ac2ffe tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:16.693044 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9a8df63e-a82e-4cc0-a8bf-d78ff6ac2ffe tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:16.693470 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9a8df63e-a82e-4cc0-a8bf-d78ff6ac2ffe tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:16.753292 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-9a8df63e-a82e-4cc0-a8bf-d78ff6ac2ffe tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:16.761271 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-9a8df63e-a82e-4cc0-a8bf-d78ff6ac2ffe tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.079934 Jun 17 15:41:16.761831 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1520/2627] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:41:16 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:41:17.473108 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-edf5bdbe-b155-4537-8023-fe61b0f35003 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:17.473716 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-edf5bdbe-b155-4537-8023-fe61b0f35003 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:17.480738 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-edf5bdbe-b155-4537-8023-fe61b0f35003 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:17.481181 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-edf5bdbe-b155-4537-8023-fe61b0f35003 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:17.482236 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-edf5bdbe-b155-4537-8023-fe61b0f35003 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:17.482649 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-edf5bdbe-b155-4537-8023-fe61b0f35003 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:17.522934 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-d6a86a93-917a-4f3c-82ed-262a655b019a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:17.523546 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-d6a86a93-917a-4f3c-82ed-262a655b019a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:17.530219 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d6a86a93-917a-4f3c-82ed-262a655b019a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:17.530666 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d6a86a93-917a-4f3c-82ed-262a655b019a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:17.531430 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d6a86a93-917a-4f3c-82ed-262a655b019a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:17.531864 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d6a86a93-917a-4f3c-82ed-262a655b019a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:17.597018 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-d6a86a93-917a-4f3c-82ed-262a655b019a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:17.605975 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-d6a86a93-917a-4f3c-82ed-262a655b019a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:17.607484 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-d6a86a93-917a-4f3c-82ed-262a655b019a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:17.608651 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-d6a86a93-917a-4f3c-82ed-262a655b019a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.089555 Jun 17 15:41:17.609233 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1521/2628] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:41:17 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 15:41:17.617724 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-edf5bdbe-b155-4537-8023-fe61b0f35003 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:17.625706 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-edf5bdbe-b155-4537-8023-fe61b0f35003 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.156463 Jun 17 15:41:17.626264 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1108/2629] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:41:17 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:41:17.778417 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-6acfbeeb-a048-4647-adb8-5eadfa8c86a5 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:17.779028 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-6acfbeeb-a048-4647-adb8-5eadfa8c86a5 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:17.785105 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6acfbeeb-a048-4647-adb8-5eadfa8c86a5 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:17.785558 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6acfbeeb-a048-4647-adb8-5eadfa8c86a5 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:17.786322 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6acfbeeb-a048-4647-adb8-5eadfa8c86a5 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:17.786759 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6acfbeeb-a048-4647-adb8-5eadfa8c86a5 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:17.849089 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-6acfbeeb-a048-4647-adb8-5eadfa8c86a5 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:17.857647 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-6acfbeeb-a048-4647-adb8-5eadfa8c86a5 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.083247 Jun 17 15:41:17.858218 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1522/2630] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:41:17 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:41:18.626699 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-d5ff7e68-095d-4dfd-95eb-92841142aac9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:18.627287 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-d5ff7e68-095d-4dfd-95eb-92841142aac9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:18.634419 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d5ff7e68-095d-4dfd-95eb-92841142aac9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:18.634800 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d5ff7e68-095d-4dfd-95eb-92841142aac9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:18.635541 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d5ff7e68-095d-4dfd-95eb-92841142aac9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:18.635974 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d5ff7e68-095d-4dfd-95eb-92841142aac9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:18.642479 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-2626f20a-2989-4a87-9992-a29f099ae816 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:18.643094 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-2626f20a-2989-4a87-9992-a29f099ae816 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:18.650195 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2626f20a-2989-4a87-9992-a29f099ae816 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:18.650642 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2626f20a-2989-4a87-9992-a29f099ae816 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:18.651409 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2626f20a-2989-4a87-9992-a29f099ae816 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:18.651840 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2626f20a-2989-4a87-9992-a29f099ae816 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:18.697930 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-d5ff7e68-095d-4dfd-95eb-92841142aac9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:18.706481 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-d5ff7e68-095d-4dfd-95eb-92841142aac9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:18.707969 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-d5ff7e68-095d-4dfd-95eb-92841142aac9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:18.709140 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-d5ff7e68-095d-4dfd-95eb-92841142aac9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.086358 Jun 17 15:41:18.709758 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1109/2631] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:41:18 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:41:18.781208 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-2626f20a-2989-4a87-9992-a29f099ae816 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:18.789307 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-2626f20a-2989-4a87-9992-a29f099ae816 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.150706 Jun 17 15:41:18.789872 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1523/2632] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:41:18 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:41:18.874819 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-ad5673db-4243-4a99-a439-02f102464784 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:18.875436 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-ad5673db-4243-4a99-a439-02f102464784 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:18.881495 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ad5673db-4243-4a99-a439-02f102464784 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:18.882517 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ad5673db-4243-4a99-a439-02f102464784 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:18.883272 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ad5673db-4243-4a99-a439-02f102464784 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:18.883713 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ad5673db-4243-4a99-a439-02f102464784 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:18.945203 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-ad5673db-4243-4a99-a439-02f102464784 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:18.953151 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-ad5673db-4243-4a99-a439-02f102464784 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.082262 Jun 17 15:41:18.953720 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1110/2633] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:41:18 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:41:19.727719 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-106fce97-a312-4326-812c-309f60fc8350 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:19.728353 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-106fce97-a312-4326-812c-309f60fc8350 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:19.735018 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-106fce97-a312-4326-812c-309f60fc8350 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:19.735463 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-106fce97-a312-4326-812c-309f60fc8350 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:19.736217 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-106fce97-a312-4326-812c-309f60fc8350 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:19.736706 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-106fce97-a312-4326-812c-309f60fc8350 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:19.799840 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-106fce97-a312-4326-812c-309f60fc8350 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:19.806756 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-662477db-d052-4344-8142-6046a57bcf75 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:19.807510 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-662477db-d052-4344-8142-6046a57bcf75 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:19.808568 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-106fce97-a312-4326-812c-309f60fc8350 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:19.810085 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-106fce97-a312-4326-812c-309f60fc8350 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:19.811200 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_api:SELECT=84 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:41:19.811331 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-106fce97-a312-4326-812c-309f60fc8350 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.088185 Jun 17 15:41:19.811902 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1524/2634] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:41:19 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:41:19.815791 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-662477db-d052-4344-8142-6046a57bcf75 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:19.816238 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-662477db-d052-4344-8142-6046a57bcf75 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:19.817021 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-662477db-d052-4344-8142-6046a57bcf75 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:19.817454 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-662477db-d052-4344-8142-6046a57bcf75 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:19.959481 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-662477db-d052-4344-8142-6046a57bcf75 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:19.968300 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-662477db-d052-4344-8142-6046a57bcf75 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.165342 Jun 17 15:41:19.968941 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1111/2635] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:41:19 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:41:19.970213 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-4369e3cc-9c16-41ab-b26a-8cc11f192d1d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:19.970911 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-4369e3cc-9c16-41ab-b26a-8cc11f192d1d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:19.978377 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4369e3cc-9c16-41ab-b26a-8cc11f192d1d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:19.978819 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4369e3cc-9c16-41ab-b26a-8cc11f192d1d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:19.979574 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4369e3cc-9c16-41ab-b26a-8cc11f192d1d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:19.979998 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4369e3cc-9c16-41ab-b26a-8cc11f192d1d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:20.046048 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-4369e3cc-9c16-41ab-b26a-8cc11f192d1d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:20.054548 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-4369e3cc-9c16-41ab-b26a-8cc11f192d1d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.088121 Jun 17 15:41:20.055136 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1525/2636] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:41:19 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:41:20.829334 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-c7d9bb3c-b546-4a4a-988d-236d66dd670b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:20.829887 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-c7d9bb3c-b546-4a4a-988d-236d66dd670b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:20.836303 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c7d9bb3c-b546-4a4a-988d-236d66dd670b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:20.836774 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c7d9bb3c-b546-4a4a-988d-236d66dd670b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:20.837542 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c7d9bb3c-b546-4a4a-988d-236d66dd670b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:20.837972 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c7d9bb3c-b546-4a4a-988d-236d66dd670b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:20.898565 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-c7d9bb3c-b546-4a4a-988d-236d66dd670b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:20.906931 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-c7d9bb3c-b546-4a4a-988d-236d66dd670b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:20.908440 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-c7d9bb3c-b546-4a4a-988d-236d66dd670b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:20.909566 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-c7d9bb3c-b546-4a4a-988d-236d66dd670b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.084231 Jun 17 15:41:20.910110 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1112/2637] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:41:20 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:41:20.985710 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-2a437266-5109-408f-8ed3-31dac34aca4d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:20.986327 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-2a437266-5109-408f-8ed3-31dac34aca4d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:20.993654 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2a437266-5109-408f-8ed3-31dac34aca4d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:20.994108 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2a437266-5109-408f-8ed3-31dac34aca4d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:20.994870 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2a437266-5109-408f-8ed3-31dac34aca4d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:20.995305 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2a437266-5109-408f-8ed3-31dac34aca4d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:21.070960 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-fd748b7d-4b50-4759-9714-83924c3c6743 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:21.071634 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-fd748b7d-4b50-4759-9714-83924c3c6743 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:21.077862 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fd748b7d-4b50-4759-9714-83924c3c6743 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:21.078309 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fd748b7d-4b50-4759-9714-83924c3c6743 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:21.079063 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fd748b7d-4b50-4759-9714-83924c3c6743 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:21.079541 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fd748b7d-4b50-4759-9714-83924c3c6743 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:21.126220 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-2a437266-5109-408f-8ed3-31dac34aca4d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:21.134327 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-2a437266-5109-408f-8ed3-31dac34aca4d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.152491 Jun 17 15:41:21.134901 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1526/2638] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:41:20 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:41:21.142130 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-fd748b7d-4b50-4759-9714-83924c3c6743 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:21.150660 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-fd748b7d-4b50-4759-9714-83924c3c6743 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.083549 Jun 17 15:41:21.151215 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1113/2639] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:41:21 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:41:21.928981 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-3d04a785-87f1-4598-8d3c-5ed7e022562f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:21.929603 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-3d04a785-87f1-4598-8d3c-5ed7e022562f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:21.935765 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3d04a785-87f1-4598-8d3c-5ed7e022562f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:21.936211 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3d04a785-87f1-4598-8d3c-5ed7e022562f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:21.937076 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3d04a785-87f1-4598-8d3c-5ed7e022562f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:21.937826 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3d04a785-87f1-4598-8d3c-5ed7e022562f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:21.998023 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-3d04a785-87f1-4598-8d3c-5ed7e022562f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:22.006540 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-3d04a785-87f1-4598-8d3c-5ed7e022562f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:22.008600 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-3d04a785-87f1-4598-8d3c-5ed7e022562f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:22.009735 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-3d04a785-87f1-4598-8d3c-5ed7e022562f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.085253 Jun 17 15:41:22.010294 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1527/2640] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:41:21 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:41:22.151348 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-8ae9f51e-4044-4781-892f-c0bf11029bcc tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:22.151954 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-8ae9f51e-4044-4781-892f-c0bf11029bcc tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:22.158502 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8ae9f51e-4044-4781-892f-c0bf11029bcc tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:22.158951 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8ae9f51e-4044-4781-892f-c0bf11029bcc tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:22.159697 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8ae9f51e-4044-4781-892f-c0bf11029bcc tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:22.160128 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8ae9f51e-4044-4781-892f-c0bf11029bcc tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:22.167322 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-71addfc4-8419-4cef-8c5f-1acf9b8dc66a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:22.167932 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-71addfc4-8419-4cef-8c5f-1acf9b8dc66a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:22.173862 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-71addfc4-8419-4cef-8c5f-1acf9b8dc66a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:22.174308 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-71addfc4-8419-4cef-8c5f-1acf9b8dc66a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:22.175091 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-71addfc4-8419-4cef-8c5f-1acf9b8dc66a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:22.175522 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-71addfc4-8419-4cef-8c5f-1acf9b8dc66a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:22.239234 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-71addfc4-8419-4cef-8c5f-1acf9b8dc66a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:22.248042 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-71addfc4-8419-4cef-8c5f-1acf9b8dc66a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.084934 Jun 17 15:41:22.248585 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1528/2641] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:41:22 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:41:22.291685 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-8ae9f51e-4044-4781-892f-c0bf11029bcc tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:22.299570 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-8ae9f51e-4044-4781-892f-c0bf11029bcc tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.152203 Jun 17 15:41:22.300127 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1114/2642] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:41:22 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:41:23.027768 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-dc634e46-4a6c-4f45-854b-5a4191fed828 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:23.028383 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-dc634e46-4a6c-4f45-854b-5a4191fed828 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:23.034841 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-dc634e46-4a6c-4f45-854b-5a4191fed828 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:23.035288 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-dc634e46-4a6c-4f45-854b-5a4191fed828 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:23.036040 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-dc634e46-4a6c-4f45-854b-5a4191fed828 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:23.036503 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-dc634e46-4a6c-4f45-854b-5a4191fed828 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:23.097944 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-dc634e46-4a6c-4f45-854b-5a4191fed828 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:23.106793 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-dc634e46-4a6c-4f45-854b-5a4191fed828 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:23.108309 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-dc634e46-4a6c-4f45-854b-5a4191fed828 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:23.109467 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-dc634e46-4a6c-4f45-854b-5a4191fed828 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.085728 Jun 17 15:41:23.110037 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1529/2643] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:41:23 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:41:23.264996 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-79fb9f2e-a587-454a-89d9-feda8c34c75a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:23.265628 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-79fb9f2e-a587-454a-89d9-feda8c34c75a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:23.272028 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-79fb9f2e-a587-454a-89d9-feda8c34c75a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:23.273133 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-79fb9f2e-a587-454a-89d9-feda8c34c75a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:23.273883 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-79fb9f2e-a587-454a-89d9-feda8c34c75a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:23.274317 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-79fb9f2e-a587-454a-89d9-feda8c34c75a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:23.317768 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-8739dc02-2c7b-4eaa-9996-24d90f76b890 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:23.318317 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-8739dc02-2c7b-4eaa-9996-24d90f76b890 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:23.325360 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8739dc02-2c7b-4eaa-9996-24d90f76b890 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:23.325808 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8739dc02-2c7b-4eaa-9996-24d90f76b890 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:23.326584 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8739dc02-2c7b-4eaa-9996-24d90f76b890 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:23.327018 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8739dc02-2c7b-4eaa-9996-24d90f76b890 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:23.338127 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-79fb9f2e-a587-454a-89d9-feda8c34c75a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:23.347652 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-79fb9f2e-a587-454a-89d9-feda8c34c75a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.086623 Jun 17 15:41:23.348466 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1115/2644] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:41:23 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:41:23.459384 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-8739dc02-2c7b-4eaa-9996-24d90f76b890 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:23.467436 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-8739dc02-2c7b-4eaa-9996-24d90f76b890 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.153768 Jun 17 15:41:23.468013 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1530/2645] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:41:23 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:41:24.127173 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-51a33947-9bc6-490f-9c67-2b279261d388 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:24.127781 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-51a33947-9bc6-490f-9c67-2b279261d388 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:24.134436 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-51a33947-9bc6-490f-9c67-2b279261d388 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:24.134885 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-51a33947-9bc6-490f-9c67-2b279261d388 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:24.135633 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-51a33947-9bc6-490f-9c67-2b279261d388 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:24.136065 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-51a33947-9bc6-490f-9c67-2b279261d388 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:24.195779 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-51a33947-9bc6-490f-9c67-2b279261d388 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:24.204104 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-51a33947-9bc6-490f-9c67-2b279261d388 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:24.205634 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-51a33947-9bc6-490f-9c67-2b279261d388 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:24.206751 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-51a33947-9bc6-490f-9c67-2b279261d388 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.083523 Jun 17 15:41:24.207318 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1116/2646] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:41:24 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:41:24.364814 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-8f4a84f4-09dd-4b39-86bc-575264300bc8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:24.365456 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-8f4a84f4-09dd-4b39-86bc-575264300bc8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:24.372580 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8f4a84f4-09dd-4b39-86bc-575264300bc8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:24.373028 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8f4a84f4-09dd-4b39-86bc-575264300bc8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:24.373782 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8f4a84f4-09dd-4b39-86bc-575264300bc8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:24.374213 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8f4a84f4-09dd-4b39-86bc-575264300bc8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:24.439827 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-8f4a84f4-09dd-4b39-86bc-575264300bc8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:24.453675 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-8f4a84f4-09dd-4b39-86bc-575264300bc8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.092606 Jun 17 15:41:24.454257 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1531/2647] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:41:24 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:41:24.484189 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-604aa87d-5399-4584-9c73-fcd08cabe76b tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:24.484840 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-604aa87d-5399-4584-9c73-fcd08cabe76b tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:24.491936 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-604aa87d-5399-4584-9c73-fcd08cabe76b tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:24.492411 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-604aa87d-5399-4584-9c73-fcd08cabe76b tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:24.493170 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-604aa87d-5399-4584-9c73-fcd08cabe76b tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:24.493605 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-604aa87d-5399-4584-9c73-fcd08cabe76b tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:24.622051 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-604aa87d-5399-4584-9c73-fcd08cabe76b tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:24.629990 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-604aa87d-5399-4584-9c73-fcd08cabe76b tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.149695 Jun 17 15:41:24.630499 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1117/2648] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:41:24 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:41:25.225160 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-841d90b2-c3e5-43a7-8718-99de4caf3dda tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:25.226024 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-841d90b2-c3e5-43a7-8718-99de4caf3dda tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:25.232024 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-841d90b2-c3e5-43a7-8718-99de4caf3dda tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:25.232508 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-841d90b2-c3e5-43a7-8718-99de4caf3dda tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:25.233272 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-841d90b2-c3e5-43a7-8718-99de4caf3dda tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:25.233704 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-841d90b2-c3e5-43a7-8718-99de4caf3dda tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:25.237552 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=100 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:41:25.295440 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-841d90b2-c3e5-43a7-8718-99de4caf3dda tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:25.304058 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-841d90b2-c3e5-43a7-8718-99de4caf3dda tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:25.305604 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-841d90b2-c3e5-43a7-8718-99de4caf3dda tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:25.306743 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-841d90b2-c3e5-43a7-8718-99de4caf3dda tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.085556 Jun 17 15:41:25.307304 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1532/2649] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:41:25 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:41:25.470500 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-7231759e-b63d-4992-8c8a-0e52609bca6b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:25.471107 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-7231759e-b63d-4992-8c8a-0e52609bca6b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:25.477538 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7231759e-b63d-4992-8c8a-0e52609bca6b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:25.477939 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7231759e-b63d-4992-8c8a-0e52609bca6b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:25.478696 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7231759e-b63d-4992-8c8a-0e52609bca6b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:25.479135 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7231759e-b63d-4992-8c8a-0e52609bca6b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:25.494311 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell1:SELECT=100 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:41:25.541578 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-7231759e-b63d-4992-8c8a-0e52609bca6b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:25.549506 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-7231759e-b63d-4992-8c8a-0e52609bca6b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.082877 Jun 17 15:41:25.550063 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1118/2650] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:41:25 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:41:25.646972 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-8c49cc81-2aea-44d0-a429-d22c57ee6333 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:25.647601 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-8c49cc81-2aea-44d0-a429-d22c57ee6333 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:25.654077 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8c49cc81-2aea-44d0-a429-d22c57ee6333 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:25.654522 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8c49cc81-2aea-44d0-a429-d22c57ee6333 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:25.655271 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8c49cc81-2aea-44d0-a429-d22c57ee6333 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:25.655699 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8c49cc81-2aea-44d0-a429-d22c57ee6333 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:25.782059 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-8c49cc81-2aea-44d0-a429-d22c57ee6333 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:25.789996 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-8c49cc81-2aea-44d0-a429-d22c57ee6333 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.146871 Jun 17 15:41:25.790557 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1533/2651] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:41:25 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:41:26.326074 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-eb8b5a98-31b6-4d03-8558-90fab4b10dd9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:26.326687 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-eb8b5a98-31b6-4d03-8558-90fab4b10dd9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:26.332771 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-eb8b5a98-31b6-4d03-8558-90fab4b10dd9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:26.333223 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-eb8b5a98-31b6-4d03-8558-90fab4b10dd9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:26.333986 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-eb8b5a98-31b6-4d03-8558-90fab4b10dd9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:26.334426 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-eb8b5a98-31b6-4d03-8558-90fab4b10dd9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:26.395718 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-eb8b5a98-31b6-4d03-8558-90fab4b10dd9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:26.404094 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-eb8b5a98-31b6-4d03-8558-90fab4b10dd9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:26.405615 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-eb8b5a98-31b6-4d03-8558-90fab4b10dd9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:26.406738 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-eb8b5a98-31b6-4d03-8558-90fab4b10dd9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.085284 Jun 17 15:41:26.407288 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1119/2652] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:41:26 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:41:26.566955 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-99de42de-34eb-470c-855c-232557112ebd tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:26.567557 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-99de42de-34eb-470c-855c-232557112ebd tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:26.574228 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-99de42de-34eb-470c-855c-232557112ebd tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:26.574673 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-99de42de-34eb-470c-855c-232557112ebd tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:26.575416 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-99de42de-34eb-470c-855c-232557112ebd tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:26.575846 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-99de42de-34eb-470c-855c-232557112ebd tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:26.635672 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-99de42de-34eb-470c-855c-232557112ebd tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:26.643476 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-99de42de-34eb-470c-855c-232557112ebd tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.080633 Jun 17 15:41:26.644044 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1534/2653] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:41:26 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:41:26.807496 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-55c81676-b220-45cd-84bc-72bdd4900ae6 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:26.808090 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-55c81676-b220-45cd-84bc-72bdd4900ae6 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:26.814905 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-55c81676-b220-45cd-84bc-72bdd4900ae6 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:26.815366 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-55c81676-b220-45cd-84bc-72bdd4900ae6 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:26.816114 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-55c81676-b220-45cd-84bc-72bdd4900ae6 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:26.816581 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-55c81676-b220-45cd-84bc-72bdd4900ae6 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:26.958446 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-55c81676-b220-45cd-84bc-72bdd4900ae6 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:26.968686 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-55c81676-b220-45cd-84bc-72bdd4900ae6 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.164799 Jun 17 15:41:26.969282 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1120/2654] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:41:26 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:41:27.424965 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-39afc20c-080b-4230-b27c-a6a20d7afa86 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:27.425577 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-39afc20c-080b-4230-b27c-a6a20d7afa86 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:27.431761 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-39afc20c-080b-4230-b27c-a6a20d7afa86 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:27.432207 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-39afc20c-080b-4230-b27c-a6a20d7afa86 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:27.432995 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-39afc20c-080b-4230-b27c-a6a20d7afa86 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:27.433425 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-39afc20c-080b-4230-b27c-a6a20d7afa86 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:27.497471 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-39afc20c-080b-4230-b27c-a6a20d7afa86 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:27.505863 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-39afc20c-080b-4230-b27c-a6a20d7afa86 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:27.507898 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-39afc20c-080b-4230-b27c-a6a20d7afa86 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:27.509056 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-39afc20c-080b-4230-b27c-a6a20d7afa86 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.088063 Jun 17 15:41:27.509599 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1535/2655] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:41:27 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:41:27.659345 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-588e4903-9878-492e-80b6-81598d7ddfa9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:27.659874 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-588e4903-9878-492e-80b6-81598d7ddfa9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:27.665911 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-588e4903-9878-492e-80b6-81598d7ddfa9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:27.666358 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-588e4903-9878-492e-80b6-81598d7ddfa9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:27.667126 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-588e4903-9878-492e-80b6-81598d7ddfa9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:27.667556 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-588e4903-9878-492e-80b6-81598d7ddfa9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:27.727778 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-588e4903-9878-492e-80b6-81598d7ddfa9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:27.735682 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-588e4903-9878-492e-80b6-81598d7ddfa9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.080350 Jun 17 15:41:27.736241 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1121/2656] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:41:27 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:41:27.986997 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-031f3288-8af9-4f7c-9e29-711d537afada tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:27.987518 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-031f3288-8af9-4f7c-9e29-711d537afada tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:27.994566 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-031f3288-8af9-4f7c-9e29-711d537afada tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:27.995005 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-031f3288-8af9-4f7c-9e29-711d537afada tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:27.995749 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-031f3288-8af9-4f7c-9e29-711d537afada tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:27.996175 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-031f3288-8af9-4f7c-9e29-711d537afada tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:28.129349 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-031f3288-8af9-4f7c-9e29-711d537afada tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:28.138142 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-031f3288-8af9-4f7c-9e29-711d537afada tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.155079 Jun 17 15:41:28.138707 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1536/2657] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:41:27 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:41:28.527501 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-dc3d4db8-f01e-4f2a-9078-58032ba36c4f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:28.528108 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-dc3d4db8-f01e-4f2a-9078-58032ba36c4f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:28.534616 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-dc3d4db8-f01e-4f2a-9078-58032ba36c4f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:28.535063 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-dc3d4db8-f01e-4f2a-9078-58032ba36c4f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:28.535817 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-dc3d4db8-f01e-4f2a-9078-58032ba36c4f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:28.536247 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-dc3d4db8-f01e-4f2a-9078-58032ba36c4f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:28.597419 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-dc3d4db8-f01e-4f2a-9078-58032ba36c4f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:28.606757 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-dc3d4db8-f01e-4f2a-9078-58032ba36c4f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:28.608205 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-dc3d4db8-f01e-4f2a-9078-58032ba36c4f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:28.609362 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-dc3d4db8-f01e-4f2a-9078-58032ba36c4f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.085818 Jun 17 15:41:28.609918 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1122/2658] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:41:28 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 15:41:28.752993 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-aa5c8b51-7987-4cf7-93ea-2b8822c6d614 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:28.753551 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-aa5c8b51-7987-4cf7-93ea-2b8822c6d614 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:28.759613 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-aa5c8b51-7987-4cf7-93ea-2b8822c6d614 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:28.760058 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-aa5c8b51-7987-4cf7-93ea-2b8822c6d614 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:28.760849 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-aa5c8b51-7987-4cf7-93ea-2b8822c6d614 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:28.761281 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-aa5c8b51-7987-4cf7-93ea-2b8822c6d614 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:28.822435 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-aa5c8b51-7987-4cf7-93ea-2b8822c6d614 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:28.830293 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-aa5c8b51-7987-4cf7-93ea-2b8822c6d614 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.081473 Jun 17 15:41:28.830851 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1537/2659] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:41:28 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:41:29.154977 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-b824e766-8198-4783-adf6-1b765e5b0d1b tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:29.155578 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-b824e766-8198-4783-adf6-1b765e5b0d1b tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:29.161568 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b824e766-8198-4783-adf6-1b765e5b0d1b tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:29.162010 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b824e766-8198-4783-adf6-1b765e5b0d1b tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:29.162752 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b824e766-8198-4783-adf6-1b765e5b0d1b tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:29.163179 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b824e766-8198-4783-adf6-1b765e5b0d1b tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:29.291262 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-b824e766-8198-4783-adf6-1b765e5b0d1b tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:29.299261 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-b824e766-8198-4783-adf6-1b765e5b0d1b tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.148013 Jun 17 15:41:29.299823 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1123/2660] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:41:29 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:41:29.627119 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-9586a383-da52-4f1f-ac07-930795445650 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:29.627729 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-9586a383-da52-4f1f-ac07-930795445650 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:29.634902 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9586a383-da52-4f1f-ac07-930795445650 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:29.635350 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9586a383-da52-4f1f-ac07-930795445650 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:29.636103 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9586a383-da52-4f1f-ac07-930795445650 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:29.636562 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9586a383-da52-4f1f-ac07-930795445650 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:29.700247 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-9586a383-da52-4f1f-ac07-930795445650 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:29.708756 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-9586a383-da52-4f1f-ac07-930795445650 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:29.710241 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-9586a383-da52-4f1f-ac07-930795445650 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:29.711363 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-9586a383-da52-4f1f-ac07-930795445650 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.088174 Jun 17 15:41:29.711906 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1538/2661] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:41:29 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:41:29.847436 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-b4c14d6c-2278-442b-bb4c-5ddc72efbc41 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:29.848130 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-b4c14d6c-2278-442b-bb4c-5ddc72efbc41 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:29.855184 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b4c14d6c-2278-442b-bb4c-5ddc72efbc41 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:29.855625 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b4c14d6c-2278-442b-bb4c-5ddc72efbc41 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:29.856956 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b4c14d6c-2278-442b-bb4c-5ddc72efbc41 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:29.857464 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b4c14d6c-2278-442b-bb4c-5ddc72efbc41 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:29.934199 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-b4c14d6c-2278-442b-bb4c-5ddc72efbc41 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:29.944164 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-b4c14d6c-2278-442b-bb4c-5ddc72efbc41 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.100650 Jun 17 15:41:29.945370 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1124/2662] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:41:29 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:41:30.316957 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-bd1844b2-ed33-4f56-a499-935f401091ed tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:30.317514 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-bd1844b2-ed33-4f56-a499-935f401091ed tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:30.323602 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bd1844b2-ed33-4f56-a499-935f401091ed tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:30.324043 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bd1844b2-ed33-4f56-a499-935f401091ed tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:30.324819 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bd1844b2-ed33-4f56-a499-935f401091ed tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:30.325249 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bd1844b2-ed33-4f56-a499-935f401091ed tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:30.454950 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-bd1844b2-ed33-4f56-a499-935f401091ed tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:30.463681 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-bd1844b2-ed33-4f56-a499-935f401091ed tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.150722 Jun 17 15:41:30.464283 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1539/2663] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:41:30 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:41:30.728848 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-2c32ddd1-cb0d-4d50-9210-a3583da5f242 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:30.729498 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-2c32ddd1-cb0d-4d50-9210-a3583da5f242 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:30.736649 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2c32ddd1-cb0d-4d50-9210-a3583da5f242 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:30.737151 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2c32ddd1-cb0d-4d50-9210-a3583da5f242 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:30.737980 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2c32ddd1-cb0d-4d50-9210-a3583da5f242 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:30.738476 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2c32ddd1-cb0d-4d50-9210-a3583da5f242 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:30.800064 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-2c32ddd1-cb0d-4d50-9210-a3583da5f242 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:30.809146 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-2c32ddd1-cb0d-4d50-9210-a3583da5f242 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:30.810649 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-2c32ddd1-cb0d-4d50-9210-a3583da5f242 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:30.811785 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-2c32ddd1-cb0d-4d50-9210-a3583da5f242 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.087584 Jun 17 15:41:30.812348 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1125/2664] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:41:30 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:41:30.963922 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-d00c0c47-91c6-4877-ad12-b1078f42d97f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:30.964673 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-d00c0c47-91c6-4877-ad12-b1078f42d97f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:30.972399 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d00c0c47-91c6-4877-ad12-b1078f42d97f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:30.972968 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d00c0c47-91c6-4877-ad12-b1078f42d97f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:30.973780 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d00c0c47-91c6-4877-ad12-b1078f42d97f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:30.974253 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d00c0c47-91c6-4877-ad12-b1078f42d97f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:31.035359 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-d00c0c47-91c6-4877-ad12-b1078f42d97f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:31.043903 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-d00c0c47-91c6-4877-ad12-b1078f42d97f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.085189 Jun 17 15:41:31.044488 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1540/2665] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:41:30 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:41:31.480655 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-f0e7bac3-6fe0-4e7d-b0ad-3014d3de871b tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:31.481305 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-f0e7bac3-6fe0-4e7d-b0ad-3014d3de871b tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:31.487884 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f0e7bac3-6fe0-4e7d-b0ad-3014d3de871b tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:31.488373 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f0e7bac3-6fe0-4e7d-b0ad-3014d3de871b tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:31.489139 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f0e7bac3-6fe0-4e7d-b0ad-3014d3de871b tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:31.489579 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f0e7bac3-6fe0-4e7d-b0ad-3014d3de871b tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:31.617172 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-f0e7bac3-6fe0-4e7d-b0ad-3014d3de871b tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:31.625113 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-f0e7bac3-6fe0-4e7d-b0ad-3014d3de871b tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.148347 Jun 17 15:41:31.625618 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1126/2666] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:41:31 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:41:31.831086 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-1b43da03-edfc-4eb9-87de-f5105df49e29 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:31.831724 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-1b43da03-edfc-4eb9-87de-f5105df49e29 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:31.837867 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1b43da03-edfc-4eb9-87de-f5105df49e29 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:31.838323 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1b43da03-edfc-4eb9-87de-f5105df49e29 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:31.839109 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1b43da03-edfc-4eb9-87de-f5105df49e29 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:31.839543 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1b43da03-edfc-4eb9-87de-f5105df49e29 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:31.901415 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-1b43da03-edfc-4eb9-87de-f5105df49e29 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:31.910891 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-1b43da03-edfc-4eb9-87de-f5105df49e29 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:31.912421 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-1b43da03-edfc-4eb9-87de-f5105df49e29 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:31.914108 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-1b43da03-edfc-4eb9-87de-f5105df49e29 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.087072 Jun 17 15:41:31.914669 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1541/2667] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:41:31 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:41:32.061042 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-df20919c-bdff-4511-a81d-eded9d4b4719 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:32.061563 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-df20919c-bdff-4511-a81d-eded9d4b4719 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:32.067639 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-df20919c-bdff-4511-a81d-eded9d4b4719 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:32.068081 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-df20919c-bdff-4511-a81d-eded9d4b4719 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:32.068863 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-df20919c-bdff-4511-a81d-eded9d4b4719 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:32.069312 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-df20919c-bdff-4511-a81d-eded9d4b4719 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:32.134989 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-df20919c-bdff-4511-a81d-eded9d4b4719 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:32.143333 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-df20919c-bdff-4511-a81d-eded9d4b4719 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.086269 Jun 17 15:41:32.143901 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1127/2668] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:41:32 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:41:32.642783 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-cc86c44e-adf5-4e31-96f3-63ee56695e38 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:32.643303 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-cc86c44e-adf5-4e31-96f3-63ee56695e38 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:32.650543 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cc86c44e-adf5-4e31-96f3-63ee56695e38 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:32.650980 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cc86c44e-adf5-4e31-96f3-63ee56695e38 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:32.651729 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cc86c44e-adf5-4e31-96f3-63ee56695e38 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:32.652156 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cc86c44e-adf5-4e31-96f3-63ee56695e38 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:32.785267 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-cc86c44e-adf5-4e31-96f3-63ee56695e38 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:32.793208 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-cc86c44e-adf5-4e31-96f3-63ee56695e38 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.154390 Jun 17 15:41:32.793851 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1542/2669] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:41:32 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:41:32.932578 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-40f8334f-6944-4f62-92eb-2b8d5d953d22 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:32.933628 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-40f8334f-6944-4f62-92eb-2b8d5d953d22 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:32.941899 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-40f8334f-6944-4f62-92eb-2b8d5d953d22 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:32.942340 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-40f8334f-6944-4f62-92eb-2b8d5d953d22 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:32.943095 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-40f8334f-6944-4f62-92eb-2b8d5d953d22 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:32.943530 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-40f8334f-6944-4f62-92eb-2b8d5d953d22 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:33.015191 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-40f8334f-6944-4f62-92eb-2b8d5d953d22 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:33.023727 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-40f8334f-6944-4f62-92eb-2b8d5d953d22 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:33.025233 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-40f8334f-6944-4f62-92eb-2b8d5d953d22 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:33.026360 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-40f8334f-6944-4f62-92eb-2b8d5d953d22 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.099196 Jun 17 15:41:33.026917 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1128/2670] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:41:32 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 15:41:33.160133 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-d2c44be1-adcb-4607-8f09-138605f5463f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:33.160759 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-d2c44be1-adcb-4607-8f09-138605f5463f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:33.166848 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d2c44be1-adcb-4607-8f09-138605f5463f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:33.167295 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d2c44be1-adcb-4607-8f09-138605f5463f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:33.168050 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d2c44be1-adcb-4607-8f09-138605f5463f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:33.168532 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d2c44be1-adcb-4607-8f09-138605f5463f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:33.228679 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-d2c44be1-adcb-4607-8f09-138605f5463f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:33.236507 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-d2c44be1-adcb-4607-8f09-138605f5463f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.080249 Jun 17 15:41:33.237073 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1543/2671] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:41:33 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:41:33.810380 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-26c55c95-47e3-43f3-a580-58dbe534c9f9 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:33.810982 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-26c55c95-47e3-43f3-a580-58dbe534c9f9 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:33.817140 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-26c55c95-47e3-43f3-a580-58dbe534c9f9 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:33.817616 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-26c55c95-47e3-43f3-a580-58dbe534c9f9 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:33.818367 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-26c55c95-47e3-43f3-a580-58dbe534c9f9 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:33.818794 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-26c55c95-47e3-43f3-a580-58dbe534c9f9 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:33.966296 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-26c55c95-47e3-43f3-a580-58dbe534c9f9 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:33.974681 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-26c55c95-47e3-43f3-a580-58dbe534c9f9 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.168036 Jun 17 15:41:33.975357 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1129/2672] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:41:33 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:41:34.044582 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-19012d42-3bb9-4bc7-8084-73a5d2a22398 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:34.045197 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-19012d42-3bb9-4bc7-8084-73a5d2a22398 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:34.054379 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-19012d42-3bb9-4bc7-8084-73a5d2a22398 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:34.054828 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-19012d42-3bb9-4bc7-8084-73a5d2a22398 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:34.055615 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-19012d42-3bb9-4bc7-8084-73a5d2a22398 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:34.056041 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-19012d42-3bb9-4bc7-8084-73a5d2a22398 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:34.153320 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-19012d42-3bb9-4bc7-8084-73a5d2a22398 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:34.162304 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-19012d42-3bb9-4bc7-8084-73a5d2a22398 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:34.163820 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-19012d42-3bb9-4bc7-8084-73a5d2a22398 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:34.164995 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-19012d42-3bb9-4bc7-8084-73a5d2a22398 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.125222 Jun 17 15:41:34.165991 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1544/2673] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:41:34 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:41:34.253978 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-242ecba5-51b3-43d8-95cf-63fabfe577b8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:34.254619 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-242ecba5-51b3-43d8-95cf-63fabfe577b8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:34.261835 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-242ecba5-51b3-43d8-95cf-63fabfe577b8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:34.262739 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-242ecba5-51b3-43d8-95cf-63fabfe577b8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:34.263040 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-242ecba5-51b3-43d8-95cf-63fabfe577b8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:34.263478 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-242ecba5-51b3-43d8-95cf-63fabfe577b8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:34.326280 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-242ecba5-51b3-43d8-95cf-63fabfe577b8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:34.334791 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-242ecba5-51b3-43d8-95cf-63fabfe577b8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.084754 Jun 17 15:41:34.335375 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1130/2674] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:41:34 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:41:34.992656 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-3d1e932d-88a3-44a8-bade-0b76a6f4df27 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:34.993260 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-3d1e932d-88a3-44a8-bade-0b76a6f4df27 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:35.000162 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3d1e932d-88a3-44a8-bade-0b76a6f4df27 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:35.000641 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3d1e932d-88a3-44a8-bade-0b76a6f4df27 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:35.001500 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3d1e932d-88a3-44a8-bade-0b76a6f4df27 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:35.001983 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3d1e932d-88a3-44a8-bade-0b76a6f4df27 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:35.132979 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-3d1e932d-88a3-44a8-bade-0b76a6f4df27 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:35.141144 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-3d1e932d-88a3-44a8-bade-0b76a6f4df27 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.152412 Jun 17 15:41:35.141705 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1545/2675] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:41:34 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:41:35.184176 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-9408d3cc-50bb-418f-a346-0d3328bd3072 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:35.184807 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-9408d3cc-50bb-418f-a346-0d3328bd3072 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:35.191344 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9408d3cc-50bb-418f-a346-0d3328bd3072 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:35.194568 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9408d3cc-50bb-418f-a346-0d3328bd3072 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:35.195399 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9408d3cc-50bb-418f-a346-0d3328bd3072 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:35.195829 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9408d3cc-50bb-418f-a346-0d3328bd3072 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:35.260876 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-9408d3cc-50bb-418f-a346-0d3328bd3072 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:35.269458 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-9408d3cc-50bb-418f-a346-0d3328bd3072 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:35.270985 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-9408d3cc-50bb-418f-a346-0d3328bd3072 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:35.272119 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-9408d3cc-50bb-418f-a346-0d3328bd3072 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.091827 Jun 17 15:41:35.272755 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1131/2676] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:41:35 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:41:35.353778 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-f96ae276-c775-47e8-ad55-67525f313f17 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:35.354391 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-f96ae276-c775-47e8-ad55-67525f313f17 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:35.361089 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f96ae276-c775-47e8-ad55-67525f313f17 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:35.361537 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f96ae276-c775-47e8-ad55-67525f313f17 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:35.362297 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f96ae276-c775-47e8-ad55-67525f313f17 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:35.362726 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f96ae276-c775-47e8-ad55-67525f313f17 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:35.423481 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-f96ae276-c775-47e8-ad55-67525f313f17 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:35.431373 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-f96ae276-c775-47e8-ad55-67525f313f17 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.081818 Jun 17 15:41:35.431926 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1546/2677] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:41:35 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:41:36.158314 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-019aec7c-4ae4-4abb-b4d1-1df8dd2ad46e tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:36.158947 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-019aec7c-4ae4-4abb-b4d1-1df8dd2ad46e tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:36.164977 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-019aec7c-4ae4-4abb-b4d1-1df8dd2ad46e tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:36.165426 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-019aec7c-4ae4-4abb-b4d1-1df8dd2ad46e tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:36.166175 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-019aec7c-4ae4-4abb-b4d1-1df8dd2ad46e tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:36.166608 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-019aec7c-4ae4-4abb-b4d1-1df8dd2ad46e tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:36.291751 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-97b3d54d-06fd-483c-8003-1ac161296e5f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:36.292385 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-97b3d54d-06fd-483c-8003-1ac161296e5f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:36.299794 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-97b3d54d-06fd-483c-8003-1ac161296e5f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:36.300265 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-97b3d54d-06fd-483c-8003-1ac161296e5f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:36.300662 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-019aec7c-4ae4-4abb-b4d1-1df8dd2ad46e tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:36.301146 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-97b3d54d-06fd-483c-8003-1ac161296e5f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:36.301624 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-97b3d54d-06fd-483c-8003-1ac161296e5f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:36.310112 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-019aec7c-4ae4-4abb-b4d1-1df8dd2ad46e tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.154775 Jun 17 15:41:36.319561 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1132/2678] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:41:36 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:41:36.366468 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-97b3d54d-06fd-483c-8003-1ac161296e5f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:36.375589 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-97b3d54d-06fd-483c-8003-1ac161296e5f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:36.377116 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-97b3d54d-06fd-483c-8003-1ac161296e5f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:36.378251 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-97b3d54d-06fd-483c-8003-1ac161296e5f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.090751 Jun 17 15:41:36.379265 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1547/2679] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:41:36 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 15:41:36.448127 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-80e2c39a-de34-4f80-bd91-9de7b46f392c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:36.448703 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-80e2c39a-de34-4f80-bd91-9de7b46f392c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:36.454909 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-80e2c39a-de34-4f80-bd91-9de7b46f392c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:36.455356 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-80e2c39a-de34-4f80-bd91-9de7b46f392c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:36.456135 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-80e2c39a-de34-4f80-bd91-9de7b46f392c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:36.456602 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-80e2c39a-de34-4f80-bd91-9de7b46f392c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:36.517577 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-80e2c39a-de34-4f80-bd91-9de7b46f392c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:36.525938 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-80e2c39a-de34-4f80-bd91-9de7b46f392c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.081669 Jun 17 15:41:36.526523 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1133/2680] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:41:36 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:41:37.327530 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-5542a8e8-b2f5-465d-880e-4c8bad006af3 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:37.328993 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-5542a8e8-b2f5-465d-880e-4c8bad006af3 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:37.335691 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5542a8e8-b2f5-465d-880e-4c8bad006af3 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:37.336141 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5542a8e8-b2f5-465d-880e-4c8bad006af3 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:37.336987 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5542a8e8-b2f5-465d-880e-4c8bad006af3 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:37.337369 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5542a8e8-b2f5-465d-880e-4c8bad006af3 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:37.397076 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-5030741e-f4eb-456f-9d58-93d305954669 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:37.397681 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-5030741e-f4eb-456f-9d58-93d305954669 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:37.404363 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5030741e-f4eb-456f-9d58-93d305954669 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:37.404931 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5030741e-f4eb-456f-9d58-93d305954669 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:37.405696 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5030741e-f4eb-456f-9d58-93d305954669 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:37.406138 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5030741e-f4eb-456f-9d58-93d305954669 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:37.474359 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-5030741e-f4eb-456f-9d58-93d305954669 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:37.478181 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-5542a8e8-b2f5-465d-880e-4c8bad006af3 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:37.480533 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=100 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:41:37.485335 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-5030741e-f4eb-456f-9d58-93d305954669 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:37.487000 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-5030741e-f4eb-456f-9d58-93d305954669 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:37.488132 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-5542a8e8-b2f5-465d-880e-4c8bad006af3 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.164674 Jun 17 15:41:37.488270 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-5030741e-f4eb-456f-9d58-93d305954669 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.095151 Jun 17 15:41:37.488757 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1548/2681] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:41:37 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:41:37.488984 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1134/2682] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:41:37 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 15:41:37.543424 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-642067dc-5a98-4dac-aba3-977bff4fd725 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:37.544031 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-642067dc-5a98-4dac-aba3-977bff4fd725 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:37.550928 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-642067dc-5a98-4dac-aba3-977bff4fd725 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:37.551478 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-642067dc-5a98-4dac-aba3-977bff4fd725 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:37.552118 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-642067dc-5a98-4dac-aba3-977bff4fd725 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:37.552616 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-642067dc-5a98-4dac-aba3-977bff4fd725 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:37.555300 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell1:SELECT=100 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:41:37.617115 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-642067dc-5a98-4dac-aba3-977bff4fd725 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:37.625054 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-642067dc-5a98-4dac-aba3-977bff4fd725 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.085621 Jun 17 15:41:37.625614 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1135/2683] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:41:37 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:41:38.507245 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-dd369fce-d170-4996-a31e-33dbfdc35e49 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:38.507824 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-1a92b5d7-b7a1-43e2-9516-fb94036c7b0e tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:38.508207 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-dd369fce-d170-4996-a31e-33dbfdc35e49 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:38.508356 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-1a92b5d7-b7a1-43e2-9516-fb94036c7b0e tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:38.514539 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-dd369fce-d170-4996-a31e-33dbfdc35e49 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:38.514728 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1a92b5d7-b7a1-43e2-9516-fb94036c7b0e tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:38.514978 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-dd369fce-d170-4996-a31e-33dbfdc35e49 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:38.515127 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1a92b5d7-b7a1-43e2-9516-fb94036c7b0e tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:38.515737 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-dd369fce-d170-4996-a31e-33dbfdc35e49 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:38.515856 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1a92b5d7-b7a1-43e2-9516-fb94036c7b0e tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:38.516168 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-dd369fce-d170-4996-a31e-33dbfdc35e49 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:38.516302 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1a92b5d7-b7a1-43e2-9516-fb94036c7b0e tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:38.580461 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-dd369fce-d170-4996-a31e-33dbfdc35e49 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:38.589378 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-dd369fce-d170-4996-a31e-33dbfdc35e49 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:38.590888 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-dd369fce-d170-4996-a31e-33dbfdc35e49 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:38.592037 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-dd369fce-d170-4996-a31e-33dbfdc35e49 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.088789 Jun 17 15:41:38.592632 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1549/2684] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:41:38 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:41:38.641763 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-e0c41ccf-397f-4cb1-aae2-689b4e5a4bdc tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:38.642382 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-e0c41ccf-397f-4cb1-aae2-689b4e5a4bdc tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:38.648654 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e0c41ccf-397f-4cb1-aae2-689b4e5a4bdc tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:38.649114 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e0c41ccf-397f-4cb1-aae2-689b4e5a4bdc tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:38.649901 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e0c41ccf-397f-4cb1-aae2-689b4e5a4bdc tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:38.650113 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-1a92b5d7-b7a1-43e2-9516-fb94036c7b0e tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:38.650428 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e0c41ccf-397f-4cb1-aae2-689b4e5a4bdc tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:38.658739 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-1a92b5d7-b7a1-43e2-9516-fb94036c7b0e tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.155350 Jun 17 15:41:38.659449 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1136/2685] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:41:38 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:41:38.717305 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-e0c41ccf-397f-4cb1-aae2-689b4e5a4bdc tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:38.725145 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-e0c41ccf-397f-4cb1-aae2-689b4e5a4bdc tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.087386 Jun 17 15:41:38.725960 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1550/2686] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:41:38 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:41:38.786328 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 15:41:38.786637 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Fri Jun 17 15:41:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 15:41:39.611015 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-a75dcfd6-8523-45a3-9f31-ffa90e9ab76e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:39.611667 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-a75dcfd6-8523-45a3-9f31-ffa90e9ab76e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:39.618628 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a75dcfd6-8523-45a3-9f31-ffa90e9ab76e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:39.619080 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a75dcfd6-8523-45a3-9f31-ffa90e9ab76e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:39.619841 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a75dcfd6-8523-45a3-9f31-ffa90e9ab76e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:39.620281 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a75dcfd6-8523-45a3-9f31-ffa90e9ab76e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:39.676260 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-cd581510-7b03-4c0a-a970-2e8b5458a814 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:39.676873 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-cd581510-7b03-4c0a-a970-2e8b5458a814 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:39.683304 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-a75dcfd6-8523-45a3-9f31-ffa90e9ab76e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:39.683505 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cd581510-7b03-4c0a-a970-2e8b5458a814 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:39.683889 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cd581510-7b03-4c0a-a970-2e8b5458a814 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:39.684721 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cd581510-7b03-4c0a-a970-2e8b5458a814 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:39.685240 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cd581510-7b03-4c0a-a970-2e8b5458a814 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:39.692461 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-a75dcfd6-8523-45a3-9f31-ffa90e9ab76e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:39.693968 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-a75dcfd6-8523-45a3-9f31-ffa90e9ab76e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:39.695131 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-a75dcfd6-8523-45a3-9f31-ffa90e9ab76e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.088708 Jun 17 15:41:39.696078 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1137/2687] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:41:39 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:41:39.742869 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-e98fd0f6-0c4b-411d-a6f8-afc620a0df82 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:39.743487 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-e98fd0f6-0c4b-411d-a6f8-afc620a0df82 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:39.749633 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e98fd0f6-0c4b-411d-a6f8-afc620a0df82 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:39.750614 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e98fd0f6-0c4b-411d-a6f8-afc620a0df82 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:39.751373 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e98fd0f6-0c4b-411d-a6f8-afc620a0df82 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:39.751811 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e98fd0f6-0c4b-411d-a6f8-afc620a0df82 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:39.816249 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-e98fd0f6-0c4b-411d-a6f8-afc620a0df82 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:39.818007 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-cd581510-7b03-4c0a-a970-2e8b5458a814 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:39.824416 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-e98fd0f6-0c4b-411d-a6f8-afc620a0df82 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.085377 Jun 17 15:41:39.824993 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1138/2688] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:41:39 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:41:39.825810 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-cd581510-7b03-4c0a-a970-2e8b5458a814 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.153551 Jun 17 15:41:39.826378 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1551/2689] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:41:39 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:41:40.713931 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-e90d9546-1f19-4d4f-bd65-e35d7538f060 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:40.714473 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-e90d9546-1f19-4d4f-bd65-e35d7538f060 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:40.721138 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e90d9546-1f19-4d4f-bd65-e35d7538f060 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:40.721589 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e90d9546-1f19-4d4f-bd65-e35d7538f060 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:40.722349 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e90d9546-1f19-4d4f-bd65-e35d7538f060 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:40.722783 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e90d9546-1f19-4d4f-bd65-e35d7538f060 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:40.785215 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-e90d9546-1f19-4d4f-bd65-e35d7538f060 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:40.793616 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-e90d9546-1f19-4d4f-bd65-e35d7538f060 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:40.795120 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-e90d9546-1f19-4d4f-bd65-e35d7538f060 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:40.796345 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-e90d9546-1f19-4d4f-bd65-e35d7538f060 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.086419 Jun 17 15:41:40.797405 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1139/2690] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:41:40 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:41:40.842648 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-685c8d67-59ec-4be3-b9a0-ecffa01c18f9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:40.843226 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-e98a9fce-bf55-40b0-8121-73788d4fd6f8 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:40.843336 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-685c8d67-59ec-4be3-b9a0-ecffa01c18f9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:40.843615 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-e98a9fce-bf55-40b0-8121-73788d4fd6f8 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:40.849728 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e98a9fce-bf55-40b0-8121-73788d4fd6f8 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:40.849872 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-685c8d67-59ec-4be3-b9a0-ecffa01c18f9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:40.850176 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-685c8d67-59ec-4be3-b9a0-ecffa01c18f9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:40.850312 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e98a9fce-bf55-40b0-8121-73788d4fd6f8 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:40.851188 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-685c8d67-59ec-4be3-b9a0-ecffa01c18f9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:40.851307 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e98a9fce-bf55-40b0-8121-73788d4fd6f8 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:40.851618 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e98a9fce-bf55-40b0-8121-73788d4fd6f8 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:40.851731 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-685c8d67-59ec-4be3-b9a0-ecffa01c18f9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:40.913986 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-685c8d67-59ec-4be3-b9a0-ecffa01c18f9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:40.922637 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-685c8d67-59ec-4be3-b9a0-ecffa01c18f9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.084005 Jun 17 15:41:40.923211 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1552/2691] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:41:40 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:41:40.980647 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-e98a9fce-bf55-40b0-8121-73788d4fd6f8 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:40.989066 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-e98a9fce-bf55-40b0-8121-73788d4fd6f8 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.150206 Jun 17 15:41:40.989627 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1140/2692] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:41:40 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:41:41.814921 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-61fb61dc-2d9e-4e2a-8d7a-2c817a3d106b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:41.815551 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-61fb61dc-2d9e-4e2a-8d7a-2c817a3d106b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:41.821629 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-61fb61dc-2d9e-4e2a-8d7a-2c817a3d106b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:41.822073 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-61fb61dc-2d9e-4e2a-8d7a-2c817a3d106b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:41.822826 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-61fb61dc-2d9e-4e2a-8d7a-2c817a3d106b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:41.823256 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-61fb61dc-2d9e-4e2a-8d7a-2c817a3d106b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:41.883842 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-61fb61dc-2d9e-4e2a-8d7a-2c817a3d106b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:41.892909 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-61fb61dc-2d9e-4e2a-8d7a-2c817a3d106b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:41.894410 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-61fb61dc-2d9e-4e2a-8d7a-2c817a3d106b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:41.895537 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-61fb61dc-2d9e-4e2a-8d7a-2c817a3d106b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.085176 Jun 17 15:41:41.896095 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1553/2693] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:41:41 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:41:41.939421 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-4c262bc2-12ba-4536-afe9-a130b851c5e8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:41.940029 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-4c262bc2-12ba-4536-afe9-a130b851c5e8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:41.946570 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4c262bc2-12ba-4536-afe9-a130b851c5e8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:41.947011 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4c262bc2-12ba-4536-afe9-a130b851c5e8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:41.947756 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4c262bc2-12ba-4536-afe9-a130b851c5e8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:41.948186 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4c262bc2-12ba-4536-afe9-a130b851c5e8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:42.006818 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-10c2f0ef-4a97-49fa-8db0-23e29eb7f503 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:42.007331 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-10c2f0ef-4a97-49fa-8db0-23e29eb7f503 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:42.012203 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-4c262bc2-12ba-4536-afe9-a130b851c5e8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:42.013527 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-10c2f0ef-4a97-49fa-8db0-23e29eb7f503 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:42.013983 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-10c2f0ef-4a97-49fa-8db0-23e29eb7f503 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:42.014747 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-10c2f0ef-4a97-49fa-8db0-23e29eb7f503 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:42.015207 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-10c2f0ef-4a97-49fa-8db0-23e29eb7f503 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:42.020742 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-4c262bc2-12ba-4536-afe9-a130b851c5e8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.085661 Jun 17 15:41:42.021314 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1141/2694] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:41:41 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:41:42.146942 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-10c2f0ef-4a97-49fa-8db0-23e29eb7f503 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:42.154856 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-10c2f0ef-4a97-49fa-8db0-23e29eb7f503 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.151993 Jun 17 15:41:42.155418 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1554/2695] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:41:42 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:41:42.913669 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-f9180758-8d23-4e99-b430-8b809239aa5d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:42.914310 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-f9180758-8d23-4e99-b430-8b809239aa5d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:42.920891 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f9180758-8d23-4e99-b430-8b809239aa5d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:42.921346 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f9180758-8d23-4e99-b430-8b809239aa5d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:42.922589 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f9180758-8d23-4e99-b430-8b809239aa5d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:42.923022 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f9180758-8d23-4e99-b430-8b809239aa5d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:42.984704 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-f9180758-8d23-4e99-b430-8b809239aa5d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:42.993159 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-f9180758-8d23-4e99-b430-8b809239aa5d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:42.994661 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-f9180758-8d23-4e99-b430-8b809239aa5d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:42.995789 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-f9180758-8d23-4e99-b430-8b809239aa5d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.086135 Jun 17 15:41:42.996355 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1142/2696] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:41:42 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:41:43.037868 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-0243fe53-c44f-4028-8724-61238dd91a46 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:43.038484 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-0243fe53-c44f-4028-8724-61238dd91a46 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:43.045313 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0243fe53-c44f-4028-8724-61238dd91a46 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:43.045764 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0243fe53-c44f-4028-8724-61238dd91a46 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:43.047076 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0243fe53-c44f-4028-8724-61238dd91a46 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:43.047810 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0243fe53-c44f-4028-8724-61238dd91a46 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:43.110417 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-0243fe53-c44f-4028-8724-61238dd91a46 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:43.118544 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-0243fe53-c44f-4028-8724-61238dd91a46 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.084573 Jun 17 15:41:43.119122 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1555/2697] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:41:43 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:41:43.172761 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-db5e2702-aea5-4047-925a-fa70690cf366 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:43.173305 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-db5e2702-aea5-4047-925a-fa70690cf366 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:43.179293 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-db5e2702-aea5-4047-925a-fa70690cf366 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:43.179742 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-db5e2702-aea5-4047-925a-fa70690cf366 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:43.180523 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-db5e2702-aea5-4047-925a-fa70690cf366 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:43.180962 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-db5e2702-aea5-4047-925a-fa70690cf366 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:43.309449 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-db5e2702-aea5-4047-925a-fa70690cf366 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:43.318184 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-db5e2702-aea5-4047-925a-fa70690cf366 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.149851 Jun 17 15:41:43.318745 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1143/2698] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:41:43 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:41:44.017568 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-7046d466-f8f4-48cd-bcde-8dc9c04b3eee tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:44.018115 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-7046d466-f8f4-48cd-bcde-8dc9c04b3eee tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:44.024166 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7046d466-f8f4-48cd-bcde-8dc9c04b3eee tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:44.024630 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7046d466-f8f4-48cd-bcde-8dc9c04b3eee tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:44.025387 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7046d466-f8f4-48cd-bcde-8dc9c04b3eee tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:44.025820 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7046d466-f8f4-48cd-bcde-8dc9c04b3eee tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:44.088282 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-7046d466-f8f4-48cd-bcde-8dc9c04b3eee tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:44.096666 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-7046d466-f8f4-48cd-bcde-8dc9c04b3eee tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:44.098177 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-7046d466-f8f4-48cd-bcde-8dc9c04b3eee tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:44.099308 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-7046d466-f8f4-48cd-bcde-8dc9c04b3eee tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.086299 Jun 17 15:41:44.099860 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1556/2699] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:41:44 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:41:44.135933 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-70025069-39db-449b-93a5-6ee6d081b3fd tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:44.136578 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-70025069-39db-449b-93a5-6ee6d081b3fd tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:44.143784 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-70025069-39db-449b-93a5-6ee6d081b3fd tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:44.144230 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-70025069-39db-449b-93a5-6ee6d081b3fd tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:44.145012 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-70025069-39db-449b-93a5-6ee6d081b3fd tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:44.145448 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-70025069-39db-449b-93a5-6ee6d081b3fd tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:44.212857 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-70025069-39db-449b-93a5-6ee6d081b3fd tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:44.220846 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-70025069-39db-449b-93a5-6ee6d081b3fd tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.088828 Jun 17 15:41:44.221409 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1144/2700] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:41:44 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:41:44.336099 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-3845890a-88d5-4543-84e7-ae5f7cc22002 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:44.336737 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-3845890a-88d5-4543-84e7-ae5f7cc22002 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:44.342837 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3845890a-88d5-4543-84e7-ae5f7cc22002 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:44.343276 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3845890a-88d5-4543-84e7-ae5f7cc22002 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:44.344093 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3845890a-88d5-4543-84e7-ae5f7cc22002 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:44.344468 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3845890a-88d5-4543-84e7-ae5f7cc22002 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:44.474307 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-3845890a-88d5-4543-84e7-ae5f7cc22002 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:44.482357 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-3845890a-88d5-4543-84e7-ae5f7cc22002 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.150088 Jun 17 15:41:44.482911 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1557/2701] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:41:44 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:41:45.117698 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-cbd302b8-e80d-4b04-9231-71c026b0948a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:45.118311 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-cbd302b8-e80d-4b04-9231-71c026b0948a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:45.124447 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cbd302b8-e80d-4b04-9231-71c026b0948a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:45.124833 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cbd302b8-e80d-4b04-9231-71c026b0948a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:45.125609 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cbd302b8-e80d-4b04-9231-71c026b0948a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:45.126047 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cbd302b8-e80d-4b04-9231-71c026b0948a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:45.186038 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-cbd302b8-e80d-4b04-9231-71c026b0948a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:45.194514 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-cbd302b8-e80d-4b04-9231-71c026b0948a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:45.196014 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-cbd302b8-e80d-4b04-9231-71c026b0948a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:45.197629 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-cbd302b8-e80d-4b04-9231-71c026b0948a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.083611 Jun 17 15:41:45.208884 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1145/2702] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:41:45 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:41:45.237353 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-06a3666a-5610-4267-91f3-f75193dbe1c0 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:45.238247 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-06a3666a-5610-4267-91f3-f75193dbe1c0 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:45.244716 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-06a3666a-5610-4267-91f3-f75193dbe1c0 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:45.245138 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-06a3666a-5610-4267-91f3-f75193dbe1c0 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:45.245881 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-06a3666a-5610-4267-91f3-f75193dbe1c0 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:45.246312 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-06a3666a-5610-4267-91f3-f75193dbe1c0 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:45.306527 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-06a3666a-5610-4267-91f3-f75193dbe1c0 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:45.314631 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-06a3666a-5610-4267-91f3-f75193dbe1c0 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.081082 Jun 17 15:41:45.315196 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1558/2703] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:41:45 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:41:45.499120 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-1dd07b04-66f9-4733-b03f-a5eda1ec5c16 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:45.499737 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-1dd07b04-66f9-4733-b03f-a5eda1ec5c16 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:45.505732 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1dd07b04-66f9-4733-b03f-a5eda1ec5c16 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:45.506182 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1dd07b04-66f9-4733-b03f-a5eda1ec5c16 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:45.506931 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1dd07b04-66f9-4733-b03f-a5eda1ec5c16 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:45.507364 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1dd07b04-66f9-4733-b03f-a5eda1ec5c16 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:45.634549 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-1dd07b04-66f9-4733-b03f-a5eda1ec5c16 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:45.642918 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-1dd07b04-66f9-4733-b03f-a5eda1ec5c16 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.147788 Jun 17 15:41:45.643468 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1146/2704] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:41:45 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:41:46.216137 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-df0c5e09-28ad-4fa5-a8e5-ba63a45d4fbc tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:46.216772 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-df0c5e09-28ad-4fa5-a8e5-ba63a45d4fbc tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:46.223303 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-df0c5e09-28ad-4fa5-a8e5-ba63a45d4fbc tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:46.223749 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-df0c5e09-28ad-4fa5-a8e5-ba63a45d4fbc tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:46.224532 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-df0c5e09-28ad-4fa5-a8e5-ba63a45d4fbc tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:46.224966 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-df0c5e09-28ad-4fa5-a8e5-ba63a45d4fbc tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:46.285574 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-df0c5e09-28ad-4fa5-a8e5-ba63a45d4fbc tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:46.294124 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-df0c5e09-28ad-4fa5-a8e5-ba63a45d4fbc tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:46.295542 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-df0c5e09-28ad-4fa5-a8e5-ba63a45d4fbc tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:46.296714 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-df0c5e09-28ad-4fa5-a8e5-ba63a45d4fbc tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.084490 Jun 17 15:41:46.297300 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1559/2705] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:41:46 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:41:46.331538 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-d44bfe58-e533-4194-b065-a763aee4ab12 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:46.332138 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-d44bfe58-e533-4194-b065-a763aee4ab12 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:46.338654 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d44bfe58-e533-4194-b065-a763aee4ab12 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:46.339103 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d44bfe58-e533-4194-b065-a763aee4ab12 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:46.340043 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d44bfe58-e533-4194-b065-a763aee4ab12 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:46.340528 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d44bfe58-e533-4194-b065-a763aee4ab12 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:46.401533 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-d44bfe58-e533-4194-b065-a763aee4ab12 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:46.410107 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-d44bfe58-e533-4194-b065-a763aee4ab12 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.083065 Jun 17 15:41:46.410670 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1147/2706] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:41:46 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:41:46.659624 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-5310955c-8adc-49de-95ff-9d1722961402 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:46.660243 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-5310955c-8adc-49de-95ff-9d1722961402 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:46.662115 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_api:SELECT=82 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:41:46.667548 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5310955c-8adc-49de-95ff-9d1722961402 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:46.667998 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5310955c-8adc-49de-95ff-9d1722961402 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:46.668794 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5310955c-8adc-49de-95ff-9d1722961402 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:46.669232 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5310955c-8adc-49de-95ff-9d1722961402 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:46.797977 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-5310955c-8adc-49de-95ff-9d1722961402 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:46.805930 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-5310955c-8adc-49de-95ff-9d1722961402 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.150271 Jun 17 15:41:46.806500 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1560/2707] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:41:46 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:41:47.314736 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-4388e334-750e-4e7b-a5fa-67b60c91d0c0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:47.315347 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-4388e334-750e-4e7b-a5fa-67b60c91d0c0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:47.321751 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4388e334-750e-4e7b-a5fa-67b60c91d0c0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:47.322389 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4388e334-750e-4e7b-a5fa-67b60c91d0c0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:47.323325 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4388e334-750e-4e7b-a5fa-67b60c91d0c0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:47.323770 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4388e334-750e-4e7b-a5fa-67b60c91d0c0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:47.395527 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-4388e334-750e-4e7b-a5fa-67b60c91d0c0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:47.404191 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-4388e334-750e-4e7b-a5fa-67b60c91d0c0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:47.405702 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-4388e334-750e-4e7b-a5fa-67b60c91d0c0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:47.407311 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-4388e334-750e-4e7b-a5fa-67b60c91d0c0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.096481 Jun 17 15:41:47.407851 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1148/2708] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:41:47 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:41:47.427717 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-ec068694-8e51-4946-b1b9-4a0ab1414ade tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:47.428384 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-ec068694-8e51-4946-b1b9-4a0ab1414ade tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:47.434862 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ec068694-8e51-4946-b1b9-4a0ab1414ade tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:47.435302 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ec068694-8e51-4946-b1b9-4a0ab1414ade tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:47.436052 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ec068694-8e51-4946-b1b9-4a0ab1414ade tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:47.436515 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ec068694-8e51-4946-b1b9-4a0ab1414ade tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:47.498743 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-ec068694-8e51-4946-b1b9-4a0ab1414ade tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:47.506684 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-ec068694-8e51-4946-b1b9-4a0ab1414ade tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.083311 Jun 17 15:41:47.507250 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1561/2709] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:41:47 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:41:47.823211 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-82aeaae4-e2ba-4e1e-900f-8e96d5acfc12 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:47.823856 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-82aeaae4-e2ba-4e1e-900f-8e96d5acfc12 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:47.829874 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-82aeaae4-e2ba-4e1e-900f-8e96d5acfc12 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:47.830372 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-82aeaae4-e2ba-4e1e-900f-8e96d5acfc12 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:47.831127 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-82aeaae4-e2ba-4e1e-900f-8e96d5acfc12 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:47.831556 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-82aeaae4-e2ba-4e1e-900f-8e96d5acfc12 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:47.957339 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-82aeaae4-e2ba-4e1e-900f-8e96d5acfc12 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:47.965505 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-82aeaae4-e2ba-4e1e-900f-8e96d5acfc12 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.146332 Jun 17 15:41:47.966074 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1149/2710] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:41:47 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:41:48.425326 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-3f81ad23-8730-4106-aab9-8bb175ca7e6c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:48.425964 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-3f81ad23-8730-4106-aab9-8bb175ca7e6c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:48.432784 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3f81ad23-8730-4106-aab9-8bb175ca7e6c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:48.433368 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3f81ad23-8730-4106-aab9-8bb175ca7e6c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:48.433985 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3f81ad23-8730-4106-aab9-8bb175ca7e6c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:48.434417 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3f81ad23-8730-4106-aab9-8bb175ca7e6c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:48.495623 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-3f81ad23-8730-4106-aab9-8bb175ca7e6c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:48.503998 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-3f81ad23-8730-4106-aab9-8bb175ca7e6c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:48.505512 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-3f81ad23-8730-4106-aab9-8bb175ca7e6c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:48.506632 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-3f81ad23-8730-4106-aab9-8bb175ca7e6c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.085313 Jun 17 15:41:48.507177 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1562/2711] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:41:48 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:41:48.523433 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-3975a0b4-bc51-4e1c-832c-be01b6bc357f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:48.524046 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-3975a0b4-bc51-4e1c-832c-be01b6bc357f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:48.530460 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3975a0b4-bc51-4e1c-832c-be01b6bc357f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:48.531562 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3975a0b4-bc51-4e1c-832c-be01b6bc357f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:48.532355 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3975a0b4-bc51-4e1c-832c-be01b6bc357f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:48.532781 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3975a0b4-bc51-4e1c-832c-be01b6bc357f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:48.592028 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-3975a0b4-bc51-4e1c-832c-be01b6bc357f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:48.600466 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-3975a0b4-bc51-4e1c-832c-be01b6bc357f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.080858 Jun 17 15:41:48.601289 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1150/2712] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:41:48 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:41:48.983230 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-04edab58-66a2-4fae-b404-f64a2af2c3ce tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:48.983841 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-04edab58-66a2-4fae-b404-f64a2af2c3ce tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:48.991248 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-04edab58-66a2-4fae-b404-f64a2af2c3ce tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:48.991695 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-04edab58-66a2-4fae-b404-f64a2af2c3ce tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:48.992490 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-04edab58-66a2-4fae-b404-f64a2af2c3ce tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:48.992919 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-04edab58-66a2-4fae-b404-f64a2af2c3ce tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:49.130831 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-04edab58-66a2-4fae-b404-f64a2af2c3ce tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:49.137745 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-04edab58-66a2-4fae-b404-f64a2af2c3ce tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.158256 Jun 17 15:41:49.138558 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1563/2713] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:41:48 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:41:49.524858 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-8f04b333-09e0-4298-b935-88077a3dc26a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:49.525470 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-8f04b333-09e0-4298-b935-88077a3dc26a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:49.532083 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8f04b333-09e0-4298-b935-88077a3dc26a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:49.532566 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8f04b333-09e0-4298-b935-88077a3dc26a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:49.533317 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8f04b333-09e0-4298-b935-88077a3dc26a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:49.533749 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8f04b333-09e0-4298-b935-88077a3dc26a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:49.596232 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-8f04b333-09e0-4298-b935-88077a3dc26a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:49.598437 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell1:SELECT=100 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:41:49.606109 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-8f04b333-09e0-4298-b935-88077a3dc26a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:49.607601 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-8f04b333-09e0-4298-b935-88077a3dc26a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:49.608745 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-8f04b333-09e0-4298-b935-88077a3dc26a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.087763 Jun 17 15:41:49.609305 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1151/2714] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:41:49 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:41:49.617853 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-d2d14ae3-61cb-487d-a8f3-78f5ebac05f8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:49.618556 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-d2d14ae3-61cb-487d-a8f3-78f5ebac05f8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:49.625853 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d2d14ae3-61cb-487d-a8f3-78f5ebac05f8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:49.626307 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d2d14ae3-61cb-487d-a8f3-78f5ebac05f8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:49.627114 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d2d14ae3-61cb-487d-a8f3-78f5ebac05f8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:49.627515 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d2d14ae3-61cb-487d-a8f3-78f5ebac05f8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:49.691472 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-d2d14ae3-61cb-487d-a8f3-78f5ebac05f8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:49.699451 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-d2d14ae3-61cb-487d-a8f3-78f5ebac05f8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.085483 Jun 17 15:41:49.700016 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1564/2715] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:41:49 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:41:50.155609 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-f79d0752-6ad3-462e-a20d-4f87587ab56a tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:50.156225 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-f79d0752-6ad3-462e-a20d-4f87587ab56a tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:50.158804 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_api:SELECT=82 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:41:50.164003 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f79d0752-6ad3-462e-a20d-4f87587ab56a tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:50.164490 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f79d0752-6ad3-462e-a20d-4f87587ab56a tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:50.165261 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f79d0752-6ad3-462e-a20d-4f87587ab56a tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:50.165700 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f79d0752-6ad3-462e-a20d-4f87587ab56a tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:50.294519 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-f79d0752-6ad3-462e-a20d-4f87587ab56a tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:50.303223 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-f79d0752-6ad3-462e-a20d-4f87587ab56a tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.151411 Jun 17 15:41:50.303789 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1152/2716] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:41:50 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:41:50.626788 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-e3918ac1-110a-45f1-a5fa-568551e92935 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:50.627401 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-e3918ac1-110a-45f1-a5fa-568551e92935 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:50.633826 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e3918ac1-110a-45f1-a5fa-568551e92935 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:50.634271 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e3918ac1-110a-45f1-a5fa-568551e92935 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:50.635015 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e3918ac1-110a-45f1-a5fa-568551e92935 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:50.635443 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e3918ac1-110a-45f1-a5fa-568551e92935 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:50.650891 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=100 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:41:50.697132 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-e3918ac1-110a-45f1-a5fa-568551e92935 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:50.705865 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-e3918ac1-110a-45f1-a5fa-568551e92935 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:50.707376 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-e3918ac1-110a-45f1-a5fa-568551e92935 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:50.708530 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-e3918ac1-110a-45f1-a5fa-568551e92935 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.085727 Jun 17 15:41:50.709078 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1565/2717] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:41:50 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:41:50.716262 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-d172d3d9-7494-4d7a-80b0-fe8c8cf2e9c6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:50.717032 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-d172d3d9-7494-4d7a-80b0-fe8c8cf2e9c6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:50.724133 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d172d3d9-7494-4d7a-80b0-fe8c8cf2e9c6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:50.724638 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d172d3d9-7494-4d7a-80b0-fe8c8cf2e9c6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:50.725428 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d172d3d9-7494-4d7a-80b0-fe8c8cf2e9c6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:50.726115 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d172d3d9-7494-4d7a-80b0-fe8c8cf2e9c6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:50.787527 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-d172d3d9-7494-4d7a-80b0-fe8c8cf2e9c6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:50.795462 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-d172d3d9-7494-4d7a-80b0-fe8c8cf2e9c6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.083003 Jun 17 15:41:50.796025 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1153/2718] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:41:50 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:41:51.320925 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-3aa2fdba-3172-405f-a2ca-7e9ce2f8f2d4 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:51.322007 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-3aa2fdba-3172-405f-a2ca-7e9ce2f8f2d4 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:51.328535 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3aa2fdba-3172-405f-a2ca-7e9ce2f8f2d4 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:51.328995 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3aa2fdba-3172-405f-a2ca-7e9ce2f8f2d4 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:51.329836 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3aa2fdba-3172-405f-a2ca-7e9ce2f8f2d4 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:51.330271 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3aa2fdba-3172-405f-a2ca-7e9ce2f8f2d4 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:51.457646 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-3aa2fdba-3172-405f-a2ca-7e9ce2f8f2d4 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:51.465536 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-3aa2fdba-3172-405f-a2ca-7e9ce2f8f2d4 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.148583 Jun 17 15:41:51.466104 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1566/2719] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:41:51 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:41:51.727619 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-663b0250-7511-469c-95f4-02739849d898 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:51.728243 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-663b0250-7511-469c-95f4-02739849d898 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:51.734572 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-663b0250-7511-469c-95f4-02739849d898 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:51.735024 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-663b0250-7511-469c-95f4-02739849d898 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:51.736495 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-663b0250-7511-469c-95f4-02739849d898 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:51.736938 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-663b0250-7511-469c-95f4-02739849d898 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:51.796258 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-663b0250-7511-469c-95f4-02739849d898 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:51.805928 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-663b0250-7511-469c-95f4-02739849d898 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:51.807443 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-663b0250-7511-469c-95f4-02739849d898 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:51.808618 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-663b0250-7511-469c-95f4-02739849d898 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.085590 Jun 17 15:41:51.809175 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1154/2720] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:41:51 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:41:51.812268 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-1b3c17a1-93ce-4f31-be59-b806256ac81a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:51.812910 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-1b3c17a1-93ce-4f31-be59-b806256ac81a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:51.819297 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1b3c17a1-93ce-4f31-be59-b806256ac81a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:51.819740 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1b3c17a1-93ce-4f31-be59-b806256ac81a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:51.820522 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1b3c17a1-93ce-4f31-be59-b806256ac81a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:51.820953 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1b3c17a1-93ce-4f31-be59-b806256ac81a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:51.884093 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-1b3c17a1-93ce-4f31-be59-b806256ac81a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:51.892479 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-1b3c17a1-93ce-4f31-be59-b806256ac81a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.083621 Jun 17 15:41:51.893044 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1567/2721] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:41:51 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:41:52.482586 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-85a37e08-ad5d-4931-9a1c-4d9d1c8a01eb tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:52.483066 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-85a37e08-ad5d-4931-9a1c-4d9d1c8a01eb tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:52.489129 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-85a37e08-ad5d-4931-9a1c-4d9d1c8a01eb tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:52.489574 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-85a37e08-ad5d-4931-9a1c-4d9d1c8a01eb tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:52.490326 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-85a37e08-ad5d-4931-9a1c-4d9d1c8a01eb tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:52.490758 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-85a37e08-ad5d-4931-9a1c-4d9d1c8a01eb tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:52.620218 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-85a37e08-ad5d-4931-9a1c-4d9d1c8a01eb tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:52.628673 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-85a37e08-ad5d-4931-9a1c-4d9d1c8a01eb tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.149968 Jun 17 15:41:52.629173 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1155/2722] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:41:52 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:41:52.826442 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-20c06806-7b07-4d72-a289-8cbaa38fe292 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:52.827085 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-20c06806-7b07-4d72-a289-8cbaa38fe292 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:52.833693 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-20c06806-7b07-4d72-a289-8cbaa38fe292 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:52.834138 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-20c06806-7b07-4d72-a289-8cbaa38fe292 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:52.834893 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-20c06806-7b07-4d72-a289-8cbaa38fe292 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:52.835324 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-20c06806-7b07-4d72-a289-8cbaa38fe292 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:52.896802 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-20c06806-7b07-4d72-a289-8cbaa38fe292 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:52.905286 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-20c06806-7b07-4d72-a289-8cbaa38fe292 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:52.906841 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-20c06806-7b07-4d72-a289-8cbaa38fe292 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:52.908040 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-20c06806-7b07-4d72-a289-8cbaa38fe292 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.085548 Jun 17 15:41:52.908622 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1568/2723] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:41:52 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:41:52.909400 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-f722fd24-3eb1-4e0a-ba48-28012b74408a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:52.910013 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-f722fd24-3eb1-4e0a-ba48-28012b74408a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:52.916504 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f722fd24-3eb1-4e0a-ba48-28012b74408a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:52.916955 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f722fd24-3eb1-4e0a-ba48-28012b74408a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:52.917717 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f722fd24-3eb1-4e0a-ba48-28012b74408a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:52.918155 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f722fd24-3eb1-4e0a-ba48-28012b74408a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:52.980550 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-f722fd24-3eb1-4e0a-ba48-28012b74408a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:52.988912 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-f722fd24-3eb1-4e0a-ba48-28012b74408a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.083555 Jun 17 15:41:52.989473 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1156/2724] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:41:52 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:41:53.645515 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-f8f5fb48-4e24-4b83-b935-59647d8dda34 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:53.646049 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-f8f5fb48-4e24-4b83-b935-59647d8dda34 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:53.652051 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f8f5fb48-4e24-4b83-b935-59647d8dda34 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:53.652531 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f8f5fb48-4e24-4b83-b935-59647d8dda34 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:53.653288 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f8f5fb48-4e24-4b83-b935-59647d8dda34 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:53.653716 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f8f5fb48-4e24-4b83-b935-59647d8dda34 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:53.783272 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-f8f5fb48-4e24-4b83-b935-59647d8dda34 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:53.791208 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-f8f5fb48-4e24-4b83-b935-59647d8dda34 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.150138 Jun 17 15:41:53.791777 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1569/2725] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:41:53 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:41:53.926054 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-53df060e-ae6b-4eeb-be83-61c3f2ed7453 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:53.926600 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-53df060e-ae6b-4eeb-be83-61c3f2ed7453 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:53.932983 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-53df060e-ae6b-4eeb-be83-61c3f2ed7453 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:53.933424 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-53df060e-ae6b-4eeb-be83-61c3f2ed7453 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:53.934171 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-53df060e-ae6b-4eeb-be83-61c3f2ed7453 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:53.934631 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-53df060e-ae6b-4eeb-be83-61c3f2ed7453 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:53.995875 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-53df060e-ae6b-4eeb-be83-61c3f2ed7453 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:54.004991 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-53df060e-ae6b-4eeb-be83-61c3f2ed7453 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:54.006475 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-53df060e-ae6b-4eeb-be83-61c3f2ed7453 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:54.007605 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-53df060e-ae6b-4eeb-be83-61c3f2ed7453 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.085578 Jun 17 15:41:54.008302 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1157/2726] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:41:53 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:41:54.125184 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-45e59fef-b4ad-456e-8ce8-afc62316e3d4 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:54.125809 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-45e59fef-b4ad-456e-8ce8-afc62316e3d4 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:54.132356 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-45e59fef-b4ad-456e-8ce8-afc62316e3d4 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:54.132821 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-45e59fef-b4ad-456e-8ce8-afc62316e3d4 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:54.133584 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-45e59fef-b4ad-456e-8ce8-afc62316e3d4 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:54.134020 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-45e59fef-b4ad-456e-8ce8-afc62316e3d4 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:54.194675 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-45e59fef-b4ad-456e-8ce8-afc62316e3d4 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:54.202559 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-45e59fef-b4ad-456e-8ce8-afc62316e3d4 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.200864 Jun 17 15:41:54.203118 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1570/2727] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:41:54 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:41:54.808180 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-b8395399-09ce-438b-acef-5f93fcbe4b3c tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:54.808814 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-b8395399-09ce-438b-acef-5f93fcbe4b3c tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:54.814868 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b8395399-09ce-438b-acef-5f93fcbe4b3c tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:54.815310 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b8395399-09ce-438b-acef-5f93fcbe4b3c tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:54.816049 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b8395399-09ce-438b-acef-5f93fcbe4b3c tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:54.816515 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b8395399-09ce-438b-acef-5f93fcbe4b3c tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:54.944778 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-b8395399-09ce-438b-acef-5f93fcbe4b3c tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:54.952599 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-b8395399-09ce-438b-acef-5f93fcbe4b3c tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.148209 Jun 17 15:41:54.953154 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1158/2728] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:41:54 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:41:55.026153 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-47423ec6-010b-45b8-8b16-747a4cee1979 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:55.026767 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-47423ec6-010b-45b8-8b16-747a4cee1979 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:55.034030 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-47423ec6-010b-45b8-8b16-747a4cee1979 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:55.034476 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-47423ec6-010b-45b8-8b16-747a4cee1979 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:55.035235 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-47423ec6-010b-45b8-8b16-747a4cee1979 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:55.035668 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-47423ec6-010b-45b8-8b16-747a4cee1979 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:55.101768 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-47423ec6-010b-45b8-8b16-747a4cee1979 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:55.111455 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-47423ec6-010b-45b8-8b16-747a4cee1979 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:55.113011 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-47423ec6-010b-45b8-8b16-747a4cee1979 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:55.114161 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-47423ec6-010b-45b8-8b16-747a4cee1979 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.091928 Jun 17 15:41:55.114712 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1571/2729] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:41:55 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:41:55.218922 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-5f0072d1-9e36-45de-828f-ec1ad4c0a677 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:55.219524 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-5f0072d1-9e36-45de-828f-ec1ad4c0a677 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:55.226475 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5f0072d1-9e36-45de-828f-ec1ad4c0a677 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:55.226914 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5f0072d1-9e36-45de-828f-ec1ad4c0a677 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:55.227661 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5f0072d1-9e36-45de-828f-ec1ad4c0a677 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:55.228088 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5f0072d1-9e36-45de-828f-ec1ad4c0a677 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:55.287372 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-5f0072d1-9e36-45de-828f-ec1ad4c0a677 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:55.295175 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-5f0072d1-9e36-45de-828f-ec1ad4c0a677 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.080166 Jun 17 15:41:55.295725 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1159/2730] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:41:55 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:41:55.969693 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-c789c3cc-9947-4a26-8a63-10c3f8ca9217 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:55.970317 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-c789c3cc-9947-4a26-8a63-10c3f8ca9217 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:55.976619 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c789c3cc-9947-4a26-8a63-10c3f8ca9217 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:55.977074 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c789c3cc-9947-4a26-8a63-10c3f8ca9217 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:55.977842 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c789c3cc-9947-4a26-8a63-10c3f8ca9217 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:55.978280 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c789c3cc-9947-4a26-8a63-10c3f8ca9217 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:56.105785 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-c789c3cc-9947-4a26-8a63-10c3f8ca9217 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:56.114435 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-c789c3cc-9947-4a26-8a63-10c3f8ca9217 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.148926 Jun 17 15:41:56.115001 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1572/2731] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:41:55 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:41:56.131386 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-fe1865ee-8128-4c75-a72b-0653607f9a7d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:56.132005 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-fe1865ee-8128-4c75-a72b-0653607f9a7d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:56.138555 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fe1865ee-8128-4c75-a72b-0653607f9a7d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:56.139009 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fe1865ee-8128-4c75-a72b-0653607f9a7d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:56.139767 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fe1865ee-8128-4c75-a72b-0653607f9a7d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:56.140210 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fe1865ee-8128-4c75-a72b-0653607f9a7d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:56.200946 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-fe1865ee-8128-4c75-a72b-0653607f9a7d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:56.209274 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-fe1865ee-8128-4c75-a72b-0653607f9a7d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:56.210777 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-fe1865ee-8128-4c75-a72b-0653607f9a7d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:56.211913 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-fe1865ee-8128-4c75-a72b-0653607f9a7d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.084461 Jun 17 15:41:56.212488 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1160/2732] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:41:56 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:41:56.311949 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-f3c0cd2f-848a-4b96-a683-e7f927c7f97f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:56.312521 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-f3c0cd2f-848a-4b96-a683-e7f927c7f97f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:56.318498 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f3c0cd2f-848a-4b96-a683-e7f927c7f97f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:56.318945 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f3c0cd2f-848a-4b96-a683-e7f927c7f97f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:56.319700 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f3c0cd2f-848a-4b96-a683-e7f927c7f97f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:56.320161 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f3c0cd2f-848a-4b96-a683-e7f927c7f97f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:56.381591 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-f3c0cd2f-848a-4b96-a683-e7f927c7f97f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:56.389519 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-f3c0cd2f-848a-4b96-a683-e7f927c7f97f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.081597 Jun 17 15:41:56.390087 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1573/2733] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:41:56 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:41:57.130619 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-497c2bab-c30b-41f9-b877-39730fad65f9 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:57.131264 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-497c2bab-c30b-41f9-b877-39730fad65f9 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:57.137768 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-497c2bab-c30b-41f9-b877-39730fad65f9 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:57.138353 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-497c2bab-c30b-41f9-b877-39730fad65f9 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:57.138966 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-497c2bab-c30b-41f9-b877-39730fad65f9 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:57.139405 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-497c2bab-c30b-41f9-b877-39730fad65f9 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:57.230500 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-77124c5e-f62e-49f6-86b0-b092c4c3fbd3 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:57.231193 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-77124c5e-f62e-49f6-86b0-b092c4c3fbd3 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:57.238631 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-77124c5e-f62e-49f6-86b0-b092c4c3fbd3 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:57.239164 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-77124c5e-f62e-49f6-86b0-b092c4c3fbd3 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:57.239986 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-77124c5e-f62e-49f6-86b0-b092c4c3fbd3 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:57.240458 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-77124c5e-f62e-49f6-86b0-b092c4c3fbd3 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:57.273139 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-497c2bab-c30b-41f9-b877-39730fad65f9 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:57.281158 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-497c2bab-c30b-41f9-b877-39730fad65f9 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.154402 Jun 17 15:41:57.281721 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1161/2734] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:41:57 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:41:57.305811 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-77124c5e-f62e-49f6-86b0-b092c4c3fbd3 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:57.315098 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-77124c5e-f62e-49f6-86b0-b092c4c3fbd3 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:57.316644 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-77124c5e-f62e-49f6-86b0-b092c4c3fbd3 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:57.317757 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-77124c5e-f62e-49f6-86b0-b092c4c3fbd3 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.091139 Jun 17 15:41:57.318317 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1574/2735] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:41:57 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 15:41:57.407159 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-bfbc6a96-96c8-47b1-824a-3769f1041fa5 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:57.407710 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-bfbc6a96-96c8-47b1-824a-3769f1041fa5 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:57.414127 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bfbc6a96-96c8-47b1-824a-3769f1041fa5 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:57.414583 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bfbc6a96-96c8-47b1-824a-3769f1041fa5 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:57.415398 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bfbc6a96-96c8-47b1-824a-3769f1041fa5 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:57.415873 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bfbc6a96-96c8-47b1-824a-3769f1041fa5 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:57.478690 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-bfbc6a96-96c8-47b1-824a-3769f1041fa5 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:57.487644 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-bfbc6a96-96c8-47b1-824a-3769f1041fa5 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.084542 Jun 17 15:41:57.488217 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1162/2736] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:41:57 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:41:58.297781 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-eb485e46-c3f8-4735-9c91-4acd9bd8572e tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:58.298541 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-eb485e46-c3f8-4735-9c91-4acd9bd8572e tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:58.305296 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-eb485e46-c3f8-4735-9c91-4acd9bd8572e tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:58.305737 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-eb485e46-c3f8-4735-9c91-4acd9bd8572e tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:58.306488 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-eb485e46-c3f8-4735-9c91-4acd9bd8572e tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:58.306915 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-eb485e46-c3f8-4735-9c91-4acd9bd8572e tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:58.336172 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-7da7bf7c-2ba9-48e7-a212-0ae19613f288 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:58.336820 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-7da7bf7c-2ba9-48e7-a212-0ae19613f288 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:58.343378 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7da7bf7c-2ba9-48e7-a212-0ae19613f288 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:58.343825 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7da7bf7c-2ba9-48e7-a212-0ae19613f288 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:58.344619 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7da7bf7c-2ba9-48e7-a212-0ae19613f288 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:58.345056 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7da7bf7c-2ba9-48e7-a212-0ae19613f288 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:58.408914 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-7da7bf7c-2ba9-48e7-a212-0ae19613f288 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:58.417551 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-7da7bf7c-2ba9-48e7-a212-0ae19613f288 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:58.419084 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-7da7bf7c-2ba9-48e7-a212-0ae19613f288 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:58.420229 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-7da7bf7c-2ba9-48e7-a212-0ae19613f288 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.087908 Jun 17 15:41:58.420893 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1163/2737] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:41:58 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 15:41:58.442512 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-eb485e46-c3f8-4735-9c91-4acd9bd8572e tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:58.450494 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-eb485e46-c3f8-4735-9c91-4acd9bd8572e tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.156636 Jun 17 15:41:58.451068 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1575/2738] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:41:58 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:41:58.505284 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-8518a010-ba7e-42a1-a25b-88838c93f68a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:58.505901 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-8518a010-ba7e-42a1-a25b-88838c93f68a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:58.512232 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8518a010-ba7e-42a1-a25b-88838c93f68a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:58.512715 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8518a010-ba7e-42a1-a25b-88838c93f68a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:58.513477 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8518a010-ba7e-42a1-a25b-88838c93f68a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:58.513915 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8518a010-ba7e-42a1-a25b-88838c93f68a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:58.580928 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-8518a010-ba7e-42a1-a25b-88838c93f68a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:58.589236 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-8518a010-ba7e-42a1-a25b-88838c93f68a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.088382 Jun 17 15:41:58.589776 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1164/2739] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:41:58 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:41:59.441093 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-4e55f08c-8ee1-45f8-b5ec-86d7bbbe1c1f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:59.441702 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-4e55f08c-8ee1-45f8-b5ec-86d7bbbe1c1f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:59.448298 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4e55f08c-8ee1-45f8-b5ec-86d7bbbe1c1f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:59.448777 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4e55f08c-8ee1-45f8-b5ec-86d7bbbe1c1f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:59.449533 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4e55f08c-8ee1-45f8-b5ec-86d7bbbe1c1f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:59.449994 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4e55f08c-8ee1-45f8-b5ec-86d7bbbe1c1f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:59.468204 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-76e6c72a-cd74-4ac7-a781-67bb7878934b tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:59.468915 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-76e6c72a-cd74-4ac7-a781-67bb7878934b tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:59.476181 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-76e6c72a-cd74-4ac7-a781-67bb7878934b tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:59.476668 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-76e6c72a-cd74-4ac7-a781-67bb7878934b tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:59.477424 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-76e6c72a-cd74-4ac7-a781-67bb7878934b tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:59.477857 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-76e6c72a-cd74-4ac7-a781-67bb7878934b tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:59.513995 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-4e55f08c-8ee1-45f8-b5ec-86d7bbbe1c1f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:59.523851 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-4e55f08c-8ee1-45f8-b5ec-86d7bbbe1c1f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:59.525416 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-4e55f08c-8ee1-45f8-b5ec-86d7bbbe1c1f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:59.526612 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-4e55f08c-8ee1-45f8-b5ec-86d7bbbe1c1f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.089416 Jun 17 15:41:59.527254 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1576/2740] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:41:59 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:41:59.607863 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-c3e723dd-3eca-4e5d-bda6-9f89b28b81df tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:41:59.608519 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-c3e723dd-3eca-4e5d-bda6-9f89b28b81df tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:41:59.615154 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c3e723dd-3eca-4e5d-bda6-9f89b28b81df tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:59.615634 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c3e723dd-3eca-4e5d-bda6-9f89b28b81df tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:59.616380 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c3e723dd-3eca-4e5d-bda6-9f89b28b81df tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:41:59.616819 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c3e723dd-3eca-4e5d-bda6-9f89b28b81df tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:41:59.618082 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-76e6c72a-cd74-4ac7-a781-67bb7878934b tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:59.626472 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-76e6c72a-cd74-4ac7-a781-67bb7878934b tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.162034 Jun 17 15:41:59.627050 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1165/2741] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:41:59 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:41:59.682857 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-c3e723dd-3eca-4e5d-bda6-9f89b28b81df tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:41:59.690769 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-c3e723dd-3eca-4e5d-bda6-9f89b28b81df tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.086895 Jun 17 15:41:59.691365 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1577/2742] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:41:59 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:42:00.545669 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-ff4bfbf1-71b9-4cdb-8c4f-11c2c341c258 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:00.546274 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-ff4bfbf1-71b9-4cdb-8c4f-11c2c341c258 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:00.553552 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ff4bfbf1-71b9-4cdb-8c4f-11c2c341c258 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:00.553994 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ff4bfbf1-71b9-4cdb-8c4f-11c2c341c258 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:00.554741 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ff4bfbf1-71b9-4cdb-8c4f-11c2c341c258 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:00.555170 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ff4bfbf1-71b9-4cdb-8c4f-11c2c341c258 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:00.615450 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-ff4bfbf1-71b9-4cdb-8c4f-11c2c341c258 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:00.623889 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-ff4bfbf1-71b9-4cdb-8c4f-11c2c341c258 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:00.625407 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-ff4bfbf1-71b9-4cdb-8c4f-11c2c341c258 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:00.626527 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-ff4bfbf1-71b9-4cdb-8c4f-11c2c341c258 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.084781 Jun 17 15:42:00.627078 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1166/2743] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:42:00 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:42:00.642860 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-4c3a412b-c87f-4c8c-a998-f168778b073d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:00.643408 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-4c3a412b-c87f-4c8c-a998-f168778b073d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:00.650149 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4c3a412b-c87f-4c8c-a998-f168778b073d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:00.650598 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4c3a412b-c87f-4c8c-a998-f168778b073d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:00.651352 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4c3a412b-c87f-4c8c-a998-f168778b073d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:00.651783 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4c3a412b-c87f-4c8c-a998-f168778b073d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:00.706988 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-59238f54-8e32-4de0-a3dc-2fb1fc91ddd1 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:00.707597 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-59238f54-8e32-4de0-a3dc-2fb1fc91ddd1 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:00.713686 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-59238f54-8e32-4de0-a3dc-2fb1fc91ddd1 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:00.714129 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-59238f54-8e32-4de0-a3dc-2fb1fc91ddd1 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:00.714872 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-59238f54-8e32-4de0-a3dc-2fb1fc91ddd1 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:00.715298 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-59238f54-8e32-4de0-a3dc-2fb1fc91ddd1 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:00.779169 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-59238f54-8e32-4de0-a3dc-2fb1fc91ddd1 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:00.785951 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-4c3a412b-c87f-4c8c-a998-f168778b073d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:00.787676 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-59238f54-8e32-4de0-a3dc-2fb1fc91ddd1 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.084503 Jun 17 15:42:00.788250 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1167/2744] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:42:00 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:42:00.793876 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-4c3a412b-c87f-4c8c-a998-f168778b073d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.154859 Jun 17 15:42:00.794446 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1578/2745] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:42:00 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:42:01.643762 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-390eb4fc-1e95-48f1-86a5-cdf913614056 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:01.644298 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-390eb4fc-1e95-48f1-86a5-cdf913614056 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:01.650767 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-390eb4fc-1e95-48f1-86a5-cdf913614056 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:01.651215 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-390eb4fc-1e95-48f1-86a5-cdf913614056 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:01.651965 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-390eb4fc-1e95-48f1-86a5-cdf913614056 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:01.652429 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-390eb4fc-1e95-48f1-86a5-cdf913614056 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:01.667076 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell1:SELECT=100 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:42:01.716571 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-390eb4fc-1e95-48f1-86a5-cdf913614056 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:01.726876 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-390eb4fc-1e95-48f1-86a5-cdf913614056 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:01.728389 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-390eb4fc-1e95-48f1-86a5-cdf913614056 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:01.729530 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-390eb4fc-1e95-48f1-86a5-cdf913614056 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.089794 Jun 17 15:42:01.730082 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1168/2746] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:42:01 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 15:42:01.804814 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-c95213e8-fd5d-4737-bedd-4b2b2644498d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:01.805449 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-c95213e8-fd5d-4737-bedd-4b2b2644498d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:01.810751 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-87f8ec8d-5e75-443d-af7d-f619058f31a4 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:01.811399 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-87f8ec8d-5e75-443d-af7d-f619058f31a4 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:01.812197 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c95213e8-fd5d-4737-bedd-4b2b2644498d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:01.812677 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c95213e8-fd5d-4737-bedd-4b2b2644498d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:01.813439 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c95213e8-fd5d-4737-bedd-4b2b2644498d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:01.813865 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c95213e8-fd5d-4737-bedd-4b2b2644498d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:01.818040 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-87f8ec8d-5e75-443d-af7d-f619058f31a4 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:01.818492 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-87f8ec8d-5e75-443d-af7d-f619058f31a4 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:01.819247 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-87f8ec8d-5e75-443d-af7d-f619058f31a4 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:01.819682 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-87f8ec8d-5e75-443d-af7d-f619058f31a4 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:01.875060 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-c95213e8-fd5d-4737-bedd-4b2b2644498d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:01.883563 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-c95213e8-fd5d-4737-bedd-4b2b2644498d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.083134 Jun 17 15:42:01.884293 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1579/2747] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:42:01 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:42:01.954798 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-87f8ec8d-5e75-443d-af7d-f619058f31a4 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:01.963521 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-87f8ec8d-5e75-443d-af7d-f619058f31a4 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.156549 Jun 17 15:42:01.964087 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1169/2748] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:42:01 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:42:02.747192 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-b0eebc3c-2110-412e-95db-9a68df10dd7f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:02.747698 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-b0eebc3c-2110-412e-95db-9a68df10dd7f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:02.754081 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b0eebc3c-2110-412e-95db-9a68df10dd7f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:02.754529 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b0eebc3c-2110-412e-95db-9a68df10dd7f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:02.755286 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b0eebc3c-2110-412e-95db-9a68df10dd7f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:02.755720 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b0eebc3c-2110-412e-95db-9a68df10dd7f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:02.817274 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-b0eebc3c-2110-412e-95db-9a68df10dd7f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:02.825620 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-b0eebc3c-2110-412e-95db-9a68df10dd7f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:02.827117 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-b0eebc3c-2110-412e-95db-9a68df10dd7f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:02.828253 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-b0eebc3c-2110-412e-95db-9a68df10dd7f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.085122 Jun 17 15:42:02.828855 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1580/2749] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:42:02 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:42:02.899764 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-6ce03cb5-9581-43da-b6c9-545c27ffec80 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:02.900429 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-6ce03cb5-9581-43da-b6c9-545c27ffec80 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:02.906738 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6ce03cb5-9581-43da-b6c9-545c27ffec80 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:02.907195 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6ce03cb5-9581-43da-b6c9-545c27ffec80 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:02.907957 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6ce03cb5-9581-43da-b6c9-545c27ffec80 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:02.908430 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6ce03cb5-9581-43da-b6c9-545c27ffec80 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:02.969049 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-6ce03cb5-9581-43da-b6c9-545c27ffec80 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:02.977991 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-6ce03cb5-9581-43da-b6c9-545c27ffec80 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.082119 Jun 17 15:42:02.978556 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1170/2750] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:42:02 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:42:02.981134 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-e02c031d-c027-4581-ab38-73c7c366b771 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:02.981748 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-e02c031d-c027-4581-ab38-73c7c366b771 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:02.987770 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e02c031d-c027-4581-ab38-73c7c366b771 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:02.988890 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e02c031d-c027-4581-ab38-73c7c366b771 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:02.989654 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e02c031d-c027-4581-ab38-73c7c366b771 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:02.990096 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e02c031d-c027-4581-ab38-73c7c366b771 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:03.129783 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-e02c031d-c027-4581-ab38-73c7c366b771 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:03.137689 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-e02c031d-c027-4581-ab38-73c7c366b771 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.160384 Jun 17 15:42:03.138241 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1581/2751] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:42:02 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:42:03.846413 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-bd0c1286-2675-4a3a-a21a-15abc68ce7df tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:03.847051 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-bd0c1286-2675-4a3a-a21a-15abc68ce7df tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:03.853989 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bd0c1286-2675-4a3a-a21a-15abc68ce7df tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:03.854437 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bd0c1286-2675-4a3a-a21a-15abc68ce7df tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:03.855185 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bd0c1286-2675-4a3a-a21a-15abc68ce7df tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:03.855616 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bd0c1286-2675-4a3a-a21a-15abc68ce7df tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:03.918782 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-bd0c1286-2675-4a3a-a21a-15abc68ce7df tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:03.927219 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-bd0c1286-2675-4a3a-a21a-15abc68ce7df tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:03.928745 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-bd0c1286-2675-4a3a-a21a-15abc68ce7df tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:03.929882 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-bd0c1286-2675-4a3a-a21a-15abc68ce7df tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.087644 Jun 17 15:42:03.930505 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1171/2752] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:42:03 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:42:03.994939 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-14782f65-dd26-4544-8fc0-d5b73b0c9970 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:03.995483 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-14782f65-dd26-4544-8fc0-d5b73b0c9970 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:04.002279 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-14782f65-dd26-4544-8fc0-d5b73b0c9970 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:04.002739 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-14782f65-dd26-4544-8fc0-d5b73b0c9970 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:04.003501 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-14782f65-dd26-4544-8fc0-d5b73b0c9970 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:04.003941 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-14782f65-dd26-4544-8fc0-d5b73b0c9970 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:04.006628 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=100 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:42:04.068900 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-14782f65-dd26-4544-8fc0-d5b73b0c9970 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:04.077454 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-14782f65-dd26-4544-8fc0-d5b73b0c9970 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.086488 Jun 17 15:42:04.078023 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1582/2753] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:42:03 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:42:04.155082 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-a0ec2eb9-b94d-4dad-9df6-15d52fce9f88 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:04.155693 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-a0ec2eb9-b94d-4dad-9df6-15d52fce9f88 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:04.162421 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a0ec2eb9-b94d-4dad-9df6-15d52fce9f88 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:04.162870 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a0ec2eb9-b94d-4dad-9df6-15d52fce9f88 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:04.163622 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a0ec2eb9-b94d-4dad-9df6-15d52fce9f88 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:04.164053 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a0ec2eb9-b94d-4dad-9df6-15d52fce9f88 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:04.516464 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-a0ec2eb9-b94d-4dad-9df6-15d52fce9f88 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:04.525137 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-a0ec2eb9-b94d-4dad-9df6-15d52fce9f88 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.373932 Jun 17 15:42:04.525744 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1172/2754] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:42:04 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:42:04.948785 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-3ba7cb5b-8174-481b-8b4c-508cd5e709a5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:04.949395 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-3ba7cb5b-8174-481b-8b4c-508cd5e709a5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:04.955623 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3ba7cb5b-8174-481b-8b4c-508cd5e709a5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:04.956070 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3ba7cb5b-8174-481b-8b4c-508cd5e709a5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:04.956867 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3ba7cb5b-8174-481b-8b4c-508cd5e709a5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:04.957296 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3ba7cb5b-8174-481b-8b4c-508cd5e709a5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:05.019308 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-3ba7cb5b-8174-481b-8b4c-508cd5e709a5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:05.027803 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-3ba7cb5b-8174-481b-8b4c-508cd5e709a5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:05.029328 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-3ba7cb5b-8174-481b-8b4c-508cd5e709a5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:05.030459 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-3ba7cb5b-8174-481b-8b4c-508cd5e709a5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.085860 Jun 17 15:42:05.031021 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1583/2755] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:42:04 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:42:05.096798 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-96171a12-9cc1-46d6-881a-02b5424ec5cc tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:05.097945 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-96171a12-9cc1-46d6-881a-02b5424ec5cc tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:05.104841 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-96171a12-9cc1-46d6-881a-02b5424ec5cc tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:05.105288 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-96171a12-9cc1-46d6-881a-02b5424ec5cc tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:05.106109 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-96171a12-9cc1-46d6-881a-02b5424ec5cc tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:05.106491 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-96171a12-9cc1-46d6-881a-02b5424ec5cc tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:05.170606 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-96171a12-9cc1-46d6-881a-02b5424ec5cc tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:05.179194 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-96171a12-9cc1-46d6-881a-02b5424ec5cc tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.086939 Jun 17 15:42:05.179757 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1173/2756] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:42:05 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:42:05.542613 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-4cbb1aa2-c05b-4b64-aa4b-2b1ff8763721 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:05.543225 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-4cbb1aa2-c05b-4b64-aa4b-2b1ff8763721 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:05.549495 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4cbb1aa2-c05b-4b64-aa4b-2b1ff8763721 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:05.549939 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4cbb1aa2-c05b-4b64-aa4b-2b1ff8763721 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:05.550839 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4cbb1aa2-c05b-4b64-aa4b-2b1ff8763721 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:05.551273 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4cbb1aa2-c05b-4b64-aa4b-2b1ff8763721 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:05.680959 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-4cbb1aa2-c05b-4b64-aa4b-2b1ff8763721 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:05.688790 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-4cbb1aa2-c05b-4b64-aa4b-2b1ff8763721 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.150104 Jun 17 15:42:05.689338 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1584/2757] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:42:05 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:42:06.049344 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-cea70f41-5496-4511-b4ea-b0bd46c64736 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:06.049873 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-cea70f41-5496-4511-b4ea-b0bd46c64736 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:06.056109 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cea70f41-5496-4511-b4ea-b0bd46c64736 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:06.056591 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cea70f41-5496-4511-b4ea-b0bd46c64736 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:06.057352 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cea70f41-5496-4511-b4ea-b0bd46c64736 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:06.057786 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cea70f41-5496-4511-b4ea-b0bd46c64736 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:06.119858 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-cea70f41-5496-4511-b4ea-b0bd46c64736 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:06.129187 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-cea70f41-5496-4511-b4ea-b0bd46c64736 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:06.130685 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-cea70f41-5496-4511-b4ea-b0bd46c64736 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:06.131817 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-cea70f41-5496-4511-b4ea-b0bd46c64736 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.086653 Jun 17 15:42:06.132390 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1174/2758] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:42:06 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:42:06.196320 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-e12086fe-7b7a-48c9-9ab2-27fd5a24d736 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:06.196942 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-e12086fe-7b7a-48c9-9ab2-27fd5a24d736 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:06.203461 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e12086fe-7b7a-48c9-9ab2-27fd5a24d736 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:06.203909 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e12086fe-7b7a-48c9-9ab2-27fd5a24d736 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:06.204686 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e12086fe-7b7a-48c9-9ab2-27fd5a24d736 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:06.205113 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e12086fe-7b7a-48c9-9ab2-27fd5a24d736 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:06.266874 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-e12086fe-7b7a-48c9-9ab2-27fd5a24d736 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:06.274896 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-e12086fe-7b7a-48c9-9ab2-27fd5a24d736 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.082410 Jun 17 15:42:06.275470 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1585/2759] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:42:06 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:42:06.706405 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-d0a6b9cf-5be7-4fc7-a9e9-c2077c13a5f8 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:06.706910 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-d0a6b9cf-5be7-4fc7-a9e9-c2077c13a5f8 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:06.713630 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d0a6b9cf-5be7-4fc7-a9e9-c2077c13a5f8 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:06.714069 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d0a6b9cf-5be7-4fc7-a9e9-c2077c13a5f8 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:06.714809 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d0a6b9cf-5be7-4fc7-a9e9-c2077c13a5f8 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:06.715233 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d0a6b9cf-5be7-4fc7-a9e9-c2077c13a5f8 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:06.845445 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-d0a6b9cf-5be7-4fc7-a9e9-c2077c13a5f8 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:06.853649 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-d0a6b9cf-5be7-4fc7-a9e9-c2077c13a5f8 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.151152 Jun 17 15:42:06.854252 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1175/2760] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:42:06 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:42:07.149997 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-09d2833d-f6d7-428c-8af4-c4eecbe542e3 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:07.150615 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-09d2833d-f6d7-428c-8af4-c4eecbe542e3 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:07.156787 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-09d2833d-f6d7-428c-8af4-c4eecbe542e3 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:07.157234 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-09d2833d-f6d7-428c-8af4-c4eecbe542e3 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:07.157995 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-09d2833d-f6d7-428c-8af4-c4eecbe542e3 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:07.158427 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-09d2833d-f6d7-428c-8af4-c4eecbe542e3 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:07.218674 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-09d2833d-f6d7-428c-8af4-c4eecbe542e3 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:07.227982 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-09d2833d-f6d7-428c-8af4-c4eecbe542e3 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:07.229522 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-09d2833d-f6d7-428c-8af4-c4eecbe542e3 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:07.230643 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-09d2833d-f6d7-428c-8af4-c4eecbe542e3 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.084684 Jun 17 15:42:07.231198 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1586/2761] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:42:07 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:42:07.293308 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-8c5a1636-ef42-4743-a1d1-bbcbc6490fd6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:07.294014 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-8c5a1636-ef42-4743-a1d1-bbcbc6490fd6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:07.301042 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8c5a1636-ef42-4743-a1d1-bbcbc6490fd6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:07.301042 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8c5a1636-ef42-4743-a1d1-bbcbc6490fd6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:07.301777 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8c5a1636-ef42-4743-a1d1-bbcbc6490fd6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:07.302209 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8c5a1636-ef42-4743-a1d1-bbcbc6490fd6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:07.363857 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-8c5a1636-ef42-4743-a1d1-bbcbc6490fd6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:07.372830 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-8c5a1636-ef42-4743-a1d1-bbcbc6490fd6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.083373 Jun 17 15:42:07.373398 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1176/2762] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:42:07 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:42:07.871366 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-7186d580-6a78-4b41-844b-0f0539bdbf97 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:07.872049 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-7186d580-6a78-4b41-844b-0f0539bdbf97 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:07.878480 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7186d580-6a78-4b41-844b-0f0539bdbf97 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:07.878960 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7186d580-6a78-4b41-844b-0f0539bdbf97 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:07.879762 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7186d580-6a78-4b41-844b-0f0539bdbf97 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:07.880188 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7186d580-6a78-4b41-844b-0f0539bdbf97 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:08.022711 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-7186d580-6a78-4b41-844b-0f0539bdbf97 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:08.035197 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-7186d580-6a78-4b41-844b-0f0539bdbf97 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.167961 Jun 17 15:42:08.035886 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1587/2763] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:42:07 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:42:08.249303 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-e3e37e6c-289d-4dda-be1f-221cb50ba788 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:08.249830 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-e3e37e6c-289d-4dda-be1f-221cb50ba788 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:08.255944 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e3e37e6c-289d-4dda-be1f-221cb50ba788 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:08.256917 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e3e37e6c-289d-4dda-be1f-221cb50ba788 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:08.257669 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e3e37e6c-289d-4dda-be1f-221cb50ba788 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:08.258100 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e3e37e6c-289d-4dda-be1f-221cb50ba788 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:08.318257 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-e3e37e6c-289d-4dda-be1f-221cb50ba788 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:08.327840 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-e3e37e6c-289d-4dda-be1f-221cb50ba788 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:08.329381 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-e3e37e6c-289d-4dda-be1f-221cb50ba788 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:08.330506 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-e3e37e6c-289d-4dda-be1f-221cb50ba788 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.085205 Jun 17 15:42:08.331068 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1177/2764] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:42:08 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:42:08.389637 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-d0a5ef56-add5-4f10-aa6b-67c5e9ae39c1 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:08.390338 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-d0a5ef56-add5-4f10-aa6b-67c5e9ae39c1 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:08.397367 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d0a5ef56-add5-4f10-aa6b-67c5e9ae39c1 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:08.397809 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d0a5ef56-add5-4f10-aa6b-67c5e9ae39c1 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:08.398557 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d0a5ef56-add5-4f10-aa6b-67c5e9ae39c1 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:08.398984 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d0a5ef56-add5-4f10-aa6b-67c5e9ae39c1 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:08.459225 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-d0a5ef56-add5-4f10-aa6b-67c5e9ae39c1 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:08.467187 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-d0a5ef56-add5-4f10-aa6b-67c5e9ae39c1 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.081747 Jun 17 15:42:08.467741 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1588/2765] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:42:08 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:42:09.052913 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-a2a06583-9a02-4f63-b908-a74f2b9295f0 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:09.053572 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-a2a06583-9a02-4f63-b908-a74f2b9295f0 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:09.059750 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a2a06583-9a02-4f63-b908-a74f2b9295f0 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:09.060196 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a2a06583-9a02-4f63-b908-a74f2b9295f0 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:09.060987 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a2a06583-9a02-4f63-b908-a74f2b9295f0 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:09.061423 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a2a06583-9a02-4f63-b908-a74f2b9295f0 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:09.199592 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-a2a06583-9a02-4f63-b908-a74f2b9295f0 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:09.207567 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-a2a06583-9a02-4f63-b908-a74f2b9295f0 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.158635 Jun 17 15:42:09.208128 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1178/2766] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:42:09 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:42:09.348524 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-2b7e4afa-22d5-4040-9720-914251526ae4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:09.349133 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-2b7e4afa-22d5-4040-9720-914251526ae4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:09.355901 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2b7e4afa-22d5-4040-9720-914251526ae4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:09.356374 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2b7e4afa-22d5-4040-9720-914251526ae4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:09.357145 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2b7e4afa-22d5-4040-9720-914251526ae4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:09.357576 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2b7e4afa-22d5-4040-9720-914251526ae4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:09.419586 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-2b7e4afa-22d5-4040-9720-914251526ae4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:09.427994 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-2b7e4afa-22d5-4040-9720-914251526ae4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:09.430188 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-2b7e4afa-22d5-4040-9720-914251526ae4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:09.431315 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-2b7e4afa-22d5-4040-9720-914251526ae4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.086801 Jun 17 15:42:09.431871 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1589/2767] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:42:09 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:42:09.484139 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-444d5e38-90f4-4661-9980-b358909dcbf1 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:09.484772 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-444d5e38-90f4-4661-9980-b358909dcbf1 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:09.491168 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-444d5e38-90f4-4661-9980-b358909dcbf1 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:09.492313 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-444d5e38-90f4-4661-9980-b358909dcbf1 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:09.493089 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-444d5e38-90f4-4661-9980-b358909dcbf1 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:09.493517 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-444d5e38-90f4-4661-9980-b358909dcbf1 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:09.552097 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-444d5e38-90f4-4661-9980-b358909dcbf1 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:09.560659 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-444d5e38-90f4-4661-9980-b358909dcbf1 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.080311 Jun 17 15:42:09.561214 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1179/2768] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:42:09 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:42:10.223622 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-8f00589a-63e1-4ba1-9b39-0a6304a5b145 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:10.224233 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-8f00589a-63e1-4ba1-9b39-0a6304a5b145 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:10.230741 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8f00589a-63e1-4ba1-9b39-0a6304a5b145 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:10.231224 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8f00589a-63e1-4ba1-9b39-0a6304a5b145 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:10.232234 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8f00589a-63e1-4ba1-9b39-0a6304a5b145 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:10.232736 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8f00589a-63e1-4ba1-9b39-0a6304a5b145 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:10.362141 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-8f00589a-63e1-4ba1-9b39-0a6304a5b145 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:10.370762 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-8f00589a-63e1-4ba1-9b39-0a6304a5b145 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.151055 Jun 17 15:42:10.371323 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1590/2769] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:42:10 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:42:10.449093 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-a5decc14-e276-4c96-bee3-13eca90a49c8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:10.449729 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-a5decc14-e276-4c96-bee3-13eca90a49c8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:10.455652 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a5decc14-e276-4c96-bee3-13eca90a49c8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:10.456104 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a5decc14-e276-4c96-bee3-13eca90a49c8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:10.456888 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a5decc14-e276-4c96-bee3-13eca90a49c8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:10.457333 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a5decc14-e276-4c96-bee3-13eca90a49c8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:10.517921 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-a5decc14-e276-4c96-bee3-13eca90a49c8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:10.526776 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-a5decc14-e276-4c96-bee3-13eca90a49c8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:10.528275 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-a5decc14-e276-4c96-bee3-13eca90a49c8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:10.529443 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-a5decc14-e276-4c96-bee3-13eca90a49c8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.084271 Jun 17 15:42:10.529991 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1180/2770] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:42:10 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:42:10.577377 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-565713cc-a28d-4c84-aa4b-e8de5df17f84 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:10.577993 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-565713cc-a28d-4c84-aa4b-e8de5df17f84 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:10.584445 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-565713cc-a28d-4c84-aa4b-e8de5df17f84 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:10.584893 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-565713cc-a28d-4c84-aa4b-e8de5df17f84 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:10.586199 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-565713cc-a28d-4c84-aa4b-e8de5df17f84 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:10.586627 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-565713cc-a28d-4c84-aa4b-e8de5df17f84 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:10.646243 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-565713cc-a28d-4c84-aa4b-e8de5df17f84 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:10.654724 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-565713cc-a28d-4c84-aa4b-e8de5df17f84 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.081205 Jun 17 15:42:10.655278 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1591/2771] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:42:10 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:42:11.387609 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-9085dc7b-f215-49ad-af0d-0e0f9927755e tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:11.388222 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-9085dc7b-f215-49ad-af0d-0e0f9927755e tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:11.394311 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9085dc7b-f215-49ad-af0d-0e0f9927755e tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:11.394756 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9085dc7b-f215-49ad-af0d-0e0f9927755e tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:11.395506 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9085dc7b-f215-49ad-af0d-0e0f9927755e tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:11.395939 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9085dc7b-f215-49ad-af0d-0e0f9927755e tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:11.523443 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-9085dc7b-f215-49ad-af0d-0e0f9927755e tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:11.531350 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-9085dc7b-f215-49ad-af0d-0e0f9927755e tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.147631 Jun 17 15:42:11.531911 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1181/2772] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:42:11 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:42:11.547957 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-bbaf80d2-12b5-42b9-b783-1e434d8ba02b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:11.548592 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-bbaf80d2-12b5-42b9-b783-1e434d8ba02b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:11.555272 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bbaf80d2-12b5-42b9-b783-1e434d8ba02b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:11.555721 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bbaf80d2-12b5-42b9-b783-1e434d8ba02b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:11.556537 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bbaf80d2-12b5-42b9-b783-1e434d8ba02b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:11.556970 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bbaf80d2-12b5-42b9-b783-1e434d8ba02b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:11.618463 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-bbaf80d2-12b5-42b9-b783-1e434d8ba02b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:11.626863 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-bbaf80d2-12b5-42b9-b783-1e434d8ba02b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:11.628432 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-bbaf80d2-12b5-42b9-b783-1e434d8ba02b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:11.629515 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-bbaf80d2-12b5-42b9-b783-1e434d8ba02b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.085450 Jun 17 15:42:11.630068 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1592/2773] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:42:11 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:42:11.671950 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-11c9ed83-7a9f-4fac-8685-0dfe9ce5e36e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:11.672612 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-11c9ed83-7a9f-4fac-8685-0dfe9ce5e36e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:11.678650 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-11c9ed83-7a9f-4fac-8685-0dfe9ce5e36e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:11.679727 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-11c9ed83-7a9f-4fac-8685-0dfe9ce5e36e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:11.680505 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-11c9ed83-7a9f-4fac-8685-0dfe9ce5e36e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:11.680936 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-11c9ed83-7a9f-4fac-8685-0dfe9ce5e36e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:11.740126 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-11c9ed83-7a9f-4fac-8685-0dfe9ce5e36e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:11.748687 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-11c9ed83-7a9f-4fac-8685-0dfe9ce5e36e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.080486 Jun 17 15:42:11.749259 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1182/2774] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:42:11 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:42:12.548540 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-1b740714-7fad-4720-aa82-c64b8963a90a tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:12.549157 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-1b740714-7fad-4720-aa82-c64b8963a90a tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:12.555202 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1b740714-7fad-4720-aa82-c64b8963a90a tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:12.555654 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1b740714-7fad-4720-aa82-c64b8963a90a tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:12.556478 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1b740714-7fad-4720-aa82-c64b8963a90a tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:12.556916 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1b740714-7fad-4720-aa82-c64b8963a90a tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:12.646899 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-08829748-b037-43eb-ba53-2f0316f54fe3 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:12.647542 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-08829748-b037-43eb-ba53-2f0316f54fe3 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:12.654587 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-08829748-b037-43eb-ba53-2f0316f54fe3 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:12.655031 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-08829748-b037-43eb-ba53-2f0316f54fe3 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:12.655785 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-08829748-b037-43eb-ba53-2f0316f54fe3 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:12.656210 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-08829748-b037-43eb-ba53-2f0316f54fe3 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:12.686860 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-1b740714-7fad-4720-aa82-c64b8963a90a tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:12.695810 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-1b740714-7fad-4720-aa82-c64b8963a90a tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.151091 Jun 17 15:42:12.696621 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1593/2775] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:42:12 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:42:12.719669 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-08829748-b037-43eb-ba53-2f0316f54fe3 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:12.728675 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-08829748-b037-43eb-ba53-2f0316f54fe3 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:12.730210 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-08829748-b037-43eb-ba53-2f0316f54fe3 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:12.731478 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-08829748-b037-43eb-ba53-2f0316f54fe3 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.088451 Jun 17 15:42:12.732035 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1183/2776] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:42:12 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:42:12.765303 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-ce6f5053-7cc9-404e-90f3-0d98d20ef748 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:12.766009 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-ce6f5053-7cc9-404e-90f3-0d98d20ef748 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:12.772199 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ce6f5053-7cc9-404e-90f3-0d98d20ef748 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:12.772688 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ce6f5053-7cc9-404e-90f3-0d98d20ef748 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:12.773460 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ce6f5053-7cc9-404e-90f3-0d98d20ef748 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:12.773887 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ce6f5053-7cc9-404e-90f3-0d98d20ef748 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:12.842461 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-ce6f5053-7cc9-404e-90f3-0d98d20ef748 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:12.850997 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-ce6f5053-7cc9-404e-90f3-0d98d20ef748 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.089326 Jun 17 15:42:12.851604 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1594/2777] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:42:12 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:42:13.713900 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-e2812676-4fdd-447a-9e59-671616f0087a tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:13.714446 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-e2812676-4fdd-447a-9e59-671616f0087a tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:13.721054 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e2812676-4fdd-447a-9e59-671616f0087a tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:13.721503 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e2812676-4fdd-447a-9e59-671616f0087a tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:13.722268 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e2812676-4fdd-447a-9e59-671616f0087a tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:13.722703 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e2812676-4fdd-447a-9e59-671616f0087a tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:13.749987 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-1784ec42-bde1-4e94-9775-a02f98c446cf tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:13.750598 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-1784ec42-bde1-4e94-9775-a02f98c446cf tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:13.758132 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1784ec42-bde1-4e94-9775-a02f98c446cf tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:13.758582 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1784ec42-bde1-4e94-9775-a02f98c446cf tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:13.759349 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1784ec42-bde1-4e94-9775-a02f98c446cf tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:13.759787 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1784ec42-bde1-4e94-9775-a02f98c446cf tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:13.825311 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-1784ec42-bde1-4e94-9775-a02f98c446cf tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:13.836195 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-1784ec42-bde1-4e94-9775-a02f98c446cf tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:13.838481 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-1784ec42-bde1-4e94-9775-a02f98c446cf tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:13.840139 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-1784ec42-bde1-4e94-9775-a02f98c446cf tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.094023 Jun 17 15:42:13.840954 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1595/2778] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:42:13 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:42:13.867706 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-e2812676-4fdd-447a-9e59-671616f0087a tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:13.869011 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-3361292a-0f5d-41f7-a270-8704f075088d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:13.869627 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-3361292a-0f5d-41f7-a270-8704f075088d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:13.875625 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3361292a-0f5d-41f7-a270-8704f075088d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:13.876065 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3361292a-0f5d-41f7-a270-8704f075088d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:13.876775 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-e2812676-4fdd-447a-9e59-671616f0087a tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.166714 Jun 17 15:42:13.876896 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3361292a-0f5d-41f7-a270-8704f075088d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:13.877259 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3361292a-0f5d-41f7-a270-8704f075088d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:13.877554 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1184/2779] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:42:13 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:42:13.937514 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-3361292a-0f5d-41f7-a270-8704f075088d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:13.945511 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-3361292a-0f5d-41f7-a270-8704f075088d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.081041 Jun 17 15:42:13.946103 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1596/2780] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:42:13 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:42:14.857868 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-fad8ee8e-8a4a-4f50-8505-ab0d19b23645 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:14.858475 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-fad8ee8e-8a4a-4f50-8505-ab0d19b23645 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:14.864574 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fad8ee8e-8a4a-4f50-8505-ab0d19b23645 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:14.865018 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fad8ee8e-8a4a-4f50-8505-ab0d19b23645 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:14.865760 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fad8ee8e-8a4a-4f50-8505-ab0d19b23645 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:14.866190 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fad8ee8e-8a4a-4f50-8505-ab0d19b23645 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:14.870045 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell1:SELECT=100 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:42:14.893248 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-38536169-06b3-4f57-8da9-f9e9f8ce9498 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:14.894008 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-38536169-06b3-4f57-8da9-f9e9f8ce9498 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:14.901208 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-38536169-06b3-4f57-8da9-f9e9f8ce9498 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:14.901650 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-38536169-06b3-4f57-8da9-f9e9f8ce9498 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:14.902409 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-38536169-06b3-4f57-8da9-f9e9f8ce9498 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:14.902837 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-38536169-06b3-4f57-8da9-f9e9f8ce9498 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:14.927107 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-fad8ee8e-8a4a-4f50-8505-ab0d19b23645 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:14.935583 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-fad8ee8e-8a4a-4f50-8505-ab0d19b23645 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:14.937098 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-fad8ee8e-8a4a-4f50-8505-ab0d19b23645 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:14.938224 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-fad8ee8e-8a4a-4f50-8505-ab0d19b23645 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.084241 Jun 17 15:42:14.949139 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1185/2781] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:42:14 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 15:42:14.963464 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-d665e33b-d820-404b-9871-4f4ea4bff262 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:14.963464 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-d665e33b-d820-404b-9871-4f4ea4bff262 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:14.969538 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d665e33b-d820-404b-9871-4f4ea4bff262 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:14.970141 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d665e33b-d820-404b-9871-4f4ea4bff262 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:14.970904 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d665e33b-d820-404b-9871-4f4ea4bff262 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:14.971339 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d665e33b-d820-404b-9871-4f4ea4bff262 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:15.032064 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-d665e33b-d820-404b-9871-4f4ea4bff262 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:15.036810 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-38536169-06b3-4f57-8da9-f9e9f8ce9498 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:15.039982 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-d665e33b-d820-404b-9871-4f4ea4bff262 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.081688 Jun 17 15:42:15.040588 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1186/2782] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:42:14 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:42:15.045459 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-38536169-06b3-4f57-8da9-f9e9f8ce9498 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.155985 Jun 17 15:42:15.046164 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1597/2783] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:42:14 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:42:15.956649 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-bf402c52-9dec-45dd-9628-19f672a75a8f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:15.957251 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-bf402c52-9dec-45dd-9628-19f672a75a8f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:15.964258 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bf402c52-9dec-45dd-9628-19f672a75a8f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:15.964727 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bf402c52-9dec-45dd-9628-19f672a75a8f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:15.965469 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bf402c52-9dec-45dd-9628-19f672a75a8f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:15.965893 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bf402c52-9dec-45dd-9628-19f672a75a8f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:16.027158 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-bf402c52-9dec-45dd-9628-19f672a75a8f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:16.035553 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-bf402c52-9dec-45dd-9628-19f672a75a8f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:16.037080 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-bf402c52-9dec-45dd-9628-19f672a75a8f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:16.038210 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-bf402c52-9dec-45dd-9628-19f672a75a8f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.085510 Jun 17 15:42:16.038760 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1187/2784] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:42:15 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:42:16.056739 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-f373e86b-433e-4903-af8b-d8896ba6404c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:16.057374 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-f373e86b-433e-4903-af8b-d8896ba6404c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:16.062736 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-012b3b34-1da8-4ee5-862b-98fa439129e2 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:16.063348 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-012b3b34-1da8-4ee5-862b-98fa439129e2 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:16.063979 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f373e86b-433e-4903-af8b-d8896ba6404c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:16.064455 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f373e86b-433e-4903-af8b-d8896ba6404c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:16.065216 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f373e86b-433e-4903-af8b-d8896ba6404c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:16.065641 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f373e86b-433e-4903-af8b-d8896ba6404c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:16.069407 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-012b3b34-1da8-4ee5-862b-98fa439129e2 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:16.069852 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-012b3b34-1da8-4ee5-862b-98fa439129e2 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:16.071231 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-012b3b34-1da8-4ee5-862b-98fa439129e2 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:16.071841 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-012b3b34-1da8-4ee5-862b-98fa439129e2 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:16.127811 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-f373e86b-433e-4903-af8b-d8896ba6404c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:16.130050 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=100 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:42:16.137919 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-f373e86b-433e-4903-af8b-d8896ba6404c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.085028 Jun 17 15:42:16.138507 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1598/2785] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:42:16 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:42:16.202224 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-012b3b34-1da8-4ee5-862b-98fa439129e2 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:16.210059 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-012b3b34-1da8-4ee5-862b-98fa439129e2 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.151085 Jun 17 15:42:16.210621 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1188/2786] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:42:16 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:42:17.057394 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-41d9b32c-821e-4823-a003-c12f23fff30d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:17.058006 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-41d9b32c-821e-4823-a003-c12f23fff30d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:17.059995 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_api:SELECT=78 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:42:17.066138 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-41d9b32c-821e-4823-a003-c12f23fff30d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:17.066587 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-41d9b32c-821e-4823-a003-c12f23fff30d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:17.067499 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-41d9b32c-821e-4823-a003-c12f23fff30d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:17.068091 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-41d9b32c-821e-4823-a003-c12f23fff30d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:17.130623 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-41d9b32c-821e-4823-a003-c12f23fff30d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:17.139153 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-41d9b32c-821e-4823-a003-c12f23fff30d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:17.140747 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-41d9b32c-821e-4823-a003-c12f23fff30d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:17.141880 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-41d9b32c-821e-4823-a003-c12f23fff30d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.089092 Jun 17 15:42:17.142417 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1599/2787] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:42:17 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:42:17.154126 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-488733e8-8a97-4be5-a5ed-da33a592615d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:17.154765 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-488733e8-8a97-4be5-a5ed-da33a592615d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:17.161244 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-488733e8-8a97-4be5-a5ed-da33a592615d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:17.161690 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-488733e8-8a97-4be5-a5ed-da33a592615d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:17.162449 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-488733e8-8a97-4be5-a5ed-da33a592615d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:17.162878 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-488733e8-8a97-4be5-a5ed-da33a592615d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:17.227851 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-e3b69d03-c051-480d-a32c-1beeaa6f4581 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:17.228498 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-e3b69d03-c051-480d-a32c-1beeaa6f4581 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:17.232094 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-488733e8-8a97-4be5-a5ed-da33a592615d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:17.234862 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e3b69d03-c051-480d-a32c-1beeaa6f4581 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:17.235311 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e3b69d03-c051-480d-a32c-1beeaa6f4581 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:17.236082 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e3b69d03-c051-480d-a32c-1beeaa6f4581 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:17.236609 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e3b69d03-c051-480d-a32c-1beeaa6f4581 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:17.240108 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-488733e8-8a97-4be5-a5ed-da33a592615d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.089882 Jun 17 15:42:17.240704 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1189/2788] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:42:17 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:42:17.367775 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-e3b69d03-c051-480d-a32c-1beeaa6f4581 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:17.375913 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-e3b69d03-c051-480d-a32c-1beeaa6f4581 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.152775 Jun 17 15:42:17.376507 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1600/2789] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:42:17 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:42:18.160447 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-4842875a-f4d5-4745-8fe1-08affb0a1e63 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:18.161069 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-4842875a-f4d5-4745-8fe1-08affb0a1e63 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:18.168130 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4842875a-f4d5-4745-8fe1-08affb0a1e63 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:18.168609 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4842875a-f4d5-4745-8fe1-08affb0a1e63 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:18.169378 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4842875a-f4d5-4745-8fe1-08affb0a1e63 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:18.169795 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4842875a-f4d5-4745-8fe1-08affb0a1e63 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:18.230718 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-4842875a-f4d5-4745-8fe1-08affb0a1e63 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:18.239014 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-4842875a-f4d5-4745-8fe1-08affb0a1e63 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:18.240530 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-4842875a-f4d5-4745-8fe1-08affb0a1e63 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:18.241652 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-4842875a-f4d5-4745-8fe1-08affb0a1e63 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.085473 Jun 17 15:42:18.242204 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1190/2790] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:42:18 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 15:42:18.257712 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-7e294688-a27b-465d-972f-7a5e96c9ae66 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:18.258329 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-7e294688-a27b-465d-972f-7a5e96c9ae66 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:18.264914 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7e294688-a27b-465d-972f-7a5e96c9ae66 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:18.265356 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7e294688-a27b-465d-972f-7a5e96c9ae66 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:18.266115 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7e294688-a27b-465d-972f-7a5e96c9ae66 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:18.266547 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7e294688-a27b-465d-972f-7a5e96c9ae66 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:18.327579 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-7e294688-a27b-465d-972f-7a5e96c9ae66 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:18.335576 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-7e294688-a27b-465d-972f-7a5e96c9ae66 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.081734 Jun 17 15:42:18.337005 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1601/2791] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:42:18 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:42:18.393578 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-7afa6131-00b6-4a38-90be-42c68ce1253d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:18.394196 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-7afa6131-00b6-4a38-90be-42c68ce1253d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:18.400810 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7afa6131-00b6-4a38-90be-42c68ce1253d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:18.401258 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7afa6131-00b6-4a38-90be-42c68ce1253d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:18.402015 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7afa6131-00b6-4a38-90be-42c68ce1253d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:18.402448 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7afa6131-00b6-4a38-90be-42c68ce1253d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:18.545216 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-7afa6131-00b6-4a38-90be-42c68ce1253d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:18.553075 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-7afa6131-00b6-4a38-90be-42c68ce1253d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.163484 Jun 17 15:42:18.553641 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1191/2792] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:42:18 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:42:19.258980 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-4f718d06-1507-4fe8-a4fc-2ca6da5fa502 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:19.259663 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-4f718d06-1507-4fe8-a4fc-2ca6da5fa502 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:19.266105 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4f718d06-1507-4fe8-a4fc-2ca6da5fa502 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:19.266554 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4f718d06-1507-4fe8-a4fc-2ca6da5fa502 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:19.267318 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4f718d06-1507-4fe8-a4fc-2ca6da5fa502 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:19.267754 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4f718d06-1507-4fe8-a4fc-2ca6da5fa502 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:19.329285 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-4f718d06-1507-4fe8-a4fc-2ca6da5fa502 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:19.337715 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-4f718d06-1507-4fe8-a4fc-2ca6da5fa502 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:19.339230 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-4f718d06-1507-4fe8-a4fc-2ca6da5fa502 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:19.340404 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-4f718d06-1507-4fe8-a4fc-2ca6da5fa502 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.085344 Jun 17 15:42:19.340962 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1602/2793] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:42:19 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:42:19.353861 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-8a55908e-c8b0-4d97-8fde-4bac53d08f86 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:19.354480 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-8a55908e-c8b0-4d97-8fde-4bac53d08f86 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:19.360998 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8a55908e-c8b0-4d97-8fde-4bac53d08f86 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:19.361449 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8a55908e-c8b0-4d97-8fde-4bac53d08f86 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:19.362199 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8a55908e-c8b0-4d97-8fde-4bac53d08f86 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:19.362636 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8a55908e-c8b0-4d97-8fde-4bac53d08f86 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:19.424356 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-8a55908e-c8b0-4d97-8fde-4bac53d08f86 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:19.433251 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-8a55908e-c8b0-4d97-8fde-4bac53d08f86 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.083985 Jun 17 15:42:19.433817 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1192/2794] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:42:19 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:42:19.569852 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-7f18b8ea-4c95-4b57-a708-a06ff083dec4 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:19.570389 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-7f18b8ea-4c95-4b57-a708-a06ff083dec4 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:19.576405 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7f18b8ea-4c95-4b57-a708-a06ff083dec4 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:19.576857 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7f18b8ea-4c95-4b57-a708-a06ff083dec4 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:19.577611 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7f18b8ea-4c95-4b57-a708-a06ff083dec4 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:19.578044 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7f18b8ea-4c95-4b57-a708-a06ff083dec4 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:19.704043 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-7f18b8ea-4c95-4b57-a708-a06ff083dec4 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:19.712479 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-7f18b8ea-4c95-4b57-a708-a06ff083dec4 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.146657 Jun 17 15:42:19.713048 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1603/2795] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:42:19 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:42:20.358730 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-f0ef565d-b3fa-46ce-8364-3b9c09adf905 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:20.359390 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-f0ef565d-b3fa-46ce-8364-3b9c09adf905 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:20.361804 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_api:SELECT=82 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:42:20.367026 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f0ef565d-b3fa-46ce-8364-3b9c09adf905 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:20.367991 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f0ef565d-b3fa-46ce-8364-3b9c09adf905 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:20.368836 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f0ef565d-b3fa-46ce-8364-3b9c09adf905 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:20.369287 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f0ef565d-b3fa-46ce-8364-3b9c09adf905 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:20.432441 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-f0ef565d-b3fa-46ce-8364-3b9c09adf905 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:20.440743 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-f0ef565d-b3fa-46ce-8364-3b9c09adf905 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:20.442231 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-f0ef565d-b3fa-46ce-8364-3b9c09adf905 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:20.443344 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-f0ef565d-b3fa-46ce-8364-3b9c09adf905 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.088817 Jun 17 15:42:20.443924 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1193/2796] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:42:20 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:42:20.450467 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-74797e5c-95c5-407f-91af-11cb9b7b918b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:20.451085 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-74797e5c-95c5-407f-91af-11cb9b7b918b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:20.457372 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-74797e5c-95c5-407f-91af-11cb9b7b918b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:20.457814 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-74797e5c-95c5-407f-91af-11cb9b7b918b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:20.458632 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-74797e5c-95c5-407f-91af-11cb9b7b918b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:20.459079 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-74797e5c-95c5-407f-91af-11cb9b7b918b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:20.521844 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-74797e5c-95c5-407f-91af-11cb9b7b918b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:20.529858 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-74797e5c-95c5-407f-91af-11cb9b7b918b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.083235 Jun 17 15:42:20.530414 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1604/2797] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:42:20 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:42:20.730232 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-c5e805f7-a9d8-48b7-88b2-170ab4911c7f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:20.730780 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-c5e805f7-a9d8-48b7-88b2-170ab4911c7f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:20.736923 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c5e805f7-a9d8-48b7-88b2-170ab4911c7f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:20.737369 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c5e805f7-a9d8-48b7-88b2-170ab4911c7f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:20.738129 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c5e805f7-a9d8-48b7-88b2-170ab4911c7f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:20.738564 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c5e805f7-a9d8-48b7-88b2-170ab4911c7f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:20.873692 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-c5e805f7-a9d8-48b7-88b2-170ab4911c7f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:20.881576 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-c5e805f7-a9d8-48b7-88b2-170ab4911c7f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.156036 Jun 17 15:42:20.882128 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1194/2798] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:42:20 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:42:21.462678 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-12796cc3-9321-4f41-a041-915965099ed7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:21.463293 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-12796cc3-9321-4f41-a041-915965099ed7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:21.469772 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-12796cc3-9321-4f41-a041-915965099ed7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:21.470220 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-12796cc3-9321-4f41-a041-915965099ed7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:21.470977 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-12796cc3-9321-4f41-a041-915965099ed7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:21.471409 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-12796cc3-9321-4f41-a041-915965099ed7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:21.532823 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-12796cc3-9321-4f41-a041-915965099ed7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:21.541292 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-12796cc3-9321-4f41-a041-915965099ed7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:21.542796 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-12796cc3-9321-4f41-a041-915965099ed7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:21.543939 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-12796cc3-9321-4f41-a041-915965099ed7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.085888 Jun 17 15:42:21.544510 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1605/2799] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:42:21 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:42:21.548807 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-6e9ff5f0-db01-4c76-bce7-2064df0098b2 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:21.549423 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-6e9ff5f0-db01-4c76-bce7-2064df0098b2 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:21.555845 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6e9ff5f0-db01-4c76-bce7-2064df0098b2 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:21.556293 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6e9ff5f0-db01-4c76-bce7-2064df0098b2 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:21.557161 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6e9ff5f0-db01-4c76-bce7-2064df0098b2 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:21.557676 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6e9ff5f0-db01-4c76-bce7-2064df0098b2 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:21.617621 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-6e9ff5f0-db01-4c76-bce7-2064df0098b2 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:21.625506 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-6e9ff5f0-db01-4c76-bce7-2064df0098b2 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.080528 Jun 17 15:42:21.626068 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1195/2800] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:42:21 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:42:21.898820 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-083703df-29ae-41fb-9fd7-3dcddcf0c040 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:21.899436 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-083703df-29ae-41fb-9fd7-3dcddcf0c040 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:21.905429 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-083703df-29ae-41fb-9fd7-3dcddcf0c040 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:21.905875 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-083703df-29ae-41fb-9fd7-3dcddcf0c040 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:21.906635 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-083703df-29ae-41fb-9fd7-3dcddcf0c040 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:21.907070 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-083703df-29ae-41fb-9fd7-3dcddcf0c040 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:22.035262 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-083703df-29ae-41fb-9fd7-3dcddcf0c040 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:22.043159 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-083703df-29ae-41fb-9fd7-3dcddcf0c040 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.148269 Jun 17 15:42:22.043727 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1606/2801] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:42:21 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:42:22.561299 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-1c4c16af-9a1b-4616-a1d2-df6238c43ce8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:22.561890 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-1c4c16af-9a1b-4616-a1d2-df6238c43ce8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:22.568250 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1c4c16af-9a1b-4616-a1d2-df6238c43ce8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:22.568721 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1c4c16af-9a1b-4616-a1d2-df6238c43ce8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:22.569464 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1c4c16af-9a1b-4616-a1d2-df6238c43ce8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:22.569891 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1c4c16af-9a1b-4616-a1d2-df6238c43ce8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:22.630680 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-1c4c16af-9a1b-4616-a1d2-df6238c43ce8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:22.639325 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-1c4c16af-9a1b-4616-a1d2-df6238c43ce8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:22.640857 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-1c4c16af-9a1b-4616-a1d2-df6238c43ce8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:22.641998 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-1c4c16af-9a1b-4616-a1d2-df6238c43ce8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.084595 Jun 17 15:42:22.642561 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1196/2802] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:42:22 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 15:42:22.643030 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-65756d82-9daa-4461-8571-5385de9e4a2c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:22.643649 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-65756d82-9daa-4461-8571-5385de9e4a2c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:22.650622 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-65756d82-9daa-4461-8571-5385de9e4a2c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:22.651181 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-65756d82-9daa-4461-8571-5385de9e4a2c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:22.651970 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-65756d82-9daa-4461-8571-5385de9e4a2c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:22.652439 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-65756d82-9daa-4461-8571-5385de9e4a2c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:22.715364 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-65756d82-9daa-4461-8571-5385de9e4a2c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:22.723221 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-65756d82-9daa-4461-8571-5385de9e4a2c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.084057 Jun 17 15:42:22.723784 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1607/2803] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:42:22 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:42:23.060185 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-1eaba4ec-eebf-41e9-940f-308a42761af4 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:23.060741 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-1eaba4ec-eebf-41e9-940f-308a42761af4 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:23.066783 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1eaba4ec-eebf-41e9-940f-308a42761af4 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:23.067232 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1eaba4ec-eebf-41e9-940f-308a42761af4 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:23.067984 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1eaba4ec-eebf-41e9-940f-308a42761af4 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:23.068452 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1eaba4ec-eebf-41e9-940f-308a42761af4 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:23.199818 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-1eaba4ec-eebf-41e9-940f-308a42761af4 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:23.208868 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-1eaba4ec-eebf-41e9-940f-308a42761af4 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.152634 Jun 17 15:42:23.210137 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1197/2804] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:42:23 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:42:23.661408 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-782816e0-59ed-4a00-a062-9e7d8a3e9985 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:23.661959 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-782816e0-59ed-4a00-a062-9e7d8a3e9985 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:23.668968 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-782816e0-59ed-4a00-a062-9e7d8a3e9985 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:23.669413 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-782816e0-59ed-4a00-a062-9e7d8a3e9985 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:23.670199 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-782816e0-59ed-4a00-a062-9e7d8a3e9985 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:23.670638 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-782816e0-59ed-4a00-a062-9e7d8a3e9985 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:23.731663 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-782816e0-59ed-4a00-a062-9e7d8a3e9985 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:23.740376 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-782816e0-59ed-4a00-a062-9e7d8a3e9985 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:23.740871 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-7fb882f4-9583-4009-ad7b-96970fe61693 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:23.741523 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-7fb882f4-9583-4009-ad7b-96970fe61693 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:23.742038 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-782816e0-59ed-4a00-a062-9e7d8a3e9985 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:23.743722 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-782816e0-59ed-4a00-a062-9e7d8a3e9985 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.086828 Jun 17 15:42:23.744282 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1608/2805] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:42:23 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:42:23.749209 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7fb882f4-9583-4009-ad7b-96970fe61693 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:23.749666 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7fb882f4-9583-4009-ad7b-96970fe61693 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:23.750440 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7fb882f4-9583-4009-ad7b-96970fe61693 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:23.750876 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7fb882f4-9583-4009-ad7b-96970fe61693 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:23.811056 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-7fb882f4-9583-4009-ad7b-96970fe61693 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:23.818950 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-7fb882f4-9583-4009-ad7b-96970fe61693 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.081895 Jun 17 15:42:23.819511 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1198/2806] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:42:23 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:42:24.228273 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-4b81eec7-c975-49cc-bcb6-c93c20da5c2e tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:24.228926 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-4b81eec7-c975-49cc-bcb6-c93c20da5c2e tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:24.234914 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4b81eec7-c975-49cc-bcb6-c93c20da5c2e tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:24.235354 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4b81eec7-c975-49cc-bcb6-c93c20da5c2e tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:24.236095 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4b81eec7-c975-49cc-bcb6-c93c20da5c2e tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:24.236552 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4b81eec7-c975-49cc-bcb6-c93c20da5c2e tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:24.361969 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-4b81eec7-c975-49cc-bcb6-c93c20da5c2e tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:24.370042 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-4b81eec7-c975-49cc-bcb6-c93c20da5c2e tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.146485 Jun 17 15:42:24.370610 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1609/2807] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:42:24 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:42:24.762194 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-88b45d7a-173f-458e-b36d-9ffa1fdef5b4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:24.762811 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-88b45d7a-173f-458e-b36d-9ffa1fdef5b4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:24.769290 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-88b45d7a-173f-458e-b36d-9ffa1fdef5b4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:24.769747 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-88b45d7a-173f-458e-b36d-9ffa1fdef5b4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:24.770487 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-88b45d7a-173f-458e-b36d-9ffa1fdef5b4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:24.770919 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-88b45d7a-173f-458e-b36d-9ffa1fdef5b4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:24.837584 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-88b45d7a-173f-458e-b36d-9ffa1fdef5b4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:24.838857 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-764640c4-6346-4ee0-8e95-8ab7d451ab3a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:24.840036 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-764640c4-6346-4ee0-8e95-8ab7d451ab3a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:24.846259 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-88b45d7a-173f-458e-b36d-9ffa1fdef5b4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:24.847742 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-88b45d7a-173f-458e-b36d-9ffa1fdef5b4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:24.847898 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-764640c4-6346-4ee0-8e95-8ab7d451ab3a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:24.848387 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-764640c4-6346-4ee0-8e95-8ab7d451ab3a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:24.848893 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-88b45d7a-173f-458e-b36d-9ffa1fdef5b4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.091264 Jun 17 15:42:24.849152 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-764640c4-6346-4ee0-8e95-8ab7d451ab3a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:24.849446 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1199/2808] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:42:24 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:42:24.849575 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-764640c4-6346-4ee0-8e95-8ab7d451ab3a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:24.912187 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-764640c4-6346-4ee0-8e95-8ab7d451ab3a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:24.920565 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-764640c4-6346-4ee0-8e95-8ab7d451ab3a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.088700 Jun 17 15:42:24.921153 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1610/2809] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:42:24 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:42:25.386954 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-7b70cd4d-4bfc-4ab8-af59-996ca5f8e387 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:25.387569 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-7b70cd4d-4bfc-4ab8-af59-996ca5f8e387 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:25.393644 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7b70cd4d-4bfc-4ab8-af59-996ca5f8e387 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:25.394089 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7b70cd4d-4bfc-4ab8-af59-996ca5f8e387 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:25.394842 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7b70cd4d-4bfc-4ab8-af59-996ca5f8e387 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:25.395280 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7b70cd4d-4bfc-4ab8-af59-996ca5f8e387 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:25.524205 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-7b70cd4d-4bfc-4ab8-af59-996ca5f8e387 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:25.532090 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-7b70cd4d-4bfc-4ab8-af59-996ca5f8e387 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.149042 Jun 17 15:42:25.532686 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1200/2810] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:42:25 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:42:25.866950 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-da2dfdcb-61d1-4d0e-a5d8-afe665e45c48 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:25.867560 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-da2dfdcb-61d1-4d0e-a5d8-afe665e45c48 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:25.873736 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-da2dfdcb-61d1-4d0e-a5d8-afe665e45c48 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:25.874177 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-da2dfdcb-61d1-4d0e-a5d8-afe665e45c48 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:25.874926 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-da2dfdcb-61d1-4d0e-a5d8-afe665e45c48 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:25.875354 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-da2dfdcb-61d1-4d0e-a5d8-afe665e45c48 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:25.937153 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-c820394c-1968-4c82-b33c-c626f068a703 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:25.937544 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-c820394c-1968-4c82-b33c-c626f068a703 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:25.939117 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-da2dfdcb-61d1-4d0e-a5d8-afe665e45c48 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:25.944110 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c820394c-1968-4c82-b33c-c626f068a703 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:25.944590 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c820394c-1968-4c82-b33c-c626f068a703 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:25.945344 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c820394c-1968-4c82-b33c-c626f068a703 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:25.946259 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c820394c-1968-4c82-b33c-c626f068a703 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:25.948085 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-da2dfdcb-61d1-4d0e-a5d8-afe665e45c48 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:25.949638 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-da2dfdcb-61d1-4d0e-a5d8-afe665e45c48 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:25.950776 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-da2dfdcb-61d1-4d0e-a5d8-afe665e45c48 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.087727 Jun 17 15:42:25.951329 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1611/2811] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:42:25 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:42:26.008602 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-c820394c-1968-4c82-b33c-c626f068a703 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:26.010831 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell1:SELECT=100 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:42:26.017549 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-c820394c-1968-4c82-b33c-c626f068a703 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.084626 Jun 17 15:42:26.018115 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1201/2812] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:42:25 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:42:26.549845 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-7cddfc8f-2978-4f5a-9032-3f099768b8ce tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:26.550456 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-7cddfc8f-2978-4f5a-9032-3f099768b8ce tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:26.557073 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7cddfc8f-2978-4f5a-9032-3f099768b8ce tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:26.557517 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7cddfc8f-2978-4f5a-9032-3f099768b8ce tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:26.558267 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7cddfc8f-2978-4f5a-9032-3f099768b8ce tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:26.558695 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7cddfc8f-2978-4f5a-9032-3f099768b8ce tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:26.684789 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-7cddfc8f-2978-4f5a-9032-3f099768b8ce tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:26.692609 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-7cddfc8f-2978-4f5a-9032-3f099768b8ce tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.146665 Jun 17 15:42:26.693162 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1612/2813] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:42:26 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:42:26.968844 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-ea2e20d6-a002-43a2-9ad7-ee683fd5de76 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:26.969379 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-ea2e20d6-a002-43a2-9ad7-ee683fd5de76 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:26.976275 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ea2e20d6-a002-43a2-9ad7-ee683fd5de76 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:26.977415 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ea2e20d6-a002-43a2-9ad7-ee683fd5de76 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:26.978185 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ea2e20d6-a002-43a2-9ad7-ee683fd5de76 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:26.978619 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ea2e20d6-a002-43a2-9ad7-ee683fd5de76 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:27.035021 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-5f592ac4-9656-45b9-8e65-36191bb7f9dc tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:27.035736 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-5f592ac4-9656-45b9-8e65-36191bb7f9dc tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:27.042095 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-ea2e20d6-a002-43a2-9ad7-ee683fd5de76 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:27.042857 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5f592ac4-9656-45b9-8e65-36191bb7f9dc tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:27.043304 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5f592ac4-9656-45b9-8e65-36191bb7f9dc tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:27.044068 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5f592ac4-9656-45b9-8e65-36191bb7f9dc tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:27.044522 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5f592ac4-9656-45b9-8e65-36191bb7f9dc tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:27.050529 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-ea2e20d6-a002-43a2-9ad7-ee683fd5de76 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:27.052028 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-ea2e20d6-a002-43a2-9ad7-ee683fd5de76 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:27.053205 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-ea2e20d6-a002-43a2-9ad7-ee683fd5de76 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.088341 Jun 17 15:42:27.053767 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1202/2814] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:42:26 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:42:27.105961 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-5f592ac4-9656-45b9-8e65-36191bb7f9dc tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:27.113988 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-5f592ac4-9656-45b9-8e65-36191bb7f9dc tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.082903 Jun 17 15:42:27.114563 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1613/2815] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:42:27 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:42:27.709563 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-a96b6557-5862-497a-9f9c-51f4cd97ea3f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:27.710103 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-a96b6557-5862-497a-9f9c-51f4cd97ea3f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:27.716773 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a96b6557-5862-497a-9f9c-51f4cd97ea3f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:27.717222 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a96b6557-5862-497a-9f9c-51f4cd97ea3f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:27.717969 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a96b6557-5862-497a-9f9c-51f4cd97ea3f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:27.718405 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a96b6557-5862-497a-9f9c-51f4cd97ea3f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:27.850359 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-a96b6557-5862-497a-9f9c-51f4cd97ea3f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:27.858515 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-a96b6557-5862-497a-9f9c-51f4cd97ea3f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.152846 Jun 17 15:42:27.859079 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1203/2816] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:42:27 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:42:28.072496 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-42ed4499-f084-44e7-bc5f-ab5fc11091fd tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:28.073071 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-42ed4499-f084-44e7-bc5f-ab5fc11091fd tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:28.079483 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-42ed4499-f084-44e7-bc5f-ab5fc11091fd tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:28.079923 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-42ed4499-f084-44e7-bc5f-ab5fc11091fd tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:28.080706 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-42ed4499-f084-44e7-bc5f-ab5fc11091fd tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:28.081134 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-42ed4499-f084-44e7-bc5f-ab5fc11091fd tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:28.130846 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-910b04e7-a5ff-4ec4-bc1f-b1dad06cbe78 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:28.132224 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-910b04e7-a5ff-4ec4-bc1f-b1dad06cbe78 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:28.138981 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-910b04e7-a5ff-4ec4-bc1f-b1dad06cbe78 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:28.139432 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-910b04e7-a5ff-4ec4-bc1f-b1dad06cbe78 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:28.140203 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-910b04e7-a5ff-4ec4-bc1f-b1dad06cbe78 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:28.140860 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-910b04e7-a5ff-4ec4-bc1f-b1dad06cbe78 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:28.145833 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-42ed4499-f084-44e7-bc5f-ab5fc11091fd tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:28.155112 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-42ed4499-f084-44e7-bc5f-ab5fc11091fd tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:28.156703 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-42ed4499-f084-44e7-bc5f-ab5fc11091fd tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:28.157837 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-42ed4499-f084-44e7-bc5f-ab5fc11091fd tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.090172 Jun 17 15:42:28.158659 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1614/2817] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:42:28 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:42:28.206952 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-910b04e7-a5ff-4ec4-bc1f-b1dad06cbe78 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:28.214854 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-910b04e7-a5ff-4ec4-bc1f-b1dad06cbe78 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.087925 Jun 17 15:42:28.215411 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1204/2818] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:42:28 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:42:28.876061 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-e351f039-795f-48d8-aef6-de826a84fbad tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:28.876719 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-e351f039-795f-48d8-aef6-de826a84fbad tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:28.883381 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e351f039-795f-48d8-aef6-de826a84fbad tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:28.883830 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e351f039-795f-48d8-aef6-de826a84fbad tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:28.884616 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e351f039-795f-48d8-aef6-de826a84fbad tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:28.885046 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e351f039-795f-48d8-aef6-de826a84fbad tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:28.900341 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=100 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:42:29.014001 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-e351f039-795f-48d8-aef6-de826a84fbad tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:29.021923 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-e351f039-795f-48d8-aef6-de826a84fbad tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.149770 Jun 17 15:42:29.022482 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1615/2819] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:42:28 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:42:29.176437 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-ffa3f4ae-3523-4ad6-9ae4-87cb51145495 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:29.177017 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-ffa3f4ae-3523-4ad6-9ae4-87cb51145495 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:29.183690 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ffa3f4ae-3523-4ad6-9ae4-87cb51145495 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:29.184132 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ffa3f4ae-3523-4ad6-9ae4-87cb51145495 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:29.184910 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ffa3f4ae-3523-4ad6-9ae4-87cb51145495 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:29.185336 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ffa3f4ae-3523-4ad6-9ae4-87cb51145495 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:29.231161 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-d6fca003-092a-451f-8649-64741f09009f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:29.231786 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-d6fca003-092a-451f-8649-64741f09009f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:29.238933 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d6fca003-092a-451f-8649-64741f09009f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:29.239419 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d6fca003-092a-451f-8649-64741f09009f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:29.240184 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d6fca003-092a-451f-8649-64741f09009f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:29.240649 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d6fca003-092a-451f-8649-64741f09009f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:29.253988 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-ffa3f4ae-3523-4ad6-9ae4-87cb51145495 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:29.263288 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-ffa3f4ae-3523-4ad6-9ae4-87cb51145495 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:29.264813 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-ffa3f4ae-3523-4ad6-9ae4-87cb51145495 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:29.265963 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-ffa3f4ae-3523-4ad6-9ae4-87cb51145495 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.093652 Jun 17 15:42:29.266554 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1205/2820] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:42:29 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:42:29.304127 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-d6fca003-092a-451f-8649-64741f09009f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:29.312594 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-d6fca003-092a-451f-8649-64741f09009f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.085265 Jun 17 15:42:29.313164 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1616/2821] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:42:29 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:42:30.040299 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-e97cffc5-f80b-4744-a067-8d872af048eb tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:30.040868 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-e97cffc5-f80b-4744-a067-8d872af048eb tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:30.046911 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e97cffc5-f80b-4744-a067-8d872af048eb tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:30.047363 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e97cffc5-f80b-4744-a067-8d872af048eb tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:30.048123 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e97cffc5-f80b-4744-a067-8d872af048eb tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:30.048592 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e97cffc5-f80b-4744-a067-8d872af048eb tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:30.175245 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-e97cffc5-f80b-4744-a067-8d872af048eb tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:30.183605 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-e97cffc5-f80b-4744-a067-8d872af048eb tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.148153 Jun 17 15:42:30.184207 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1206/2822] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:42:30 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:42:30.282839 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-38f00059-b5d5-4c34-9c3b-8428e9c32f7f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:30.283468 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-38f00059-b5d5-4c34-9c3b-8428e9c32f7f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:30.290574 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-38f00059-b5d5-4c34-9c3b-8428e9c32f7f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:30.290958 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-38f00059-b5d5-4c34-9c3b-8428e9c32f7f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:30.291704 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-38f00059-b5d5-4c34-9c3b-8428e9c32f7f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:30.292130 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-38f00059-b5d5-4c34-9c3b-8428e9c32f7f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:30.329482 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-a6084da8-f744-451a-a2aa-0bae2f3c2e2c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:30.330228 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-a6084da8-f744-451a-a2aa-0bae2f3c2e2c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:30.337582 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a6084da8-f744-451a-a2aa-0bae2f3c2e2c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:30.338115 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a6084da8-f744-451a-a2aa-0bae2f3c2e2c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:30.338977 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a6084da8-f744-451a-a2aa-0bae2f3c2e2c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:30.339478 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a6084da8-f744-451a-a2aa-0bae2f3c2e2c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:30.354515 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-38f00059-b5d5-4c34-9c3b-8428e9c32f7f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:30.363037 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-38f00059-b5d5-4c34-9c3b-8428e9c32f7f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:30.364546 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-38f00059-b5d5-4c34-9c3b-8428e9c32f7f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:30.365679 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-38f00059-b5d5-4c34-9c3b-8428e9c32f7f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.086778 Jun 17 15:42:30.366233 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1617/2823] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:42:30 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:42:30.404859 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-a6084da8-f744-451a-a2aa-0bae2f3c2e2c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:30.412753 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-a6084da8-f744-451a-a2aa-0bae2f3c2e2c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.087052 Jun 17 15:42:30.413308 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1207/2824] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:42:30 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:42:31.200589 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-eaa5ee71-75ed-4abc-8b88-7455cd474cf4 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:31.201198 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-eaa5ee71-75ed-4abc-8b88-7455cd474cf4 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:31.207293 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-eaa5ee71-75ed-4abc-8b88-7455cd474cf4 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:31.207744 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-eaa5ee71-75ed-4abc-8b88-7455cd474cf4 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:31.208527 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-eaa5ee71-75ed-4abc-8b88-7455cd474cf4 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:31.208963 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-eaa5ee71-75ed-4abc-8b88-7455cd474cf4 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:31.344657 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-eaa5ee71-75ed-4abc-8b88-7455cd474cf4 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:31.353788 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-eaa5ee71-75ed-4abc-8b88-7455cd474cf4 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.157027 Jun 17 15:42:31.354371 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1618/2825] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:42:31 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:42:31.384050 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-8f93db82-3de4-418a-bd01-dde50466d5e1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:31.384686 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-8f93db82-3de4-418a-bd01-dde50466d5e1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:31.391074 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8f93db82-3de4-418a-bd01-dde50466d5e1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:31.391512 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8f93db82-3de4-418a-bd01-dde50466d5e1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:31.392254 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8f93db82-3de4-418a-bd01-dde50466d5e1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:31.392708 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8f93db82-3de4-418a-bd01-dde50466d5e1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:31.429040 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-0926bec6-2352-479c-8e94-b84095d78687 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:31.430483 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-0926bec6-2352-479c-8e94-b84095d78687 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:31.436792 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0926bec6-2352-479c-8e94-b84095d78687 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:31.437265 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0926bec6-2352-479c-8e94-b84095d78687 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:31.438029 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0926bec6-2352-479c-8e94-b84095d78687 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:31.438463 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0926bec6-2352-479c-8e94-b84095d78687 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:31.454328 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-8f93db82-3de4-418a-bd01-dde50466d5e1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:31.463304 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-8f93db82-3de4-418a-bd01-dde50466d5e1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:31.464838 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-8f93db82-3de4-418a-bd01-dde50466d5e1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:31.465967 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-8f93db82-3de4-418a-bd01-dde50466d5e1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.085890 Jun 17 15:42:31.466519 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1208/2826] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:42:31 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:42:31.501033 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-0926bec6-2352-479c-8e94-b84095d78687 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:31.509047 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-0926bec6-2352-479c-8e94-b84095d78687 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.083834 Jun 17 15:42:31.509608 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1619/2827] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:42:31 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:42:32.371386 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-3b020015-3f8a-4863-a2ce-0e06dfac8cb4 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:32.372036 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-3b020015-3f8a-4863-a2ce-0e06dfac8cb4 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:32.378657 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3b020015-3f8a-4863-a2ce-0e06dfac8cb4 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:32.378657 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3b020015-3f8a-4863-a2ce-0e06dfac8cb4 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:32.379391 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3b020015-3f8a-4863-a2ce-0e06dfac8cb4 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:32.379828 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3b020015-3f8a-4863-a2ce-0e06dfac8cb4 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:32.484301 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-11e0f42e-e5d1-44a6-aa68-831961814343 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:32.484926 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-11e0f42e-e5d1-44a6-aa68-831961814343 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:32.491337 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-11e0f42e-e5d1-44a6-aa68-831961814343 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:32.491783 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-11e0f42e-e5d1-44a6-aa68-831961814343 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:32.493075 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-11e0f42e-e5d1-44a6-aa68-831961814343 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:32.493513 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-11e0f42e-e5d1-44a6-aa68-831961814343 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:32.509057 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-3b020015-3f8a-4863-a2ce-0e06dfac8cb4 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:32.517148 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-3b020015-3f8a-4863-a2ce-0e06dfac8cb4 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.150021 Jun 17 15:42:32.517728 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1209/2828] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:42:32 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:42:32.525126 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-31f3acd2-3288-4926-a73e-4bc6696a923a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:32.525750 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-31f3acd2-3288-4926-a73e-4bc6696a923a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:32.531706 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-31f3acd2-3288-4926-a73e-4bc6696a923a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:32.532156 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-31f3acd2-3288-4926-a73e-4bc6696a923a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:32.532960 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-31f3acd2-3288-4926-a73e-4bc6696a923a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:32.533401 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-31f3acd2-3288-4926-a73e-4bc6696a923a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:32.558329 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-11e0f42e-e5d1-44a6-aa68-831961814343 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:32.567687 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-11e0f42e-e5d1-44a6-aa68-831961814343 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:32.569318 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-11e0f42e-e5d1-44a6-aa68-831961814343 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:32.571250 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-11e0f42e-e5d1-44a6-aa68-831961814343 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.090222 Jun 17 15:42:32.572087 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1620/2829] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:42:32 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:42:32.598591 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-31f3acd2-3288-4926-a73e-4bc6696a923a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:32.607494 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-31f3acd2-3288-4926-a73e-4bc6696a923a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.085973 Jun 17 15:42:32.608062 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1210/2830] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:42:32 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:42:33.534314 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-f05294fa-f1c4-4d54-8651-730c2f9c76a2 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:33.535069 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-f05294fa-f1c4-4d54-8651-730c2f9c76a2 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:33.541657 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f05294fa-f1c4-4d54-8651-730c2f9c76a2 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:33.542101 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f05294fa-f1c4-4d54-8651-730c2f9c76a2 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:33.542868 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f05294fa-f1c4-4d54-8651-730c2f9c76a2 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:33.543300 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f05294fa-f1c4-4d54-8651-730c2f9c76a2 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:33.589737 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-a054f867-160b-4683-b4f5-8e3c3b106de0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:33.590336 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-a054f867-160b-4683-b4f5-8e3c3b106de0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:33.596773 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a054f867-160b-4683-b4f5-8e3c3b106de0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:33.597214 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a054f867-160b-4683-b4f5-8e3c3b106de0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:33.597992 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a054f867-160b-4683-b4f5-8e3c3b106de0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:33.598417 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a054f867-160b-4683-b4f5-8e3c3b106de0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:33.662117 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-a054f867-160b-4683-b4f5-8e3c3b106de0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:33.670994 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-a054f867-160b-4683-b4f5-8e3c3b106de0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:33.672542 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-a054f867-160b-4683-b4f5-8e3c3b106de0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:33.673687 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-a054f867-160b-4683-b4f5-8e3c3b106de0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.088454 Jun 17 15:42:33.674245 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1211/2831] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:42:33 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 15:42:33.676655 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-f05294fa-f1c4-4d54-8651-730c2f9c76a2 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:33.678775 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-a1208228-17ea-4077-a1e4-0d4465d22fc4 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:33.679385 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-a1208228-17ea-4077-a1e4-0d4465d22fc4 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:33.684978 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-f05294fa-f1c4-4d54-8651-730c2f9c76a2 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.154612 Jun 17 15:42:33.685416 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a1208228-17ea-4077-a1e4-0d4465d22fc4 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:33.685553 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1621/2832] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:42:33 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:42:33.686005 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a1208228-17ea-4077-a1e4-0d4465d22fc4 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:33.686777 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a1208228-17ea-4077-a1e4-0d4465d22fc4 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:33.687212 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a1208228-17ea-4077-a1e4-0d4465d22fc4 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:33.748230 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-a1208228-17ea-4077-a1e4-0d4465d22fc4 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:33.756779 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-a1208228-17ea-4077-a1e4-0d4465d22fc4 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.081463 Jun 17 15:42:33.757346 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1212/2833] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:42:33 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:42:34.691211 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-45e739d2-7fff-4d1b-9c7a-3eae4027e0a1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:34.691745 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-45e739d2-7fff-4d1b-9c7a-3eae4027e0a1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:34.698502 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-45e739d2-7fff-4d1b-9c7a-3eae4027e0a1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:34.698947 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-45e739d2-7fff-4d1b-9c7a-3eae4027e0a1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:34.699710 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-45e739d2-7fff-4d1b-9c7a-3eae4027e0a1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:34.700143 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-45e739d2-7fff-4d1b-9c7a-3eae4027e0a1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:34.701630 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-8070bb53-0e2d-4471-92d9-3370c0debd92 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:34.702241 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-8070bb53-0e2d-4471-92d9-3370c0debd92 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:34.708649 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8070bb53-0e2d-4471-92d9-3370c0debd92 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:34.709096 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8070bb53-0e2d-4471-92d9-3370c0debd92 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:34.709837 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8070bb53-0e2d-4471-92d9-3370c0debd92 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:34.710266 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8070bb53-0e2d-4471-92d9-3370c0debd92 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:34.762149 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-45e739d2-7fff-4d1b-9c7a-3eae4027e0a1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:34.772440 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-45e739d2-7fff-4d1b-9c7a-3eae4027e0a1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:34.774555 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-45e739d2-7fff-4d1b-9c7a-3eae4027e0a1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:34.775914 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-45e739d2-7fff-4d1b-9c7a-3eae4027e0a1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.088715 Jun 17 15:42:34.776519 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1622/2834] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:42:34 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:42:34.781267 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-a3d8c770-d38a-4dc6-9049-3c6f0f85d584 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:34.781883 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-a3d8c770-d38a-4dc6-9049-3c6f0f85d584 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:34.787912 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a3d8c770-d38a-4dc6-9049-3c6f0f85d584 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:34.788388 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a3d8c770-d38a-4dc6-9049-3c6f0f85d584 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:34.789843 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a3d8c770-d38a-4dc6-9049-3c6f0f85d584 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:34.790278 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a3d8c770-d38a-4dc6-9049-3c6f0f85d584 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:34.846072 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-8070bb53-0e2d-4471-92d9-3370c0debd92 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:34.854578 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-8070bb53-0e2d-4471-92d9-3370c0debd92 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.156683 Jun 17 15:42:34.855188 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-a3d8c770-d38a-4dc6-9049-3c6f0f85d584 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:34.855381 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1213/2835] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:42:34 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:42:34.863512 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-a3d8c770-d38a-4dc6-9049-3c6f0f85d584 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.086004 Jun 17 15:42:34.864070 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1623/2836] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:42:34 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:42:35.794973 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-4d0467c9-9ddd-49df-bdb6-97e2540cb999 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:35.795827 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-4d0467c9-9ddd-49df-bdb6-97e2540cb999 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:35.804049 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4d0467c9-9ddd-49df-bdb6-97e2540cb999 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:35.804536 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4d0467c9-9ddd-49df-bdb6-97e2540cb999 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:35.805914 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4d0467c9-9ddd-49df-bdb6-97e2540cb999 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:35.806357 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4d0467c9-9ddd-49df-bdb6-97e2540cb999 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:35.871922 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-7db2ee45-211f-459c-8dc5-c66041ff2701 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:35.875049 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-7db2ee45-211f-459c-8dc5-c66041ff2701 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:35.876462 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-4d0467c9-9ddd-49df-bdb6-97e2540cb999 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:35.883017 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7db2ee45-211f-459c-8dc5-c66041ff2701 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:35.883455 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7db2ee45-211f-459c-8dc5-c66041ff2701 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:35.884250 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7db2ee45-211f-459c-8dc5-c66041ff2701 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:35.885055 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7db2ee45-211f-459c-8dc5-c66041ff2701 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:35.887480 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-4d0467c9-9ddd-49df-bdb6-97e2540cb999 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:35.889040 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-4d0467c9-9ddd-49df-bdb6-97e2540cb999 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:35.890213 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-4d0467c9-9ddd-49df-bdb6-97e2540cb999 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.099420 Jun 17 15:42:35.891151 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1214/2837] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:42:35 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:42:35.895768 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-39d014c1-7926-42ac-bd1c-ba04416c2b43 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:35.896398 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-39d014c1-7926-42ac-bd1c-ba04416c2b43 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:35.902738 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-39d014c1-7926-42ac-bd1c-ba04416c2b43 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:35.903189 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-39d014c1-7926-42ac-bd1c-ba04416c2b43 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:35.903948 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-39d014c1-7926-42ac-bd1c-ba04416c2b43 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:35.904966 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-39d014c1-7926-42ac-bd1c-ba04416c2b43 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:35.970322 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-39d014c1-7926-42ac-bd1c-ba04416c2b43 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:35.980136 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-39d014c1-7926-42ac-bd1c-ba04416c2b43 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.087813 Jun 17 15:42:35.980767 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1215/2838] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:42:35 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:42:36.107011 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-7db2ee45-211f-459c-8dc5-c66041ff2701 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:36.115077 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-7db2ee45-211f-459c-8dc5-c66041ff2701 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.247890 Jun 17 15:42:36.115636 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1624/2839] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:42:35 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:42:36.908079 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-33237fc9-88f1-46ed-afc2-1f17b8df7aaf tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:36.908706 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-33237fc9-88f1-46ed-afc2-1f17b8df7aaf tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:36.915176 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-33237fc9-88f1-46ed-afc2-1f17b8df7aaf tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:36.915624 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-33237fc9-88f1-46ed-afc2-1f17b8df7aaf tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:36.916421 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-33237fc9-88f1-46ed-afc2-1f17b8df7aaf tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:36.916861 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-33237fc9-88f1-46ed-afc2-1f17b8df7aaf tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:36.980988 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-33237fc9-88f1-46ed-afc2-1f17b8df7aaf tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:36.989724 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-33237fc9-88f1-46ed-afc2-1f17b8df7aaf tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:36.991268 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-33237fc9-88f1-46ed-afc2-1f17b8df7aaf tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:36.992911 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-33237fc9-88f1-46ed-afc2-1f17b8df7aaf tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.088306 Jun 17 15:42:36.993601 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1216/2840] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:42:36 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:42:36.998745 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-009b2c1d-2851-4e9b-ae78-fa4b68e375da tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:36.999349 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-009b2c1d-2851-4e9b-ae78-fa4b68e375da tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:37.005862 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-009b2c1d-2851-4e9b-ae78-fa4b68e375da tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:37.006281 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-009b2c1d-2851-4e9b-ae78-fa4b68e375da tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:37.007032 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-009b2c1d-2851-4e9b-ae78-fa4b68e375da tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:37.007460 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-009b2c1d-2851-4e9b-ae78-fa4b68e375da tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:37.069621 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-009b2c1d-2851-4e9b-ae78-fa4b68e375da tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:37.078178 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-009b2c1d-2851-4e9b-ae78-fa4b68e375da tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.083300 Jun 17 15:42:37.078738 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1625/2841] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:42:36 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:42:37.131918 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-8cea08b7-0bb0-4254-ba34-a60c877de6f3 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:37.132560 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-8cea08b7-0bb0-4254-ba34-a60c877de6f3 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:37.138591 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8cea08b7-0bb0-4254-ba34-a60c877de6f3 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:37.139033 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8cea08b7-0bb0-4254-ba34-a60c877de6f3 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:37.139781 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8cea08b7-0bb0-4254-ba34-a60c877de6f3 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:37.140209 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8cea08b7-0bb0-4254-ba34-a60c877de6f3 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:37.269316 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-8cea08b7-0bb0-4254-ba34-a60c877de6f3 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:37.277147 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-8cea08b7-0bb0-4254-ba34-a60c877de6f3 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.149046 Jun 17 15:42:37.277705 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1217/2842] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:42:37 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:42:38.010773 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-b202eeba-496b-4bdc-b824-176926580279 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:38.011363 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-b202eeba-496b-4bdc-b824-176926580279 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:38.017756 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b202eeba-496b-4bdc-b824-176926580279 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:38.018199 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b202eeba-496b-4bdc-b824-176926580279 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:38.018944 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b202eeba-496b-4bdc-b824-176926580279 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:38.019370 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b202eeba-496b-4bdc-b824-176926580279 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:38.089396 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-b202eeba-496b-4bdc-b824-176926580279 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:38.094847 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-96af1094-f2b4-4299-a546-910fc922bb12 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:38.095582 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-96af1094-f2b4-4299-a546-910fc922bb12 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:38.097976 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-b202eeba-496b-4bdc-b824-176926580279 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:38.099478 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-b202eeba-496b-4bdc-b824-176926580279 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:38.100668 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-b202eeba-496b-4bdc-b824-176926580279 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.094342 Jun 17 15:42:38.101483 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1626/2843] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:42:38 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:42:38.102443 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-96af1094-f2b4-4299-a546-910fc922bb12 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:38.102881 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-96af1094-f2b4-4299-a546-910fc922bb12 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:38.103700 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-96af1094-f2b4-4299-a546-910fc922bb12 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:38.104130 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-96af1094-f2b4-4299-a546-910fc922bb12 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:38.119341 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell1:SELECT=100 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:42:38.167850 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-96af1094-f2b4-4299-a546-910fc922bb12 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:38.175696 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-96af1094-f2b4-4299-a546-910fc922bb12 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.084734 Jun 17 15:42:38.176257 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1218/2844] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:42:38 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:42:38.301461 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-2c69eb97-e9a0-44cb-9792-600fe28e9e81 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:38.301982 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-2c69eb97-e9a0-44cb-9792-600fe28e9e81 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:38.308630 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2c69eb97-e9a0-44cb-9792-600fe28e9e81 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:38.309080 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2c69eb97-e9a0-44cb-9792-600fe28e9e81 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:38.309836 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2c69eb97-e9a0-44cb-9792-600fe28e9e81 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:38.310297 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2c69eb97-e9a0-44cb-9792-600fe28e9e81 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:38.436557 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-2c69eb97-e9a0-44cb-9792-600fe28e9e81 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:38.444470 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-2c69eb97-e9a0-44cb-9792-600fe28e9e81 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.146934 Jun 17 15:42:38.445028 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1627/2845] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:42:38 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:42:39.123023 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-e2003e85-080c-4025-be3f-76a0c1e2f643 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:39.123625 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-e2003e85-080c-4025-be3f-76a0c1e2f643 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:39.130311 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e2003e85-080c-4025-be3f-76a0c1e2f643 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:39.130746 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e2003e85-080c-4025-be3f-76a0c1e2f643 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:39.131484 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e2003e85-080c-4025-be3f-76a0c1e2f643 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:39.131910 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e2003e85-080c-4025-be3f-76a0c1e2f643 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:39.191916 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-6471576a-00b8-4274-a0fc-7d383e3ff491 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:39.192643 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-6471576a-00b8-4274-a0fc-7d383e3ff491 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:39.199557 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6471576a-00b8-4274-a0fc-7d383e3ff491 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:39.200076 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6471576a-00b8-4274-a0fc-7d383e3ff491 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:39.200940 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6471576a-00b8-4274-a0fc-7d383e3ff491 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:39.201241 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-e2003e85-080c-4025-be3f-76a0c1e2f643 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:39.201520 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6471576a-00b8-4274-a0fc-7d383e3ff491 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:39.210264 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-e2003e85-080c-4025-be3f-76a0c1e2f643 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:39.212260 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-e2003e85-080c-4025-be3f-76a0c1e2f643 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:39.213435 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-e2003e85-080c-4025-be3f-76a0c1e2f643 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.094287 Jun 17 15:42:39.214283 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1219/2846] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:42:39 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:42:39.263249 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-6471576a-00b8-4274-a0fc-7d383e3ff491 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:39.271181 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-6471576a-00b8-4274-a0fc-7d383e3ff491 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.083189 Jun 17 15:42:39.271751 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1628/2847] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:42:39 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:42:39.463223 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-037806a4-3b55-4069-b2f2-be6dc6d13b72 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:39.463866 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-037806a4-3b55-4069-b2f2-be6dc6d13b72 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:39.470123 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-037806a4-3b55-4069-b2f2-be6dc6d13b72 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:39.470566 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-037806a4-3b55-4069-b2f2-be6dc6d13b72 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:39.471328 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-037806a4-3b55-4069-b2f2-be6dc6d13b72 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:39.471749 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-037806a4-3b55-4069-b2f2-be6dc6d13b72 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:39.608794 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-037806a4-3b55-4069-b2f2-be6dc6d13b72 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:39.616694 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-037806a4-3b55-4069-b2f2-be6dc6d13b72 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.158096 Jun 17 15:42:39.617255 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1220/2848] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:42:39 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:42:40.233140 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-fa0c6ce9-b31f-40eb-8b14-369926c2ae8b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:40.233856 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-fa0c6ce9-b31f-40eb-8b14-369926c2ae8b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:40.240354 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fa0c6ce9-b31f-40eb-8b14-369926c2ae8b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:40.240808 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fa0c6ce9-b31f-40eb-8b14-369926c2ae8b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:40.241573 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fa0c6ce9-b31f-40eb-8b14-369926c2ae8b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:40.242008 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fa0c6ce9-b31f-40eb-8b14-369926c2ae8b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:40.290526 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-499667d8-2dc0-40bb-8593-4c8ecfe44567 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:40.291130 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-499667d8-2dc0-40bb-8593-4c8ecfe44567 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:40.297571 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-499667d8-2dc0-40bb-8593-4c8ecfe44567 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:40.298013 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-499667d8-2dc0-40bb-8593-4c8ecfe44567 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:40.298762 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-499667d8-2dc0-40bb-8593-4c8ecfe44567 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:40.299190 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-499667d8-2dc0-40bb-8593-4c8ecfe44567 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:40.303714 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-fa0c6ce9-b31f-40eb-8b14-369926c2ae8b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:40.312773 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-fa0c6ce9-b31f-40eb-8b14-369926c2ae8b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:40.314279 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-fa0c6ce9-b31f-40eb-8b14-369926c2ae8b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:40.315424 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-fa0c6ce9-b31f-40eb-8b14-369926c2ae8b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.086239 Jun 17 15:42:40.315972 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1629/2849] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:42:40 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:42:40.360995 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-499667d8-2dc0-40bb-8593-4c8ecfe44567 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:40.369643 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-499667d8-2dc0-40bb-8593-4c8ecfe44567 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.084487 Jun 17 15:42:40.370178 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1221/2850] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:42:40 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:42:40.632680 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-847f3ed3-4f59-48db-92ac-2d8bfdf31c9c tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:40.633322 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-847f3ed3-4f59-48db-92ac-2d8bfdf31c9c tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:40.639256 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-847f3ed3-4f59-48db-92ac-2d8bfdf31c9c tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:40.639700 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-847f3ed3-4f59-48db-92ac-2d8bfdf31c9c tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:40.640477 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-847f3ed3-4f59-48db-92ac-2d8bfdf31c9c tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:40.640906 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-847f3ed3-4f59-48db-92ac-2d8bfdf31c9c tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:40.774698 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-847f3ed3-4f59-48db-92ac-2d8bfdf31c9c tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:40.782861 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-847f3ed3-4f59-48db-92ac-2d8bfdf31c9c tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.153979 Jun 17 15:42:40.783436 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1630/2851] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:42:40 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:42:41.333796 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-99b491bc-5649-47eb-b001-a031bcb96431 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:41.334403 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-99b491bc-5649-47eb-b001-a031bcb96431 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:41.340897 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-99b491bc-5649-47eb-b001-a031bcb96431 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:41.341348 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-99b491bc-5649-47eb-b001-a031bcb96431 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:41.342085 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-99b491bc-5649-47eb-b001-a031bcb96431 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:41.342508 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-99b491bc-5649-47eb-b001-a031bcb96431 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:41.386919 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-0ab31a72-2a5f-4ee0-86bf-23895ad67774 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:41.387539 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-0ab31a72-2a5f-4ee0-86bf-23895ad67774 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:41.394126 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0ab31a72-2a5f-4ee0-86bf-23895ad67774 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:41.394578 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0ab31a72-2a5f-4ee0-86bf-23895ad67774 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:41.395341 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0ab31a72-2a5f-4ee0-86bf-23895ad67774 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:41.395774 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0ab31a72-2a5f-4ee0-86bf-23895ad67774 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:41.405299 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-99b491bc-5649-47eb-b001-a031bcb96431 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:41.413923 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-99b491bc-5649-47eb-b001-a031bcb96431 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:41.415451 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-99b491bc-5649-47eb-b001-a031bcb96431 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:41.416753 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-99b491bc-5649-47eb-b001-a031bcb96431 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.086809 Jun 17 15:42:41.417292 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1222/2852] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:42:41 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:42:41.456518 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-0ab31a72-2a5f-4ee0-86bf-23895ad67774 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:41.464460 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-0ab31a72-2a5f-4ee0-86bf-23895ad67774 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.081938 Jun 17 15:42:41.465018 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1631/2853] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:42:41 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:42:41.801848 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-4ee1cb10-d62e-458e-9d99-ba72953eebef tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:41.802469 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-4ee1cb10-d62e-458e-9d99-ba72953eebef tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:41.809187 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4ee1cb10-d62e-458e-9d99-ba72953eebef tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:41.809631 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4ee1cb10-d62e-458e-9d99-ba72953eebef tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:41.810383 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4ee1cb10-d62e-458e-9d99-ba72953eebef tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:41.810818 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4ee1cb10-d62e-458e-9d99-ba72953eebef tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:41.938241 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-4ee1cb10-d62e-458e-9d99-ba72953eebef tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:41.946302 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-4ee1cb10-d62e-458e-9d99-ba72953eebef tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.148306 Jun 17 15:42:41.946864 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1223/2854] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:42:41 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:42:42.435041 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-df1ad94d-2adb-4c09-b496-49fcc831896d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:42.435649 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-df1ad94d-2adb-4c09-b496-49fcc831896d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:42.442115 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-df1ad94d-2adb-4c09-b496-49fcc831896d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:42.442579 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-df1ad94d-2adb-4c09-b496-49fcc831896d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:42.443316 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-df1ad94d-2adb-4c09-b496-49fcc831896d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:42.443750 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-df1ad94d-2adb-4c09-b496-49fcc831896d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:42.448139 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=100 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:42:42.481896 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-0ef5ba37-e781-4195-a396-19ef1361f89e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:42.482509 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-0ef5ba37-e781-4195-a396-19ef1361f89e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:42.489120 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0ef5ba37-e781-4195-a396-19ef1361f89e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:42.489566 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0ef5ba37-e781-4195-a396-19ef1361f89e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:42.490325 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0ef5ba37-e781-4195-a396-19ef1361f89e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:42.490759 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0ef5ba37-e781-4195-a396-19ef1361f89e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:42.505582 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-df1ad94d-2adb-4c09-b496-49fcc831896d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:42.514309 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-df1ad94d-2adb-4c09-b496-49fcc831896d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:42.515804 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-df1ad94d-2adb-4c09-b496-49fcc831896d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:42.516998 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-df1ad94d-2adb-4c09-b496-49fcc831896d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.085920 Jun 17 15:42:42.517550 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1632/2855] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:42:42 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:42:42.555154 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-0ef5ba37-e781-4195-a396-19ef1361f89e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:42.564037 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-0ef5ba37-e781-4195-a396-19ef1361f89e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.086183 Jun 17 15:42:42.564639 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1224/2856] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:42:42 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:42:42.963685 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-618bb7c4-5db0-48fe-8440-ee168234bec7 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:42.964318 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-618bb7c4-5db0-48fe-8440-ee168234bec7 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:42.970329 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-618bb7c4-5db0-48fe-8440-ee168234bec7 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:42.970775 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-618bb7c4-5db0-48fe-8440-ee168234bec7 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:42.971522 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-618bb7c4-5db0-48fe-8440-ee168234bec7 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:42.971949 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-618bb7c4-5db0-48fe-8440-ee168234bec7 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:43.101997 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-618bb7c4-5db0-48fe-8440-ee168234bec7 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:43.110105 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-618bb7c4-5db0-48fe-8440-ee168234bec7 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.150275 Jun 17 15:42:43.110687 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1633/2857] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:42:42 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:42:43.535072 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-b5e71588-4b63-4b97-9932-8999fec2f42a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:43.535684 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-b5e71588-4b63-4b97-9932-8999fec2f42a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:43.542724 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b5e71588-4b63-4b97-9932-8999fec2f42a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:43.543171 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b5e71588-4b63-4b97-9932-8999fec2f42a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:43.543936 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b5e71588-4b63-4b97-9932-8999fec2f42a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:43.544446 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b5e71588-4b63-4b97-9932-8999fec2f42a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:43.581175 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-caefcff9-0a8b-4899-aac2-e072322b9973 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:43.581796 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-caefcff9-0a8b-4899-aac2-e072322b9973 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:43.588928 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-caefcff9-0a8b-4899-aac2-e072322b9973 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:43.589377 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-caefcff9-0a8b-4899-aac2-e072322b9973 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:43.590146 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-caefcff9-0a8b-4899-aac2-e072322b9973 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:43.590576 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-caefcff9-0a8b-4899-aac2-e072322b9973 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:43.607221 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-b5e71588-4b63-4b97-9932-8999fec2f42a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:43.615567 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-b5e71588-4b63-4b97-9932-8999fec2f42a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:43.617107 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-b5e71588-4b63-4b97-9932-8999fec2f42a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:43.618240 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-b5e71588-4b63-4b97-9932-8999fec2f42a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.087153 Jun 17 15:42:43.618794 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1225/2858] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:42:43 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:42:43.651448 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-caefcff9-0a8b-4899-aac2-e072322b9973 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:43.659375 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-caefcff9-0a8b-4899-aac2-e072322b9973 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.081977 Jun 17 15:42:43.659940 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1634/2859] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:42:43 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:42:44.127175 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-77512690-9349-4a22-acd7-da8ce06f9259 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:44.127822 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-77512690-9349-4a22-acd7-da8ce06f9259 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:44.134326 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-77512690-9349-4a22-acd7-da8ce06f9259 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:44.134772 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-77512690-9349-4a22-acd7-da8ce06f9259 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:44.135520 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-77512690-9349-4a22-acd7-da8ce06f9259 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:44.135955 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-77512690-9349-4a22-acd7-da8ce06f9259 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:44.262046 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-77512690-9349-4a22-acd7-da8ce06f9259 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:44.269898 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-77512690-9349-4a22-acd7-da8ce06f9259 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.146611 Jun 17 15:42:44.270468 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1226/2860] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:42:44 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:42:44.636483 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-8ded97f7-ccc4-40e1-ba38-55db0b843adc tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:44.637040 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-8ded97f7-ccc4-40e1-ba38-55db0b843adc tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:44.643458 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8ded97f7-ccc4-40e1-ba38-55db0b843adc tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:44.643905 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8ded97f7-ccc4-40e1-ba38-55db0b843adc tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:44.644687 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8ded97f7-ccc4-40e1-ba38-55db0b843adc tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:44.645119 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8ded97f7-ccc4-40e1-ba38-55db0b843adc tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:44.677273 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-5c3b57de-0581-4e31-98af-ed0f0f29a1a1 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:44.677983 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-5c3b57de-0581-4e31-98af-ed0f0f29a1a1 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:44.684898 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5c3b57de-0581-4e31-98af-ed0f0f29a1a1 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:44.685491 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5c3b57de-0581-4e31-98af-ed0f0f29a1a1 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:44.686243 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5c3b57de-0581-4e31-98af-ed0f0f29a1a1 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:44.686679 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5c3b57de-0581-4e31-98af-ed0f0f29a1a1 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:44.705733 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-8ded97f7-ccc4-40e1-ba38-55db0b843adc tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:44.714213 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-8ded97f7-ccc4-40e1-ba38-55db0b843adc tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:44.715713 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-8ded97f7-ccc4-40e1-ba38-55db0b843adc tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:44.716876 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-8ded97f7-ccc4-40e1-ba38-55db0b843adc tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.084411 Jun 17 15:42:44.722705 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1635/2861] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:42:44 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:42:44.758510 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-5c3b57de-0581-4e31-98af-ed0f0f29a1a1 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:44.766447 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-5c3b57de-0581-4e31-98af-ed0f0f29a1a1 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.093313 Jun 17 15:42:44.767005 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1227/2862] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:42:44 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:42:45.286626 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-433faac7-4cc1-4588-ab3e-bb4e8db60b05 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:45.287230 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-433faac7-4cc1-4588-ab3e-bb4e8db60b05 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:45.293919 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-433faac7-4cc1-4588-ab3e-bb4e8db60b05 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:45.294361 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-433faac7-4cc1-4588-ab3e-bb4e8db60b05 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:45.295108 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-433faac7-4cc1-4588-ab3e-bb4e8db60b05 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:45.295536 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-433faac7-4cc1-4588-ab3e-bb4e8db60b05 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:45.433242 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-433faac7-4cc1-4588-ab3e-bb4e8db60b05 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:45.441038 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-433faac7-4cc1-4588-ab3e-bb4e8db60b05 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.158280 Jun 17 15:42:45.441589 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1636/2863] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:42:45 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:42:45.742450 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-0e1ca37e-43f7-4d6e-97a2-e964f17ff753 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:45.743047 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-0e1ca37e-43f7-4d6e-97a2-e964f17ff753 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:45.749582 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0e1ca37e-43f7-4d6e-97a2-e964f17ff753 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:45.750024 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0e1ca37e-43f7-4d6e-97a2-e964f17ff753 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:45.750768 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0e1ca37e-43f7-4d6e-97a2-e964f17ff753 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:45.751206 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0e1ca37e-43f7-4d6e-97a2-e964f17ff753 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:45.782995 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-d0e4d27a-1a4f-40a3-ba79-743fdbcf1675 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:45.783599 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-d0e4d27a-1a4f-40a3-ba79-743fdbcf1675 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:45.790545 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d0e4d27a-1a4f-40a3-ba79-743fdbcf1675 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:45.791004 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d0e4d27a-1a4f-40a3-ba79-743fdbcf1675 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:45.791786 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d0e4d27a-1a4f-40a3-ba79-743fdbcf1675 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:45.792270 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d0e4d27a-1a4f-40a3-ba79-743fdbcf1675 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:45.814972 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-0e1ca37e-43f7-4d6e-97a2-e964f17ff753 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:45.824374 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-0e1ca37e-43f7-4d6e-97a2-e964f17ff753 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:45.825998 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-0e1ca37e-43f7-4d6e-97a2-e964f17ff753 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:45.827213 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-0e1ca37e-43f7-4d6e-97a2-e964f17ff753 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.089140 Jun 17 15:42:45.827855 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1228/2864] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:42:45 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:42:45.854351 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-d0e4d27a-1a4f-40a3-ba79-743fdbcf1675 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:45.862484 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-d0e4d27a-1a4f-40a3-ba79-743fdbcf1675 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.083283 Jun 17 15:42:45.863083 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1637/2865] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:42:45 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:42:46.458748 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-1e4480f4-61ef-43b1-afc0-7525a02833b0 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:46.459384 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-1e4480f4-61ef-43b1-afc0-7525a02833b0 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:46.465895 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1e4480f4-61ef-43b1-afc0-7525a02833b0 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:46.466418 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1e4480f4-61ef-43b1-afc0-7525a02833b0 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:46.467097 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1e4480f4-61ef-43b1-afc0-7525a02833b0 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:46.467527 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1e4480f4-61ef-43b1-afc0-7525a02833b0 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:46.596212 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-1e4480f4-61ef-43b1-afc0-7525a02833b0 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:46.605282 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-1e4480f4-61ef-43b1-afc0-7525a02833b0 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.150353 Jun 17 15:42:46.605889 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1229/2866] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:42:46 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:42:46.845233 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-f92a7e82-c458-45f6-b055-98038898a405 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:46.845853 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-f92a7e82-c458-45f6-b055-98038898a405 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:46.853405 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f92a7e82-c458-45f6-b055-98038898a405 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:46.857383 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f92a7e82-c458-45f6-b055-98038898a405 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:46.858223 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f92a7e82-c458-45f6-b055-98038898a405 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:46.859549 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f92a7e82-c458-45f6-b055-98038898a405 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:46.879342 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-7e0dfcb3-44ec-4d9e-9dca-f29b4c2292fa tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:46.879952 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-7e0dfcb3-44ec-4d9e-9dca-f29b4c2292fa tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:46.886850 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7e0dfcb3-44ec-4d9e-9dca-f29b4c2292fa tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:46.887296 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7e0dfcb3-44ec-4d9e-9dca-f29b4c2292fa tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:46.888088 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7e0dfcb3-44ec-4d9e-9dca-f29b4c2292fa tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:46.888548 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7e0dfcb3-44ec-4d9e-9dca-f29b4c2292fa tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:46.923352 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-f92a7e82-c458-45f6-b055-98038898a405 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:46.932304 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-f92a7e82-c458-45f6-b055-98038898a405 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:46.933866 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-f92a7e82-c458-45f6-b055-98038898a405 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:46.935008 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-f92a7e82-c458-45f6-b055-98038898a405 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.093765 Jun 17 15:42:46.935766 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1638/2867] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:42:46 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:42:46.956772 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-7e0dfcb3-44ec-4d9e-9dca-f29b4c2292fa tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:46.965638 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-7e0dfcb3-44ec-4d9e-9dca-f29b4c2292fa tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.090109 Jun 17 15:42:46.966218 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1230/2868] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:42:46 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:42:47.623153 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-96df0907-1e39-4adb-b372-a2bf798d83ef tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:47.623764 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-96df0907-1e39-4adb-b372-a2bf798d83ef tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:47.625642 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_api:SELECT=80 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:42:47.631019 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-96df0907-1e39-4adb-b372-a2bf798d83ef tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:47.631412 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-96df0907-1e39-4adb-b372-a2bf798d83ef tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:47.632169 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-96df0907-1e39-4adb-b372-a2bf798d83ef tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:47.632685 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-96df0907-1e39-4adb-b372-a2bf798d83ef tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:47.953626 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-91e7972d-6cd4-41e9-8be7-33373b452784 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:47.954193 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-91e7972d-6cd4-41e9-8be7-33373b452784 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:47.961300 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-91e7972d-6cd4-41e9-8be7-33373b452784 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:47.961748 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-91e7972d-6cd4-41e9-8be7-33373b452784 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:47.962547 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-91e7972d-6cd4-41e9-8be7-33373b452784 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:47.963018 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-91e7972d-6cd4-41e9-8be7-33373b452784 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:47.994357 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-96df0907-1e39-4adb-b372-a2bf798d83ef tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:48.002499 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-96df0907-1e39-4adb-b372-a2bf798d83ef tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.383188 Jun 17 15:42:48.003081 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1639/2869] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:42:47 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:42:48.007783 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-a087fdcc-3dbb-4dfd-b65a-eeba36d33cc9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:48.008596 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-a087fdcc-3dbb-4dfd-b65a-eeba36d33cc9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:48.014740 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a087fdcc-3dbb-4dfd-b65a-eeba36d33cc9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:48.015141 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a087fdcc-3dbb-4dfd-b65a-eeba36d33cc9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:48.015916 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a087fdcc-3dbb-4dfd-b65a-eeba36d33cc9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:48.016371 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a087fdcc-3dbb-4dfd-b65a-eeba36d33cc9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:48.030416 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-91e7972d-6cd4-41e9-8be7-33373b452784 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:48.039479 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-91e7972d-6cd4-41e9-8be7-33373b452784 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:48.041013 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-91e7972d-6cd4-41e9-8be7-33373b452784 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:48.042158 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-91e7972d-6cd4-41e9-8be7-33373b452784 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.092561 Jun 17 15:42:48.042713 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1231/2870] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:42:47 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 15:42:48.078196 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-a087fdcc-3dbb-4dfd-b65a-eeba36d33cc9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:48.086603 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-a087fdcc-3dbb-4dfd-b65a-eeba36d33cc9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.082570 Jun 17 15:42:48.087166 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1640/2871] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:42:48 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:42:49.019773 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-678c911d-54b3-4835-a583-3a24bd22b50a tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:49.020366 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-678c911d-54b3-4835-a583-3a24bd22b50a tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:49.026857 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-678c911d-54b3-4835-a583-3a24bd22b50a tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:49.027303 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-678c911d-54b3-4835-a583-3a24bd22b50a tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:49.028049 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-678c911d-54b3-4835-a583-3a24bd22b50a tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:49.028523 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-678c911d-54b3-4835-a583-3a24bd22b50a tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:49.059007 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-7808a19c-cfb1-422d-bf3f-d017a9109e53 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:49.059607 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-7808a19c-cfb1-422d-bf3f-d017a9109e53 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:49.066256 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7808a19c-cfb1-422d-bf3f-d017a9109e53 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:49.066689 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7808a19c-cfb1-422d-bf3f-d017a9109e53 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:49.067452 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7808a19c-cfb1-422d-bf3f-d017a9109e53 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:49.067973 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7808a19c-cfb1-422d-bf3f-d017a9109e53 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:49.131137 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-7808a19c-cfb1-422d-bf3f-d017a9109e53 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:49.149877 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-7808a19c-cfb1-422d-bf3f-d017a9109e53 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:49.152293 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-7808a19c-cfb1-422d-bf3f-d017a9109e53 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:49.153879 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-7808a19c-cfb1-422d-bf3f-d017a9109e53 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.098709 Jun 17 15:42:49.154941 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1641/2872] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:42:49 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 15:42:49.160135 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-147e36fa-e204-4560-b8d4-1170d2d27e23 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:49.160776 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-147e36fa-e204-4560-b8d4-1170d2d27e23 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:49.164857 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-678c911d-54b3-4835-a583-3a24bd22b50a tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:49.167452 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-147e36fa-e204-4560-b8d4-1170d2d27e23 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:49.167911 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-147e36fa-e204-4560-b8d4-1170d2d27e23 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:49.168709 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-147e36fa-e204-4560-b8d4-1170d2d27e23 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:49.169147 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-147e36fa-e204-4560-b8d4-1170d2d27e23 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:49.172965 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-678c911d-54b3-4835-a583-3a24bd22b50a tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.157103 Jun 17 15:42:49.173538 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1232/2873] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:42:49 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:42:49.229074 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-147e36fa-e204-4560-b8d4-1170d2d27e23 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:49.238910 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-147e36fa-e204-4560-b8d4-1170d2d27e23 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.082521 Jun 17 15:42:49.239919 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1642/2874] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:42:49 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:42:50.173694 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-9cc01589-c214-492a-abdd-6bbac596cf00 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:50.174300 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-9cc01589-c214-492a-abdd-6bbac596cf00 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:50.180947 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9cc01589-c214-492a-abdd-6bbac596cf00 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:50.181402 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9cc01589-c214-492a-abdd-6bbac596cf00 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:50.182158 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9cc01589-c214-492a-abdd-6bbac596cf00 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:50.182591 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9cc01589-c214-492a-abdd-6bbac596cf00 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:50.190599 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-b6b94e09-e03b-466b-940d-74021e466dce tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:50.191215 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-b6b94e09-e03b-466b-940d-74021e466dce tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:50.199625 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b6b94e09-e03b-466b-940d-74021e466dce tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:50.200077 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b6b94e09-e03b-466b-940d-74021e466dce tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:50.200874 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b6b94e09-e03b-466b-940d-74021e466dce tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:50.201311 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b6b94e09-e03b-466b-940d-74021e466dce tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:50.252669 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-9cc01589-c214-492a-abdd-6bbac596cf00 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:50.262589 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-9cc01589-c214-492a-abdd-6bbac596cf00 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:50.264124 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-9cc01589-c214-492a-abdd-6bbac596cf00 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:50.265356 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-9cc01589-c214-492a-abdd-6bbac596cf00 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.096470 Jun 17 15:42:50.265924 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1233/2875] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:42:50 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:42:50.271175 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-d7a37d5a-4a1d-4c27-a436-734b4cd9541f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:50.271806 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-d7a37d5a-4a1d-4c27-a436-734b4cd9541f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:50.278146 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d7a37d5a-4a1d-4c27-a436-734b4cd9541f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:50.278634 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d7a37d5a-4a1d-4c27-a436-734b4cd9541f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:50.279584 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d7a37d5a-4a1d-4c27-a436-734b4cd9541f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:50.279770 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d7a37d5a-4a1d-4c27-a436-734b4cd9541f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:50.336592 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-b6b94e09-e03b-466b-940d-74021e466dce tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:50.344675 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-b6b94e09-e03b-466b-940d-74021e466dce tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.157982 Jun 17 15:42:50.345435 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1643/2876] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:42:50 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:42:50.350579 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-d7a37d5a-4a1d-4c27-a436-734b4cd9541f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:50.357651 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-d7a37d5a-4a1d-4c27-a436-734b4cd9541f tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.090767 Jun 17 15:42:50.358214 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1234/2877] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:42:50 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:42:51.283628 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-811e31a7-8a32-47b1-ad71-81245dad3078 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:51.284184 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-811e31a7-8a32-47b1-ad71-81245dad3078 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:51.291256 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-811e31a7-8a32-47b1-ad71-81245dad3078 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:51.291694 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-811e31a7-8a32-47b1-ad71-81245dad3078 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:51.292575 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-811e31a7-8a32-47b1-ad71-81245dad3078 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:51.293009 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-811e31a7-8a32-47b1-ad71-81245dad3078 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:51.354744 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-811e31a7-8a32-47b1-ad71-81245dad3078 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:51.361999 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-f85be2fc-8f42-4458-9478-93059dd02524 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:51.362690 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-f85be2fc-8f42-4458-9478-93059dd02524 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:51.363752 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-811e31a7-8a32-47b1-ad71-81245dad3078 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:51.364995 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_api:SELECT=84 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:42:51.365372 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-811e31a7-8a32-47b1-ad71-81245dad3078 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:51.366528 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-811e31a7-8a32-47b1-ad71-81245dad3078 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.086935 Jun 17 15:42:51.367959 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1644/2878] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:42:51 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:42:51.373890 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-06f67b42-b1fb-4239-a2a3-2f40e01e8a20 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:51.374505 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-06f67b42-b1fb-4239-a2a3-2f40e01e8a20 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:51.377010 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f85be2fc-8f42-4458-9478-93059dd02524 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:51.377466 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f85be2fc-8f42-4458-9478-93059dd02524 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:51.378239 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f85be2fc-8f42-4458-9478-93059dd02524 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:51.378995 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f85be2fc-8f42-4458-9478-93059dd02524 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:51.380570 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-06f67b42-b1fb-4239-a2a3-2f40e01e8a20 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:51.381024 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-06f67b42-b1fb-4239-a2a3-2f40e01e8a20 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:51.381525 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell1:SELECT=100 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:42:51.381791 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-06f67b42-b1fb-4239-a2a3-2f40e01e8a20 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:51.382233 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-06f67b42-b1fb-4239-a2a3-2f40e01e8a20 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:51.442827 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-06f67b42-b1fb-4239-a2a3-2f40e01e8a20 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:51.451555 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-06f67b42-b1fb-4239-a2a3-2f40e01e8a20 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.081274 Jun 17 15:42:51.452119 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1645/2879] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:42:51 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:42:51.510850 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-f85be2fc-8f42-4458-9478-93059dd02524 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:51.518753 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-f85be2fc-8f42-4458-9478-93059dd02524 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.160715 Jun 17 15:42:51.519305 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1235/2880] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:42:51 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:42:52.384600 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-bc47a35c-6d70-4e77-b9ed-c5d653c2404c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:52.385211 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-bc47a35c-6d70-4e77-b9ed-c5d653c2404c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:52.391593 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bc47a35c-6d70-4e77-b9ed-c5d653c2404c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:52.392036 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bc47a35c-6d70-4e77-b9ed-c5d653c2404c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:52.392810 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bc47a35c-6d70-4e77-b9ed-c5d653c2404c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:52.393241 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bc47a35c-6d70-4e77-b9ed-c5d653c2404c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:52.454647 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-bc47a35c-6d70-4e77-b9ed-c5d653c2404c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:52.463493 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-bc47a35c-6d70-4e77-b9ed-c5d653c2404c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:52.465029 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-bc47a35c-6d70-4e77-b9ed-c5d653c2404c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:52.466155 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-bc47a35c-6d70-4e77-b9ed-c5d653c2404c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.085585 Jun 17 15:42:52.466697 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1646/2881] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:42:52 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:42:52.468754 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-8b79e511-1a73-4c08-9bb4-84ba61bbb9cb tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:52.469373 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-8b79e511-1a73-4c08-9bb4-84ba61bbb9cb tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:52.475470 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8b79e511-1a73-4c08-9bb4-84ba61bbb9cb tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:52.476172 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8b79e511-1a73-4c08-9bb4-84ba61bbb9cb tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:52.476948 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8b79e511-1a73-4c08-9bb4-84ba61bbb9cb tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:52.477385 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8b79e511-1a73-4c08-9bb4-84ba61bbb9cb tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:52.536280 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-243b7f4b-2e9d-492e-869a-6a536c01eb05 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:52.536917 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-243b7f4b-2e9d-492e-869a-6a536c01eb05 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:52.537703 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-8b79e511-1a73-4c08-9bb4-84ba61bbb9cb tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:52.542959 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-243b7f4b-2e9d-492e-869a-6a536c01eb05 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:52.543409 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-243b7f4b-2e9d-492e-869a-6a536c01eb05 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:52.544176 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-243b7f4b-2e9d-492e-869a-6a536c01eb05 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:52.544639 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-243b7f4b-2e9d-492e-869a-6a536c01eb05 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:52.545514 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-8b79e511-1a73-4c08-9bb4-84ba61bbb9cb tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.080472 Jun 17 15:42:52.546118 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1236/2882] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:42:52 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:42:52.674469 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-243b7f4b-2e9d-492e-869a-6a536c01eb05 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:52.682423 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-243b7f4b-2e9d-492e-869a-6a536c01eb05 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.150048 Jun 17 15:42:52.682991 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1647/2883] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:42:52 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:42:53.483954 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-e91fbfc6-462a-4bc4-a532-2766d55b70fb tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:53.484599 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-e91fbfc6-462a-4bc4-a532-2766d55b70fb tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:53.491277 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e91fbfc6-462a-4bc4-a532-2766d55b70fb tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:53.491729 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e91fbfc6-462a-4bc4-a532-2766d55b70fb tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:53.492609 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e91fbfc6-462a-4bc4-a532-2766d55b70fb tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:53.493052 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e91fbfc6-462a-4bc4-a532-2766d55b70fb tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:53.555103 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-e91fbfc6-462a-4bc4-a532-2766d55b70fb tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:53.562952 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-eb97a80b-afbe-4d12-98d6-a9e64a23706d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:53.563560 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-eb97a80b-afbe-4d12-98d6-a9e64a23706d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:53.564734 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-e91fbfc6-462a-4bc4-a532-2766d55b70fb tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:53.566242 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-e91fbfc6-462a-4bc4-a532-2766d55b70fb tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:53.567390 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-e91fbfc6-462a-4bc4-a532-2766d55b70fb tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.087430 Jun 17 15:42:53.567977 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1237/2884] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:42:53 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:42:53.570472 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-eb97a80b-afbe-4d12-98d6-a9e64a23706d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:53.570911 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-eb97a80b-afbe-4d12-98d6-a9e64a23706d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:53.571712 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-eb97a80b-afbe-4d12-98d6-a9e64a23706d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:53.572172 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-eb97a80b-afbe-4d12-98d6-a9e64a23706d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:53.636450 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-eb97a80b-afbe-4d12-98d6-a9e64a23706d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:53.639584 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=100 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:42:53.647201 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-eb97a80b-afbe-4d12-98d6-a9e64a23706d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.088048 Jun 17 15:42:53.647783 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1648/2885] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:42:53 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:42:53.699641 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-4385d427-de68-4961-b617-e0ba50206e9d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:53.700253 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-4385d427-de68-4961-b617-e0ba50206e9d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:53.706342 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4385d427-de68-4961-b617-e0ba50206e9d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:53.706792 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4385d427-de68-4961-b617-e0ba50206e9d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:53.707556 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4385d427-de68-4961-b617-e0ba50206e9d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:53.707991 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4385d427-de68-4961-b617-e0ba50206e9d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:53.842893 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-4385d427-de68-4961-b617-e0ba50206e9d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:53.851137 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-4385d427-de68-4961-b617-e0ba50206e9d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.155299 Jun 17 15:42:53.851705 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1238/2886] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:42:53 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:42:54.585678 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-203f59d0-4b18-4968-950d-aea2c6a04407 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:54.586271 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-203f59d0-4b18-4968-950d-aea2c6a04407 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:54.592867 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-203f59d0-4b18-4968-950d-aea2c6a04407 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:54.593312 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-203f59d0-4b18-4968-950d-aea2c6a04407 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:54.594073 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-203f59d0-4b18-4968-950d-aea2c6a04407 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:54.594499 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-203f59d0-4b18-4968-950d-aea2c6a04407 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:54.658165 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-203f59d0-4b18-4968-950d-aea2c6a04407 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:54.664284 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-9189c999-b0db-4c1f-b6ae-b92fe48692ff tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:54.664915 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-9189c999-b0db-4c1f-b6ae-b92fe48692ff tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:54.666857 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-203f59d0-4b18-4968-950d-aea2c6a04407 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:54.668391 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-203f59d0-4b18-4968-950d-aea2c6a04407 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:54.669560 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-203f59d0-4b18-4968-950d-aea2c6a04407 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.087850 Jun 17 15:42:54.670313 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1649/2887] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:42:54 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:42:54.671461 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9189c999-b0db-4c1f-b6ae-b92fe48692ff tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:54.671904 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9189c999-b0db-4c1f-b6ae-b92fe48692ff tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:54.672694 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9189c999-b0db-4c1f-b6ae-b92fe48692ff tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:54.673123 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9189c999-b0db-4c1f-b6ae-b92fe48692ff tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:54.735834 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-9189c999-b0db-4c1f-b6ae-b92fe48692ff tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:54.744593 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-9189c999-b0db-4c1f-b6ae-b92fe48692ff tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.083989 Jun 17 15:42:54.745171 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1239/2888] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:42:54 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:42:54.867968 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-9074a1d8-b58e-4106-a5b1-6d74b27943f6 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:54.869224 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-9074a1d8-b58e-4106-a5b1-6d74b27943f6 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:54.875389 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9074a1d8-b58e-4106-a5b1-6d74b27943f6 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:54.875825 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9074a1d8-b58e-4106-a5b1-6d74b27943f6 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:54.876617 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9074a1d8-b58e-4106-a5b1-6d74b27943f6 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:54.877045 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9074a1d8-b58e-4106-a5b1-6d74b27943f6 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:55.013033 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-9074a1d8-b58e-4106-a5b1-6d74b27943f6 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:55.021206 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-9074a1d8-b58e-4106-a5b1-6d74b27943f6 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.157097 Jun 17 15:42:55.021780 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1650/2889] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:42:54 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:42:55.428284 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 15:42:55.428709 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Fri Jun 17 15:42:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 15:42:55.687778 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-c76dc6e1-2f41-4a4a-95ba-82f2630f0d74 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:55.688415 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-c76dc6e1-2f41-4a4a-95ba-82f2630f0d74 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:55.694843 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c76dc6e1-2f41-4a4a-95ba-82f2630f0d74 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:55.695288 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c76dc6e1-2f41-4a4a-95ba-82f2630f0d74 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:55.697203 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c76dc6e1-2f41-4a4a-95ba-82f2630f0d74 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:55.697645 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c76dc6e1-2f41-4a4a-95ba-82f2630f0d74 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:55.760949 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-c76dc6e1-2f41-4a4a-95ba-82f2630f0d74 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:55.765066 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-0682d42f-2b38-456c-b99f-1cb87e9419c9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:55.769442 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-0682d42f-2b38-456c-b99f-1cb87e9419c9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:55.769790 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-c76dc6e1-2f41-4a4a-95ba-82f2630f0d74 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:55.771270 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-c76dc6e1-2f41-4a4a-95ba-82f2630f0d74 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:55.772703 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-c76dc6e1-2f41-4a4a-95ba-82f2630f0d74 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.089080 Jun 17 15:42:55.773265 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1240/2890] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:42:55 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:42:55.780056 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0682d42f-2b38-456c-b99f-1cb87e9419c9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:55.780498 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0682d42f-2b38-456c-b99f-1cb87e9419c9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:55.781280 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0682d42f-2b38-456c-b99f-1cb87e9419c9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:55.781713 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0682d42f-2b38-456c-b99f-1cb87e9419c9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:55.845036 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-0682d42f-2b38-456c-b99f-1cb87e9419c9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:55.854139 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-0682d42f-2b38-456c-b99f-1cb87e9419c9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.095897 Jun 17 15:42:55.854721 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1651/2891] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:42:55 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:42:56.038441 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-d4e46f47-eefd-40d9-a5ca-09ab65f16c71 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:56.038966 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-d4e46f47-eefd-40d9-a5ca-09ab65f16c71 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:56.045023 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d4e46f47-eefd-40d9-a5ca-09ab65f16c71 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:56.045469 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d4e46f47-eefd-40d9-a5ca-09ab65f16c71 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:56.046226 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d4e46f47-eefd-40d9-a5ca-09ab65f16c71 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:56.046655 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d4e46f47-eefd-40d9-a5ca-09ab65f16c71 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:56.192634 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-d4e46f47-eefd-40d9-a5ca-09ab65f16c71 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:56.201313 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-d4e46f47-eefd-40d9-a5ca-09ab65f16c71 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.166793 Jun 17 15:42:56.201886 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1241/2892] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:42:56 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:42:56.791256 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-a2a55df8-5b04-4d0b-b1ea-58c6f7df4e24 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:56.792466 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-a2a55df8-5b04-4d0b-b1ea-58c6f7df4e24 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:56.798428 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a2a55df8-5b04-4d0b-b1ea-58c6f7df4e24 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:56.798870 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a2a55df8-5b04-4d0b-b1ea-58c6f7df4e24 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:56.799634 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a2a55df8-5b04-4d0b-b1ea-58c6f7df4e24 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:56.800057 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a2a55df8-5b04-4d0b-b1ea-58c6f7df4e24 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:56.821153 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 15:42:56.821424 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Fri Jun 17 15:42:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 (ip 10.222.0.48) !!! Jun 17 15:42:56.873366 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-a2a55df8-5b04-4d0b-b1ea-58c6f7df4e24 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:56.875410 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-308af3f9-4d63-4d2f-87dd-cd7d4550d41b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:56.876160 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-308af3f9-4d63-4d2f-87dd-cd7d4550d41b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:56.883054 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-308af3f9-4d63-4d2f-87dd-cd7d4550d41b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:56.883578 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-308af3f9-4d63-4d2f-87dd-cd7d4550d41b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:56.884315 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-a2a55df8-5b04-4d0b-b1ea-58c6f7df4e24 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:56.884526 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-308af3f9-4d63-4d2f-87dd-cd7d4550d41b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:56.884725 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-308af3f9-4d63-4d2f-87dd-cd7d4550d41b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:56.886764 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-a2a55df8-5b04-4d0b-b1ea-58c6f7df4e24 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:56.888029 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-a2a55df8-5b04-4d0b-b1ea-58c6f7df4e24 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.100848 Jun 17 15:42:56.889067 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1652/2893] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:42:56 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:42:56.950967 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-308af3f9-4d63-4d2f-87dd-cd7d4550d41b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:56.959376 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-308af3f9-4d63-4d2f-87dd-cd7d4550d41b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.092004 Jun 17 15:42:56.959973 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1242/2894] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:42:56 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:42:57.219018 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-60b196b9-d8f3-4dd4-a12e-a9083149fcb6 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:57.219872 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-60b196b9-d8f3-4dd4-a12e-a9083149fcb6 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:57.226457 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-60b196b9-d8f3-4dd4-a12e-a9083149fcb6 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:57.226910 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-60b196b9-d8f3-4dd4-a12e-a9083149fcb6 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:57.227678 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-60b196b9-d8f3-4dd4-a12e-a9083149fcb6 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:57.228113 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-60b196b9-d8f3-4dd4-a12e-a9083149fcb6 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:57.366730 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-60b196b9-d8f3-4dd4-a12e-a9083149fcb6 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:57.375471 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-60b196b9-d8f3-4dd4-a12e-a9083149fcb6 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.160301 Jun 17 15:42:57.376050 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1653/2895] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:42:57 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:42:57.906606 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-d6afb2e9-7180-491d-8672-fc4b3150523c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:57.907194 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-d6afb2e9-7180-491d-8672-fc4b3150523c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:57.913843 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d6afb2e9-7180-491d-8672-fc4b3150523c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:57.914292 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d6afb2e9-7180-491d-8672-fc4b3150523c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:57.915051 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d6afb2e9-7180-491d-8672-fc4b3150523c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:57.915490 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d6afb2e9-7180-491d-8672-fc4b3150523c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:57.979788 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-35b3f727-b30b-45a0-86c4-32e711ee783d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:57.980397 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-d6afb2e9-7180-491d-8672-fc4b3150523c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:57.980547 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-35b3f727-b30b-45a0-86c4-32e711ee783d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:57.987012 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-35b3f727-b30b-45a0-86c4-32e711ee783d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:57.987460 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-35b3f727-b30b-45a0-86c4-32e711ee783d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:57.988228 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-35b3f727-b30b-45a0-86c4-32e711ee783d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:57.988688 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-35b3f727-b30b-45a0-86c4-32e711ee783d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:57.989720 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-d6afb2e9-7180-491d-8672-fc4b3150523c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:57.991209 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-d6afb2e9-7180-491d-8672-fc4b3150523c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:57.992436 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-d6afb2e9-7180-491d-8672-fc4b3150523c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.089701 Jun 17 15:42:57.993007 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1243/2896] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:42:57 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:42:58.052597 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-35b3f727-b30b-45a0-86c4-32e711ee783d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:58.060868 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-35b3f727-b30b-45a0-86c4-32e711ee783d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.085595 Jun 17 15:42:58.061453 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1654/2897] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:42:57 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:42:58.392040 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-c172bf3b-181c-464e-8161-4191e7b34358 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:58.392694 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-c172bf3b-181c-464e-8161-4191e7b34358 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:58.398780 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c172bf3b-181c-464e-8161-4191e7b34358 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:58.399226 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c172bf3b-181c-464e-8161-4191e7b34358 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:58.399979 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c172bf3b-181c-464e-8161-4191e7b34358 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:58.400444 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c172bf3b-181c-464e-8161-4191e7b34358 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:58.533891 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-c172bf3b-181c-464e-8161-4191e7b34358 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:58.541998 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-c172bf3b-181c-464e-8161-4191e7b34358 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.153802 Jun 17 15:42:58.542561 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1244/2898] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:42:58 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:42:58.901948 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 15:42:58.902169 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Fri Jun 17 15:42:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 15:42:59.011858 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-73b6d595-c1d6-47aa-bc8c-bfa522c9a4e2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:59.012498 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-73b6d595-c1d6-47aa-bc8c-bfa522c9a4e2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:59.019373 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-73b6d595-c1d6-47aa-bc8c-bfa522c9a4e2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:59.019815 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-73b6d595-c1d6-47aa-bc8c-bfa522c9a4e2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:59.020612 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-73b6d595-c1d6-47aa-bc8c-bfa522c9a4e2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:59.021047 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-73b6d595-c1d6-47aa-bc8c-bfa522c9a4e2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:59.078596 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-f9451858-5fa8-409a-aa32-37e6fa84bbee tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:59.079267 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-f9451858-5fa8-409a-aa32-37e6fa84bbee tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:59.086006 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f9451858-5fa8-409a-aa32-37e6fa84bbee tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:59.086456 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f9451858-5fa8-409a-aa32-37e6fa84bbee tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:59.087230 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f9451858-5fa8-409a-aa32-37e6fa84bbee tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:59.087673 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f9451858-5fa8-409a-aa32-37e6fa84bbee tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:59.095563 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-73b6d595-c1d6-47aa-bc8c-bfa522c9a4e2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:59.105001 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-73b6d595-c1d6-47aa-bc8c-bfa522c9a4e2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:59.107091 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-73b6d595-c1d6-47aa-bc8c-bfa522c9a4e2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:59.108785 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-73b6d595-c1d6-47aa-bc8c-bfa522c9a4e2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.100713 Jun 17 15:42:59.109650 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1655/2899] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:42:59 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:42:59.159588 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-f9451858-5fa8-409a-aa32-37e6fa84bbee tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:59.168735 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-f9451858-5fa8-409a-aa32-37e6fa84bbee tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.093979 Jun 17 15:42:59.169316 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1245/2900] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:42:59 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:42:59.559203 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-44ee6275-48ba-4557-bbae-87e23ac1f225 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:42:59.559724 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-44ee6275-48ba-4557-bbae-87e23ac1f225 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:42:59.565789 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-44ee6275-48ba-4557-bbae-87e23ac1f225 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:59.566234 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-44ee6275-48ba-4557-bbae-87e23ac1f225 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:59.566983 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-44ee6275-48ba-4557-bbae-87e23ac1f225 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:42:59.567411 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-44ee6275-48ba-4557-bbae-87e23ac1f225 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:42:59.751043 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-44ee6275-48ba-4557-bbae-87e23ac1f225 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:42:59.759483 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-44ee6275-48ba-4557-bbae-87e23ac1f225 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.204192 Jun 17 15:42:59.760060 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1656/2901] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:42:59 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:43:00.127651 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-e8d1b0f5-0988-4c6c-832a-3c8b01dc4dc8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:00.128224 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-e8d1b0f5-0988-4c6c-832a-3c8b01dc4dc8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:00.134833 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e8d1b0f5-0988-4c6c-832a-3c8b01dc4dc8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:00.135781 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e8d1b0f5-0988-4c6c-832a-3c8b01dc4dc8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:00.136570 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e8d1b0f5-0988-4c6c-832a-3c8b01dc4dc8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:00.137008 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e8d1b0f5-0988-4c6c-832a-3c8b01dc4dc8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:00.185699 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-d5ffe64b-666a-414b-b872-e9a173b25fbe tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:00.186333 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-d5ffe64b-666a-414b-b872-e9a173b25fbe tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:00.192935 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d5ffe64b-666a-414b-b872-e9a173b25fbe tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:00.193384 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d5ffe64b-666a-414b-b872-e9a173b25fbe tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:00.194161 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d5ffe64b-666a-414b-b872-e9a173b25fbe tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:00.194598 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d5ffe64b-666a-414b-b872-e9a173b25fbe tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:00.199608 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-e8d1b0f5-0988-4c6c-832a-3c8b01dc4dc8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:00.208354 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-e8d1b0f5-0988-4c6c-832a-3c8b01dc4dc8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:00.209855 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-e8d1b0f5-0988-4c6c-832a-3c8b01dc4dc8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:00.210995 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-e8d1b0f5-0988-4c6c-832a-3c8b01dc4dc8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.087718 Jun 17 15:43:00.211549 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1246/2902] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:43:00 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:43:00.257417 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-d5ffe64b-666a-414b-b872-e9a173b25fbe tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:00.265976 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-d5ffe64b-666a-414b-b872-e9a173b25fbe tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.084193 Jun 17 15:43:00.266542 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1657/2903] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:43:00 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:43:00.777579 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-e85f708b-0bc1-4a2f-8700-b0fc8b4bbf34 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:00.778202 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-e85f708b-0bc1-4a2f-8700-b0fc8b4bbf34 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:00.784503 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e85f708b-0bc1-4a2f-8700-b0fc8b4bbf34 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:00.784950 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e85f708b-0bc1-4a2f-8700-b0fc8b4bbf34 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:00.785710 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e85f708b-0bc1-4a2f-8700-b0fc8b4bbf34 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:00.786197 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e85f708b-0bc1-4a2f-8700-b0fc8b4bbf34 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:00.925494 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-e85f708b-0bc1-4a2f-8700-b0fc8b4bbf34 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:00.934621 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-e85f708b-0bc1-4a2f-8700-b0fc8b4bbf34 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.161104 Jun 17 15:43:00.935643 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1247/2904] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:43:00 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:43:01.231136 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-74bf7d34-727f-48f1-b71d-febae011a190 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:01.231743 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-74bf7d34-727f-48f1-b71d-febae011a190 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:01.238734 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-74bf7d34-727f-48f1-b71d-febae011a190 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:01.239174 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-74bf7d34-727f-48f1-b71d-febae011a190 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:01.239929 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-74bf7d34-727f-48f1-b71d-febae011a190 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:01.240375 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-74bf7d34-727f-48f1-b71d-febae011a190 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:01.283027 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-f7294340-2013-4799-814b-7876e71f89e2 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:01.283639 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-f7294340-2013-4799-814b-7876e71f89e2 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:01.290219 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f7294340-2013-4799-814b-7876e71f89e2 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:01.290669 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f7294340-2013-4799-814b-7876e71f89e2 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:01.292076 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f7294340-2013-4799-814b-7876e71f89e2 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:01.292539 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f7294340-2013-4799-814b-7876e71f89e2 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:01.302260 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-74bf7d34-727f-48f1-b71d-febae011a190 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:01.310818 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-74bf7d34-727f-48f1-b71d-febae011a190 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:01.312354 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-74bf7d34-727f-48f1-b71d-febae011a190 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:01.313484 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-74bf7d34-727f-48f1-b71d-febae011a190 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.086897 Jun 17 15:43:01.314035 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1658/2905] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:43:01 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:43:01.354664 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-f7294340-2013-4799-814b-7876e71f89e2 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:01.362648 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-f7294340-2013-4799-814b-7876e71f89e2 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.083656 Jun 17 15:43:01.363408 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1248/2906] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:43:01 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:43:01.952969 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-e4b2cb9c-ab28-40f0-a411-54788ef3d7bc tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:01.953586 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-e4b2cb9c-ab28-40f0-a411-54788ef3d7bc tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:01.959777 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e4b2cb9c-ab28-40f0-a411-54788ef3d7bc tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:01.960231 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e4b2cb9c-ab28-40f0-a411-54788ef3d7bc tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:01.961050 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e4b2cb9c-ab28-40f0-a411-54788ef3d7bc tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:01.961488 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e4b2cb9c-ab28-40f0-a411-54788ef3d7bc tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:02.092682 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-e4b2cb9c-ab28-40f0-a411-54788ef3d7bc tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:02.100630 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-e4b2cb9c-ab28-40f0-a411-54788ef3d7bc tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.152635 Jun 17 15:43:02.101464 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1659/2907] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:43:01 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:43:02.331236 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-41523a2c-a902-400f-90d9-52a666a2a1a1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:02.331830 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-41523a2c-a902-400f-90d9-52a666a2a1a1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:02.338364 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-41523a2c-a902-400f-90d9-52a666a2a1a1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:02.338807 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-41523a2c-a902-400f-90d9-52a666a2a1a1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:02.339559 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-41523a2c-a902-400f-90d9-52a666a2a1a1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:02.339989 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-41523a2c-a902-400f-90d9-52a666a2a1a1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:02.379610 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-0230f5b6-1fb2-49a7-aab0-7f9f1b684622 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:02.380230 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-0230f5b6-1fb2-49a7-aab0-7f9f1b684622 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:02.386907 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0230f5b6-1fb2-49a7-aab0-7f9f1b684622 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:02.387353 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0230f5b6-1fb2-49a7-aab0-7f9f1b684622 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:02.388123 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0230f5b6-1fb2-49a7-aab0-7f9f1b684622 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:02.388588 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0230f5b6-1fb2-49a7-aab0-7f9f1b684622 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:02.403397 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-41523a2c-a902-400f-90d9-52a666a2a1a1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:02.411836 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-41523a2c-a902-400f-90d9-52a666a2a1a1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:02.413375 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-41523a2c-a902-400f-90d9-52a666a2a1a1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:02.414534 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-41523a2c-a902-400f-90d9-52a666a2a1a1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.087408 Jun 17 15:43:02.415097 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1249/2908] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:43:02 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:43:02.451518 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-0230f5b6-1fb2-49a7-aab0-7f9f1b684622 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:02.459803 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-0230f5b6-1fb2-49a7-aab0-7f9f1b684622 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.084107 Jun 17 15:43:02.460384 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1660/2909] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:43:02 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:43:03.117525 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-134ff509-a81f-44ed-9dc7-4c5ede79c974 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:03.118137 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-134ff509-a81f-44ed-9dc7-4c5ede79c974 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:03.124301 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-134ff509-a81f-44ed-9dc7-4c5ede79c974 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:03.124782 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-134ff509-a81f-44ed-9dc7-4c5ede79c974 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:03.125540 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-134ff509-a81f-44ed-9dc7-4c5ede79c974 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:03.125975 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-134ff509-a81f-44ed-9dc7-4c5ede79c974 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:03.260806 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-134ff509-a81f-44ed-9dc7-4c5ede79c974 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:03.268850 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-134ff509-a81f-44ed-9dc7-4c5ede79c974 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.155115 Jun 17 15:43:03.269427 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1250/2910] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:43:03 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:43:03.433559 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-f92fbfe1-bffe-4473-932a-047f0f3777e0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:03.434138 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-f92fbfe1-bffe-4473-932a-047f0f3777e0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:03.440766 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f92fbfe1-bffe-4473-932a-047f0f3777e0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:03.441212 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f92fbfe1-bffe-4473-932a-047f0f3777e0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:03.441962 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f92fbfe1-bffe-4473-932a-047f0f3777e0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:03.442389 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f92fbfe1-bffe-4473-932a-047f0f3777e0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:03.476887 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-da4139a9-ce37-4dfb-a540-0d54bd4da04e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:03.477524 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-da4139a9-ce37-4dfb-a540-0d54bd4da04e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:03.484052 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-da4139a9-ce37-4dfb-a540-0d54bd4da04e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:03.484537 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-da4139a9-ce37-4dfb-a540-0d54bd4da04e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:03.485334 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-da4139a9-ce37-4dfb-a540-0d54bd4da04e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:03.485855 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-da4139a9-ce37-4dfb-a540-0d54bd4da04e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:03.505614 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-f92fbfe1-bffe-4473-932a-047f0f3777e0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:03.514986 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-f92fbfe1-bffe-4473-932a-047f0f3777e0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:03.516521 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-f92fbfe1-bffe-4473-932a-047f0f3777e0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:03.517664 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-f92fbfe1-bffe-4473-932a-047f0f3777e0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.088557 Jun 17 15:43:03.518537 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1661/2911] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:43:03 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:43:03.550359 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-da4139a9-ce37-4dfb-a540-0d54bd4da04e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:03.552648 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell1:SELECT=100 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:43:03.561039 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-da4139a9-ce37-4dfb-a540-0d54bd4da04e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.088284 Jun 17 15:43:03.561629 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1251/2912] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:43:03 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:43:04.286072 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-03a74834-9f36-47f0-a6a2-2445f655505e tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:04.286695 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-03a74834-9f36-47f0-a6a2-2445f655505e tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:04.293386 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-03a74834-9f36-47f0-a6a2-2445f655505e tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:04.293840 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-03a74834-9f36-47f0-a6a2-2445f655505e tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:04.294603 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-03a74834-9f36-47f0-a6a2-2445f655505e tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:04.295041 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-03a74834-9f36-47f0-a6a2-2445f655505e tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:04.433035 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-03a74834-9f36-47f0-a6a2-2445f655505e tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:04.441369 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-03a74834-9f36-47f0-a6a2-2445f655505e tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.159138 Jun 17 15:43:04.442016 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1662/2913] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:43:04 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:43:04.536519 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-0c2de479-935f-4792-8c1b-849ed426dbf5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:04.537101 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-0c2de479-935f-4792-8c1b-849ed426dbf5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:04.543488 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0c2de479-935f-4792-8c1b-849ed426dbf5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:04.543938 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0c2de479-935f-4792-8c1b-849ed426dbf5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:04.544731 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0c2de479-935f-4792-8c1b-849ed426dbf5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:04.545171 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0c2de479-935f-4792-8c1b-849ed426dbf5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:04.578815 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-e03b23f3-1d86-4e51-a778-85ee0703917a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:04.579551 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-e03b23f3-1d86-4e51-a778-85ee0703917a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:04.585815 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e03b23f3-1d86-4e51-a778-85ee0703917a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:04.586349 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e03b23f3-1d86-4e51-a778-85ee0703917a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:04.587122 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e03b23f3-1d86-4e51-a778-85ee0703917a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:04.587557 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e03b23f3-1d86-4e51-a778-85ee0703917a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:04.609292 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-0c2de479-935f-4792-8c1b-849ed426dbf5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:04.618420 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-0c2de479-935f-4792-8c1b-849ed426dbf5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:04.619919 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-0c2de479-935f-4792-8c1b-849ed426dbf5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:04.621109 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-0c2de479-935f-4792-8c1b-849ed426dbf5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.088684 Jun 17 15:43:04.621665 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1252/2914] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:43:04 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:43:04.664929 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-e03b23f3-1d86-4e51-a778-85ee0703917a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:04.673435 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-e03b23f3-1d86-4e51-a778-85ee0703917a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.098386 Jun 17 15:43:04.674017 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1663/2915] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:43:04 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:43:05.459300 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-b2c3766b-5ef3-4a11-9e21-8b816e463c66 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:05.459832 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-b2c3766b-5ef3-4a11-9e21-8b816e463c66 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:05.466641 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b2c3766b-5ef3-4a11-9e21-8b816e463c66 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:05.467113 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b2c3766b-5ef3-4a11-9e21-8b816e463c66 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:05.467880 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b2c3766b-5ef3-4a11-9e21-8b816e463c66 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:05.468316 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b2c3766b-5ef3-4a11-9e21-8b816e463c66 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:05.601506 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-b2c3766b-5ef3-4a11-9e21-8b816e463c66 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:05.610754 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-b2c3766b-5ef3-4a11-9e21-8b816e463c66 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.155451 Jun 17 15:43:05.611339 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1253/2916] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:43:05 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:43:05.639809 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-1c4ed180-6012-4e55-a951-4c29b551eeb7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:05.640494 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-1c4ed180-6012-4e55-a951-4c29b551eeb7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:05.647726 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1c4ed180-6012-4e55-a951-4c29b551eeb7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:05.648195 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1c4ed180-6012-4e55-a951-4c29b551eeb7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:05.649001 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1c4ed180-6012-4e55-a951-4c29b551eeb7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:05.649437 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1c4ed180-6012-4e55-a951-4c29b551eeb7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:05.692197 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-b11d5044-04a7-484b-b771-0815171f5e53 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:05.692840 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-b11d5044-04a7-484b-b771-0815171f5e53 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:05.699273 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b11d5044-04a7-484b-b771-0815171f5e53 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:05.699725 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b11d5044-04a7-484b-b771-0815171f5e53 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:05.700523 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b11d5044-04a7-484b-b771-0815171f5e53 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:05.700960 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b11d5044-04a7-484b-b771-0815171f5e53 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:05.717890 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-1c4ed180-6012-4e55-a951-4c29b551eeb7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:05.726666 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-1c4ed180-6012-4e55-a951-4c29b551eeb7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:05.728169 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-1c4ed180-6012-4e55-a951-4c29b551eeb7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:05.729884 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-1c4ed180-6012-4e55-a951-4c29b551eeb7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.094452 Jun 17 15:43:05.730438 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1664/2917] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:43:05 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:43:05.769700 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-b11d5044-04a7-484b-b771-0815171f5e53 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:05.778609 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-b11d5044-04a7-484b-b771-0815171f5e53 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.090150 Jun 17 15:43:05.779182 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1254/2918] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:43:05 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:43:06.628406 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-36b3d6d7-4c06-4361-af52-8e6ac6e78d6f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:06.628955 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-36b3d6d7-4c06-4361-af52-8e6ac6e78d6f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:06.636019 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-36b3d6d7-4c06-4361-af52-8e6ac6e78d6f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:06.636513 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-36b3d6d7-4c06-4361-af52-8e6ac6e78d6f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:06.637296 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-36b3d6d7-4c06-4361-af52-8e6ac6e78d6f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:06.637732 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-36b3d6d7-4c06-4361-af52-8e6ac6e78d6f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:06.654214 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=100 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:43:06.747662 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-9bcc6d52-d1b3-4f40-bff2-8f18ad8b38ae tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:06.748395 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-9bcc6d52-d1b3-4f40-bff2-8f18ad8b38ae tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:06.755880 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9bcc6d52-d1b3-4f40-bff2-8f18ad8b38ae tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:06.756400 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9bcc6d52-d1b3-4f40-bff2-8f18ad8b38ae tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:06.757228 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9bcc6d52-d1b3-4f40-bff2-8f18ad8b38ae tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:06.757670 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9bcc6d52-d1b3-4f40-bff2-8f18ad8b38ae tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:06.771707 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-36b3d6d7-4c06-4361-af52-8e6ac6e78d6f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:06.779772 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-36b3d6d7-4c06-4361-af52-8e6ac6e78d6f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.156296 Jun 17 15:43:06.788431 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1665/2919] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:43:06 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:43:06.796657 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-49141706-aaa9-48d4-a85e-dbbb89337b88 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:06.797268 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-49141706-aaa9-48d4-a85e-dbbb89337b88 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:06.803752 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-49141706-aaa9-48d4-a85e-dbbb89337b88 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:06.804298 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-49141706-aaa9-48d4-a85e-dbbb89337b88 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:06.805016 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-49141706-aaa9-48d4-a85e-dbbb89337b88 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:06.805443 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-49141706-aaa9-48d4-a85e-dbbb89337b88 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:06.824168 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-9bcc6d52-d1b3-4f40-bff2-8f18ad8b38ae tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:06.833760 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-9bcc6d52-d1b3-4f40-bff2-8f18ad8b38ae tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:06.835120 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-9bcc6d52-d1b3-4f40-bff2-8f18ad8b38ae tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:06.836299 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-9bcc6d52-d1b3-4f40-bff2-8f18ad8b38ae tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.093146 Jun 17 15:43:06.845232 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1255/2920] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:43:06 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 15:43:06.874656 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-49141706-aaa9-48d4-a85e-dbbb89337b88 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:06.882785 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-49141706-aaa9-48d4-a85e-dbbb89337b88 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.091473 Jun 17 15:43:06.883279 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1666/2921] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:43:06 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:43:07.796894 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-888aeaf9-b8da-4d58-9f15-74cf3d49f7d9 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:07.797504 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-888aeaf9-b8da-4d58-9f15-74cf3d49f7d9 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:07.803773 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-888aeaf9-b8da-4d58-9f15-74cf3d49f7d9 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:07.804212 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-888aeaf9-b8da-4d58-9f15-74cf3d49f7d9 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:07.804998 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-888aeaf9-b8da-4d58-9f15-74cf3d49f7d9 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:07.805432 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-888aeaf9-b8da-4d58-9f15-74cf3d49f7d9 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:07.855896 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-e5697e1f-17f3-424c-9a80-c39f72727132 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:07.856559 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-e5697e1f-17f3-424c-9a80-c39f72727132 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:07.863801 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e5697e1f-17f3-424c-9a80-c39f72727132 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:07.864248 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e5697e1f-17f3-424c-9a80-c39f72727132 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:07.865046 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e5697e1f-17f3-424c-9a80-c39f72727132 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:07.865542 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e5697e1f-17f3-424c-9a80-c39f72727132 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:07.929497 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-e5697e1f-17f3-424c-9a80-c39f72727132 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:07.938826 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-e5697e1f-17f3-424c-9a80-c39f72727132 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:07.940419 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-e5697e1f-17f3-424c-9a80-c39f72727132 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:07.941476 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-e5697e1f-17f3-424c-9a80-c39f72727132 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.090285 Jun 17 15:43:07.942028 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1667/2922] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:43:07 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 15:43:07.946537 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-b94e7ca6-e583-4053-bc3a-246683471476 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:07.948280 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-b94e7ca6-e583-4053-bc3a-246683471476 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:07.954394 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b94e7ca6-e583-4053-bc3a-246683471476 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:07.954771 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b94e7ca6-e583-4053-bc3a-246683471476 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:07.955526 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b94e7ca6-e583-4053-bc3a-246683471476 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:07.955954 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b94e7ca6-e583-4053-bc3a-246683471476 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:07.969849 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-888aeaf9-b8da-4d58-9f15-74cf3d49f7d9 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:07.978938 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-888aeaf9-b8da-4d58-9f15-74cf3d49f7d9 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.185957 Jun 17 15:43:07.979516 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1256/2923] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:43:07 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:43:08.021152 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-b94e7ca6-e583-4053-bc3a-246683471476 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:08.029426 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-b94e7ca6-e583-4053-bc3a-246683471476 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.086353 Jun 17 15:43:08.030162 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1668/2924] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:43:07 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:43:08.959166 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-95f11a3f-23d6-4beb-b47d-6b5cb4018cb8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:08.959741 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-95f11a3f-23d6-4beb-b47d-6b5cb4018cb8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:08.966967 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-95f11a3f-23d6-4beb-b47d-6b5cb4018cb8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:08.967928 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-95f11a3f-23d6-4beb-b47d-6b5cb4018cb8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:08.968186 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-95f11a3f-23d6-4beb-b47d-6b5cb4018cb8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:08.969708 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-95f11a3f-23d6-4beb-b47d-6b5cb4018cb8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:08.996351 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-82219edb-235f-484a-9da7-d13535181c97 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:08.997056 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-82219edb-235f-484a-9da7-d13535181c97 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:09.003750 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-82219edb-235f-484a-9da7-d13535181c97 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:09.004275 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-82219edb-235f-484a-9da7-d13535181c97 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:09.005161 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-82219edb-235f-484a-9da7-d13535181c97 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:09.005661 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-82219edb-235f-484a-9da7-d13535181c97 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:09.035690 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-95f11a3f-23d6-4beb-b47d-6b5cb4018cb8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:09.044718 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-95f11a3f-23d6-4beb-b47d-6b5cb4018cb8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:09.046218 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-95f11a3f-23d6-4beb-b47d-6b5cb4018cb8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:09.047364 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-95f11a3f-23d6-4beb-b47d-6b5cb4018cb8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.092213 Jun 17 15:43:09.047908 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1257/2925] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:43:08 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:43:09.052504 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-c420000c-6b94-4089-b938-2b93d581d438 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:09.053114 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-c420000c-6b94-4089-b938-2b93d581d438 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:09.059393 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c420000c-6b94-4089-b938-2b93d581d438 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:09.059839 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c420000c-6b94-4089-b938-2b93d581d438 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:09.060637 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c420000c-6b94-4089-b938-2b93d581d438 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:09.061068 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c420000c-6b94-4089-b938-2b93d581d438 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:09.126008 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-c420000c-6b94-4089-b938-2b93d581d438 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:09.134161 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-c420000c-6b94-4089-b938-2b93d581d438 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.085141 Jun 17 15:43:09.134684 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1258/2926] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:43:09 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:43:09.152597 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-82219edb-235f-484a-9da7-d13535181c97 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:09.160928 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-82219edb-235f-484a-9da7-d13535181c97 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.168451 Jun 17 15:43:09.161604 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1669/2927] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:43:08 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:43:10.065899 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-35859092-8944-47c8-b277-3fb9f5dc334e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:10.066480 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-35859092-8944-47c8-b277-3fb9f5dc334e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:10.073377 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-35859092-8944-47c8-b277-3fb9f5dc334e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:10.073824 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-35859092-8944-47c8-b277-3fb9f5dc334e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:10.074590 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-35859092-8944-47c8-b277-3fb9f5dc334e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:10.075026 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-35859092-8944-47c8-b277-3fb9f5dc334e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:10.138863 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-35859092-8944-47c8-b277-3fb9f5dc334e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:10.147492 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-35859092-8944-47c8-b277-3fb9f5dc334e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:10.149034 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-35859092-8944-47c8-b277-3fb9f5dc334e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:10.150191 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-35859092-8944-47c8-b277-3fb9f5dc334e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.088377 Jun 17 15:43:10.151262 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1259/2928] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:43:10 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:43:10.153797 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-4ba0426a-833a-4bc8-befe-82485ceea697 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:10.154411 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-4ba0426a-833a-4bc8-befe-82485ceea697 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:10.161337 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4ba0426a-833a-4bc8-befe-82485ceea697 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:10.161783 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4ba0426a-833a-4bc8-befe-82485ceea697 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:10.162550 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4ba0426a-833a-4bc8-befe-82485ceea697 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:10.162974 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4ba0426a-833a-4bc8-befe-82485ceea697 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:10.178310 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-0b3fbb34-584e-4090-bf35-b31160ef3984 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:10.178931 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-0b3fbb34-584e-4090-bf35-b31160ef3984 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:10.185356 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0b3fbb34-584e-4090-bf35-b31160ef3984 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:10.185807 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0b3fbb34-584e-4090-bf35-b31160ef3984 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:10.186592 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0b3fbb34-584e-4090-bf35-b31160ef3984 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:10.187084 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0b3fbb34-584e-4090-bf35-b31160ef3984 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:10.227244 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-4ba0426a-833a-4bc8-befe-82485ceea697 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:10.236045 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-4ba0426a-833a-4bc8-befe-82485ceea697 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.086545 Jun 17 15:43:10.236741 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1670/2929] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:43:10 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:43:10.320047 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-0b3fbb34-584e-4090-bf35-b31160ef3984 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:10.328141 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-0b3fbb34-584e-4090-bf35-b31160ef3984 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.153658 Jun 17 15:43:10.328740 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1260/2930] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:43:10 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:43:11.169273 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-e093f586-71fa-4b07-8c6f-2b73a6a2714f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:11.169880 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-e093f586-71fa-4b07-8c6f-2b73a6a2714f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:11.176417 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e093f586-71fa-4b07-8c6f-2b73a6a2714f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:11.176858 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e093f586-71fa-4b07-8c6f-2b73a6a2714f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:11.177611 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e093f586-71fa-4b07-8c6f-2b73a6a2714f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:11.178038 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e093f586-71fa-4b07-8c6f-2b73a6a2714f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:11.239989 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-e093f586-71fa-4b07-8c6f-2b73a6a2714f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:11.251215 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-e093f586-71fa-4b07-8c6f-2b73a6a2714f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:11.252739 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-e093f586-71fa-4b07-8c6f-2b73a6a2714f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:11.252944 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-9923d288-9afc-4eb3-8ef6-15443c74a781 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:11.253573 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-9923d288-9afc-4eb3-8ef6-15443c74a781 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:11.254091 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-e093f586-71fa-4b07-8c6f-2b73a6a2714f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.089094 Jun 17 15:43:11.256995 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1671/2931] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:43:11 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:43:11.260486 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9923d288-9afc-4eb3-8ef6-15443c74a781 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:11.260949 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9923d288-9afc-4eb3-8ef6-15443c74a781 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:11.261719 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9923d288-9afc-4eb3-8ef6-15443c74a781 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:11.262151 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9923d288-9afc-4eb3-8ef6-15443c74a781 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:11.326306 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-9923d288-9afc-4eb3-8ef6-15443c74a781 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:11.335465 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-9923d288-9afc-4eb3-8ef6-15443c74a781 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.086234 Jun 17 15:43:11.336060 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1261/2932] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:43:11 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:43:11.345069 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-b2f2ec8d-072d-4dbf-a78b-0ba7836b6393 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:11.345771 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-b2f2ec8d-072d-4dbf-a78b-0ba7836b6393 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:11.353525 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b2f2ec8d-072d-4dbf-a78b-0ba7836b6393 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:11.354506 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b2f2ec8d-072d-4dbf-a78b-0ba7836b6393 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:11.355351 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b2f2ec8d-072d-4dbf-a78b-0ba7836b6393 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:11.355866 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b2f2ec8d-072d-4dbf-a78b-0ba7836b6393 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:11.495110 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-b2f2ec8d-072d-4dbf-a78b-0ba7836b6393 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:11.503196 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-b2f2ec8d-072d-4dbf-a78b-0ba7836b6393 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.161945 Jun 17 15:43:11.503768 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1672/2933] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:43:11 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:43:12.272281 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-8abb263e-e880-40e5-87ba-9d5ae365e726 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:12.272913 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-8abb263e-e880-40e5-87ba-9d5ae365e726 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:12.279988 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8abb263e-e880-40e5-87ba-9d5ae365e726 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:12.280468 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8abb263e-e880-40e5-87ba-9d5ae365e726 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:12.281217 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8abb263e-e880-40e5-87ba-9d5ae365e726 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:12.281646 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8abb263e-e880-40e5-87ba-9d5ae365e726 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:12.343379 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-8abb263e-e880-40e5-87ba-9d5ae365e726 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:12.353360 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-8abb263e-e880-40e5-87ba-9d5ae365e726 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:12.354814 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-68c29c97-d188-40eb-a153-91dbe154ac87 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:12.355302 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-8abb263e-e880-40e5-87ba-9d5ae365e726 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:12.355437 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-68c29c97-d188-40eb-a153-91dbe154ac87 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:12.355996 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-8abb263e-e880-40e5-87ba-9d5ae365e726 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.087655 Jun 17 15:43:12.356604 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1262/2934] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:43:12 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:43:12.362295 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-68c29c97-d188-40eb-a153-91dbe154ac87 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:12.362740 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-68c29c97-d188-40eb-a153-91dbe154ac87 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:12.363499 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-68c29c97-d188-40eb-a153-91dbe154ac87 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:12.363931 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-68c29c97-d188-40eb-a153-91dbe154ac87 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:12.426188 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-68c29c97-d188-40eb-a153-91dbe154ac87 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:12.435195 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-68c29c97-d188-40eb-a153-91dbe154ac87 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.084365 Jun 17 15:43:12.435923 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1673/2935] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:43:12 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:43:12.520519 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-fdb0c023-aae4-4894-948a-80fdc0fed807 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:12.521135 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-fdb0c023-aae4-4894-948a-80fdc0fed807 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:12.527346 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fdb0c023-aae4-4894-948a-80fdc0fed807 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:12.527726 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fdb0c023-aae4-4894-948a-80fdc0fed807 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:12.528533 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fdb0c023-aae4-4894-948a-80fdc0fed807 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:12.528961 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fdb0c023-aae4-4894-948a-80fdc0fed807 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:12.663169 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-fdb0c023-aae4-4894-948a-80fdc0fed807 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:12.672172 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-fdb0c023-aae4-4894-948a-80fdc0fed807 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.155570 Jun 17 15:43:12.672784 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1263/2936] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:43:12 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:43:13.374310 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-35fccfd9-5537-478b-a84a-cab00b6c0f38 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:13.375072 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-35fccfd9-5537-478b-a84a-cab00b6c0f38 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:13.382244 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-35fccfd9-5537-478b-a84a-cab00b6c0f38 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:13.382698 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-35fccfd9-5537-478b-a84a-cab00b6c0f38 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:13.383479 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-35fccfd9-5537-478b-a84a-cab00b6c0f38 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:13.383915 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-35fccfd9-5537-478b-a84a-cab00b6c0f38 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:13.452185 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-8736f561-3342-4dfd-a8b7-0bc360ab28c2 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:13.452879 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-8736f561-3342-4dfd-a8b7-0bc360ab28c2 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:13.453002 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-35fccfd9-5537-478b-a84a-cab00b6c0f38 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:13.459760 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8736f561-3342-4dfd-a8b7-0bc360ab28c2 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:13.460197 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8736f561-3342-4dfd-a8b7-0bc360ab28c2 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:13.460995 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8736f561-3342-4dfd-a8b7-0bc360ab28c2 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:13.461423 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8736f561-3342-4dfd-a8b7-0bc360ab28c2 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:13.468184 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-35fccfd9-5537-478b-a84a-cab00b6c0f38 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:13.471476 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-35fccfd9-5537-478b-a84a-cab00b6c0f38 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:13.472852 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-35fccfd9-5537-478b-a84a-cab00b6c0f38 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.102518 Jun 17 15:43:13.473420 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1674/2937] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:43:13 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:43:13.538799 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-8736f561-3342-4dfd-a8b7-0bc360ab28c2 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:13.546709 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-8736f561-3342-4dfd-a8b7-0bc360ab28c2 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.098886 Jun 17 15:43:13.547264 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1264/2938] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:43:13 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:43:13.696682 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-d479c869-2d47-4453-b2df-8158c503d3e1 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:13.697206 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-d479c869-2d47-4453-b2df-8158c503d3e1 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:13.704906 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d479c869-2d47-4453-b2df-8158c503d3e1 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:13.705369 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d479c869-2d47-4453-b2df-8158c503d3e1 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:13.706118 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d479c869-2d47-4453-b2df-8158c503d3e1 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:13.706628 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d479c869-2d47-4453-b2df-8158c503d3e1 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:13.843293 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-d479c869-2d47-4453-b2df-8158c503d3e1 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:13.852257 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-d479c869-2d47-4453-b2df-8158c503d3e1 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.159475 Jun 17 15:43:13.852883 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1675/2939] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:43:13 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:43:14.491399 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-a21d41be-e593-47db-9d5f-80f05fd8b9e9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:14.492061 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-a21d41be-e593-47db-9d5f-80f05fd8b9e9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:14.498780 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a21d41be-e593-47db-9d5f-80f05fd8b9e9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:14.499228 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a21d41be-e593-47db-9d5f-80f05fd8b9e9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:14.499988 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a21d41be-e593-47db-9d5f-80f05fd8b9e9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:14.500447 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a21d41be-e593-47db-9d5f-80f05fd8b9e9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:14.561176 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-a21d41be-e593-47db-9d5f-80f05fd8b9e9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:14.563689 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-99f94304-6a26-4670-9c79-1d7a2c447f8b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:14.564296 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-99f94304-6a26-4670-9c79-1d7a2c447f8b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:14.569833 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-a21d41be-e593-47db-9d5f-80f05fd8b9e9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:14.570720 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-99f94304-6a26-4670-9c79-1d7a2c447f8b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:14.571167 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-99f94304-6a26-4670-9c79-1d7a2c447f8b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:14.571310 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-a21d41be-e593-47db-9d5f-80f05fd8b9e9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:14.571925 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-99f94304-6a26-4670-9c79-1d7a2c447f8b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:14.572370 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-99f94304-6a26-4670-9c79-1d7a2c447f8b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:14.572556 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-a21d41be-e593-47db-9d5f-80f05fd8b9e9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.085162 Jun 17 15:43:14.573011 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1265/2940] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:43:14 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:43:14.637288 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-99f94304-6a26-4670-9c79-1d7a2c447f8b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:14.645273 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-99f94304-6a26-4670-9c79-1d7a2c447f8b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.085406 Jun 17 15:43:14.645845 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1676/2941] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:43:14 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:43:14.869579 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-adfd1a6d-1e58-4ea1-a005-fe670108a8fa tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:14.870188 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-adfd1a6d-1e58-4ea1-a005-fe670108a8fa tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:14.876248 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-adfd1a6d-1e58-4ea1-a005-fe670108a8fa tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:14.876716 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-adfd1a6d-1e58-4ea1-a005-fe670108a8fa tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:14.877468 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-adfd1a6d-1e58-4ea1-a005-fe670108a8fa tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:14.877894 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-adfd1a6d-1e58-4ea1-a005-fe670108a8fa tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:15.010959 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-adfd1a6d-1e58-4ea1-a005-fe670108a8fa tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:15.019251 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-adfd1a6d-1e58-4ea1-a005-fe670108a8fa tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.153429 Jun 17 15:43:15.019837 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1266/2942] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:43:14 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:43:15.590292 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-1683830f-391d-4223-9509-f10b9305b6d9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:15.590939 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-1683830f-391d-4223-9509-f10b9305b6d9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:15.597613 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1683830f-391d-4223-9509-f10b9305b6d9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:15.598048 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1683830f-391d-4223-9509-f10b9305b6d9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:15.598814 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1683830f-391d-4223-9509-f10b9305b6d9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:15.599233 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1683830f-391d-4223-9509-f10b9305b6d9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:15.661483 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-1683830f-391d-4223-9509-f10b9305b6d9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:15.662582 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-eeee8ac2-c752-4d1c-918c-9ba1e6718e2b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:15.663260 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-eeee8ac2-c752-4d1c-918c-9ba1e6718e2b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:15.670239 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-eeee8ac2-c752-4d1c-918c-9ba1e6718e2b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:15.670618 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-1683830f-391d-4223-9509-f10b9305b6d9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:15.670749 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-eeee8ac2-c752-4d1c-918c-9ba1e6718e2b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:15.671461 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-eeee8ac2-c752-4d1c-918c-9ba1e6718e2b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:15.671882 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-eeee8ac2-c752-4d1c-918c-9ba1e6718e2b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:15.672109 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-1683830f-391d-4223-9509-f10b9305b6d9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:15.673263 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-1683830f-391d-4223-9509-f10b9305b6d9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.087062 Jun 17 15:43:15.673949 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1677/2943] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:43:15 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:43:15.735818 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-eeee8ac2-c752-4d1c-918c-9ba1e6718e2b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:15.743741 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-eeee8ac2-c752-4d1c-918c-9ba1e6718e2b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.085176 Jun 17 15:43:15.744319 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1267/2944] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:43:15 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:43:16.037323 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-dd3d9338-9679-49f9-9d05-0801f3a37986 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:16.037851 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-dd3d9338-9679-49f9-9d05-0801f3a37986 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:16.044573 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-dd3d9338-9679-49f9-9d05-0801f3a37986 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:16.045018 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-dd3d9338-9679-49f9-9d05-0801f3a37986 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:16.045768 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-dd3d9338-9679-49f9-9d05-0801f3a37986 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:16.046194 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-dd3d9338-9679-49f9-9d05-0801f3a37986 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:16.176149 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-dd3d9338-9679-49f9-9d05-0801f3a37986 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:16.184054 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-dd3d9338-9679-49f9-9d05-0801f3a37986 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.150702 Jun 17 15:43:16.184650 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1678/2945] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:43:16 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:43:16.691491 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-3f94a3e3-54db-4e34-8aff-8fbd94635865 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:16.692095 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-3f94a3e3-54db-4e34-8aff-8fbd94635865 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:16.699287 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3f94a3e3-54db-4e34-8aff-8fbd94635865 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:16.699730 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3f94a3e3-54db-4e34-8aff-8fbd94635865 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:16.700541 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3f94a3e3-54db-4e34-8aff-8fbd94635865 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:16.700975 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3f94a3e3-54db-4e34-8aff-8fbd94635865 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:16.718381 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell1:SELECT=100 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:43:16.761948 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-9ced4721-f626-4936-978f-032cbb9eb825 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:16.762566 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-9ced4721-f626-4936-978f-032cbb9eb825 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:16.767475 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-3f94a3e3-54db-4e34-8aff-8fbd94635865 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:16.769472 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9ced4721-f626-4936-978f-032cbb9eb825 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:16.769926 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9ced4721-f626-4936-978f-032cbb9eb825 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:16.770714 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9ced4721-f626-4936-978f-032cbb9eb825 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:16.771144 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9ced4721-f626-4936-978f-032cbb9eb825 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:16.778346 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-3f94a3e3-54db-4e34-8aff-8fbd94635865 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:16.779864 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-3f94a3e3-54db-4e34-8aff-8fbd94635865 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:16.781078 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-3f94a3e3-54db-4e34-8aff-8fbd94635865 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.093634 Jun 17 15:43:16.781642 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1268/2946] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:43:16 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:43:16.841442 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-9ced4721-f626-4936-978f-032cbb9eb825 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:16.849828 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-9ced4721-f626-4936-978f-032cbb9eb825 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.092272 Jun 17 15:43:16.850414 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1679/2947] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:43:16 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:43:17.200605 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-0a9dd92e-dfa4-4dad-ae3d-a258b522405c tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:17.201255 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-0a9dd92e-dfa4-4dad-ae3d-a258b522405c tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:17.207386 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0a9dd92e-dfa4-4dad-ae3d-a258b522405c tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:17.207827 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0a9dd92e-dfa4-4dad-ae3d-a258b522405c tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:17.208612 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0a9dd92e-dfa4-4dad-ae3d-a258b522405c tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:17.209037 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0a9dd92e-dfa4-4dad-ae3d-a258b522405c tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:17.343505 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-0a9dd92e-dfa4-4dad-ae3d-a258b522405c tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:17.352349 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-0a9dd92e-dfa4-4dad-ae3d-a258b522405c tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.155509 Jun 17 15:43:17.352943 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1269/2948] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:43:17 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:43:17.799492 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-aa3f569b-69ab-45a9-9ba9-adc9a29d6268 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:17.800103 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-aa3f569b-69ab-45a9-9ba9-adc9a29d6268 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:17.802422 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_api:SELECT=82 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:43:17.808101 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-aa3f569b-69ab-45a9-9ba9-adc9a29d6268 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:17.808581 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-aa3f569b-69ab-45a9-9ba9-adc9a29d6268 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:17.809355 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-aa3f569b-69ab-45a9-9ba9-adc9a29d6268 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:17.809790 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-aa3f569b-69ab-45a9-9ba9-adc9a29d6268 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:17.867079 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-3e1fcc42-7b88-4b90-b521-e91e9499aab4 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:17.867670 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-3e1fcc42-7b88-4b90-b521-e91e9499aab4 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:17.873986 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-aa3f569b-69ab-45a9-9ba9-adc9a29d6268 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:17.874887 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3e1fcc42-7b88-4b90-b521-e91e9499aab4 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:17.875401 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3e1fcc42-7b88-4b90-b521-e91e9499aab4 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:17.876272 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3e1fcc42-7b88-4b90-b521-e91e9499aab4 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:17.876788 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3e1fcc42-7b88-4b90-b521-e91e9499aab4 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:17.882775 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-aa3f569b-69ab-45a9-9ba9-adc9a29d6268 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:17.884346 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-aa3f569b-69ab-45a9-9ba9-adc9a29d6268 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:17.886172 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-aa3f569b-69ab-45a9-9ba9-adc9a29d6268 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.090687 Jun 17 15:43:17.886736 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1680/2949] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:43:17 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:43:17.938689 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-3e1fcc42-7b88-4b90-b521-e91e9499aab4 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:17.946663 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-3e1fcc42-7b88-4b90-b521-e91e9499aab4 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.083477 Jun 17 15:43:17.947228 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1270/2950] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:43:17 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:43:18.376885 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-60d89a2e-4c07-4e9d-abbd-2ea04ecf8771 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:18.377535 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-60d89a2e-4c07-4e9d-abbd-2ea04ecf8771 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:18.383882 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-60d89a2e-4c07-4e9d-abbd-2ea04ecf8771 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:18.384350 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-60d89a2e-4c07-4e9d-abbd-2ea04ecf8771 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:18.385777 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-60d89a2e-4c07-4e9d-abbd-2ea04ecf8771 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:18.386213 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-60d89a2e-4c07-4e9d-abbd-2ea04ecf8771 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:18.515358 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-60d89a2e-4c07-4e9d-abbd-2ea04ecf8771 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:18.523406 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-60d89a2e-4c07-4e9d-abbd-2ea04ecf8771 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.150445 Jun 17 15:43:18.523977 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1681/2951] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:43:18 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:43:18.904178 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-70dc77a8-3e85-4a6a-a53d-0a7862423131 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:18.904817 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-70dc77a8-3e85-4a6a-a53d-0a7862423131 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:18.911599 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-70dc77a8-3e85-4a6a-a53d-0a7862423131 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:18.912075 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-70dc77a8-3e85-4a6a-a53d-0a7862423131 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:18.912893 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-70dc77a8-3e85-4a6a-a53d-0a7862423131 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:18.913332 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-70dc77a8-3e85-4a6a-a53d-0a7862423131 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:18.963911 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-bfe7ba2a-b19a-4963-8160-5dd610751c35 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:18.964763 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-bfe7ba2a-b19a-4963-8160-5dd610751c35 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:18.971500 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bfe7ba2a-b19a-4963-8160-5dd610751c35 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:18.971949 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bfe7ba2a-b19a-4963-8160-5dd610751c35 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:18.972753 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bfe7ba2a-b19a-4963-8160-5dd610751c35 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:18.973179 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bfe7ba2a-b19a-4963-8160-5dd610751c35 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:18.976367 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=100 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:43:18.986736 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-70dc77a8-3e85-4a6a-a53d-0a7862423131 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:18.996838 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-70dc77a8-3e85-4a6a-a53d-0a7862423131 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:18.998432 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-70dc77a8-3e85-4a6a-a53d-0a7862423131 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:18.999605 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-70dc77a8-3e85-4a6a-a53d-0a7862423131 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.099389 Jun 17 15:43:19.000168 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1271/2952] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:43:18 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 15:43:19.037696 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-bfe7ba2a-b19a-4963-8160-5dd610751c35 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:19.046519 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-bfe7ba2a-b19a-4963-8160-5dd610751c35 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.086500 Jun 17 15:43:19.047105 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1682/2953] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:43:18 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:43:19.540875 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-7592237d-e7d5-40ec-887e-4044b2aaeb63 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:19.541494 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-7592237d-e7d5-40ec-887e-4044b2aaeb63 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:19.548292 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7592237d-e7d5-40ec-887e-4044b2aaeb63 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:19.548816 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7592237d-e7d5-40ec-887e-4044b2aaeb63 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:19.549701 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7592237d-e7d5-40ec-887e-4044b2aaeb63 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:19.550179 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7592237d-e7d5-40ec-887e-4044b2aaeb63 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:19.690637 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-7592237d-e7d5-40ec-887e-4044b2aaeb63 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:19.699973 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-7592237d-e7d5-40ec-887e-4044b2aaeb63 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.162882 Jun 17 15:43:19.700611 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1272/2954] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:43:19 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:43:20.019444 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-3925028c-089c-49d0-8bc5-59338180c173 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:20.020231 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-3925028c-089c-49d0-8bc5-59338180c173 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:20.029771 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3925028c-089c-49d0-8bc5-59338180c173 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:20.030577 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3925028c-089c-49d0-8bc5-59338180c173 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:20.031979 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3925028c-089c-49d0-8bc5-59338180c173 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:20.032797 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3925028c-089c-49d0-8bc5-59338180c173 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:20.063979 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-bdb2379b-847d-49b3-862e-c5c001a56d23 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:20.064733 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-bdb2379b-847d-49b3-862e-c5c001a56d23 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:20.075318 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bdb2379b-847d-49b3-862e-c5c001a56d23 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:20.075965 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bdb2379b-847d-49b3-862e-c5c001a56d23 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:20.079004 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bdb2379b-847d-49b3-862e-c5c001a56d23 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:20.079571 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bdb2379b-847d-49b3-862e-c5c001a56d23 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:20.102521 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-3925028c-089c-49d0-8bc5-59338180c173 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:20.115222 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-3925028c-089c-49d0-8bc5-59338180c173 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:20.116782 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-3925028c-089c-49d0-8bc5-59338180c173 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:20.117986 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-3925028c-089c-49d0-8bc5-59338180c173 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.104082 Jun 17 15:43:20.118654 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1683/2955] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:43:20 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:43:20.169071 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-bdb2379b-847d-49b3-862e-c5c001a56d23 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:20.175958 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-bdb2379b-847d-49b3-862e-c5c001a56d23 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.115721 Jun 17 15:43:20.176576 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1273/2956] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:43:20 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:43:20.718959 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-dfcc4660-269c-45fd-8c16-ba4d32efe3cb tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:20.719497 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-dfcc4660-269c-45fd-8c16-ba4d32efe3cb tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:20.726459 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-dfcc4660-269c-45fd-8c16-ba4d32efe3cb tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:20.726906 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-dfcc4660-269c-45fd-8c16-ba4d32efe3cb tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:20.727685 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-dfcc4660-269c-45fd-8c16-ba4d32efe3cb tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:20.728152 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-dfcc4660-269c-45fd-8c16-ba4d32efe3cb tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:20.875601 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-dfcc4660-269c-45fd-8c16-ba4d32efe3cb tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:20.883915 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-dfcc4660-269c-45fd-8c16-ba4d32efe3cb tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.169023 Jun 17 15:43:20.884532 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1684/2957] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:43:20 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:43:21.139716 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-b40d50d5-2f2f-4bb2-ad65-3092cca27b96 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:21.140421 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-b40d50d5-2f2f-4bb2-ad65-3092cca27b96 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:21.148351 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b40d50d5-2f2f-4bb2-ad65-3092cca27b96 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:21.148806 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b40d50d5-2f2f-4bb2-ad65-3092cca27b96 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:21.150075 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b40d50d5-2f2f-4bb2-ad65-3092cca27b96 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:21.151251 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b40d50d5-2f2f-4bb2-ad65-3092cca27b96 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:21.193678 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-bc002b3b-b19b-4c0c-b44d-fee2205e323d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:21.194388 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-bc002b3b-b19b-4c0c-b44d-fee2205e323d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:21.202170 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bc002b3b-b19b-4c0c-b44d-fee2205e323d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:21.202632 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bc002b3b-b19b-4c0c-b44d-fee2205e323d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:21.203413 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bc002b3b-b19b-4c0c-b44d-fee2205e323d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:21.203855 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bc002b3b-b19b-4c0c-b44d-fee2205e323d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:21.227586 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-b40d50d5-2f2f-4bb2-ad65-3092cca27b96 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:21.235429 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-b40d50d5-2f2f-4bb2-ad65-3092cca27b96 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:21.236952 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-b40d50d5-2f2f-4bb2-ad65-3092cca27b96 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:21.238161 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-b40d50d5-2f2f-4bb2-ad65-3092cca27b96 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.102514 Jun 17 15:43:21.238720 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1274/2958] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:43:21 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:43:21.268556 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-bc002b3b-b19b-4c0c-b44d-fee2205e323d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:21.277317 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-bc002b3b-b19b-4c0c-b44d-fee2205e323d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.087574 Jun 17 15:43:21.278130 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1685/2959] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:43:21 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:43:21.901795 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-5b237cc3-de4d-4287-b5cd-6cf1dc7354d6 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:21.902409 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-5b237cc3-de4d-4287-b5cd-6cf1dc7354d6 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:21.904295 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_api:SELECT=80 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:43:21.909864 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5b237cc3-de4d-4287-b5cd-6cf1dc7354d6 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:21.910306 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5b237cc3-de4d-4287-b5cd-6cf1dc7354d6 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:21.911067 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5b237cc3-de4d-4287-b5cd-6cf1dc7354d6 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:21.911498 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5b237cc3-de4d-4287-b5cd-6cf1dc7354d6 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:22.046656 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-5b237cc3-de4d-4287-b5cd-6cf1dc7354d6 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:22.054605 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-5b237cc3-de4d-4287-b5cd-6cf1dc7354d6 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.156614 Jun 17 15:43:22.055186 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1275/2960] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:43:21 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:43:22.256752 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-c97b20af-7213-4c6b-befc-be1da24a0d78 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:22.257335 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-c97b20af-7213-4c6b-befc-be1da24a0d78 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:22.263791 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c97b20af-7213-4c6b-befc-be1da24a0d78 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:22.264263 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c97b20af-7213-4c6b-befc-be1da24a0d78 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:22.265057 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c97b20af-7213-4c6b-befc-be1da24a0d78 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:22.265487 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c97b20af-7213-4c6b-befc-be1da24a0d78 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:22.294879 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-db79d2d0-d821-4374-bc56-983caebfb7ac tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:22.295475 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-db79d2d0-d821-4374-bc56-983caebfb7ac tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:22.302291 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-db79d2d0-d821-4374-bc56-983caebfb7ac tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:22.302738 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-db79d2d0-d821-4374-bc56-983caebfb7ac tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:22.303503 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-db79d2d0-d821-4374-bc56-983caebfb7ac tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:22.303939 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-db79d2d0-d821-4374-bc56-983caebfb7ac tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:22.332147 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-c97b20af-7213-4c6b-befc-be1da24a0d78 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:22.341604 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-c97b20af-7213-4c6b-befc-be1da24a0d78 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:22.343120 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-c97b20af-7213-4c6b-befc-be1da24a0d78 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:22.344275 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-c97b20af-7213-4c6b-befc-be1da24a0d78 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.091679 Jun 17 15:43:22.345942 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1686/2961] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:43:22 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:43:22.371972 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-db79d2d0-d821-4374-bc56-983caebfb7ac tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:22.380388 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-db79d2d0-d821-4374-bc56-983caebfb7ac tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.089926 Jun 17 15:43:22.380972 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1276/2962] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:43:22 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:43:23.071723 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-4ba717ef-e4ab-45fe-bbdc-fc7410829bd5 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:23.072282 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-4ba717ef-e4ab-45fe-bbdc-fc7410829bd5 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:23.081921 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4ba717ef-e4ab-45fe-bbdc-fc7410829bd5 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:23.082380 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4ba717ef-e4ab-45fe-bbdc-fc7410829bd5 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:23.083186 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4ba717ef-e4ab-45fe-bbdc-fc7410829bd5 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:23.083629 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4ba717ef-e4ab-45fe-bbdc-fc7410829bd5 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:23.233480 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-4ba717ef-e4ab-45fe-bbdc-fc7410829bd5 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:23.241469 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-4ba717ef-e4ab-45fe-bbdc-fc7410829bd5 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.174098 Jun 17 15:43:23.242022 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1687/2963] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:43:23 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:43:23.363066 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-9ec3c41f-bac7-4858-92e4-e19ec4dcce06 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:23.363665 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-9ec3c41f-bac7-4858-92e4-e19ec4dcce06 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:23.370770 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9ec3c41f-bac7-4858-92e4-e19ec4dcce06 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:23.371205 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9ec3c41f-bac7-4858-92e4-e19ec4dcce06 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:23.371983 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9ec3c41f-bac7-4858-92e4-e19ec4dcce06 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:23.372440 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9ec3c41f-bac7-4858-92e4-e19ec4dcce06 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:23.398412 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-9dc899dd-47eb-4fa7-95b6-0f22d7902430 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:23.399073 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-9dc899dd-47eb-4fa7-95b6-0f22d7902430 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:23.405751 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9dc899dd-47eb-4fa7-95b6-0f22d7902430 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:23.406205 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9dc899dd-47eb-4fa7-95b6-0f22d7902430 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:23.406980 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9dc899dd-47eb-4fa7-95b6-0f22d7902430 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:23.407422 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9dc899dd-47eb-4fa7-95b6-0f22d7902430 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:23.436263 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-9ec3c41f-bac7-4858-92e4-e19ec4dcce06 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:23.446100 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-9ec3c41f-bac7-4858-92e4-e19ec4dcce06 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:23.447696 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-9ec3c41f-bac7-4858-92e4-e19ec4dcce06 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:23.448907 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-9ec3c41f-bac7-4858-92e4-e19ec4dcce06 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.089701 Jun 17 15:43:23.449472 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1277/2964] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:43:23 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:43:23.474345 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-9dc899dd-47eb-4fa7-95b6-0f22d7902430 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:23.484028 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-9dc899dd-47eb-4fa7-95b6-0f22d7902430 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.089755 Jun 17 15:43:23.484658 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1688/2965] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:43:23 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:43:24.259217 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-3c7689d2-d198-4eaa-936c-ed20c1c57ebb tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:24.260483 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-3c7689d2-d198-4eaa-936c-ed20c1c57ebb tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:24.266961 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3c7689d2-d198-4eaa-936c-ed20c1c57ebb tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:24.267401 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3c7689d2-d198-4eaa-936c-ed20c1c57ebb tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:24.268157 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3c7689d2-d198-4eaa-936c-ed20c1c57ebb tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:24.268627 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3c7689d2-d198-4eaa-936c-ed20c1c57ebb tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:24.417505 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-3c7689d2-d198-4eaa-936c-ed20c1c57ebb tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:24.426157 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-3c7689d2-d198-4eaa-936c-ed20c1c57ebb tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.170736 Jun 17 15:43:24.426764 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1278/2966] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:43:24 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:43:24.467288 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-61ccfb3e-d980-491f-81bf-d7bb14b1fbc4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:24.467926 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-61ccfb3e-d980-491f-81bf-d7bb14b1fbc4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:24.474771 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-61ccfb3e-d980-491f-81bf-d7bb14b1fbc4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:24.475221 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-61ccfb3e-d980-491f-81bf-d7bb14b1fbc4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:24.476240 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-61ccfb3e-d980-491f-81bf-d7bb14b1fbc4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:24.476708 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-61ccfb3e-d980-491f-81bf-d7bb14b1fbc4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:24.502741 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-a62515b0-f8d0-4ee1-9cee-af50120a4e7c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:24.503504 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-a62515b0-f8d0-4ee1-9cee-af50120a4e7c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:24.510801 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a62515b0-f8d0-4ee1-9cee-af50120a4e7c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:24.511172 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a62515b0-f8d0-4ee1-9cee-af50120a4e7c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:24.511944 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a62515b0-f8d0-4ee1-9cee-af50120a4e7c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:24.512408 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a62515b0-f8d0-4ee1-9cee-af50120a4e7c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:24.550713 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-61ccfb3e-d980-491f-81bf-d7bb14b1fbc4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:24.564430 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-61ccfb3e-d980-491f-81bf-d7bb14b1fbc4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:24.566123 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-61ccfb3e-d980-491f-81bf-d7bb14b1fbc4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:24.567422 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-61ccfb3e-d980-491f-81bf-d7bb14b1fbc4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.104059 Jun 17 15:43:24.568342 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1689/2967] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:43:24 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 15:43:24.585115 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-a62515b0-f8d0-4ee1-9cee-af50120a4e7c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:24.593297 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-a62515b0-f8d0-4ee1-9cee-af50120a4e7c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.095453 Jun 17 15:43:24.594110 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1279/2968] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:43:24 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:43:25.444429 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-46b3c0a4-9148-45c2-a683-f21bdf29cd66 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:25.445044 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-46b3c0a4-9148-45c2-a683-f21bdf29cd66 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:25.451634 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-46b3c0a4-9148-45c2-a683-f21bdf29cd66 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:25.452083 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-46b3c0a4-9148-45c2-a683-f21bdf29cd66 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:25.452878 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-46b3c0a4-9148-45c2-a683-f21bdf29cd66 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:25.453314 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-46b3c0a4-9148-45c2-a683-f21bdf29cd66 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:25.587070 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-ed39a80d-7f46-4fb9-a359-5bdd5af91e91 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:25.587791 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-ed39a80d-7f46-4fb9-a359-5bdd5af91e91 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:25.595351 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ed39a80d-7f46-4fb9-a359-5bdd5af91e91 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:25.595789 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ed39a80d-7f46-4fb9-a359-5bdd5af91e91 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:25.596606 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ed39a80d-7f46-4fb9-a359-5bdd5af91e91 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:25.597040 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ed39a80d-7f46-4fb9-a359-5bdd5af91e91 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:25.614223 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-46b3c0a4-9148-45c2-a683-f21bdf29cd66 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:25.622743 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-46b3c0a4-9148-45c2-a683-f21bdf29cd66 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.182113 Jun 17 15:43:25.623305 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1690/2969] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:43:25 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:43:25.628066 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-5d0500d2-c3a5-455c-907d-b564c99a05ed tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:25.628890 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-5d0500d2-c3a5-455c-907d-b564c99a05ed tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:25.635831 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5d0500d2-c3a5-455c-907d-b564c99a05ed tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:25.636297 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5d0500d2-c3a5-455c-907d-b564c99a05ed tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:25.637111 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5d0500d2-c3a5-455c-907d-b564c99a05ed tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:25.637548 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5d0500d2-c3a5-455c-907d-b564c99a05ed tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:25.682361 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-ed39a80d-7f46-4fb9-a359-5bdd5af91e91 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:25.692114 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-ed39a80d-7f46-4fb9-a359-5bdd5af91e91 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:25.693660 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-ed39a80d-7f46-4fb9-a359-5bdd5af91e91 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:25.694826 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-ed39a80d-7f46-4fb9-a359-5bdd5af91e91 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.111711 Jun 17 15:43:25.695608 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1280/2970] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:43:25 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 15:43:25.708909 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-5d0500d2-c3a5-455c-907d-b564c99a05ed tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:25.718289 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-5d0500d2-c3a5-455c-907d-b564c99a05ed tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.093922 Jun 17 15:43:25.718953 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1691/2971] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:43:25 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:43:26.644466 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-46943072-648c-4eca-9c5b-762de0cdf20a tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:26.645101 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-46943072-648c-4eca-9c5b-762de0cdf20a tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:26.652750 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-46943072-648c-4eca-9c5b-762de0cdf20a tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:26.653246 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-46943072-648c-4eca-9c5b-762de0cdf20a tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:26.654065 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-46943072-648c-4eca-9c5b-762de0cdf20a tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:26.654532 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-46943072-648c-4eca-9c5b-762de0cdf20a tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:26.715438 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-b12b33ac-04ca-4bbc-8e5b-1c10b92178ed tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:26.716385 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-b12b33ac-04ca-4bbc-8e5b-1c10b92178ed tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:26.723250 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b12b33ac-04ca-4bbc-8e5b-1c10b92178ed tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:26.723701 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b12b33ac-04ca-4bbc-8e5b-1c10b92178ed tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:26.724538 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b12b33ac-04ca-4bbc-8e5b-1c10b92178ed tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:26.724968 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b12b33ac-04ca-4bbc-8e5b-1c10b92178ed tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:26.798331 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-b12b33ac-04ca-4bbc-8e5b-1c10b92178ed tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:26.811415 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-b12b33ac-04ca-4bbc-8e5b-1c10b92178ed tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:26.815001 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-b12b33ac-04ca-4bbc-8e5b-1c10b92178ed tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:26.817200 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-b12b33ac-04ca-4bbc-8e5b-1c10b92178ed tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.106287 Jun 17 15:43:26.818392 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1692/2972] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:43:26 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 15:43:26.826905 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-91cf3c8b-51be-41ee-b435-3d795f107cc3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:26.828045 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-91cf3c8b-51be-41ee-b435-3d795f107cc3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:26.829990 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-46943072-648c-4eca-9c5b-762de0cdf20a tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:26.839861 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-91cf3c8b-51be-41ee-b435-3d795f107cc3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:26.840679 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-91cf3c8b-51be-41ee-b435-3d795f107cc3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:26.841961 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-46943072-648c-4eca-9c5b-762de0cdf20a tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.201516 Jun 17 15:43:26.842133 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-91cf3c8b-51be-41ee-b435-3d795f107cc3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:26.842580 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1281/2973] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:43:26 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:43:26.842808 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-91cf3c8b-51be-41ee-b435-3d795f107cc3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:26.939313 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-91cf3c8b-51be-41ee-b435-3d795f107cc3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:26.949309 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-91cf3c8b-51be-41ee-b435-3d795f107cc3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.129559 Jun 17 15:43:26.949911 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1693/2974] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:43:26 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:43:27.837602 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-01d104bd-2b2a-42c5-b6f0-3394bb4870c9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:27.838601 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-01d104bd-2b2a-42c5-b6f0-3394bb4870c9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:27.846532 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-01d104bd-2b2a-42c5-b6f0-3394bb4870c9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:27.846985 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-01d104bd-2b2a-42c5-b6f0-3394bb4870c9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:27.847757 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-01d104bd-2b2a-42c5-b6f0-3394bb4870c9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:27.848189 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-01d104bd-2b2a-42c5-b6f0-3394bb4870c9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:27.864232 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-62e1a12f-8236-4383-8bfa-370b26499f33 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:27.865276 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-62e1a12f-8236-4383-8bfa-370b26499f33 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:27.876709 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-62e1a12f-8236-4383-8bfa-370b26499f33 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:27.881582 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-62e1a12f-8236-4383-8bfa-370b26499f33 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:27.883077 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-62e1a12f-8236-4383-8bfa-370b26499f33 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:27.883811 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-62e1a12f-8236-4383-8bfa-370b26499f33 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:27.934701 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-01d104bd-2b2a-42c5-b6f0-3394bb4870c9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:27.944407 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-01d104bd-2b2a-42c5-b6f0-3394bb4870c9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:27.945955 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-01d104bd-2b2a-42c5-b6f0-3394bb4870c9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:27.947198 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-01d104bd-2b2a-42c5-b6f0-3394bb4870c9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.113774 Jun 17 15:43:27.947772 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1282/2975] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:43:27 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:43:27.966789 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-88a7d6f6-520c-4c60-8de9-2ac9c9f1632b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:27.967401 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-88a7d6f6-520c-4c60-8de9-2ac9c9f1632b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:27.974030 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-88a7d6f6-520c-4c60-8de9-2ac9c9f1632b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:27.974479 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-88a7d6f6-520c-4c60-8de9-2ac9c9f1632b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:27.975280 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-88a7d6f6-520c-4c60-8de9-2ac9c9f1632b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:27.975720 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-88a7d6f6-520c-4c60-8de9-2ac9c9f1632b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:28.053184 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-88a7d6f6-520c-4c60-8de9-2ac9c9f1632b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:28.056398 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-62e1a12f-8236-4383-8bfa-370b26499f33 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:28.062326 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-88a7d6f6-520c-4c60-8de9-2ac9c9f1632b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.099525 Jun 17 15:43:28.062912 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1283/2976] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:43:27 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:43:28.065188 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-62e1a12f-8236-4383-8bfa-370b26499f33 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.207645 Jun 17 15:43:28.065773 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1694/2977] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:43:27 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:43:28.966476 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-f8201cdf-8f2e-47f7-a069-b5762cf8dc88 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:28.967130 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-f8201cdf-8f2e-47f7-a069-b5762cf8dc88 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:28.974353 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f8201cdf-8f2e-47f7-a069-b5762cf8dc88 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:28.974835 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f8201cdf-8f2e-47f7-a069-b5762cf8dc88 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:28.975761 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f8201cdf-8f2e-47f7-a069-b5762cf8dc88 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:28.976490 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f8201cdf-8f2e-47f7-a069-b5762cf8dc88 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:29.048973 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-f8201cdf-8f2e-47f7-a069-b5762cf8dc88 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:29.058618 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-f8201cdf-8f2e-47f7-a069-b5762cf8dc88 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:29.060094 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-f8201cdf-8f2e-47f7-a069-b5762cf8dc88 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:29.061270 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-f8201cdf-8f2e-47f7-a069-b5762cf8dc88 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.098768 Jun 17 15:43:29.061833 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1284/2978] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:43:28 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:43:29.080265 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-7a57fd2d-eb08-4dfb-9352-b039e6160d20 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:29.080990 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-7a57fd2d-eb08-4dfb-9352-b039e6160d20 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:29.086710 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-598f61fe-322b-48df-bcbd-3ea5dbe2e70f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:29.087803 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-598f61fe-322b-48df-bcbd-3ea5dbe2e70f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:29.087933 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7a57fd2d-eb08-4dfb-9352-b039e6160d20 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:29.088306 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7a57fd2d-eb08-4dfb-9352-b039e6160d20 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:29.089109 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7a57fd2d-eb08-4dfb-9352-b039e6160d20 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:29.089542 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7a57fd2d-eb08-4dfb-9352-b039e6160d20 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:29.098639 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-598f61fe-322b-48df-bcbd-3ea5dbe2e70f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:29.099299 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-598f61fe-322b-48df-bcbd-3ea5dbe2e70f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:29.100102 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-598f61fe-322b-48df-bcbd-3ea5dbe2e70f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:29.100911 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-598f61fe-322b-48df-bcbd-3ea5dbe2e70f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:29.105312 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell1:SELECT=100 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:43:29.159113 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-7a57fd2d-eb08-4dfb-9352-b039e6160d20 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:29.169329 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-7a57fd2d-eb08-4dfb-9352-b039e6160d20 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.092991 Jun 17 15:43:29.170269 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1695/2979] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:43:29 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:43:29.286039 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-598f61fe-322b-48df-bcbd-3ea5dbe2e70f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:29.295395 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-598f61fe-322b-48df-bcbd-3ea5dbe2e70f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.216081 Jun 17 15:43:29.295989 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1285/2980] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:43:29 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:43:30.079687 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-94e1e474-872d-4037-8c1a-669daa5cd0a9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:30.080217 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-94e1e474-872d-4037-8c1a-669daa5cd0a9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:30.087195 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-94e1e474-872d-4037-8c1a-669daa5cd0a9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:30.088857 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-94e1e474-872d-4037-8c1a-669daa5cd0a9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:30.089044 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-94e1e474-872d-4037-8c1a-669daa5cd0a9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:30.089412 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-94e1e474-872d-4037-8c1a-669daa5cd0a9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:30.168192 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-94e1e474-872d-4037-8c1a-669daa5cd0a9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:30.177462 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-94e1e474-872d-4037-8c1a-669daa5cd0a9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:30.179037 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-94e1e474-872d-4037-8c1a-669daa5cd0a9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:30.180204 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-94e1e474-872d-4037-8c1a-669daa5cd0a9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.104646 Jun 17 15:43:30.181054 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1696/2981] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:43:30 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 15:43:30.193289 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-86331bdf-49f9-4486-b18a-0d68c2f7572d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:30.194462 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-86331bdf-49f9-4486-b18a-0d68c2f7572d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:30.205222 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-86331bdf-49f9-4486-b18a-0d68c2f7572d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:30.205820 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-86331bdf-49f9-4486-b18a-0d68c2f7572d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:30.206724 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-86331bdf-49f9-4486-b18a-0d68c2f7572d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:30.207345 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-86331bdf-49f9-4486-b18a-0d68c2f7572d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:30.278586 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-86331bdf-49f9-4486-b18a-0d68c2f7572d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:30.291559 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-86331bdf-49f9-4486-b18a-0d68c2f7572d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.105706 Jun 17 15:43:30.292414 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1286/2982] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:43:30 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:43:30.314271 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-478abda5-d1e1-40f5-9892-d7ee8e6fae87 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:30.314911 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-478abda5-d1e1-40f5-9892-d7ee8e6fae87 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:30.321635 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-478abda5-d1e1-40f5-9892-d7ee8e6fae87 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:30.322777 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-478abda5-d1e1-40f5-9892-d7ee8e6fae87 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:30.323685 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-478abda5-d1e1-40f5-9892-d7ee8e6fae87 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:30.324218 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-478abda5-d1e1-40f5-9892-d7ee8e6fae87 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:30.478018 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-478abda5-d1e1-40f5-9892-d7ee8e6fae87 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:30.486557 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-478abda5-d1e1-40f5-9892-d7ee8e6fae87 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.176394 Jun 17 15:43:30.487151 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1697/2983] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:43:30 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:43:31.207490 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-f3ed79c2-590d-47ef-a202-41a9ceca02d7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:31.208281 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-f3ed79c2-590d-47ef-a202-41a9ceca02d7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:31.215813 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f3ed79c2-590d-47ef-a202-41a9ceca02d7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:31.216259 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f3ed79c2-590d-47ef-a202-41a9ceca02d7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:31.217084 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f3ed79c2-590d-47ef-a202-41a9ceca02d7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:31.217516 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f3ed79c2-590d-47ef-a202-41a9ceca02d7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:31.285175 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-f3ed79c2-590d-47ef-a202-41a9ceca02d7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:31.295215 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-f3ed79c2-590d-47ef-a202-41a9ceca02d7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:31.296772 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-f3ed79c2-590d-47ef-a202-41a9ceca02d7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:31.297941 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-f3ed79c2-590d-47ef-a202-41a9ceca02d7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.094719 Jun 17 15:43:31.298512 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1287/2984] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:43:31 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:43:31.309397 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-54c70b0d-e4ff-42e6-a948-2aad1a169813 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:31.310322 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-54c70b0d-e4ff-42e6-a948-2aad1a169813 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:31.316787 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-54c70b0d-e4ff-42e6-a948-2aad1a169813 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:31.317261 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-54c70b0d-e4ff-42e6-a948-2aad1a169813 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:31.318002 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-54c70b0d-e4ff-42e6-a948-2aad1a169813 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:31.318428 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-54c70b0d-e4ff-42e6-a948-2aad1a169813 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:31.385542 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-54c70b0d-e4ff-42e6-a948-2aad1a169813 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:31.388233 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=100 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:43:31.397122 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-54c70b0d-e4ff-42e6-a948-2aad1a169813 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.092070 Jun 17 15:43:31.397795 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1698/2985] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:43:31 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:43:31.503623 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-4f178749-8c37-4bee-9166-ea2847a0c03d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:31.504247 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-4f178749-8c37-4bee-9166-ea2847a0c03d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:31.511122 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4f178749-8c37-4bee-9166-ea2847a0c03d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:31.511568 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4f178749-8c37-4bee-9166-ea2847a0c03d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:31.512676 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4f178749-8c37-4bee-9166-ea2847a0c03d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:31.513107 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4f178749-8c37-4bee-9166-ea2847a0c03d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:31.658759 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-4f178749-8c37-4bee-9166-ea2847a0c03d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:31.669504 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-4f178749-8c37-4bee-9166-ea2847a0c03d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.169400 Jun 17 15:43:31.670455 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1288/2986] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:43:31 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:43:32.316718 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-15b64ebe-39b8-46c5-8a4e-5bdf35528d1b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:32.317382 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-15b64ebe-39b8-46c5-8a4e-5bdf35528d1b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:32.325221 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-15b64ebe-39b8-46c5-8a4e-5bdf35528d1b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:32.325696 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-15b64ebe-39b8-46c5-8a4e-5bdf35528d1b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:32.326460 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-15b64ebe-39b8-46c5-8a4e-5bdf35528d1b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:32.326888 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-15b64ebe-39b8-46c5-8a4e-5bdf35528d1b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:32.407939 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-15b64ebe-39b8-46c5-8a4e-5bdf35528d1b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:32.415925 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-ef17edab-978f-4a69-aed8-8da2ee179b56 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:32.416872 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-ef17edab-978f-4a69-aed8-8da2ee179b56 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:32.417066 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-15b64ebe-39b8-46c5-8a4e-5bdf35528d1b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:32.418550 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-15b64ebe-39b8-46c5-8a4e-5bdf35528d1b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:32.419709 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-15b64ebe-39b8-46c5-8a4e-5bdf35528d1b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.107108 Jun 17 15:43:32.420257 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1699/2987] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:43:32 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 15:43:32.427309 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ef17edab-978f-4a69-aed8-8da2ee179b56 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:32.428185 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ef17edab-978f-4a69-aed8-8da2ee179b56 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:32.429678 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ef17edab-978f-4a69-aed8-8da2ee179b56 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:32.430496 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ef17edab-978f-4a69-aed8-8da2ee179b56 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:32.500046 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-ef17edab-978f-4a69-aed8-8da2ee179b56 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:32.508701 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-ef17edab-978f-4a69-aed8-8da2ee179b56 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.097429 Jun 17 15:43:32.509287 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1289/2988] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:43:32 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:43:32.691619 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-749f7077-ef26-48aa-a124-6bf3accccae9 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:32.692268 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-749f7077-ef26-48aa-a124-6bf3accccae9 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:32.698781 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-749f7077-ef26-48aa-a124-6bf3accccae9 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:32.699229 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-749f7077-ef26-48aa-a124-6bf3accccae9 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:32.700005 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-749f7077-ef26-48aa-a124-6bf3accccae9 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:32.700474 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-749f7077-ef26-48aa-a124-6bf3accccae9 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:32.848916 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-749f7077-ef26-48aa-a124-6bf3accccae9 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:32.858740 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-749f7077-ef26-48aa-a124-6bf3accccae9 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.170902 Jun 17 15:43:32.859487 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1700/2989] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:43:32 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:43:33.438306 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-ea235854-ddb0-48e6-94b8-9d51403ac551 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:33.439012 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-ea235854-ddb0-48e6-94b8-9d51403ac551 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:33.445812 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ea235854-ddb0-48e6-94b8-9d51403ac551 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:33.446253 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ea235854-ddb0-48e6-94b8-9d51403ac551 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:33.447508 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ea235854-ddb0-48e6-94b8-9d51403ac551 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:33.447939 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ea235854-ddb0-48e6-94b8-9d51403ac551 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:33.515950 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-ea235854-ddb0-48e6-94b8-9d51403ac551 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:33.526240 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-ea235854-ddb0-48e6-94b8-9d51403ac551 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:33.527787 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-ea235854-ddb0-48e6-94b8-9d51403ac551 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:33.529077 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-ea235854-ddb0-48e6-94b8-9d51403ac551 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.094740 Jun 17 15:43:33.529924 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1290/2990] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:43:33 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:43:33.531939 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-a788cb0e-aa0a-4fed-b697-78b81480a4d1 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:33.532680 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-a788cb0e-aa0a-4fed-b697-78b81480a4d1 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:33.540621 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a788cb0e-aa0a-4fed-b697-78b81480a4d1 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:33.541339 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a788cb0e-aa0a-4fed-b697-78b81480a4d1 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:33.542134 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a788cb0e-aa0a-4fed-b697-78b81480a4d1 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:33.542569 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a788cb0e-aa0a-4fed-b697-78b81480a4d1 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:33.615216 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-a788cb0e-aa0a-4fed-b697-78b81480a4d1 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:33.623872 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-a788cb0e-aa0a-4fed-b697-78b81480a4d1 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.096617 Jun 17 15:43:33.624507 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1701/2991] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:43:33 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:43:33.877596 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-1e6d08cb-3e91-47ed-ae2c-1c567a2bf404 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:33.878302 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-1e6d08cb-3e91-47ed-ae2c-1c567a2bf404 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:33.885415 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1e6d08cb-3e91-47ed-ae2c-1c567a2bf404 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:33.885831 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1e6d08cb-3e91-47ed-ae2c-1c567a2bf404 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:33.886597 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1e6d08cb-3e91-47ed-ae2c-1c567a2bf404 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:33.887312 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1e6d08cb-3e91-47ed-ae2c-1c567a2bf404 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:34.025573 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-1e6d08cb-3e91-47ed-ae2c-1c567a2bf404 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:34.034254 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-1e6d08cb-3e91-47ed-ae2c-1c567a2bf404 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.160535 Jun 17 15:43:34.034755 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1291/2992] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:43:33 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:43:34.547314 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-a69d06eb-391a-427d-9b8a-387da87887fe tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:34.547966 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-a69d06eb-391a-427d-9b8a-387da87887fe tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:34.555152 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a69d06eb-391a-427d-9b8a-387da87887fe tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:34.555597 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a69d06eb-391a-427d-9b8a-387da87887fe tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:34.556919 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a69d06eb-391a-427d-9b8a-387da87887fe tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:34.557358 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a69d06eb-391a-427d-9b8a-387da87887fe tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:34.625656 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-a69d06eb-391a-427d-9b8a-387da87887fe tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:34.635440 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-a69d06eb-391a-427d-9b8a-387da87887fe tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:34.636966 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-a69d06eb-391a-427d-9b8a-387da87887fe tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:34.638191 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-a69d06eb-391a-427d-9b8a-387da87887fe tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.094858 Jun 17 15:43:34.638755 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1702/2993] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:43:34 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:43:34.642513 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-a198ad39-dba1-419d-937e-1128d9324a48 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:34.643138 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-a198ad39-dba1-419d-937e-1128d9324a48 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:34.655969 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a198ad39-dba1-419d-937e-1128d9324a48 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:34.656629 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a198ad39-dba1-419d-937e-1128d9324a48 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:34.658197 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a198ad39-dba1-419d-937e-1128d9324a48 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:34.658638 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a198ad39-dba1-419d-937e-1128d9324a48 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:34.723577 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-a198ad39-dba1-419d-937e-1128d9324a48 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:34.732555 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-a198ad39-dba1-419d-937e-1128d9324a48 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.093990 Jun 17 15:43:34.733152 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1292/2994] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:43:34 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:43:35.051226 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-3fe7a3d4-34d3-4c17-b483-6ddad0d47d23 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:35.051747 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-3fe7a3d4-34d3-4c17-b483-6ddad0d47d23 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:35.058717 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3fe7a3d4-34d3-4c17-b483-6ddad0d47d23 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:35.059159 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3fe7a3d4-34d3-4c17-b483-6ddad0d47d23 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:35.059931 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3fe7a3d4-34d3-4c17-b483-6ddad0d47d23 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:35.060375 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3fe7a3d4-34d3-4c17-b483-6ddad0d47d23 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:35.201128 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-3fe7a3d4-34d3-4c17-b483-6ddad0d47d23 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:35.209488 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-3fe7a3d4-34d3-4c17-b483-6ddad0d47d23 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.162158 Jun 17 15:43:35.210472 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1703/2995] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:43:35 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:43:35.657159 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-ecfc15f3-fa86-408f-87b0-922e552970e2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:35.657912 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-ecfc15f3-fa86-408f-87b0-922e552970e2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:35.665428 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ecfc15f3-fa86-408f-87b0-922e552970e2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:35.665920 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ecfc15f3-fa86-408f-87b0-922e552970e2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:35.666726 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ecfc15f3-fa86-408f-87b0-922e552970e2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:35.667159 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ecfc15f3-fa86-408f-87b0-922e552970e2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:35.736267 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-ecfc15f3-fa86-408f-87b0-922e552970e2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:35.746606 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-ecfc15f3-fa86-408f-87b0-922e552970e2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:35.748134 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-ecfc15f3-fa86-408f-87b0-922e552970e2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:35.749700 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-ecfc15f3-fa86-408f-87b0-922e552970e2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.096747 Jun 17 15:43:35.750509 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1293/2996] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:43:35 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:43:35.754021 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-4904745e-edcf-4438-a967-c4dde3dfc0c1 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:35.754834 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-4904745e-edcf-4438-a967-c4dde3dfc0c1 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:35.765445 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4904745e-edcf-4438-a967-c4dde3dfc0c1 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:35.770373 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4904745e-edcf-4438-a967-c4dde3dfc0c1 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:35.770373 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4904745e-edcf-4438-a967-c4dde3dfc0c1 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:35.770373 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4904745e-edcf-4438-a967-c4dde3dfc0c1 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:35.839335 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-4904745e-edcf-4438-a967-c4dde3dfc0c1 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:35.848370 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-4904745e-edcf-4438-a967-c4dde3dfc0c1 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.101437 Jun 17 15:43:35.848962 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1704/2997] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:43:35 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:43:36.229385 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-63d4c0cf-e0bd-4cce-be27-07b85ea19e82 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:36.230013 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-63d4c0cf-e0bd-4cce-be27-07b85ea19e82 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:36.236518 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-63d4c0cf-e0bd-4cce-be27-07b85ea19e82 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:36.236976 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-63d4c0cf-e0bd-4cce-be27-07b85ea19e82 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:36.237823 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-63d4c0cf-e0bd-4cce-be27-07b85ea19e82 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:36.238263 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-63d4c0cf-e0bd-4cce-be27-07b85ea19e82 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:36.389165 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-63d4c0cf-e0bd-4cce-be27-07b85ea19e82 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:36.397687 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-63d4c0cf-e0bd-4cce-be27-07b85ea19e82 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.172397 Jun 17 15:43:36.398281 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1294/2998] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:43:36 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:43:36.769844 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-3f5b48aa-192c-4fa2-892d-2225b979b53e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:36.770475 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-3f5b48aa-192c-4fa2-892d-2225b979b53e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:36.777562 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3f5b48aa-192c-4fa2-892d-2225b979b53e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:36.777998 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3f5b48aa-192c-4fa2-892d-2225b979b53e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:36.778747 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3f5b48aa-192c-4fa2-892d-2225b979b53e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:36.779172 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3f5b48aa-192c-4fa2-892d-2225b979b53e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:36.843542 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-3f5b48aa-192c-4fa2-892d-2225b979b53e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:36.852246 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-3f5b48aa-192c-4fa2-892d-2225b979b53e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:36.854435 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-3f5b48aa-192c-4fa2-892d-2225b979b53e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:36.855560 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-3f5b48aa-192c-4fa2-892d-2225b979b53e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.089752 Jun 17 15:43:36.856104 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1705/2999] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:43:36 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:43:36.865328 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-7713027a-df23-4fbc-adf6-25b618385126 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:36.865936 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-7713027a-df23-4fbc-adf6-25b618385126 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:36.872436 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7713027a-df23-4fbc-adf6-25b618385126 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:36.872875 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7713027a-df23-4fbc-adf6-25b618385126 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:36.873615 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7713027a-df23-4fbc-adf6-25b618385126 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:36.874043 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7713027a-df23-4fbc-adf6-25b618385126 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:36.934946 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-7713027a-df23-4fbc-adf6-25b618385126 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:36.942992 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-7713027a-df23-4fbc-adf6-25b618385126 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.081476 Jun 17 15:43:36.943559 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1295/3000] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:43:36 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:43:37.415373 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-4e8f9c23-1f32-457f-a804-f62e1c06eae6 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:37.416049 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-4e8f9c23-1f32-457f-a804-f62e1c06eae6 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:37.422547 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4e8f9c23-1f32-457f-a804-f62e1c06eae6 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:37.423042 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4e8f9c23-1f32-457f-a804-f62e1c06eae6 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:37.423859 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4e8f9c23-1f32-457f-a804-f62e1c06eae6 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:37.424421 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4e8f9c23-1f32-457f-a804-f62e1c06eae6 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:37.572706 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-4e8f9c23-1f32-457f-a804-f62e1c06eae6 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:37.580995 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-4e8f9c23-1f32-457f-a804-f62e1c06eae6 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.169542 Jun 17 15:43:37.581616 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1706/3001] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:43:37 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:43:37.874124 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-d62c4224-a509-4842-a3bd-5efe864234c9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:37.874741 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-d62c4224-a509-4842-a3bd-5efe864234c9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:37.881503 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d62c4224-a509-4842-a3bd-5efe864234c9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:37.881948 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d62c4224-a509-4842-a3bd-5efe864234c9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:37.883142 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d62c4224-a509-4842-a3bd-5efe864234c9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:37.883142 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d62c4224-a509-4842-a3bd-5efe864234c9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:37.947870 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-d62c4224-a509-4842-a3bd-5efe864234c9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:37.957592 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-d62c4224-a509-4842-a3bd-5efe864234c9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:37.958951 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-445499d8-4c3e-4119-8f0b-b5d59bca85b5 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:37.959451 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-d62c4224-a509-4842-a3bd-5efe864234c9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:37.959691 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-445499d8-4c3e-4119-8f0b-b5d59bca85b5 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:37.960939 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-d62c4224-a509-4842-a3bd-5efe864234c9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.090722 Jun 17 15:43:37.961707 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1296/3002] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:43:37 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:43:37.969728 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-445499d8-4c3e-4119-8f0b-b5d59bca85b5 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:37.969975 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-445499d8-4c3e-4119-8f0b-b5d59bca85b5 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:37.970953 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-445499d8-4c3e-4119-8f0b-b5d59bca85b5 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:37.971373 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-445499d8-4c3e-4119-8f0b-b5d59bca85b5 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:38.053220 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-445499d8-4c3e-4119-8f0b-b5d59bca85b5 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:38.062133 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-445499d8-4c3e-4119-8f0b-b5d59bca85b5 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.106932 Jun 17 15:43:38.062718 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1707/3003] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:43:37 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:43:38.599196 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-07b01112-8d07-4afb-9efd-88112695916e tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:38.599809 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-07b01112-8d07-4afb-9efd-88112695916e tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:38.606384 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-07b01112-8d07-4afb-9efd-88112695916e tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:38.606830 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-07b01112-8d07-4afb-9efd-88112695916e tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:38.607601 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-07b01112-8d07-4afb-9efd-88112695916e tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:38.608030 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-07b01112-8d07-4afb-9efd-88112695916e tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:38.744699 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-07b01112-8d07-4afb-9efd-88112695916e tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:38.753380 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-07b01112-8d07-4afb-9efd-88112695916e tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.158008 Jun 17 15:43:38.754020 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1297/3004] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:43:38 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:43:38.979383 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-3130ecda-ff5f-4e15-a1d7-d5b58aea70f9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:38.980030 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-3130ecda-ff5f-4e15-a1d7-d5b58aea70f9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:38.986710 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3130ecda-ff5f-4e15-a1d7-d5b58aea70f9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:38.987156 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3130ecda-ff5f-4e15-a1d7-d5b58aea70f9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:38.987921 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3130ecda-ff5f-4e15-a1d7-d5b58aea70f9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:38.988375 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3130ecda-ff5f-4e15-a1d7-d5b58aea70f9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:39.050801 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-3130ecda-ff5f-4e15-a1d7-d5b58aea70f9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:39.060777 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-3130ecda-ff5f-4e15-a1d7-d5b58aea70f9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:39.062293 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-3130ecda-ff5f-4e15-a1d7-d5b58aea70f9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:39.063444 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-3130ecda-ff5f-4e15-a1d7-d5b58aea70f9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.088328 Jun 17 15:43:39.064012 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1708/3005] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:43:38 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:43:39.079085 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-98c3f6a4-15ac-4dc8-84f9-7b349f0acd9a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:39.079690 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-98c3f6a4-15ac-4dc8-84f9-7b349f0acd9a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:39.086501 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-98c3f6a4-15ac-4dc8-84f9-7b349f0acd9a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:39.086948 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-98c3f6a4-15ac-4dc8-84f9-7b349f0acd9a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:39.087767 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-98c3f6a4-15ac-4dc8-84f9-7b349f0acd9a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:39.088206 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-98c3f6a4-15ac-4dc8-84f9-7b349f0acd9a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:39.153411 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-98c3f6a4-15ac-4dc8-84f9-7b349f0acd9a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:39.162985 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-98c3f6a4-15ac-4dc8-84f9-7b349f0acd9a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.087621 Jun 17 15:43:39.163553 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1298/3006] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:43:39 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:43:39.771144 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-ac93e712-5fb0-45ce-80e5-60f340f91e28 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:39.771683 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-ac93e712-5fb0-45ce-80e5-60f340f91e28 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:39.778593 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ac93e712-5fb0-45ce-80e5-60f340f91e28 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:39.779043 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ac93e712-5fb0-45ce-80e5-60f340f91e28 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:39.780277 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ac93e712-5fb0-45ce-80e5-60f340f91e28 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:39.780277 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ac93e712-5fb0-45ce-80e5-60f340f91e28 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:39.920450 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-ac93e712-5fb0-45ce-80e5-60f340f91e28 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:39.928932 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-ac93e712-5fb0-45ce-80e5-60f340f91e28 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.161675 Jun 17 15:43:39.929511 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1709/3007] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:43:39 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:43:40.082752 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-c0f0c703-bad3-480c-8d0b-de1c58af5b5c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:40.083398 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-c0f0c703-bad3-480c-8d0b-de1c58af5b5c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:40.090555 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c0f0c703-bad3-480c-8d0b-de1c58af5b5c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:40.091002 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c0f0c703-bad3-480c-8d0b-de1c58af5b5c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:40.091773 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c0f0c703-bad3-480c-8d0b-de1c58af5b5c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:40.092193 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c0f0c703-bad3-480c-8d0b-de1c58af5b5c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:40.153947 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-c0f0c703-bad3-480c-8d0b-de1c58af5b5c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:40.162287 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-c0f0c703-bad3-480c-8d0b-de1c58af5b5c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:40.163786 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-c0f0c703-bad3-480c-8d0b-de1c58af5b5c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:40.164946 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-c0f0c703-bad3-480c-8d0b-de1c58af5b5c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.086174 Jun 17 15:43:40.165499 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1299/3008] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:43:40 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:43:40.183104 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-50edca03-0f81-4ea2-b369-7a45d7deade1 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:40.183717 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-50edca03-0f81-4ea2-b369-7a45d7deade1 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:40.190361 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-50edca03-0f81-4ea2-b369-7a45d7deade1 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:40.190814 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-50edca03-0f81-4ea2-b369-7a45d7deade1 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:40.191580 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-50edca03-0f81-4ea2-b369-7a45d7deade1 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:40.192019 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-50edca03-0f81-4ea2-b369-7a45d7deade1 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:40.252690 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-50edca03-0f81-4ea2-b369-7a45d7deade1 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:40.261168 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-50edca03-0f81-4ea2-b369-7a45d7deade1 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.082067 Jun 17 15:43:40.261739 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1710/3009] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:43:40 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:43:40.946152 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-f7585f40-725f-4ad5-91c9-3a9dbd561a27 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:40.946765 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-f7585f40-725f-4ad5-91c9-3a9dbd561a27 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:40.953169 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f7585f40-725f-4ad5-91c9-3a9dbd561a27 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:40.953620 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f7585f40-725f-4ad5-91c9-3a9dbd561a27 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:40.954400 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f7585f40-725f-4ad5-91c9-3a9dbd561a27 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:40.954839 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f7585f40-725f-4ad5-91c9-3a9dbd561a27 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:41.091477 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-f7585f40-725f-4ad5-91c9-3a9dbd561a27 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:41.100045 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-f7585f40-725f-4ad5-91c9-3a9dbd561a27 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.157762 Jun 17 15:43:41.100650 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1300/3010] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:43:40 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:43:41.183567 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-367f7ad3-794b-4013-8abe-770925686ccb tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:41.184171 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-367f7ad3-794b-4013-8abe-770925686ccb tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:41.190639 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-367f7ad3-794b-4013-8abe-770925686ccb tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:41.191083 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-367f7ad3-794b-4013-8abe-770925686ccb tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:41.191828 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-367f7ad3-794b-4013-8abe-770925686ccb tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:41.192258 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-367f7ad3-794b-4013-8abe-770925686ccb tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:41.255277 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-367f7ad3-794b-4013-8abe-770925686ccb tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:41.264890 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-367f7ad3-794b-4013-8abe-770925686ccb tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:41.266369 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-367f7ad3-794b-4013-8abe-770925686ccb tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:41.267499 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-367f7ad3-794b-4013-8abe-770925686ccb tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.088418 Jun 17 15:43:41.268050 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1711/3011] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:43:41 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:43:41.277740 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-0475ac0e-7bd3-4a2b-8c4b-b1ab6113c686 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:41.278391 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-0475ac0e-7bd3-4a2b-8c4b-b1ab6113c686 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:41.284752 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0475ac0e-7bd3-4a2b-8c4b-b1ab6113c686 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:41.285165 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0475ac0e-7bd3-4a2b-8c4b-b1ab6113c686 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:41.285934 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0475ac0e-7bd3-4a2b-8c4b-b1ab6113c686 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:41.286374 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0475ac0e-7bd3-4a2b-8c4b-b1ab6113c686 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:41.350180 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-0475ac0e-7bd3-4a2b-8c4b-b1ab6113c686 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:41.352657 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell1:SELECT=100 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:43:41.359808 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-0475ac0e-7bd3-4a2b-8c4b-b1ab6113c686 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.085889 Jun 17 15:43:41.360413 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1301/3012] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:43:41 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:43:42.117260 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-b5d448bc-8543-45ba-8ce8-82edf8e26591 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:42.117869 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-b5d448bc-8543-45ba-8ce8-82edf8e26591 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:42.123786 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b5d448bc-8543-45ba-8ce8-82edf8e26591 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:42.124629 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b5d448bc-8543-45ba-8ce8-82edf8e26591 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:42.125376 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b5d448bc-8543-45ba-8ce8-82edf8e26591 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:42.125802 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b5d448bc-8543-45ba-8ce8-82edf8e26591 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:42.256731 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-b5d448bc-8543-45ba-8ce8-82edf8e26591 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:42.264877 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-b5d448bc-8543-45ba-8ce8-82edf8e26591 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.151509 Jun 17 15:43:42.265431 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1712/3013] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:43:42 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:43:42.285211 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-bbe95ac3-4896-4511-8e05-edbeccf3b72a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:42.285847 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-bbe95ac3-4896-4511-8e05-edbeccf3b72a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:42.292959 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bbe95ac3-4896-4511-8e05-edbeccf3b72a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:42.293404 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bbe95ac3-4896-4511-8e05-edbeccf3b72a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:42.294148 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bbe95ac3-4896-4511-8e05-edbeccf3b72a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:42.294577 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bbe95ac3-4896-4511-8e05-edbeccf3b72a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:42.356513 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-bbe95ac3-4896-4511-8e05-edbeccf3b72a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:42.364967 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-bbe95ac3-4896-4511-8e05-edbeccf3b72a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:42.366444 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-bbe95ac3-4896-4511-8e05-edbeccf3b72a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:42.367606 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-bbe95ac3-4896-4511-8e05-edbeccf3b72a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.086234 Jun 17 15:43:42.368111 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1302/3014] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:43:42 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:43:42.377439 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-aab2ff1f-e9d8-485e-b165-83ff7f6a2576 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:42.378045 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-aab2ff1f-e9d8-485e-b165-83ff7f6a2576 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:42.384144 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-aab2ff1f-e9d8-485e-b165-83ff7f6a2576 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:42.385111 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-aab2ff1f-e9d8-485e-b165-83ff7f6a2576 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:42.385865 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-aab2ff1f-e9d8-485e-b165-83ff7f6a2576 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:42.386302 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-aab2ff1f-e9d8-485e-b165-83ff7f6a2576 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:42.447850 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-aab2ff1f-e9d8-485e-b165-83ff7f6a2576 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:42.455734 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-aab2ff1f-e9d8-485e-b165-83ff7f6a2576 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.082164 Jun 17 15:43:42.456289 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1713/3015] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:43:42 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:43:43.281301 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-b6807752-fb49-495d-b178-c981383850b4 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:43.282333 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-b6807752-fb49-495d-b178-c981383850b4 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:43.288096 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b6807752-fb49-495d-b178-c981383850b4 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:43.288754 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b6807752-fb49-495d-b178-c981383850b4 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:43.289327 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b6807752-fb49-495d-b178-c981383850b4 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:43.289763 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b6807752-fb49-495d-b178-c981383850b4 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:43.384637 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-def78561-3f61-4702-b410-dd4972d82991 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:43.385247 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-def78561-3f61-4702-b410-dd4972d82991 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:43.391760 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-def78561-3f61-4702-b410-dd4972d82991 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:43.392209 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-def78561-3f61-4702-b410-dd4972d82991 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:43.393003 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-def78561-3f61-4702-b410-dd4972d82991 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:43.393433 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-def78561-3f61-4702-b410-dd4972d82991 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:43.428648 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-b6807752-fb49-495d-b178-c981383850b4 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:43.441506 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-b6807752-fb49-495d-b178-c981383850b4 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.163906 Jun 17 15:43:43.442353 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1303/3016] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:43:43 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:43:43.457199 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-def78561-3f61-4702-b410-dd4972d82991 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:43.470107 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-def78561-3f61-4702-b410-dd4972d82991 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:43.472281 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-def78561-3f61-4702-b410-dd4972d82991 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:43.473685 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-def78561-3f61-4702-b410-dd4972d82991 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.092986 Jun 17 15:43:43.474259 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1714/3017] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:43:43 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 15:43:43.477746 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-4b0f1c41-116e-4f99-93eb-e27d3ff128f0 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:43.479619 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-4b0f1c41-116e-4f99-93eb-e27d3ff128f0 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:43.490612 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4b0f1c41-116e-4f99-93eb-e27d3ff128f0 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:43.491437 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4b0f1c41-116e-4f99-93eb-e27d3ff128f0 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:43.492873 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4b0f1c41-116e-4f99-93eb-e27d3ff128f0 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:43.493660 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4b0f1c41-116e-4f99-93eb-e27d3ff128f0 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:43.566195 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-4b0f1c41-116e-4f99-93eb-e27d3ff128f0 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:43.574314 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-4b0f1c41-116e-4f99-93eb-e27d3ff128f0 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.104259 Jun 17 15:43:43.574878 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1304/3018] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:43:43 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:43:44.459340 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-2e96cca4-fe64-4262-afc2-0ca338a69d3c tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:44.459951 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-2e96cca4-fe64-4262-afc2-0ca338a69d3c tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:44.466575 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2e96cca4-fe64-4262-afc2-0ca338a69d3c tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:44.467023 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2e96cca4-fe64-4262-afc2-0ca338a69d3c tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:44.467778 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2e96cca4-fe64-4262-afc2-0ca338a69d3c tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:44.468208 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2e96cca4-fe64-4262-afc2-0ca338a69d3c tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:44.483202 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=100 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:43:44.492785 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-7f9fcc67-0bba-4b40-89e4-0950ac278825 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:44.493394 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-7f9fcc67-0bba-4b40-89e4-0950ac278825 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:44.499878 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7f9fcc67-0bba-4b40-89e4-0950ac278825 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:44.500318 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7f9fcc67-0bba-4b40-89e4-0950ac278825 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:44.501105 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7f9fcc67-0bba-4b40-89e4-0950ac278825 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:44.501539 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7f9fcc67-0bba-4b40-89e4-0950ac278825 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:44.563204 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-7f9fcc67-0bba-4b40-89e4-0950ac278825 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:44.571685 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-7f9fcc67-0bba-4b40-89e4-0950ac278825 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:44.573205 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-7f9fcc67-0bba-4b40-89e4-0950ac278825 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:44.574338 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-7f9fcc67-0bba-4b40-89e4-0950ac278825 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.085545 Jun 17 15:43:44.574897 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1305/3019] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:43:44 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 15:43:44.590588 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-3d0e2b30-d1f2-45f3-9aeb-53c4027d1f5c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:44.591191 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-3d0e2b30-d1f2-45f3-9aeb-53c4027d1f5c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:44.597287 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3d0e2b30-d1f2-45f3-9aeb-53c4027d1f5c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:44.597733 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3d0e2b30-d1f2-45f3-9aeb-53c4027d1f5c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:44.598484 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3d0e2b30-d1f2-45f3-9aeb-53c4027d1f5c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:44.598914 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3d0e2b30-d1f2-45f3-9aeb-53c4027d1f5c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:44.601704 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-2e96cca4-fe64-4262-afc2-0ca338a69d3c tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:44.610168 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-2e96cca4-fe64-4262-afc2-0ca338a69d3c tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.154703 Jun 17 15:43:44.610749 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1715/3020] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:43:44 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:43:44.659225 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-3d0e2b30-d1f2-45f3-9aeb-53c4027d1f5c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:44.667568 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-3d0e2b30-d1f2-45f3-9aeb-53c4027d1f5c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.080624 Jun 17 15:43:44.668129 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1306/3021] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:43:44 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:43:45.593209 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-eea3eb80-18d1-43d4-ae8b-9178eff68366 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:45.593809 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-eea3eb80-18d1-43d4-ae8b-9178eff68366 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:45.600495 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-eea3eb80-18d1-43d4-ae8b-9178eff68366 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:45.600946 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-eea3eb80-18d1-43d4-ae8b-9178eff68366 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:45.601966 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-eea3eb80-18d1-43d4-ae8b-9178eff68366 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:45.602404 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-eea3eb80-18d1-43d4-ae8b-9178eff68366 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:45.627752 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-48a352a9-770e-4e41-993d-ff0fbe90731f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:45.628364 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-48a352a9-770e-4e41-993d-ff0fbe90731f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:45.635579 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-48a352a9-770e-4e41-993d-ff0fbe90731f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:45.636033 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-48a352a9-770e-4e41-993d-ff0fbe90731f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:45.636832 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-48a352a9-770e-4e41-993d-ff0fbe90731f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:45.637268 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-48a352a9-770e-4e41-993d-ff0fbe90731f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:45.665001 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-eea3eb80-18d1-43d4-ae8b-9178eff68366 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:45.674332 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-eea3eb80-18d1-43d4-ae8b-9178eff68366 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:45.675863 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-eea3eb80-18d1-43d4-ae8b-9178eff68366 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:45.677114 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-eea3eb80-18d1-43d4-ae8b-9178eff68366 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.087958 Jun 17 15:43:45.677681 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1716/3022] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:43:45 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:43:45.685573 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-3f00e419-e9c1-4846-9f7d-73f407e06585 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:45.686361 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-3f00e419-e9c1-4846-9f7d-73f407e06585 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:45.692553 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3f00e419-e9c1-4846-9f7d-73f407e06585 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:45.692996 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3f00e419-e9c1-4846-9f7d-73f407e06585 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:45.693757 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3f00e419-e9c1-4846-9f7d-73f407e06585 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:45.694186 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3f00e419-e9c1-4846-9f7d-73f407e06585 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:45.763615 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-3f00e419-e9c1-4846-9f7d-73f407e06585 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:45.772288 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-3f00e419-e9c1-4846-9f7d-73f407e06585 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.091337 Jun 17 15:43:45.772935 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1717/3023] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:43:45 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:43:45.778117 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-48a352a9-770e-4e41-993d-ff0fbe90731f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:45.788751 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-48a352a9-770e-4e41-993d-ff0fbe90731f tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.164802 Jun 17 15:43:45.789342 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1307/3024] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:43:45 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:43:46.697420 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-bf3effa6-d176-411d-b673-2920ec8f6f0a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:46.697985 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-bf3effa6-d176-411d-b673-2920ec8f6f0a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:46.704473 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bf3effa6-d176-411d-b673-2920ec8f6f0a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:46.704924 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bf3effa6-d176-411d-b673-2920ec8f6f0a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:46.705686 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bf3effa6-d176-411d-b673-2920ec8f6f0a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:46.706121 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bf3effa6-d176-411d-b673-2920ec8f6f0a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:46.769810 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-bf3effa6-d176-411d-b673-2920ec8f6f0a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:46.779114 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-bf3effa6-d176-411d-b673-2920ec8f6f0a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:46.780634 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-bf3effa6-d176-411d-b673-2920ec8f6f0a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:46.781765 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-bf3effa6-d176-411d-b673-2920ec8f6f0a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.089085 Jun 17 15:43:46.782325 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1718/3025] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:43:46 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:43:46.788816 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-d49997d4-d4a4-4538-a534-92eb2a0f4cce tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:46.789444 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-d49997d4-d4a4-4538-a534-92eb2a0f4cce tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:46.796739 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d49997d4-d4a4-4538-a534-92eb2a0f4cce tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:46.797187 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d49997d4-d4a4-4538-a534-92eb2a0f4cce tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:46.797958 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d49997d4-d4a4-4538-a534-92eb2a0f4cce tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:46.798395 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d49997d4-d4a4-4538-a534-92eb2a0f4cce tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:46.806122 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-7cc79dd2-cc23-4499-b2df-0a73439bc6e5 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:46.806721 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-7cc79dd2-cc23-4499-b2df-0a73439bc6e5 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:46.813120 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7cc79dd2-cc23-4499-b2df-0a73439bc6e5 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:46.813299 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7cc79dd2-cc23-4499-b2df-0a73439bc6e5 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:46.814001 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7cc79dd2-cc23-4499-b2df-0a73439bc6e5 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:46.814429 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7cc79dd2-cc23-4499-b2df-0a73439bc6e5 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:46.861986 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-d49997d4-d4a4-4538-a534-92eb2a0f4cce tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:46.874966 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-d49997d4-d4a4-4538-a534-92eb2a0f4cce tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.089895 Jun 17 15:43:46.875498 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1308/3026] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:43:46 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:43:46.952801 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-7cc79dd2-cc23-4499-b2df-0a73439bc6e5 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:46.960957 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-7cc79dd2-cc23-4499-b2df-0a73439bc6e5 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.158706 Jun 17 15:43:46.961641 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1719/3027] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:43:46 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:43:47.802112 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-3640d9eb-3bc9-467a-ae45-b1df34fe1c48 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:47.803271 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-3640d9eb-3bc9-467a-ae45-b1df34fe1c48 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:47.815798 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3640d9eb-3bc9-467a-ae45-b1df34fe1c48 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:47.816654 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3640d9eb-3bc9-467a-ae45-b1df34fe1c48 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:47.818065 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3640d9eb-3bc9-467a-ae45-b1df34fe1c48 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:47.818851 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3640d9eb-3bc9-467a-ae45-b1df34fe1c48 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:47.891789 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-771d01e6-683f-43c1-980a-e3d659b1dbed tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:47.892505 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-3640d9eb-3bc9-467a-ae45-b1df34fe1c48 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:47.892661 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-771d01e6-683f-43c1-980a-e3d659b1dbed tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:47.896093 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_api:SELECT=80 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:43:47.901211 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-771d01e6-683f-43c1-980a-e3d659b1dbed tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:47.901665 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-771d01e6-683f-43c1-980a-e3d659b1dbed tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:47.902458 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-771d01e6-683f-43c1-980a-e3d659b1dbed tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:47.902899 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-771d01e6-683f-43c1-980a-e3d659b1dbed tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:47.908630 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-3640d9eb-3bc9-467a-ae45-b1df34fe1c48 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:47.911693 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-3640d9eb-3bc9-467a-ae45-b1df34fe1c48 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:47.913969 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-3640d9eb-3bc9-467a-ae45-b1df34fe1c48 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.116562 Jun 17 15:43:47.915105 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1309/3028] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:43:47 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:43:47.975419 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-771d01e6-683f-43c1-980a-e3d659b1dbed tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:47.980248 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-89b50a99-fa76-46ad-b62c-c1bf11e8457d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:47.980927 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-89b50a99-fa76-46ad-b62c-c1bf11e8457d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:47.984659 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-771d01e6-683f-43c1-980a-e3d659b1dbed tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.097053 Jun 17 15:43:47.985253 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1720/3029] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:43:47 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:43:47.987103 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-89b50a99-fa76-46ad-b62c-c1bf11e8457d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:47.987549 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-89b50a99-fa76-46ad-b62c-c1bf11e8457d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:47.988321 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-89b50a99-fa76-46ad-b62c-c1bf11e8457d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:47.988767 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-89b50a99-fa76-46ad-b62c-c1bf11e8457d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:48.150899 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-89b50a99-fa76-46ad-b62c-c1bf11e8457d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:48.159289 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-89b50a99-fa76-46ad-b62c-c1bf11e8457d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.183637 Jun 17 15:43:48.159881 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1310/3030] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:43:47 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:43:48.937028 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-230e9d52-3886-497d-a9b5-fe21cab2d6a2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:48.937719 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-230e9d52-3886-497d-a9b5-fe21cab2d6a2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:48.948094 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-230e9d52-3886-497d-a9b5-fe21cab2d6a2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:48.948567 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-230e9d52-3886-497d-a9b5-fe21cab2d6a2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:48.949342 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-230e9d52-3886-497d-a9b5-fe21cab2d6a2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:48.949774 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-230e9d52-3886-497d-a9b5-fe21cab2d6a2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:49.001638 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-cc2ccf22-96dc-4ece-ab2b-3647eb219f6d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:49.002245 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-cc2ccf22-96dc-4ece-ab2b-3647eb219f6d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:49.009258 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cc2ccf22-96dc-4ece-ab2b-3647eb219f6d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:49.010233 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cc2ccf22-96dc-4ece-ab2b-3647eb219f6d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:49.011007 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cc2ccf22-96dc-4ece-ab2b-3647eb219f6d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:49.011425 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cc2ccf22-96dc-4ece-ab2b-3647eb219f6d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:49.015264 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-230e9d52-3886-497d-a9b5-fe21cab2d6a2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:49.026631 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-230e9d52-3886-497d-a9b5-fe21cab2d6a2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:49.028069 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-230e9d52-3886-497d-a9b5-fe21cab2d6a2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:49.029260 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-230e9d52-3886-497d-a9b5-fe21cab2d6a2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.096240 Jun 17 15:43:49.029819 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1721/3031] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:43:48 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:43:49.076498 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-cc2ccf22-96dc-4ece-ab2b-3647eb219f6d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:49.084795 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-cc2ccf22-96dc-4ece-ab2b-3647eb219f6d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.086926 Jun 17 15:43:49.085368 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1311/3032] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:43:48 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:43:49.177149 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-a1558fe5-e8f8-4f0a-94a1-5307da751934 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:49.177754 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-a1558fe5-e8f8-4f0a-94a1-5307da751934 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:49.184562 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a1558fe5-e8f8-4f0a-94a1-5307da751934 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:49.185005 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a1558fe5-e8f8-4f0a-94a1-5307da751934 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:49.185773 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a1558fe5-e8f8-4f0a-94a1-5307da751934 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:49.186203 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a1558fe5-e8f8-4f0a-94a1-5307da751934 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:49.323321 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-a1558fe5-e8f8-4f0a-94a1-5307da751934 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:49.331640 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-a1558fe5-e8f8-4f0a-94a1-5307da751934 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.158308 Jun 17 15:43:49.332214 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1722/3033] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:43:49 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:43:50.047498 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-a0cc904e-58cd-42b2-94ec-1174fd756781 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:50.048087 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-a0cc904e-58cd-42b2-94ec-1174fd756781 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:50.054956 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a0cc904e-58cd-42b2-94ec-1174fd756781 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:50.055399 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a0cc904e-58cd-42b2-94ec-1174fd756781 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:50.056169 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a0cc904e-58cd-42b2-94ec-1174fd756781 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:50.056636 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a0cc904e-58cd-42b2-94ec-1174fd756781 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:50.102483 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-47938683-edf6-4ccc-bfdc-a4a938ea9380 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:50.103412 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-47938683-edf6-4ccc-bfdc-a4a938ea9380 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:50.111228 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-47938683-edf6-4ccc-bfdc-a4a938ea9380 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:50.111669 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-47938683-edf6-4ccc-bfdc-a4a938ea9380 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:50.112472 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-47938683-edf6-4ccc-bfdc-a4a938ea9380 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:50.112922 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-47938683-edf6-4ccc-bfdc-a4a938ea9380 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:50.121925 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-a0cc904e-58cd-42b2-94ec-1174fd756781 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:50.131174 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-a0cc904e-58cd-42b2-94ec-1174fd756781 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:50.132750 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-a0cc904e-58cd-42b2-94ec-1174fd756781 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:50.133918 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-a0cc904e-58cd-42b2-94ec-1174fd756781 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.090496 Jun 17 15:43:50.134997 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1312/3034] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:43:50 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:43:50.179789 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-47938683-edf6-4ccc-bfdc-a4a938ea9380 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:50.188484 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-47938683-edf6-4ccc-bfdc-a4a938ea9380 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.090622 Jun 17 15:43:50.189058 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1723/3035] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:43:50 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:43:50.348875 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-7762203b-f727-45e6-a0f0-057dc3291723 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:50.349497 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-7762203b-f727-45e6-a0f0-057dc3291723 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:50.356032 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7762203b-f727-45e6-a0f0-057dc3291723 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:50.356523 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7762203b-f727-45e6-a0f0-057dc3291723 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:50.357296 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7762203b-f727-45e6-a0f0-057dc3291723 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:50.357756 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7762203b-f727-45e6-a0f0-057dc3291723 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:50.491122 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-7762203b-f727-45e6-a0f0-057dc3291723 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:50.499676 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-7762203b-f727-45e6-a0f0-057dc3291723 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.154735 Jun 17 15:43:50.500243 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1313/3036] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:43:50 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:43:51.153320 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-5b9e0d02-9c9a-4507-87fb-31ae666416f5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:51.154249 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-5b9e0d02-9c9a-4507-87fb-31ae666416f5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:51.162989 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5b9e0d02-9c9a-4507-87fb-31ae666416f5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:51.162989 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5b9e0d02-9c9a-4507-87fb-31ae666416f5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:51.164270 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5b9e0d02-9c9a-4507-87fb-31ae666416f5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:51.165055 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5b9e0d02-9c9a-4507-87fb-31ae666416f5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:51.205940 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-688eddcb-9a9b-4b86-b807-e7ce221cbdbf tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:51.206687 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-688eddcb-9a9b-4b86-b807-e7ce221cbdbf tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:51.213652 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-688eddcb-9a9b-4b86-b807-e7ce221cbdbf tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:51.214084 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-688eddcb-9a9b-4b86-b807-e7ce221cbdbf tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:51.214853 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-688eddcb-9a9b-4b86-b807-e7ce221cbdbf tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:51.215282 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-688eddcb-9a9b-4b86-b807-e7ce221cbdbf tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:51.245351 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-5b9e0d02-9c9a-4507-87fb-31ae666416f5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:51.258061 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-5b9e0d02-9c9a-4507-87fb-31ae666416f5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:51.265268 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-5b9e0d02-9c9a-4507-87fb-31ae666416f5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:51.266492 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-5b9e0d02-9c9a-4507-87fb-31ae666416f5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.117778 Jun 17 15:43:51.267098 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1724/3037] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:43:51 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:43:51.291920 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-688eddcb-9a9b-4b86-b807-e7ce221cbdbf tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:51.300029 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-688eddcb-9a9b-4b86-b807-e7ce221cbdbf tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.097993 Jun 17 15:43:51.300639 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1314/3038] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:43:51 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:43:51.517613 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-fa673f3b-c2e1-4db7-b1e4-848ff99a01fe tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:51.518148 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-fa673f3b-c2e1-4db7-b1e4-848ff99a01fe tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:51.525719 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fa673f3b-c2e1-4db7-b1e4-848ff99a01fe tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:51.526171 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fa673f3b-c2e1-4db7-b1e4-848ff99a01fe tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:51.526952 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fa673f3b-c2e1-4db7-b1e4-848ff99a01fe tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:51.527395 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fa673f3b-c2e1-4db7-b1e4-848ff99a01fe tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:51.672015 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-fa673f3b-c2e1-4db7-b1e4-848ff99a01fe tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:51.681956 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-fa673f3b-c2e1-4db7-b1e4-848ff99a01fe tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.168026 Jun 17 15:43:51.682553 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1725/3039] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:43:51 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:43:52.284980 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-51adb606-c254-4daa-ae39-2697c7f8d5f0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:52.285592 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-51adb606-c254-4daa-ae39-2697c7f8d5f0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:52.287909 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_api:SELECT=80 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:43:52.293746 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-51adb606-c254-4daa-ae39-2697c7f8d5f0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:52.294194 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-51adb606-c254-4daa-ae39-2697c7f8d5f0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:52.294949 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-51adb606-c254-4daa-ae39-2697c7f8d5f0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:52.295384 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-51adb606-c254-4daa-ae39-2697c7f8d5f0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:52.317007 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-fbb47afb-22a4-489b-90d3-f4e74f8f171c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:52.318291 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-fbb47afb-22a4-489b-90d3-f4e74f8f171c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:52.324745 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fbb47afb-22a4-489b-90d3-f4e74f8f171c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:52.325196 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fbb47afb-22a4-489b-90d3-f4e74f8f171c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:52.325958 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fbb47afb-22a4-489b-90d3-f4e74f8f171c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:52.326388 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fbb47afb-22a4-489b-90d3-f4e74f8f171c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:52.357915 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-51adb606-c254-4daa-ae39-2697c7f8d5f0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:52.366520 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-51adb606-c254-4daa-ae39-2697c7f8d5f0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:52.368022 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-51adb606-c254-4daa-ae39-2697c7f8d5f0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:52.369785 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-51adb606-c254-4daa-ae39-2697c7f8d5f0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.088714 Jun 17 15:43:52.370352 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1315/3040] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:43:52 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:43:52.389574 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-fbb47afb-22a4-489b-90d3-f4e74f8f171c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:52.397573 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-fbb47afb-22a4-489b-90d3-f4e74f8f171c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.084418 Jun 17 15:43:52.398136 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1726/3041] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:43:52 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:43:52.698735 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-a8394d31-7771-4f42-8b92-1079f79223ee tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:52.699352 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-a8394d31-7771-4f42-8b92-1079f79223ee tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:52.705318 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a8394d31-7771-4f42-8b92-1079f79223ee tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:52.705764 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a8394d31-7771-4f42-8b92-1079f79223ee tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:52.706511 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a8394d31-7771-4f42-8b92-1079f79223ee tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:52.706944 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a8394d31-7771-4f42-8b92-1079f79223ee tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:52.834029 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-a8394d31-7771-4f42-8b92-1079f79223ee tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:52.842541 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-a8394d31-7771-4f42-8b92-1079f79223ee tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.147650 Jun 17 15:43:52.843102 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1316/3042] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:43:52 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:43:53.387806 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-56da171b-3084-4520-b533-908337b402ea tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:53.388476 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-56da171b-3084-4520-b533-908337b402ea tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:53.395498 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-56da171b-3084-4520-b533-908337b402ea tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:53.395940 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-56da171b-3084-4520-b533-908337b402ea tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:53.396732 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-56da171b-3084-4520-b533-908337b402ea tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:53.397157 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-56da171b-3084-4520-b533-908337b402ea tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:53.414966 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-bc19bd81-439d-4f50-a642-12eb178a59ec tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:53.415578 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-bc19bd81-439d-4f50-a642-12eb178a59ec tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:53.422093 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bc19bd81-439d-4f50-a642-12eb178a59ec tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:53.422531 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bc19bd81-439d-4f50-a642-12eb178a59ec tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:53.423290 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bc19bd81-439d-4f50-a642-12eb178a59ec tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:53.423721 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bc19bd81-439d-4f50-a642-12eb178a59ec tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:53.460776 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-56da171b-3084-4520-b533-908337b402ea tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:53.469852 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-56da171b-3084-4520-b533-908337b402ea tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:53.471383 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-56da171b-3084-4520-b533-908337b402ea tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:53.472581 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-56da171b-3084-4520-b533-908337b402ea tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.089368 Jun 17 15:43:53.473153 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1727/3043] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:43:53 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:43:53.491302 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-bc19bd81-439d-4f50-a642-12eb178a59ec tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:53.499765 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-bc19bd81-439d-4f50-a642-12eb178a59ec tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.088591 Jun 17 15:43:53.500353 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1317/3044] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:43:53 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:43:53.860214 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-1a04fec3-12a7-4c7b-b9e6-bd4d3d891263 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:53.860861 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-1a04fec3-12a7-4c7b-b9e6-bd4d3d891263 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:53.866900 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1a04fec3-12a7-4c7b-b9e6-bd4d3d891263 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:53.867335 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1a04fec3-12a7-4c7b-b9e6-bd4d3d891263 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:53.868084 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1a04fec3-12a7-4c7b-b9e6-bd4d3d891263 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:53.868560 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1a04fec3-12a7-4c7b-b9e6-bd4d3d891263 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:53.998368 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-1a04fec3-12a7-4c7b-b9e6-bd4d3d891263 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:54.006260 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-1a04fec3-12a7-4c7b-b9e6-bd4d3d891263 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.150010 Jun 17 15:43:54.006828 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1728/3045] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:43:53 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:43:54.516647 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-391637e1-b69d-442a-8abe-ef161bfe24c3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:54.517409 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-391637e1-b69d-442a-8abe-ef161bfe24c3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:54.523783 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-391637e1-b69d-442a-8abe-ef161bfe24c3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:54.524225 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-391637e1-b69d-442a-8abe-ef161bfe24c3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:54.525604 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-391637e1-b69d-442a-8abe-ef161bfe24c3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:54.526036 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-391637e1-b69d-442a-8abe-ef161bfe24c3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:54.588504 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-391637e1-b69d-442a-8abe-ef161bfe24c3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:54.595289 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-17fcd320-5123-4765-b9a7-d97720882076 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:54.595898 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-17fcd320-5123-4765-b9a7-d97720882076 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:54.596629 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-391637e1-b69d-442a-8abe-ef161bfe24c3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.083726 Jun 17 15:43:54.597197 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1729/3046] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:43:54 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:43:54.602424 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-17fcd320-5123-4765-b9a7-d97720882076 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:54.602863 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-17fcd320-5123-4765-b9a7-d97720882076 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:54.603616 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-17fcd320-5123-4765-b9a7-d97720882076 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:54.604046 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-17fcd320-5123-4765-b9a7-d97720882076 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:54.618369 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell1:SELECT=100 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:43:54.666975 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-17fcd320-5123-4765-b9a7-d97720882076 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:54.675262 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-17fcd320-5123-4765-b9a7-d97720882076 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:54.676778 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-17fcd320-5123-4765-b9a7-d97720882076 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:54.677892 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-17fcd320-5123-4765-b9a7-d97720882076 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.191199 Jun 17 15:43:54.678447 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1318/3047] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:43:54 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:43:55.133189 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-1ddeccac-24dc-4c42-a974-1a936c7224a2 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:55.133804 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-1ddeccac-24dc-4c42-a974-1a936c7224a2 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:55.140246 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1ddeccac-24dc-4c42-a974-1a936c7224a2 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:55.140731 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1ddeccac-24dc-4c42-a974-1a936c7224a2 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:55.141530 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1ddeccac-24dc-4c42-a974-1a936c7224a2 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:55.141968 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1ddeccac-24dc-4c42-a974-1a936c7224a2 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:55.270171 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-1ddeccac-24dc-4c42-a974-1a936c7224a2 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:55.278150 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-1ddeccac-24dc-4c42-a974-1a936c7224a2 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.258453 Jun 17 15:43:55.278659 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1730/3048] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:43:55 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:43:55.613935 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-bd011832-9f9f-4a94-bb89-afbc4bf188d9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:55.614570 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-bd011832-9f9f-4a94-bb89-afbc4bf188d9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:55.621773 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bd011832-9f9f-4a94-bb89-afbc4bf188d9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:55.622215 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bd011832-9f9f-4a94-bb89-afbc4bf188d9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:55.622962 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bd011832-9f9f-4a94-bb89-afbc4bf188d9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:55.623391 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bd011832-9f9f-4a94-bb89-afbc4bf188d9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:55.682490 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-bd011832-9f9f-4a94-bb89-afbc4bf188d9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:55.690436 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-bd011832-9f9f-4a94-bb89-afbc4bf188d9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.080564 Jun 17 15:43:55.691078 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1319/3049] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:43:55 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:43:55.696138 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-08321c68-7784-40ed-ad44-3d329de57efe tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:55.696777 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-08321c68-7784-40ed-ad44-3d329de57efe tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:55.703874 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-08321c68-7784-40ed-ad44-3d329de57efe tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:55.704346 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-08321c68-7784-40ed-ad44-3d329de57efe tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:55.705107 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-08321c68-7784-40ed-ad44-3d329de57efe tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:55.705571 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-08321c68-7784-40ed-ad44-3d329de57efe tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:55.771264 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-08321c68-7784-40ed-ad44-3d329de57efe tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:55.780084 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-08321c68-7784-40ed-ad44-3d329de57efe tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:55.781641 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-08321c68-7784-40ed-ad44-3d329de57efe tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:55.782781 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-08321c68-7784-40ed-ad44-3d329de57efe tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.090584 Jun 17 15:43:55.783339 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1731/3050] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:43:55 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 15:43:56.295786 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-7802b5cd-98af-4c0b-8f08-7986fdc1413c tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:56.296451 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-7802b5cd-98af-4c0b-8f08-7986fdc1413c tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:56.302628 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7802b5cd-98af-4c0b-8f08-7986fdc1413c tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:56.303010 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7802b5cd-98af-4c0b-8f08-7986fdc1413c tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:56.303775 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7802b5cd-98af-4c0b-8f08-7986fdc1413c tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:56.304209 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7802b5cd-98af-4c0b-8f08-7986fdc1413c tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:56.433693 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-7802b5cd-98af-4c0b-8f08-7986fdc1413c tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:56.441897 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-7802b5cd-98af-4c0b-8f08-7986fdc1413c tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.150703 Jun 17 15:43:56.442535 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1320/3051] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:43:56 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:43:56.707657 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-2b3c3a8e-ca1d-4f9f-bf01-773119057da9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:56.708295 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-2b3c3a8e-ca1d-4f9f-bf01-773119057da9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:56.715076 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2b3c3a8e-ca1d-4f9f-bf01-773119057da9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:56.715516 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2b3c3a8e-ca1d-4f9f-bf01-773119057da9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:56.716275 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2b3c3a8e-ca1d-4f9f-bf01-773119057da9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:56.716735 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2b3c3a8e-ca1d-4f9f-bf01-773119057da9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:56.720972 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=100 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:43:56.777379 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-2b3c3a8e-ca1d-4f9f-bf01-773119057da9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:56.785443 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-2b3c3a8e-ca1d-4f9f-bf01-773119057da9 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.081684 Jun 17 15:43:56.786016 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1732/3052] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:43:56 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:43:56.801087 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-c8832af9-99b7-440f-8aca-b9c585aaa664 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:56.801700 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-c8832af9-99b7-440f-8aca-b9c585aaa664 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:56.808084 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c8832af9-99b7-440f-8aca-b9c585aaa664 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:56.808582 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c8832af9-99b7-440f-8aca-b9c585aaa664 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:56.809332 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c8832af9-99b7-440f-8aca-b9c585aaa664 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:56.809765 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c8832af9-99b7-440f-8aca-b9c585aaa664 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:56.878504 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-c8832af9-99b7-440f-8aca-b9c585aaa664 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:56.887273 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-c8832af9-99b7-440f-8aca-b9c585aaa664 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:56.888783 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-c8832af9-99b7-440f-8aca-b9c585aaa664 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:56.889902 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-c8832af9-99b7-440f-8aca-b9c585aaa664 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.092655 Jun 17 15:43:56.890446 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1321/3053] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:43:56 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:43:57.459256 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-8f7c8284-495c-467e-86cb-f8161b5891a0 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:57.459897 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-8f7c8284-495c-467e-86cb-f8161b5891a0 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:57.466484 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8f7c8284-495c-467e-86cb-f8161b5891a0 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:57.466930 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8f7c8284-495c-467e-86cb-f8161b5891a0 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:57.467691 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8f7c8284-495c-467e-86cb-f8161b5891a0 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:57.468120 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8f7c8284-495c-467e-86cb-f8161b5891a0 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:57.602396 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-8f7c8284-495c-467e-86cb-f8161b5891a0 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:57.611029 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-8f7c8284-495c-467e-86cb-f8161b5891a0 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.155656 Jun 17 15:43:57.611597 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1733/3054] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:43:57 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:43:57.805953 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-1869c906-5543-478e-819c-58346365277d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:57.807088 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-1869c906-5543-478e-819c-58346365277d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:57.815333 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1869c906-5543-478e-819c-58346365277d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:57.815780 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1869c906-5543-478e-819c-58346365277d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:57.816560 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1869c906-5543-478e-819c-58346365277d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:57.816991 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1869c906-5543-478e-819c-58346365277d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:57.877678 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-1869c906-5543-478e-819c-58346365277d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:57.885497 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-1869c906-5543-478e-819c-58346365277d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.086732 Jun 17 15:43:57.886060 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1322/3055] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:43:57 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:43:57.908546 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-0d33909c-7eb6-4f5d-bd2b-d341221b46e4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:57.909293 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-0d33909c-7eb6-4f5d-bd2b-d341221b46e4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:57.916483 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0d33909c-7eb6-4f5d-bd2b-d341221b46e4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:57.916943 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0d33909c-7eb6-4f5d-bd2b-d341221b46e4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:57.917703 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0d33909c-7eb6-4f5d-bd2b-d341221b46e4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:57.918140 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0d33909c-7eb6-4f5d-bd2b-d341221b46e4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:57.979162 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-0d33909c-7eb6-4f5d-bd2b-d341221b46e4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:57.988631 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-0d33909c-7eb6-4f5d-bd2b-d341221b46e4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:57.990158 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-0d33909c-7eb6-4f5d-bd2b-d341221b46e4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:57.991305 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-0d33909c-7eb6-4f5d-bd2b-d341221b46e4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.086725 Jun 17 15:43:57.991855 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1734/3056] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:43:57 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:43:58.629763 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-2af72ced-1464-443e-a02b-aa6dd8e47bd2 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:58.630293 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-2af72ced-1464-443e-a02b-aa6dd8e47bd2 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:58.636862 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2af72ced-1464-443e-a02b-aa6dd8e47bd2 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:58.637309 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2af72ced-1464-443e-a02b-aa6dd8e47bd2 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:58.638057 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2af72ced-1464-443e-a02b-aa6dd8e47bd2 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:58.638487 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2af72ced-1464-443e-a02b-aa6dd8e47bd2 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:58.764445 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-2af72ced-1464-443e-a02b-aa6dd8e47bd2 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:58.772300 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-2af72ced-1464-443e-a02b-aa6dd8e47bd2 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.146442 Jun 17 15:43:58.772948 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1323/3057] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:43:58 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:43:58.901694 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-d2bb8093-00c4-4e27-88c6-157d9a01d2a8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:58.902212 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-d2bb8093-00c4-4e27-88c6-157d9a01d2a8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:58.908469 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d2bb8093-00c4-4e27-88c6-157d9a01d2a8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:58.908919 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d2bb8093-00c4-4e27-88c6-157d9a01d2a8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:58.909681 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d2bb8093-00c4-4e27-88c6-157d9a01d2a8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:58.910114 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d2bb8093-00c4-4e27-88c6-157d9a01d2a8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:58.973532 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-d2bb8093-00c4-4e27-88c6-157d9a01d2a8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:58.982312 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-d2bb8093-00c4-4e27-88c6-157d9a01d2a8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.084585 Jun 17 15:43:58.982881 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1735/3058] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:43:58 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:43:59.008269 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-f948b00b-664e-4252-9498-bc8f45fc1331 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:59.008900 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-f948b00b-664e-4252-9498-bc8f45fc1331 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:59.015261 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f948b00b-664e-4252-9498-bc8f45fc1331 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:59.015703 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f948b00b-664e-4252-9498-bc8f45fc1331 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:59.016503 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f948b00b-664e-4252-9498-bc8f45fc1331 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:59.016931 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f948b00b-664e-4252-9498-bc8f45fc1331 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:59.080782 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-f948b00b-664e-4252-9498-bc8f45fc1331 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:59.089225 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-f948b00b-664e-4252-9498-bc8f45fc1331 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:59.090720 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-f948b00b-664e-4252-9498-bc8f45fc1331 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:59.091842 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-f948b00b-664e-4252-9498-bc8f45fc1331 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.087430 Jun 17 15:43:59.092423 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1324/3059] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:43:59 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:43:59.790159 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-c82bbc74-554a-4d8e-9a3e-ca0af75db133 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:43:59.790159 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-c82bbc74-554a-4d8e-9a3e-ca0af75db133 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:43:59.796246 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c82bbc74-554a-4d8e-9a3e-ca0af75db133 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:59.796916 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c82bbc74-554a-4d8e-9a3e-ca0af75db133 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:59.797577 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c82bbc74-554a-4d8e-9a3e-ca0af75db133 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:43:59.798009 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c82bbc74-554a-4d8e-9a3e-ca0af75db133 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:43:59.931387 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-c82bbc74-554a-4d8e-9a3e-ca0af75db133 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:43:59.939850 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-c82bbc74-554a-4d8e-9a3e-ca0af75db133 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.154406 Jun 17 15:43:59.940435 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1736/3060] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:43:59 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:43:59.999856 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-b4292b6a-52e1-46f0-b123-bbca4054b33c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:00.000502 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-b4292b6a-52e1-46f0-b123-bbca4054b33c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:00.007818 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b4292b6a-52e1-46f0-b123-bbca4054b33c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:00.008263 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b4292b6a-52e1-46f0-b123-bbca4054b33c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:00.009058 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b4292b6a-52e1-46f0-b123-bbca4054b33c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:00.010201 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b4292b6a-52e1-46f0-b123-bbca4054b33c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:00.074323 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-b4292b6a-52e1-46f0-b123-bbca4054b33c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:00.082273 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-b4292b6a-52e1-46f0-b123-bbca4054b33c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.086219 Jun 17 15:44:00.082837 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1325/3061] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:43:59 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:44:00.110319 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-d5273157-7dba-4326-b25f-330123bc0fb2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:00.110927 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-d5273157-7dba-4326-b25f-330123bc0fb2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:00.117410 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d5273157-7dba-4326-b25f-330123bc0fb2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:00.117868 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d5273157-7dba-4326-b25f-330123bc0fb2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:00.118635 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d5273157-7dba-4326-b25f-330123bc0fb2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:00.119576 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d5273157-7dba-4326-b25f-330123bc0fb2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:00.183421 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-d5273157-7dba-4326-b25f-330123bc0fb2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:00.192035 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-d5273157-7dba-4326-b25f-330123bc0fb2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:00.193558 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-d5273157-7dba-4326-b25f-330123bc0fb2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:00.194695 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-d5273157-7dba-4326-b25f-330123bc0fb2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.088676 Jun 17 15:44:00.195245 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1737/3062] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:44:00 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:44:00.957086 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-cce44bd1-6cd6-4c9a-b8ed-adcf99d05b7c tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:00.957692 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-cce44bd1-6cd6-4c9a-b8ed-adcf99d05b7c tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:00.964457 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cce44bd1-6cd6-4c9a-b8ed-adcf99d05b7c tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:00.964913 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cce44bd1-6cd6-4c9a-b8ed-adcf99d05b7c tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:00.965688 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cce44bd1-6cd6-4c9a-b8ed-adcf99d05b7c tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:00.966129 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cce44bd1-6cd6-4c9a-b8ed-adcf99d05b7c tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:01.100374 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-cce44bd1-6cd6-4c9a-b8ed-adcf99d05b7c tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:01.100933 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-1796a961-0a72-4275-98c1-cd5fda95ea42 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:01.101575 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-1796a961-0a72-4275-98c1-cd5fda95ea42 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:01.107828 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1796a961-0a72-4275-98c1-cd5fda95ea42 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:01.108279 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1796a961-0a72-4275-98c1-cd5fda95ea42 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:01.109085 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1796a961-0a72-4275-98c1-cd5fda95ea42 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:01.109517 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1796a961-0a72-4275-98c1-cd5fda95ea42 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:01.110107 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-cce44bd1-6cd6-4c9a-b8ed-adcf99d05b7c tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.156796 Jun 17 15:44:01.110705 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1326/3063] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:44:00 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:44:01.174617 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-1796a961-0a72-4275-98c1-cd5fda95ea42 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:01.182810 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-1796a961-0a72-4275-98c1-cd5fda95ea42 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.087106 Jun 17 15:44:01.183387 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1738/3064] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:44:01 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:44:01.214239 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-164c1e81-3628-496b-8c8d-63d647d566dd tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:01.214853 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-164c1e81-3628-496b-8c8d-63d647d566dd tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:01.221041 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-164c1e81-3628-496b-8c8d-63d647d566dd tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:01.221494 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-164c1e81-3628-496b-8c8d-63d647d566dd tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:01.222262 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-164c1e81-3628-496b-8c8d-63d647d566dd tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:01.222698 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-164c1e81-3628-496b-8c8d-63d647d566dd tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:01.284043 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-164c1e81-3628-496b-8c8d-63d647d566dd tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:01.292724 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-164c1e81-3628-496b-8c8d-63d647d566dd tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:01.294223 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-164c1e81-3628-496b-8c8d-63d647d566dd tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:01.295368 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-164c1e81-3628-496b-8c8d-63d647d566dd tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.085711 Jun 17 15:44:01.296017 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1327/3065] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:44:01 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:44:02.126971 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-c6b8a5a8-1fa9-4fcf-abfd-4103435fc88d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:02.127641 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-c6b8a5a8-1fa9-4fcf-abfd-4103435fc88d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:02.134367 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c6b8a5a8-1fa9-4fcf-abfd-4103435fc88d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:02.134811 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c6b8a5a8-1fa9-4fcf-abfd-4103435fc88d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:02.135578 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c6b8a5a8-1fa9-4fcf-abfd-4103435fc88d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:02.136006 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c6b8a5a8-1fa9-4fcf-abfd-4103435fc88d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:02.199332 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-fc7ee15b-0e7b-49f1-b528-1b428408a95c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:02.200196 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-fc7ee15b-0e7b-49f1-b528-1b428408a95c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:02.207772 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fc7ee15b-0e7b-49f1-b528-1b428408a95c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:02.208220 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fc7ee15b-0e7b-49f1-b528-1b428408a95c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:02.209031 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fc7ee15b-0e7b-49f1-b528-1b428408a95c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:02.209466 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fc7ee15b-0e7b-49f1-b528-1b428408a95c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:02.272589 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-c6b8a5a8-1fa9-4fcf-abfd-4103435fc88d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:02.282243 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-c6b8a5a8-1fa9-4fcf-abfd-4103435fc88d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.158645 Jun 17 15:44:02.282447 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1739/3066] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:44:02 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:44:02.285122 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-fc7ee15b-0e7b-49f1-b528-1b428408a95c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:02.294098 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-fc7ee15b-0e7b-49f1-b528-1b428408a95c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.098732 Jun 17 15:44:02.294690 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1328/3067] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:44:02 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:44:02.317097 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-0efa8fab-6fae-46e9-a576-faad60f113a1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:02.317709 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-0efa8fab-6fae-46e9-a576-faad60f113a1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:02.324121 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0efa8fab-6fae-46e9-a576-faad60f113a1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:02.324637 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0efa8fab-6fae-46e9-a576-faad60f113a1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:02.325407 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0efa8fab-6fae-46e9-a576-faad60f113a1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:02.325832 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0efa8fab-6fae-46e9-a576-faad60f113a1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:02.388280 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-0efa8fab-6fae-46e9-a576-faad60f113a1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:02.396761 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-0efa8fab-6fae-46e9-a576-faad60f113a1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:02.398858 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-0efa8fab-6fae-46e9-a576-faad60f113a1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:02.399450 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-0efa8fab-6fae-46e9-a576-faad60f113a1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.086391 Jun 17 15:44:02.400517 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1740/3068] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:44:02 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:44:03.299972 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-113718b5-4ec8-4267-940f-4e8265fb30d8 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:03.300614 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-113718b5-4ec8-4267-940f-4e8265fb30d8 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:03.307207 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-113718b5-4ec8-4267-940f-4e8265fb30d8 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:03.308107 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-113718b5-4ec8-4267-940f-4e8265fb30d8 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:03.308900 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-113718b5-4ec8-4267-940f-4e8265fb30d8 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:03.309339 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-113718b5-4ec8-4267-940f-4e8265fb30d8 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:03.311964 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-8d310492-f81d-4602-b4da-a174b137eaea tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:03.312677 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-8d310492-f81d-4602-b4da-a174b137eaea tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:03.319302 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8d310492-f81d-4602-b4da-a174b137eaea tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:03.319751 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8d310492-f81d-4602-b4da-a174b137eaea tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:03.320547 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8d310492-f81d-4602-b4da-a174b137eaea tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:03.320979 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8d310492-f81d-4602-b4da-a174b137eaea tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:03.387429 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-8d310492-f81d-4602-b4da-a174b137eaea tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:03.395574 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-8d310492-f81d-4602-b4da-a174b137eaea tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.088541 Jun 17 15:44:03.396157 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1741/3069] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:44:03 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:44:03.418466 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-a8ca1cd3-ede6-4146-8030-385234fc4fe2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:03.419070 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-a8ca1cd3-ede6-4146-8030-385234fc4fe2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:03.425022 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a8ca1cd3-ede6-4146-8030-385234fc4fe2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:03.425560 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a8ca1cd3-ede6-4146-8030-385234fc4fe2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:03.426225 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a8ca1cd3-ede6-4146-8030-385234fc4fe2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:03.426646 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a8ca1cd3-ede6-4146-8030-385234fc4fe2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:03.443021 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-113718b5-4ec8-4267-940f-4e8265fb30d8 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:03.450959 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-113718b5-4ec8-4267-940f-4e8265fb30d8 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.154821 Jun 17 15:44:03.451530 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1329/3070] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:44:03 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:44:03.487561 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-a8ca1cd3-ede6-4146-8030-385234fc4fe2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:03.496610 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-a8ca1cd3-ede6-4146-8030-385234fc4fe2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:03.498103 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-a8ca1cd3-ede6-4146-8030-385234fc4fe2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:03.499221 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-a8ca1cd3-ede6-4146-8030-385234fc4fe2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.085097 Jun 17 15:44:03.499807 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1742/3071] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:44:03 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 15:44:04.412318 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-dc399b43-96f7-465e-823f-837115efee60 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:04.412948 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-dc399b43-96f7-465e-823f-837115efee60 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:04.419395 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-dc399b43-96f7-465e-823f-837115efee60 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:04.419839 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-dc399b43-96f7-465e-823f-837115efee60 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:04.420616 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-dc399b43-96f7-465e-823f-837115efee60 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:04.421051 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-dc399b43-96f7-465e-823f-837115efee60 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:04.467774 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-4130779d-b46e-4b5c-81b4-2a8905fedb68 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:04.468384 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-4130779d-b46e-4b5c-81b4-2a8905fedb68 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:04.474779 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4130779d-b46e-4b5c-81b4-2a8905fedb68 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:04.475222 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4130779d-b46e-4b5c-81b4-2a8905fedb68 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:04.475970 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4130779d-b46e-4b5c-81b4-2a8905fedb68 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:04.476714 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4130779d-b46e-4b5c-81b4-2a8905fedb68 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:04.482148 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-dc399b43-96f7-465e-823f-837115efee60 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:04.490117 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-dc399b43-96f7-465e-823f-837115efee60 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.081663 Jun 17 15:44:04.490691 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1330/3072] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:44:04 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:44:04.517195 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-f20e3697-4ab7-4a8c-9c17-552ea44d1ac5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:04.517796 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-f20e3697-4ab7-4a8c-9c17-552ea44d1ac5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:04.523909 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f20e3697-4ab7-4a8c-9c17-552ea44d1ac5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:04.524374 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f20e3697-4ab7-4a8c-9c17-552ea44d1ac5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:04.525137 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f20e3697-4ab7-4a8c-9c17-552ea44d1ac5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:04.525564 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f20e3697-4ab7-4a8c-9c17-552ea44d1ac5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:04.589509 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-f20e3697-4ab7-4a8c-9c17-552ea44d1ac5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:04.597830 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-f20e3697-4ab7-4a8c-9c17-552ea44d1ac5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:04.599315 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-f20e3697-4ab7-4a8c-9c17-552ea44d1ac5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:04.600461 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-f20e3697-4ab7-4a8c-9c17-552ea44d1ac5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.087041 Jun 17 15:44:04.601016 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1331/3073] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:44:04 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 15:44:04.607548 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-4130779d-b46e-4b5c-81b4-2a8905fedb68 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:04.615671 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-4130779d-b46e-4b5c-81b4-2a8905fedb68 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.151702 Jun 17 15:44:04.616227 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1743/3074] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:44:04 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:44:05.507462 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-ccb9531d-0c25-4cdf-b01f-aa398337de44 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:05.508077 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-ccb9531d-0c25-4cdf-b01f-aa398337de44 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:05.515086 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ccb9531d-0c25-4cdf-b01f-aa398337de44 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:05.515535 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ccb9531d-0c25-4cdf-b01f-aa398337de44 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:05.516294 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ccb9531d-0c25-4cdf-b01f-aa398337de44 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:05.516765 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ccb9531d-0c25-4cdf-b01f-aa398337de44 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:05.576154 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-ccb9531d-0c25-4cdf-b01f-aa398337de44 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:05.583914 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-ccb9531d-0c25-4cdf-b01f-aa398337de44 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.080294 Jun 17 15:44:05.584495 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1332/3075] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:44:05 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:44:05.618341 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-acd05d9c-27ce-4013-837c-1803276c6bb6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:05.619103 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-acd05d9c-27ce-4013-837c-1803276c6bb6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:05.628130 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-acd05d9c-27ce-4013-837c-1803276c6bb6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:05.628548 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-acd05d9c-27ce-4013-837c-1803276c6bb6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:05.629349 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-acd05d9c-27ce-4013-837c-1803276c6bb6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:05.629783 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-acd05d9c-27ce-4013-837c-1803276c6bb6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:05.633070 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-c2ec94fd-e1e1-4fc9-9749-6aba6ab743b8 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:05.633690 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-c2ec94fd-e1e1-4fc9-9749-6aba6ab743b8 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:05.640218 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c2ec94fd-e1e1-4fc9-9749-6aba6ab743b8 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:05.640699 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c2ec94fd-e1e1-4fc9-9749-6aba6ab743b8 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:05.641460 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c2ec94fd-e1e1-4fc9-9749-6aba6ab743b8 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:05.641901 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c2ec94fd-e1e1-4fc9-9749-6aba6ab743b8 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:05.692115 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-acd05d9c-27ce-4013-837c-1803276c6bb6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:05.701280 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-acd05d9c-27ce-4013-837c-1803276c6bb6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:05.702810 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-acd05d9c-27ce-4013-837c-1803276c6bb6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:05.703935 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-acd05d9c-27ce-4013-837c-1803276c6bb6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.089488 Jun 17 15:44:05.704510 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1744/3076] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:44:05 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:44:05.767571 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-c2ec94fd-e1e1-4fc9-9749-6aba6ab743b8 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:05.776055 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-c2ec94fd-e1e1-4fc9-9749-6aba6ab743b8 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.146865 Jun 17 15:44:05.776656 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1333/3077] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:44:05 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:44:06.601507 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-23da6cd6-a355-4490-accc-21e76e32aa45 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:06.602138 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-23da6cd6-a355-4490-accc-21e76e32aa45 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:06.608619 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-23da6cd6-a355-4490-accc-21e76e32aa45 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:06.609059 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-23da6cd6-a355-4490-accc-21e76e32aa45 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:06.609803 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-23da6cd6-a355-4490-accc-21e76e32aa45 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:06.610232 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-23da6cd6-a355-4490-accc-21e76e32aa45 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:06.677294 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-23da6cd6-a355-4490-accc-21e76e32aa45 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:06.685540 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-23da6cd6-a355-4490-accc-21e76e32aa45 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.088129 Jun 17 15:44:06.686095 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1745/3078] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:44:06 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:44:06.722098 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-5457a720-8111-4cc1-b72d-0a00afec3123 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:06.722705 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-5457a720-8111-4cc1-b72d-0a00afec3123 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:06.730006 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5457a720-8111-4cc1-b72d-0a00afec3123 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:06.730448 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5457a720-8111-4cc1-b72d-0a00afec3123 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:06.731197 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5457a720-8111-4cc1-b72d-0a00afec3123 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:06.731627 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5457a720-8111-4cc1-b72d-0a00afec3123 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:06.793747 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-6c3c9639-09e6-49e0-b3bf-82680925aab8 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:06.794394 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-6c3c9639-09e6-49e0-b3bf-82680925aab8 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:06.795397 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-5457a720-8111-4cc1-b72d-0a00afec3123 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:06.800586 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6c3c9639-09e6-49e0-b3bf-82680925aab8 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:06.801035 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6c3c9639-09e6-49e0-b3bf-82680925aab8 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:06.801796 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6c3c9639-09e6-49e0-b3bf-82680925aab8 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:06.802228 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6c3c9639-09e6-49e0-b3bf-82680925aab8 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:06.803835 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-5457a720-8111-4cc1-b72d-0a00afec3123 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:06.805339 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-5457a720-8111-4cc1-b72d-0a00afec3123 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:06.806465 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-5457a720-8111-4cc1-b72d-0a00afec3123 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.088198 Jun 17 15:44:06.807210 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1334/3079] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:44:06 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:44:06.938148 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-6c3c9639-09e6-49e0-b3bf-82680925aab8 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:06.950242 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-6c3c9639-09e6-49e0-b3bf-82680925aab8 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.160537 Jun 17 15:44:06.951196 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1746/3080] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:44:06 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:44:07.702746 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-c6c55cc3-cfa1-4e5c-9cbe-6014d6efe02c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:07.703265 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-c6c55cc3-cfa1-4e5c-9cbe-6014d6efe02c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:07.709303 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c6c55cc3-cfa1-4e5c-9cbe-6014d6efe02c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:07.709746 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c6c55cc3-cfa1-4e5c-9cbe-6014d6efe02c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:07.710484 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c6c55cc3-cfa1-4e5c-9cbe-6014d6efe02c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:07.710913 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c6c55cc3-cfa1-4e5c-9cbe-6014d6efe02c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:07.713386 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell1:SELECT=100 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:44:07.773700 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-c6c55cc3-cfa1-4e5c-9cbe-6014d6efe02c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:07.781754 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-c6c55cc3-cfa1-4e5c-9cbe-6014d6efe02c tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.082896 Jun 17 15:44:07.782315 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1335/3081] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:44:07 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:44:07.823577 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-5583a95a-251f-442d-bfeb-9c34f2be2814 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:07.824197 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-5583a95a-251f-442d-bfeb-9c34f2be2814 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:07.830812 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5583a95a-251f-442d-bfeb-9c34f2be2814 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:07.831254 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5583a95a-251f-442d-bfeb-9c34f2be2814 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:07.831998 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5583a95a-251f-442d-bfeb-9c34f2be2814 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:07.832460 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5583a95a-251f-442d-bfeb-9c34f2be2814 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:07.900796 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-5583a95a-251f-442d-bfeb-9c34f2be2814 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:07.909449 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-5583a95a-251f-442d-bfeb-9c34f2be2814 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:07.910938 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-5583a95a-251f-442d-bfeb-9c34f2be2814 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:07.912060 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-5583a95a-251f-442d-bfeb-9c34f2be2814 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.092372 Jun 17 15:44:07.912640 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1747/3082] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:44:07 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:44:07.967127 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-0654245a-99f4-42d8-ad35-ac8dd342ce37 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:07.967653 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-0654245a-99f4-42d8-ad35-ac8dd342ce37 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:07.973735 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0654245a-99f4-42d8-ad35-ac8dd342ce37 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:07.974180 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0654245a-99f4-42d8-ad35-ac8dd342ce37 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:07.974935 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0654245a-99f4-42d8-ad35-ac8dd342ce37 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:07.975365 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0654245a-99f4-42d8-ad35-ac8dd342ce37 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:08.106663 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-0654245a-99f4-42d8-ad35-ac8dd342ce37 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:08.114631 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-0654245a-99f4-42d8-ad35-ac8dd342ce37 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.151518 Jun 17 15:44:08.115190 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1336/3083] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:44:07 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:44:08.799054 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-4b47bf50-456b-419f-a037-435ccab9ae11 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:08.799606 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-4b47bf50-456b-419f-a037-435ccab9ae11 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:08.805661 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4b47bf50-456b-419f-a037-435ccab9ae11 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:08.806108 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4b47bf50-456b-419f-a037-435ccab9ae11 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:08.806862 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4b47bf50-456b-419f-a037-435ccab9ae11 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:08.807292 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4b47bf50-456b-419f-a037-435ccab9ae11 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:08.870386 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-4b47bf50-456b-419f-a037-435ccab9ae11 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:08.872647 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=100 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:44:08.879435 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-4b47bf50-456b-419f-a037-435ccab9ae11 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.084325 Jun 17 15:44:08.880031 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1748/3084] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:44:08 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:44:08.929460 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-b005a507-656a-4e32-b4c8-8b7a5a202aa9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:08.930063 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-b005a507-656a-4e32-b4c8-8b7a5a202aa9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:08.936971 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b005a507-656a-4e32-b4c8-8b7a5a202aa9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:08.937412 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b005a507-656a-4e32-b4c8-8b7a5a202aa9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:08.938158 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b005a507-656a-4e32-b4c8-8b7a5a202aa9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:08.938587 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b005a507-656a-4e32-b4c8-8b7a5a202aa9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:08.999919 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-b005a507-656a-4e32-b4c8-8b7a5a202aa9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:09.008232 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-b005a507-656a-4e32-b4c8-8b7a5a202aa9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:09.010411 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-b005a507-656a-4e32-b4c8-8b7a5a202aa9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:09.011539 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-b005a507-656a-4e32-b4c8-8b7a5a202aa9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.085909 Jun 17 15:44:09.012078 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1337/3085] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:44:08 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:44:09.132356 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-f7d55a8e-0205-444d-a876-66e21bae8782 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:09.132981 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-f7d55a8e-0205-444d-a876-66e21bae8782 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:09.140251 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f7d55a8e-0205-444d-a876-66e21bae8782 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:09.140732 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f7d55a8e-0205-444d-a876-66e21bae8782 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:09.141713 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f7d55a8e-0205-444d-a876-66e21bae8782 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:09.142186 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f7d55a8e-0205-444d-a876-66e21bae8782 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:09.273478 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-f7d55a8e-0205-444d-a876-66e21bae8782 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:09.281434 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-f7d55a8e-0205-444d-a876-66e21bae8782 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.152993 Jun 17 15:44:09.281995 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1749/3086] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:44:09 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:44:09.896805 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-e4e28c37-19a5-4878-9bd1-985d9d45aa53 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:09.897406 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-e4e28c37-19a5-4878-9bd1-985d9d45aa53 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:09.903511 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e4e28c37-19a5-4878-9bd1-985d9d45aa53 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:09.903954 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e4e28c37-19a5-4878-9bd1-985d9d45aa53 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:09.904730 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e4e28c37-19a5-4878-9bd1-985d9d45aa53 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:09.905163 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e4e28c37-19a5-4878-9bd1-985d9d45aa53 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:09.968553 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-e4e28c37-19a5-4878-9bd1-985d9d45aa53 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:09.976721 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-e4e28c37-19a5-4878-9bd1-985d9d45aa53 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.083472 Jun 17 15:44:09.977293 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1338/3087] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:44:09 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:44:10.029356 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-e5883ef8-060a-496a-ad60-478ab91f9902 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:10.029962 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-e5883ef8-060a-496a-ad60-478ab91f9902 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:10.036482 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e5883ef8-060a-496a-ad60-478ab91f9902 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:10.036936 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e5883ef8-060a-496a-ad60-478ab91f9902 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:10.037696 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e5883ef8-060a-496a-ad60-478ab91f9902 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:10.038127 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e5883ef8-060a-496a-ad60-478ab91f9902 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:10.099702 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-e5883ef8-060a-496a-ad60-478ab91f9902 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:10.109272 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-e5883ef8-060a-496a-ad60-478ab91f9902 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:10.110771 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-e5883ef8-060a-496a-ad60-478ab91f9902 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:10.111908 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-e5883ef8-060a-496a-ad60-478ab91f9902 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.086549 Jun 17 15:44:10.112490 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1750/3088] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:44:10 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:44:10.298701 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-727cb65e-b692-415f-9fe0-4d24021be267 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:10.299299 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-727cb65e-b692-415f-9fe0-4d24021be267 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:10.305285 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-727cb65e-b692-415f-9fe0-4d24021be267 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:10.305724 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-727cb65e-b692-415f-9fe0-4d24021be267 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:10.307117 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-727cb65e-b692-415f-9fe0-4d24021be267 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:10.307543 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-727cb65e-b692-415f-9fe0-4d24021be267 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:10.434786 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-727cb65e-b692-415f-9fe0-4d24021be267 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:10.443327 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-727cb65e-b692-415f-9fe0-4d24021be267 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.148454 Jun 17 15:44:10.443897 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1339/3089] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:44:10 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:44:10.994011 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-e5b3e131-e154-4e13-a47e-cd6c1c2a35b8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:10.994614 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-e5b3e131-e154-4e13-a47e-cd6c1c2a35b8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:11.000641 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e5b3e131-e154-4e13-a47e-cd6c1c2a35b8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:11.001083 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e5b3e131-e154-4e13-a47e-cd6c1c2a35b8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:11.001832 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e5b3e131-e154-4e13-a47e-cd6c1c2a35b8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:11.002258 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e5b3e131-e154-4e13-a47e-cd6c1c2a35b8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:11.066638 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-e5b3e131-e154-4e13-a47e-cd6c1c2a35b8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:11.075420 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-e5b3e131-e154-4e13-a47e-cd6c1c2a35b8 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.085263 Jun 17 15:44:11.075994 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1751/3090] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:44:10 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:44:11.131185 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-224b9432-a472-44f5-88b6-69ad49513a3c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:11.131801 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-224b9432-a472-44f5-88b6-69ad49513a3c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:11.140211 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-224b9432-a472-44f5-88b6-69ad49513a3c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:11.140776 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-224b9432-a472-44f5-88b6-69ad49513a3c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:11.141470 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-224b9432-a472-44f5-88b6-69ad49513a3c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:11.141910 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-224b9432-a472-44f5-88b6-69ad49513a3c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:11.203427 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-224b9432-a472-44f5-88b6-69ad49513a3c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:11.211834 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-224b9432-a472-44f5-88b6-69ad49513a3c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:11.213376 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-224b9432-a472-44f5-88b6-69ad49513a3c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:11.214499 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-224b9432-a472-44f5-88b6-69ad49513a3c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.087273 Jun 17 15:44:11.215061 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1340/3091] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:44:11 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 15:44:11.460421 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-e749b5dc-06d4-43ab-9390-a281b95fef11 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:11.461026 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-e749b5dc-06d4-43ab-9390-a281b95fef11 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:11.467049 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e749b5dc-06d4-43ab-9390-a281b95fef11 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:11.467520 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e749b5dc-06d4-43ab-9390-a281b95fef11 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:11.468233 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e749b5dc-06d4-43ab-9390-a281b95fef11 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:11.468690 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e749b5dc-06d4-43ab-9390-a281b95fef11 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:11.597220 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-e749b5dc-06d4-43ab-9390-a281b95fef11 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:11.605684 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-e749b5dc-06d4-43ab-9390-a281b95fef11 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.149255 Jun 17 15:44:11.606239 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1752/3092] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:44:11 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:44:12.093080 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-cde0947e-5396-4353-840c-ef7003e71f07 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:12.093696 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-cde0947e-5396-4353-840c-ef7003e71f07 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:12.099990 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cde0947e-5396-4353-840c-ef7003e71f07 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:12.100479 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cde0947e-5396-4353-840c-ef7003e71f07 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:12.101495 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cde0947e-5396-4353-840c-ef7003e71f07 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:12.101935 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cde0947e-5396-4353-840c-ef7003e71f07 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:12.164907 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-cde0947e-5396-4353-840c-ef7003e71f07 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:12.173343 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-cde0947e-5396-4353-840c-ef7003e71f07 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.084189 Jun 17 15:44:12.173902 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1341/3093] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:44:12 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:44:12.232432 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-61590377-de98-4eea-a9f0-55089fdca608 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:12.233036 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-61590377-de98-4eea-a9f0-55089fdca608 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:12.239433 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-61590377-de98-4eea-a9f0-55089fdca608 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:12.239905 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-61590377-de98-4eea-a9f0-55089fdca608 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:12.240682 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-61590377-de98-4eea-a9f0-55089fdca608 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:12.241108 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-61590377-de98-4eea-a9f0-55089fdca608 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:12.302329 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-61590377-de98-4eea-a9f0-55089fdca608 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:12.310888 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-61590377-de98-4eea-a9f0-55089fdca608 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:12.312382 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-61590377-de98-4eea-a9f0-55089fdca608 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:12.313506 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-61590377-de98-4eea-a9f0-55089fdca608 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.085738 Jun 17 15:44:12.314055 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1753/3094] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:44:12 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:44:12.622308 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-64263c18-3ce8-428a-9b3b-b2eb30f0e0f7 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:12.622918 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-64263c18-3ce8-428a-9b3b-b2eb30f0e0f7 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:12.629166 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-64263c18-3ce8-428a-9b3b-b2eb30f0e0f7 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:12.629553 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-64263c18-3ce8-428a-9b3b-b2eb30f0e0f7 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:12.630300 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-64263c18-3ce8-428a-9b3b-b2eb30f0e0f7 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:12.630726 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-64263c18-3ce8-428a-9b3b-b2eb30f0e0f7 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:12.758527 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-64263c18-3ce8-428a-9b3b-b2eb30f0e0f7 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:12.767055 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-64263c18-3ce8-428a-9b3b-b2eb30f0e0f7 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.148572 Jun 17 15:44:12.767621 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1342/3095] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:44:12 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:44:13.190305 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-79948bf3-2e64-4e31-8cbf-e5a7d11c2582 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:13.190920 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-79948bf3-2e64-4e31-8cbf-e5a7d11c2582 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:13.196916 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-79948bf3-2e64-4e31-8cbf-e5a7d11c2582 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:13.197360 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-79948bf3-2e64-4e31-8cbf-e5a7d11c2582 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:13.198123 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-79948bf3-2e64-4e31-8cbf-e5a7d11c2582 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:13.198555 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-79948bf3-2e64-4e31-8cbf-e5a7d11c2582 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:13.261820 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-79948bf3-2e64-4e31-8cbf-e5a7d11c2582 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:13.270068 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-79948bf3-2e64-4e31-8cbf-e5a7d11c2582 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.083614 Jun 17 15:44:13.271708 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1754/3096] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:44:13 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:44:13.331995 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-2e084c31-b43d-430f-97a4-87bb2f296fd6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:13.332657 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-2e084c31-b43d-430f-97a4-87bb2f296fd6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:13.339908 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2e084c31-b43d-430f-97a4-87bb2f296fd6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:13.340447 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2e084c31-b43d-430f-97a4-87bb2f296fd6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:13.341351 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2e084c31-b43d-430f-97a4-87bb2f296fd6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:13.341847 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2e084c31-b43d-430f-97a4-87bb2f296fd6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:13.407699 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-2e084c31-b43d-430f-97a4-87bb2f296fd6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:13.416878 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-2e084c31-b43d-430f-97a4-87bb2f296fd6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:13.418383 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-2e084c31-b43d-430f-97a4-87bb2f296fd6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:13.419500 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-2e084c31-b43d-430f-97a4-87bb2f296fd6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.091498 Jun 17 15:44:13.420058 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1343/3097] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:44:13 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:44:13.784152 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-acbb41dc-76ab-472b-9d8d-ac80e51ea3ec tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:13.784803 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-acbb41dc-76ab-472b-9d8d-ac80e51ea3ec tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:13.790877 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-acbb41dc-76ab-472b-9d8d-ac80e51ea3ec tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:13.791317 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-acbb41dc-76ab-472b-9d8d-ac80e51ea3ec tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:13.792067 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-acbb41dc-76ab-472b-9d8d-ac80e51ea3ec tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:13.792530 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-acbb41dc-76ab-472b-9d8d-ac80e51ea3ec tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:13.927869 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-acbb41dc-76ab-472b-9d8d-ac80e51ea3ec tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:13.935909 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-acbb41dc-76ab-472b-9d8d-ac80e51ea3ec tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.155626 Jun 17 15:44:13.936514 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1755/3098] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:44:13 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:44:14.286992 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-0bd4f70c-7b41-41f8-a2e9-231394b62a26 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:14.287596 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-0bd4f70c-7b41-41f8-a2e9-231394b62a26 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:14.294586 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0bd4f70c-7b41-41f8-a2e9-231394b62a26 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:14.295033 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0bd4f70c-7b41-41f8-a2e9-231394b62a26 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:14.295774 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0bd4f70c-7b41-41f8-a2e9-231394b62a26 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:14.296202 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0bd4f70c-7b41-41f8-a2e9-231394b62a26 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:14.363998 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-0bd4f70c-7b41-41f8-a2e9-231394b62a26 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:14.372551 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-0bd4f70c-7b41-41f8-a2e9-231394b62a26 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.089412 Jun 17 15:44:14.373123 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1344/3099] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:44:14 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:44:14.437765 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-b9626b04-ba61-45dd-8db1-a881ab58d8d4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:14.438369 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-b9626b04-ba61-45dd-8db1-a881ab58d8d4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:14.444915 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b9626b04-ba61-45dd-8db1-a881ab58d8d4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:14.445355 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b9626b04-ba61-45dd-8db1-a881ab58d8d4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:14.446129 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b9626b04-ba61-45dd-8db1-a881ab58d8d4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:14.447214 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b9626b04-ba61-45dd-8db1-a881ab58d8d4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:14.507460 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-b9626b04-ba61-45dd-8db1-a881ab58d8d4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:14.516578 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-b9626b04-ba61-45dd-8db1-a881ab58d8d4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:14.518074 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-b9626b04-ba61-45dd-8db1-a881ab58d8d4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:14.519206 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-b9626b04-ba61-45dd-8db1-a881ab58d8d4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.085310 Jun 17 15:44:14.519760 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1756/3100] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:44:14 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:44:14.953058 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-3c0a085a-ea54-4e37-8530-2b2180f239b3 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:14.953665 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-3c0a085a-ea54-4e37-8530-2b2180f239b3 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:14.959667 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3c0a085a-ea54-4e37-8530-2b2180f239b3 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:14.960108 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3c0a085a-ea54-4e37-8530-2b2180f239b3 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:14.960887 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3c0a085a-ea54-4e37-8530-2b2180f239b3 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:14.961317 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3c0a085a-ea54-4e37-8530-2b2180f239b3 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:15.089076 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-3c0a085a-ea54-4e37-8530-2b2180f239b3 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:15.096960 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-3c0a085a-ea54-4e37-8530-2b2180f239b3 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.147766 Jun 17 15:44:15.097520 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1345/3101] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:44:14 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:44:15.388889 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-4d540818-4d6f-4678-87b0-227ff312995b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:15.389499 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-4d540818-4d6f-4678-87b0-227ff312995b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:15.395770 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4d540818-4d6f-4678-87b0-227ff312995b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:15.396212 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4d540818-4d6f-4678-87b0-227ff312995b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:15.396994 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4d540818-4d6f-4678-87b0-227ff312995b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:15.397423 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4d540818-4d6f-4678-87b0-227ff312995b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:15.457136 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-4d540818-4d6f-4678-87b0-227ff312995b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:15.465660 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-4d540818-4d6f-4678-87b0-227ff312995b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.080603 Jun 17 15:44:15.466212 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1757/3102] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:44:15 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:44:15.536910 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-a04ecb1e-1125-446f-9213-d83f8c4e25a1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:15.537516 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-a04ecb1e-1125-446f-9213-d83f8c4e25a1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:15.543899 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a04ecb1e-1125-446f-9213-d83f8c4e25a1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:15.544372 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a04ecb1e-1125-446f-9213-d83f8c4e25a1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:15.545122 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a04ecb1e-1125-446f-9213-d83f8c4e25a1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:15.545548 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a04ecb1e-1125-446f-9213-d83f8c4e25a1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:15.605775 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-a04ecb1e-1125-446f-9213-d83f8c4e25a1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:15.614049 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-a04ecb1e-1125-446f-9213-d83f8c4e25a1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:15.615539 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-a04ecb1e-1125-446f-9213-d83f8c4e25a1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:15.616973 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-a04ecb1e-1125-446f-9213-d83f8c4e25a1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.083916 Jun 17 15:44:15.617527 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1346/3103] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:44:15 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:44:16.115384 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-4b300f18-e25e-42e2-9740-a83ee306ba1c tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:16.116003 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-4b300f18-e25e-42e2-9740-a83ee306ba1c tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:16.123086 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4b300f18-e25e-42e2-9740-a83ee306ba1c tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:16.123534 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4b300f18-e25e-42e2-9740-a83ee306ba1c tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:16.124648 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4b300f18-e25e-42e2-9740-a83ee306ba1c tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:16.125090 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4b300f18-e25e-42e2-9740-a83ee306ba1c tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:16.255208 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-4b300f18-e25e-42e2-9740-a83ee306ba1c tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:16.263130 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-4b300f18-e25e-42e2-9740-a83ee306ba1c tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.152075 Jun 17 15:44:16.263689 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1758/3104] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:44:16 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:44:16.483405 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-95d70a5f-afca-46dd-86dd-9283e40bf029 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:16.484388 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-95d70a5f-afca-46dd-86dd-9283e40bf029 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:16.490356 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-95d70a5f-afca-46dd-86dd-9283e40bf029 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:16.490797 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-95d70a5f-afca-46dd-86dd-9283e40bf029 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:16.491538 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-95d70a5f-afca-46dd-86dd-9283e40bf029 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:16.492285 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-95d70a5f-afca-46dd-86dd-9283e40bf029 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:16.551370 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-95d70a5f-afca-46dd-86dd-9283e40bf029 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:16.559392 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-95d70a5f-afca-46dd-86dd-9283e40bf029 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.079751 Jun 17 15:44:16.560051 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1347/3105] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:44:16 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:44:16.635058 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-1e6fbf05-9669-498c-a699-a6c57cf538c8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:16.635607 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-1e6fbf05-9669-498c-a699-a6c57cf538c8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:16.642080 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1e6fbf05-9669-498c-a699-a6c57cf538c8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:16.642528 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1e6fbf05-9669-498c-a699-a6c57cf538c8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:16.643283 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1e6fbf05-9669-498c-a699-a6c57cf538c8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:16.643716 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1e6fbf05-9669-498c-a699-a6c57cf538c8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:16.704040 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-1e6fbf05-9669-498c-a699-a6c57cf538c8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:16.712977 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-1e6fbf05-9669-498c-a699-a6c57cf538c8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:16.714512 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-1e6fbf05-9669-498c-a699-a6c57cf538c8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:16.715647 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-1e6fbf05-9669-498c-a699-a6c57cf538c8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.084646 Jun 17 15:44:16.716209 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1759/3106] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:44:16 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:44:17.332037 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-da236d08-2aaa-4b10-8328-efbf7ca87b1d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:17.332698 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-da236d08-2aaa-4b10-8328-efbf7ca87b1d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:17.338849 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-da236d08-2aaa-4b10-8328-efbf7ca87b1d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:17.339296 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-da236d08-2aaa-4b10-8328-efbf7ca87b1d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:17.340046 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-da236d08-2aaa-4b10-8328-efbf7ca87b1d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:17.340512 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-da236d08-2aaa-4b10-8328-efbf7ca87b1d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:17.576172 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-126f96d1-6ce7-487f-b467-d4425a7acf3e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:17.576860 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-126f96d1-6ce7-487f-b467-d4425a7acf3e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:17.583081 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-126f96d1-6ce7-487f-b467-d4425a7acf3e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:17.583460 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-126f96d1-6ce7-487f-b467-d4425a7acf3e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:17.584232 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-126f96d1-6ce7-487f-b467-d4425a7acf3e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:17.584703 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-126f96d1-6ce7-487f-b467-d4425a7acf3e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:17.646620 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-126f96d1-6ce7-487f-b467-d4425a7acf3e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:17.654809 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-126f96d1-6ce7-487f-b467-d4425a7acf3e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.082495 Jun 17 15:44:17.655386 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1760/3107] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:44:17 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:44:17.699706 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-da236d08-2aaa-4b10-8328-efbf7ca87b1d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:17.707583 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-da236d08-2aaa-4b10-8328-efbf7ca87b1d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.379427 Jun 17 15:44:17.708139 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1348/3108] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:44:17 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:44:17.733881 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-6c8c062a-64fd-425d-bcf6-ef7ba41ce7a2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:17.734480 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-6c8c062a-64fd-425d-bcf6-ef7ba41ce7a2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:17.740529 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6c8c062a-64fd-425d-bcf6-ef7ba41ce7a2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:17.740972 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6c8c062a-64fd-425d-bcf6-ef7ba41ce7a2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:17.741718 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6c8c062a-64fd-425d-bcf6-ef7ba41ce7a2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:17.742147 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6c8c062a-64fd-425d-bcf6-ef7ba41ce7a2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:17.805309 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-6c8c062a-64fd-425d-bcf6-ef7ba41ce7a2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:17.814320 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-6c8c062a-64fd-425d-bcf6-ef7ba41ce7a2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:17.815807 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-6c8c062a-64fd-425d-bcf6-ef7ba41ce7a2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:17.816949 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-6c8c062a-64fd-425d-bcf6-ef7ba41ce7a2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.086973 Jun 17 15:44:17.817492 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1761/3109] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:44:17 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:44:18.672457 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-3f6b4579-d4ab-471e-ae35-a757afe18d8b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:18.672987 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-3f6b4579-d4ab-471e-ae35-a757afe18d8b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:18.679609 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3f6b4579-d4ab-471e-ae35-a757afe18d8b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:18.680056 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3f6b4579-d4ab-471e-ae35-a757afe18d8b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:18.680839 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3f6b4579-d4ab-471e-ae35-a757afe18d8b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:18.681276 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3f6b4579-d4ab-471e-ae35-a757afe18d8b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:18.724557 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-f76a2fb8-e87f-4b85-8efc-260cdf100d41 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:18.725177 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-f76a2fb8-e87f-4b85-8efc-260cdf100d41 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:18.728517 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_api:SELECT=84 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:44:18.734078 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f76a2fb8-e87f-4b85-8efc-260cdf100d41 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:18.734522 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f76a2fb8-e87f-4b85-8efc-260cdf100d41 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:18.735279 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f76a2fb8-e87f-4b85-8efc-260cdf100d41 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:18.735713 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f76a2fb8-e87f-4b85-8efc-260cdf100d41 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:18.741951 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-3f6b4579-d4ab-471e-ae35-a757afe18d8b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:18.750136 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-3f6b4579-d4ab-471e-ae35-a757afe18d8b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.081598 Jun 17 15:44:18.750907 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1349/3110] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:44:18 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:44:18.834669 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-e3b20052-50cf-47bc-bf71-0a6cb3be18c7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:18.835276 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-e3b20052-50cf-47bc-bf71-0a6cb3be18c7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:18.841782 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e3b20052-50cf-47bc-bf71-0a6cb3be18c7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:18.842223 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e3b20052-50cf-47bc-bf71-0a6cb3be18c7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:18.842977 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e3b20052-50cf-47bc-bf71-0a6cb3be18c7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:18.843400 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e3b20052-50cf-47bc-bf71-0a6cb3be18c7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:18.866483 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-f76a2fb8-e87f-4b85-8efc-260cdf100d41 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:18.874304 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-f76a2fb8-e87f-4b85-8efc-260cdf100d41 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.153615 Jun 17 15:44:18.874878 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1762/3111] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:44:18 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:44:18.905228 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-e3b20052-50cf-47bc-bf71-0a6cb3be18c7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:18.913430 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-e3b20052-50cf-47bc-bf71-0a6cb3be18c7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:18.914912 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-e3b20052-50cf-47bc-bf71-0a6cb3be18c7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:18.916635 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-e3b20052-50cf-47bc-bf71-0a6cb3be18c7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.085789 Jun 17 15:44:18.917223 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1350/3112] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:44:18 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 15:44:19.766700 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-9171b1b1-4907-4053-8e58-ca912daeecfd tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:19.767280 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-9171b1b1-4907-4053-8e58-ca912daeecfd tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:19.773743 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9171b1b1-4907-4053-8e58-ca912daeecfd tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:19.774191 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9171b1b1-4907-4053-8e58-ca912daeecfd tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:19.774946 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9171b1b1-4907-4053-8e58-ca912daeecfd tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:19.775377 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9171b1b1-4907-4053-8e58-ca912daeecfd tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:19.836599 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-9171b1b1-4907-4053-8e58-ca912daeecfd tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:19.844623 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-9171b1b1-4907-4053-8e58-ca912daeecfd tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.081925 Jun 17 15:44:19.845186 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1763/3113] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:44:19 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:44:19.890760 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-dc33b67e-896d-4804-97ee-3d197008d293 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:19.891474 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-dc33b67e-896d-4804-97ee-3d197008d293 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:19.903872 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-dc33b67e-896d-4804-97ee-3d197008d293 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:19.904358 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-dc33b67e-896d-4804-97ee-3d197008d293 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:19.905505 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-dc33b67e-896d-4804-97ee-3d197008d293 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:19.905694 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-dc33b67e-896d-4804-97ee-3d197008d293 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:19.935175 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-159c3ef2-8df7-4db0-92ae-92e2550d2686 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:19.936146 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-159c3ef2-8df7-4db0-92ae-92e2550d2686 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:19.942835 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-159c3ef2-8df7-4db0-92ae-92e2550d2686 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:19.943273 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-159c3ef2-8df7-4db0-92ae-92e2550d2686 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:19.944032 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-159c3ef2-8df7-4db0-92ae-92e2550d2686 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:19.944502 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-159c3ef2-8df7-4db0-92ae-92e2550d2686 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:20.006173 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-159c3ef2-8df7-4db0-92ae-92e2550d2686 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:20.014972 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-159c3ef2-8df7-4db0-92ae-92e2550d2686 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:20.016491 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-159c3ef2-8df7-4db0-92ae-92e2550d2686 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:20.017692 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-159c3ef2-8df7-4db0-92ae-92e2550d2686 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.086964 Jun 17 15:44:20.018198 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1764/3114] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:44:19 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 15:44:20.037052 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-dc33b67e-896d-4804-97ee-3d197008d293 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:20.039238 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell1:SELECT=100 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:44:20.046659 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-dc33b67e-896d-4804-97ee-3d197008d293 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.159668 Jun 17 15:44:20.047218 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1351/3115] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:44:19 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:44:20.861760 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-b657040d-47c4-4326-b029-b2697d47372b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:20.862589 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-b657040d-47c4-4326-b029-b2697d47372b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:20.869132 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b657040d-47c4-4326-b029-b2697d47372b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:20.870061 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b657040d-47c4-4326-b029-b2697d47372b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:20.870829 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b657040d-47c4-4326-b029-b2697d47372b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:20.871254 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b657040d-47c4-4326-b029-b2697d47372b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:20.887639 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=100 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:44:20.937566 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-b657040d-47c4-4326-b029-b2697d47372b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:20.945657 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-b657040d-47c4-4326-b029-b2697d47372b tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.087913 Jun 17 15:44:20.946225 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1765/3116] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:44:20 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:44:21.035948 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-f4449f58-87e6-4592-a408-afc75eb40309 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:21.036525 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-f4449f58-87e6-4592-a408-afc75eb40309 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:21.043034 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f4449f58-87e6-4592-a408-afc75eb40309 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:21.043488 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f4449f58-87e6-4592-a408-afc75eb40309 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:21.044273 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f4449f58-87e6-4592-a408-afc75eb40309 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:21.044783 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f4449f58-87e6-4592-a408-afc75eb40309 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:21.064083 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-26a2ed3a-7925-4f45-a318-a2496875adcb tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:21.064730 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-26a2ed3a-7925-4f45-a318-a2496875adcb tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:21.071180 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-26a2ed3a-7925-4f45-a318-a2496875adcb tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:21.071636 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-26a2ed3a-7925-4f45-a318-a2496875adcb tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:21.072484 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-26a2ed3a-7925-4f45-a318-a2496875adcb tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:21.073572 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-26a2ed3a-7925-4f45-a318-a2496875adcb tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:21.107400 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-f4449f58-87e6-4592-a408-afc75eb40309 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:21.116085 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-f4449f58-87e6-4592-a408-afc75eb40309 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:21.117631 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-f4449f58-87e6-4592-a408-afc75eb40309 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:21.118776 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-f4449f58-87e6-4592-a408-afc75eb40309 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.086850 Jun 17 15:44:21.119372 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1352/3117] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:44:21 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:44:21.203265 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-26a2ed3a-7925-4f45-a318-a2496875adcb tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:21.211186 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-26a2ed3a-7925-4f45-a318-a2496875adcb tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.151008 Jun 17 15:44:21.211750 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1766/3118] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:44:21 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:44:21.963016 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-2c7a5436-3700-42d0-a809-6c4cd77782e3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:21.964156 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-2c7a5436-3700-42d0-a809-6c4cd77782e3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:21.970273 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2c7a5436-3700-42d0-a809-6c4cd77782e3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:21.970717 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2c7a5436-3700-42d0-a809-6c4cd77782e3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:21.971470 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2c7a5436-3700-42d0-a809-6c4cd77782e3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:21.971901 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2c7a5436-3700-42d0-a809-6c4cd77782e3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:22.039091 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-2c7a5436-3700-42d0-a809-6c4cd77782e3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:22.047379 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-2c7a5436-3700-42d0-a809-6c4cd77782e3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.088239 Jun 17 15:44:22.047932 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1353/3119] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:44:21 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:44:22.137801 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-8a58b073-c0a9-4dd5-a1cf-541d18d9d731 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:22.138407 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-8a58b073-c0a9-4dd5-a1cf-541d18d9d731 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:22.144837 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8a58b073-c0a9-4dd5-a1cf-541d18d9d731 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:22.145276 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8a58b073-c0a9-4dd5-a1cf-541d18d9d731 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:22.146051 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8a58b073-c0a9-4dd5-a1cf-541d18d9d731 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:22.146477 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8a58b073-c0a9-4dd5-a1cf-541d18d9d731 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:22.206594 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-8a58b073-c0a9-4dd5-a1cf-541d18d9d731 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:22.215674 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-8a58b073-c0a9-4dd5-a1cf-541d18d9d731 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:22.217211 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-8a58b073-c0a9-4dd5-a1cf-541d18d9d731 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:22.218343 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-8a58b073-c0a9-4dd5-a1cf-541d18d9d731 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.084939 Jun 17 15:44:22.218897 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1767/3120] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:44:22 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 15:44:22.227969 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-5f3f007b-3131-484b-b92e-9c92688b90b9 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:22.228613 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-5f3f007b-3131-484b-b92e-9c92688b90b9 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:22.234658 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5f3f007b-3131-484b-b92e-9c92688b90b9 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:22.235102 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5f3f007b-3131-484b-b92e-9c92688b90b9 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:22.235852 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5f3f007b-3131-484b-b92e-9c92688b90b9 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:22.236285 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5f3f007b-3131-484b-b92e-9c92688b90b9 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:22.365658 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-5f3f007b-3131-484b-b92e-9c92688b90b9 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:22.379177 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-5f3f007b-3131-484b-b92e-9c92688b90b9 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.154904 Jun 17 15:44:22.379762 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1354/3121] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:44:22 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:44:23.064618 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-0d9c7898-363d-4f92-aff7-fb8c160cf56d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:23.065230 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-0d9c7898-363d-4f92-aff7-fb8c160cf56d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:23.071297 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0d9c7898-363d-4f92-aff7-fb8c160cf56d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:23.071739 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0d9c7898-363d-4f92-aff7-fb8c160cf56d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:23.072528 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0d9c7898-363d-4f92-aff7-fb8c160cf56d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:23.072963 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0d9c7898-363d-4f92-aff7-fb8c160cf56d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:23.137324 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-0d9c7898-363d-4f92-aff7-fb8c160cf56d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:23.145448 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-0d9c7898-363d-4f92-aff7-fb8c160cf56d tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.084765 Jun 17 15:44:23.146065 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1768/3122] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:44:23 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:44:23.236753 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-9df85c3f-91e9-40f6-88f1-a2a578725fe5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:23.237353 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-9df85c3f-91e9-40f6-88f1-a2a578725fe5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:23.239698 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_api:SELECT=80 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:44:23.245019 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9df85c3f-91e9-40f6-88f1-a2a578725fe5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:23.245464 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9df85c3f-91e9-40f6-88f1-a2a578725fe5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:23.246224 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9df85c3f-91e9-40f6-88f1-a2a578725fe5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:23.246659 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9df85c3f-91e9-40f6-88f1-a2a578725fe5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:23.316610 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-9df85c3f-91e9-40f6-88f1-a2a578725fe5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:23.324982 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-9df85c3f-91e9-40f6-88f1-a2a578725fe5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:23.326659 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-9df85c3f-91e9-40f6-88f1-a2a578725fe5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:23.327821 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-9df85c3f-91e9-40f6-88f1-a2a578725fe5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.095254 Jun 17 15:44:23.328397 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1355/3123] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:44:23 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:44:23.397369 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-22909691-4810-440b-89b6-89f4bac0603a tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:23.397983 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-22909691-4810-440b-89b6-89f4bac0603a tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:23.404641 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-22909691-4810-440b-89b6-89f4bac0603a tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:23.405090 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-22909691-4810-440b-89b6-89f4bac0603a tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:23.405854 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-22909691-4810-440b-89b6-89f4bac0603a tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:23.406292 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-22909691-4810-440b-89b6-89f4bac0603a tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:23.533923 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-22909691-4810-440b-89b6-89f4bac0603a tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:23.541861 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-22909691-4810-440b-89b6-89f4bac0603a tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.148423 Jun 17 15:44:23.542424 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1769/3124] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:44:23 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:44:24.162820 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-0a58491c-9718-4126-9087-4889bc8be593 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:24.163424 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-0a58491c-9718-4126-9087-4889bc8be593 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:24.169967 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0a58491c-9718-4126-9087-4889bc8be593 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:24.170407 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0a58491c-9718-4126-9087-4889bc8be593 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:24.171169 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0a58491c-9718-4126-9087-4889bc8be593 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:24.171598 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0a58491c-9718-4126-9087-4889bc8be593 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:24.231114 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-0a58491c-9718-4126-9087-4889bc8be593 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:24.238942 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-0a58491c-9718-4126-9087-4889bc8be593 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.079998 Jun 17 15:44:24.239500 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1356/3125] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:44:24 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:44:24.347102 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-a12c498d-298c-4d13-80c9-9eb9f971980b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:24.347719 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-a12c498d-298c-4d13-80c9-9eb9f971980b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:24.354555 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a12c498d-298c-4d13-80c9-9eb9f971980b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:24.355006 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a12c498d-298c-4d13-80c9-9eb9f971980b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:24.355819 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a12c498d-298c-4d13-80c9-9eb9f971980b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:24.356256 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a12c498d-298c-4d13-80c9-9eb9f971980b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:24.418350 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-a12c498d-298c-4d13-80c9-9eb9f971980b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:24.426737 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-a12c498d-298c-4d13-80c9-9eb9f971980b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:24.428249 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-a12c498d-298c-4d13-80c9-9eb9f971980b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:24.429413 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-a12c498d-298c-4d13-80c9-9eb9f971980b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.086277 Jun 17 15:44:24.429973 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1770/3126] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:44:24 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:44:24.559053 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-d7874c59-133c-4d13-b7a3-16881fcc1e0a tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:24.559665 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-d7874c59-133c-4d13-b7a3-16881fcc1e0a tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:24.566159 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d7874c59-133c-4d13-b7a3-16881fcc1e0a tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:24.566614 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d7874c59-133c-4d13-b7a3-16881fcc1e0a tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:24.567400 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d7874c59-133c-4d13-b7a3-16881fcc1e0a tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:24.567846 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d7874c59-133c-4d13-b7a3-16881fcc1e0a tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:24.696644 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-d7874c59-133c-4d13-b7a3-16881fcc1e0a tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:24.705463 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-d7874c59-133c-4d13-b7a3-16881fcc1e0a tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.150372 Jun 17 15:44:24.706027 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1357/3127] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:44:24 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:44:25.255835 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-7c20bed4-b3a3-4515-908a-f352fab65651 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:25.256494 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-7c20bed4-b3a3-4515-908a-f352fab65651 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:25.262713 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7c20bed4-b3a3-4515-908a-f352fab65651 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:25.263151 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7c20bed4-b3a3-4515-908a-f352fab65651 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:25.263898 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7c20bed4-b3a3-4515-908a-f352fab65651 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:25.264341 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7c20bed4-b3a3-4515-908a-f352fab65651 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:25.323875 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-7c20bed4-b3a3-4515-908a-f352fab65651 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:25.331672 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-7c20bed4-b3a3-4515-908a-f352fab65651 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.079746 Jun 17 15:44:25.332234 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1771/3128] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:44:25 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:44:25.447000 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-bb7864da-114a-4317-96ce-611332cbfd2e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:25.447646 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-bb7864da-114a-4317-96ce-611332cbfd2e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:25.453681 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bb7864da-114a-4317-96ce-611332cbfd2e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:25.454155 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bb7864da-114a-4317-96ce-611332cbfd2e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:25.454911 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bb7864da-114a-4317-96ce-611332cbfd2e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:25.455351 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bb7864da-114a-4317-96ce-611332cbfd2e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:25.515657 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-bb7864da-114a-4317-96ce-611332cbfd2e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:25.524320 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-bb7864da-114a-4317-96ce-611332cbfd2e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:25.526414 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-bb7864da-114a-4317-96ce-611332cbfd2e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:25.527583 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-bb7864da-114a-4317-96ce-611332cbfd2e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.084471 Jun 17 15:44:25.528172 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1358/3129] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:44:25 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:44:25.722601 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-69243c68-8858-4ac8-9011-e473b6717759 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:25.723195 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-69243c68-8858-4ac8-9011-e473b6717759 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:25.730623 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-69243c68-8858-4ac8-9011-e473b6717759 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:25.731098 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-69243c68-8858-4ac8-9011-e473b6717759 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:25.731825 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-69243c68-8858-4ac8-9011-e473b6717759 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:25.732255 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-69243c68-8858-4ac8-9011-e473b6717759 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:26.085555 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-69243c68-8858-4ac8-9011-e473b6717759 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:26.094163 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-69243c68-8858-4ac8-9011-e473b6717759 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.375503 Jun 17 15:44:26.094731 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1772/3130] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:44:25 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:44:26.350851 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-3460644c-e1f8-465f-99ef-0274f1502c47 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:26.351713 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-3460644c-e1f8-465f-99ef-0274f1502c47 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:26.357673 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3460644c-e1f8-465f-99ef-0274f1502c47 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:26.358114 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3460644c-e1f8-465f-99ef-0274f1502c47 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:26.358859 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3460644c-e1f8-465f-99ef-0274f1502c47 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:26.359286 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3460644c-e1f8-465f-99ef-0274f1502c47 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:26.420355 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-3460644c-e1f8-465f-99ef-0274f1502c47 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:26.428442 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-3460644c-e1f8-465f-99ef-0274f1502c47 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.082352 Jun 17 15:44:26.429008 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1359/3131] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:44:26 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:44:26.546028 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-1bc37687-2dc6-4fad-b527-71dbb4d43bfc tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:26.546656 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-1bc37687-2dc6-4fad-b527-71dbb4d43bfc tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:26.552789 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1bc37687-2dc6-4fad-b527-71dbb4d43bfc tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:26.553236 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1bc37687-2dc6-4fad-b527-71dbb4d43bfc tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:26.553984 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1bc37687-2dc6-4fad-b527-71dbb4d43bfc tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:26.554479 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1bc37687-2dc6-4fad-b527-71dbb4d43bfc tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:26.614554 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-1bc37687-2dc6-4fad-b527-71dbb4d43bfc tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:26.623425 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-1bc37687-2dc6-4fad-b527-71dbb4d43bfc tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:26.624965 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-1bc37687-2dc6-4fad-b527-71dbb4d43bfc tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:26.626092 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-1bc37687-2dc6-4fad-b527-71dbb4d43bfc tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.084517 Jun 17 15:44:26.626638 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1773/3132] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:44:26 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:44:27.112144 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-dcd28398-af14-405b-8cad-6e4db52f72ee tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:27.112777 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-dcd28398-af14-405b-8cad-6e4db52f72ee tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:27.119100 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-dcd28398-af14-405b-8cad-6e4db52f72ee tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:27.119584 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-dcd28398-af14-405b-8cad-6e4db52f72ee tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:27.120393 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-dcd28398-af14-405b-8cad-6e4db52f72ee tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:27.120880 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-dcd28398-af14-405b-8cad-6e4db52f72ee tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:27.251021 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-dcd28398-af14-405b-8cad-6e4db52f72ee tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:27.258851 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-dcd28398-af14-405b-8cad-6e4db52f72ee tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.150554 Jun 17 15:44:27.259420 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1360/3133] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:44:27 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:44:27.445837 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-f9c90915-75f7-4495-95a6-c1cc54939f65 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:27.446445 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-f9c90915-75f7-4495-95a6-c1cc54939f65 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:27.453466 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f9c90915-75f7-4495-95a6-c1cc54939f65 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:27.453918 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f9c90915-75f7-4495-95a6-c1cc54939f65 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:27.454670 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f9c90915-75f7-4495-95a6-c1cc54939f65 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:27.455098 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f9c90915-75f7-4495-95a6-c1cc54939f65 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:27.515155 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-f9c90915-75f7-4495-95a6-c1cc54939f65 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:27.523014 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-f9c90915-75f7-4495-95a6-c1cc54939f65 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.081071 Jun 17 15:44:27.523570 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1774/3134] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:44:27 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:44:27.643892 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-4ffbbf0d-72d1-4691-b778-88b658c9c77e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:27.644456 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-4ffbbf0d-72d1-4691-b778-88b658c9c77e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:27.650895 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4ffbbf0d-72d1-4691-b778-88b658c9c77e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:27.651345 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4ffbbf0d-72d1-4691-b778-88b658c9c77e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:27.652108 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4ffbbf0d-72d1-4691-b778-88b658c9c77e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:27.652579 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4ffbbf0d-72d1-4691-b778-88b658c9c77e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:27.727066 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-4ffbbf0d-72d1-4691-b778-88b658c9c77e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:27.735451 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-4ffbbf0d-72d1-4691-b778-88b658c9c77e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:27.736983 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-4ffbbf0d-72d1-4691-b778-88b658c9c77e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:27.738115 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-4ffbbf0d-72d1-4691-b778-88b658c9c77e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.098231 Jun 17 15:44:27.738719 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1361/3135] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:44:27 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:44:28.276346 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-5c13eb58-fd6d-4b89-914e-3043106d2058 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:28.276959 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-5c13eb58-fd6d-4b89-914e-3043106d2058 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:28.283000 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5c13eb58-fd6d-4b89-914e-3043106d2058 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:28.283446 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5c13eb58-fd6d-4b89-914e-3043106d2058 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:28.284197 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5c13eb58-fd6d-4b89-914e-3043106d2058 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:28.284651 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5c13eb58-fd6d-4b89-914e-3043106d2058 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:28.414559 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-5c13eb58-fd6d-4b89-914e-3043106d2058 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:28.422919 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-5c13eb58-fd6d-4b89-914e-3043106d2058 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.150499 Jun 17 15:44:28.423481 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1775/3136] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:44:28 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:44:28.540603 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-d2dec313-6c33-4614-a872-e4151eeada0e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:28.541174 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-d2dec313-6c33-4614-a872-e4151eeada0e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:28.547632 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d2dec313-6c33-4614-a872-e4151eeada0e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:28.548077 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d2dec313-6c33-4614-a872-e4151eeada0e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:28.548893 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d2dec313-6c33-4614-a872-e4151eeada0e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:28.549329 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d2dec313-6c33-4614-a872-e4151eeada0e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:28.610431 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-d2dec313-6c33-4614-a872-e4151eeada0e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:28.618312 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-d2dec313-6c33-4614-a872-e4151eeada0e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.081660 Jun 17 15:44:28.618876 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1362/3137] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:44:28 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:44:28.756428 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-255081e9-c1b5-4bcf-adcf-0e5933703b0a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:28.757033 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-255081e9-c1b5-4bcf-adcf-0e5933703b0a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:28.763644 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-255081e9-c1b5-4bcf-adcf-0e5933703b0a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:28.764087 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-255081e9-c1b5-4bcf-adcf-0e5933703b0a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:28.764864 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-255081e9-c1b5-4bcf-adcf-0e5933703b0a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:28.765296 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-255081e9-c1b5-4bcf-adcf-0e5933703b0a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:28.825698 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-255081e9-c1b5-4bcf-adcf-0e5933703b0a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:28.834239 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-255081e9-c1b5-4bcf-adcf-0e5933703b0a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:28.835717 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-255081e9-c1b5-4bcf-adcf-0e5933703b0a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:28.836891 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-255081e9-c1b5-4bcf-adcf-0e5933703b0a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.084411 Jun 17 15:44:28.837422 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1776/3138] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:44:28 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:44:29.440459 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-8f07be7b-99e4-4595-af0d-b7241e016864 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:29.441068 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-8f07be7b-99e4-4595-af0d-b7241e016864 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:29.447564 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8f07be7b-99e4-4595-af0d-b7241e016864 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:29.448540 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8f07be7b-99e4-4595-af0d-b7241e016864 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:29.449280 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8f07be7b-99e4-4595-af0d-b7241e016864 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:29.449708 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8f07be7b-99e4-4595-af0d-b7241e016864 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:29.579750 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-8f07be7b-99e4-4595-af0d-b7241e016864 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:29.587585 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-8f07be7b-99e4-4595-af0d-b7241e016864 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.151073 Jun 17 15:44:29.588140 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1363/3139] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:44:29 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:44:29.636835 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-03a59844-2022-4263-a22e-46093f93c377 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:29.637382 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-03a59844-2022-4263-a22e-46093f93c377 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:29.643315 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-03a59844-2022-4263-a22e-46093f93c377 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:29.643766 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-03a59844-2022-4263-a22e-46093f93c377 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:29.644546 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-03a59844-2022-4263-a22e-46093f93c377 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:29.644988 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-03a59844-2022-4263-a22e-46093f93c377 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:29.704283 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-03a59844-2022-4263-a22e-46093f93c377 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:29.712566 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-03a59844-2022-4263-a22e-46093f93c377 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.080319 Jun 17 15:44:29.713128 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1777/3140] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:44:29 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:44:29.855788 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-7ebdb64e-3736-4da5-9d89-e8c5001a846e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:29.856424 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-7ebdb64e-3736-4da5-9d89-e8c5001a846e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:29.862369 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7ebdb64e-3736-4da5-9d89-e8c5001a846e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:29.862840 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7ebdb64e-3736-4da5-9d89-e8c5001a846e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:29.863577 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7ebdb64e-3736-4da5-9d89-e8c5001a846e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:29.864006 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7ebdb64e-3736-4da5-9d89-e8c5001a846e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:29.924769 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-7ebdb64e-3736-4da5-9d89-e8c5001a846e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:29.933161 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-7ebdb64e-3736-4da5-9d89-e8c5001a846e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:29.934640 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-7ebdb64e-3736-4da5-9d89-e8c5001a846e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:29.935751 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-7ebdb64e-3736-4da5-9d89-e8c5001a846e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.084758 Jun 17 15:44:29.936300 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1364/3141] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:44:29 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:44:30.605623 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-9755500c-8f17-4cf8-9a5e-88c1634e2e87 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:30.606234 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-9755500c-8f17-4cf8-9a5e-88c1634e2e87 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:30.612747 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9755500c-8f17-4cf8-9a5e-88c1634e2e87 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:30.613194 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9755500c-8f17-4cf8-9a5e-88c1634e2e87 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:30.613953 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9755500c-8f17-4cf8-9a5e-88c1634e2e87 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:30.614384 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9755500c-8f17-4cf8-9a5e-88c1634e2e87 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:30.730034 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-435177fa-231f-46b4-9414-1dbcc1a6fa0a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:30.730656 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-435177fa-231f-46b4-9414-1dbcc1a6fa0a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:30.737101 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-435177fa-231f-46b4-9414-1dbcc1a6fa0a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:30.737551 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-435177fa-231f-46b4-9414-1dbcc1a6fa0a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:30.738310 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-435177fa-231f-46b4-9414-1dbcc1a6fa0a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:30.738745 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-435177fa-231f-46b4-9414-1dbcc1a6fa0a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:30.742040 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-9755500c-8f17-4cf8-9a5e-88c1634e2e87 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:30.750497 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-9755500c-8f17-4cf8-9a5e-88c1634e2e87 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.149867 Jun 17 15:44:30.751045 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1778/3142] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:44:30 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:44:30.800630 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-435177fa-231f-46b4-9414-1dbcc1a6fa0a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:30.809354 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-435177fa-231f-46b4-9414-1dbcc1a6fa0a tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.084002 Jun 17 15:44:30.809919 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1365/3143] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:44:30 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:44:30.953766 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-1e3fd747-8693-4df4-9031-09fd37f5c838 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:30.954340 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-1e3fd747-8693-4df4-9031-09fd37f5c838 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:30.960412 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1e3fd747-8693-4df4-9031-09fd37f5c838 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:30.960858 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1e3fd747-8693-4df4-9031-09fd37f5c838 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:30.961635 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1e3fd747-8693-4df4-9031-09fd37f5c838 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:30.962058 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1e3fd747-8693-4df4-9031-09fd37f5c838 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:31.023768 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-1e3fd747-8693-4df4-9031-09fd37f5c838 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:31.032716 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-1e3fd747-8693-4df4-9031-09fd37f5c838 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:31.034202 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-1e3fd747-8693-4df4-9031-09fd37f5c838 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:31.035324 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-1e3fd747-8693-4df4-9031-09fd37f5c838 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.085649 Jun 17 15:44:31.035882 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1779/3144] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:44:30 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:44:31.617342 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 15:44:31.617523 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Fri Jun 17 15:44:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 15:44:31.767592 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-22c3c4fc-366b-4143-8c73-bf836a13362a tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:31.768208 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-22c3c4fc-366b-4143-8c73-bf836a13362a tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:31.775080 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-22c3c4fc-366b-4143-8c73-bf836a13362a tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:31.775518 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-22c3c4fc-366b-4143-8c73-bf836a13362a tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:31.776344 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-22c3c4fc-366b-4143-8c73-bf836a13362a tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:31.776722 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-22c3c4fc-366b-4143-8c73-bf836a13362a tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:31.826615 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-a1fa82af-ea98-470d-ad58-ab0382a34aa3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:31.827268 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-a1fa82af-ea98-470d-ad58-ab0382a34aa3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:31.833654 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a1fa82af-ea98-470d-ad58-ab0382a34aa3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:31.834109 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a1fa82af-ea98-470d-ad58-ab0382a34aa3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:31.834881 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a1fa82af-ea98-470d-ad58-ab0382a34aa3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:31.835312 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a1fa82af-ea98-470d-ad58-ab0382a34aa3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:31.897834 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-a1fa82af-ea98-470d-ad58-ab0382a34aa3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:31.905962 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-a1fa82af-ea98-470d-ad58-ab0382a34aa3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.083745 Jun 17 15:44:31.906734 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1780/3145] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:44:31 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:44:31.913886 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-22c3c4fc-366b-4143-8c73-bf836a13362a tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:31.923385 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-22c3c4fc-366b-4143-8c73-bf836a13362a tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.159596 Jun 17 15:44:31.923956 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1366/3146] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:44:31 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:44:32.054167 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-082efefa-8d19-460b-8a44-43132c9b66d0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:32.054686 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-082efefa-8d19-460b-8a44-43132c9b66d0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:32.061297 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-082efefa-8d19-460b-8a44-43132c9b66d0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:32.061744 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-082efefa-8d19-460b-8a44-43132c9b66d0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:32.062498 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-082efefa-8d19-460b-8a44-43132c9b66d0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:32.062935 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-082efefa-8d19-460b-8a44-43132c9b66d0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:32.131382 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-082efefa-8d19-460b-8a44-43132c9b66d0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:32.139835 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-082efefa-8d19-460b-8a44-43132c9b66d0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:32.141366 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-082efefa-8d19-460b-8a44-43132c9b66d0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:32.142500 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-082efefa-8d19-460b-8a44-43132c9b66d0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.092455 Jun 17 15:44:32.143051 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1781/3147] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:44:32 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:44:32.923011 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-8fd79a16-ffa8-492e-b97a-11081e3320cf tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:32.923643 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-8fd79a16-ffa8-492e-b97a-11081e3320cf tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:32.930414 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8fd79a16-ffa8-492e-b97a-11081e3320cf tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:32.930855 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8fd79a16-ffa8-492e-b97a-11081e3320cf tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:32.931606 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8fd79a16-ffa8-492e-b97a-11081e3320cf tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:32.932031 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8fd79a16-ffa8-492e-b97a-11081e3320cf tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:32.940960 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-362542ce-22db-4484-aa41-3bc9ae5575d7 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:32.941553 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-362542ce-22db-4484-aa41-3bc9ae5575d7 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:32.948026 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-362542ce-22db-4484-aa41-3bc9ae5575d7 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:32.949073 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-362542ce-22db-4484-aa41-3bc9ae5575d7 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:32.949823 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-362542ce-22db-4484-aa41-3bc9ae5575d7 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:32.950247 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-362542ce-22db-4484-aa41-3bc9ae5575d7 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:32.954204 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=100 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:44:32.995101 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-8fd79a16-ffa8-492e-b97a-11081e3320cf tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:33.003036 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-8fd79a16-ffa8-492e-b97a-11081e3320cf tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.083927 Jun 17 15:44:33.003686 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1367/3148] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:44:32 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:44:33.083839 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-362542ce-22db-4484-aa41-3bc9ae5575d7 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:33.092523 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-362542ce-22db-4484-aa41-3bc9ae5575d7 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.155297 Jun 17 15:44:33.093099 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1782/3149] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:44:32 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:44:33.160656 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-b0a98ce5-7b84-4550-bbd0-3acbbed7083c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:33.161263 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-b0a98ce5-7b84-4550-bbd0-3acbbed7083c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:33.167186 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b0a98ce5-7b84-4550-bbd0-3acbbed7083c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:33.167628 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b0a98ce5-7b84-4550-bbd0-3acbbed7083c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:33.168430 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b0a98ce5-7b84-4550-bbd0-3acbbed7083c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:33.168858 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b0a98ce5-7b84-4550-bbd0-3acbbed7083c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:33.183251 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell1:SELECT=100 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:44:33.229951 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-b0a98ce5-7b84-4550-bbd0-3acbbed7083c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:33.238148 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-b0a98ce5-7b84-4550-bbd0-3acbbed7083c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:33.239626 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-b0a98ce5-7b84-4550-bbd0-3acbbed7083c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:33.240771 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-b0a98ce5-7b84-4550-bbd0-3acbbed7083c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.084038 Jun 17 15:44:33.241322 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1368/3150] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:44:33 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:44:34.020747 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-79335eb1-4108-495b-a945-01139e960983 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:34.021399 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-79335eb1-4108-495b-a945-01139e960983 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:34.028709 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-79335eb1-4108-495b-a945-01139e960983 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:34.029156 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-79335eb1-4108-495b-a945-01139e960983 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:34.029929 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-79335eb1-4108-495b-a945-01139e960983 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:34.030393 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-79335eb1-4108-495b-a945-01139e960983 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:34.090690 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-79335eb1-4108-495b-a945-01139e960983 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:34.098658 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-79335eb1-4108-495b-a945-01139e960983 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.082114 Jun 17 15:44:34.099222 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1783/3151] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:44:34 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:44:34.110315 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-ea99a2d5-156b-4ac2-ad5d-a27358b75c20 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:34.111381 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-ea99a2d5-156b-4ac2-ad5d-a27358b75c20 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:34.117860 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ea99a2d5-156b-4ac2-ad5d-a27358b75c20 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:34.118302 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ea99a2d5-156b-4ac2-ad5d-a27358b75c20 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:34.119047 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ea99a2d5-156b-4ac2-ad5d-a27358b75c20 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:34.119473 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ea99a2d5-156b-4ac2-ad5d-a27358b75c20 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:34.245442 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-ea99a2d5-156b-4ac2-ad5d-a27358b75c20 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:34.253467 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-ea99a2d5-156b-4ac2-ad5d-a27358b75c20 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.147082 Jun 17 15:44:34.254023 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1369/3152] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:44:34 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:44:34.259222 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-c73717ae-f52d-4496-b1fe-630b7289dec5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:34.259830 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-c73717ae-f52d-4496-b1fe-630b7289dec5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:34.265850 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c73717ae-f52d-4496-b1fe-630b7289dec5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:34.266296 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c73717ae-f52d-4496-b1fe-630b7289dec5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:34.267051 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c73717ae-f52d-4496-b1fe-630b7289dec5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:34.267484 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c73717ae-f52d-4496-b1fe-630b7289dec5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:34.328802 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-c73717ae-f52d-4496-b1fe-630b7289dec5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:34.337761 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-c73717ae-f52d-4496-b1fe-630b7289dec5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:34.339662 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-c73717ae-f52d-4496-b1fe-630b7289dec5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:34.340826 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-c73717ae-f52d-4496-b1fe-630b7289dec5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.085460 Jun 17 15:44:34.341389 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1784/3153] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:44:34 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:44:35.115973 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-6e25cbc6-3c3c-4ae2-9aa4-c7fb34bfcb73 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:35.116615 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-6e25cbc6-3c3c-4ae2-9aa4-c7fb34bfcb73 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:35.123798 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6e25cbc6-3c3c-4ae2-9aa4-c7fb34bfcb73 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:35.124276 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6e25cbc6-3c3c-4ae2-9aa4-c7fb34bfcb73 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:35.125113 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6e25cbc6-3c3c-4ae2-9aa4-c7fb34bfcb73 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:35.125503 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6e25cbc6-3c3c-4ae2-9aa4-c7fb34bfcb73 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:35.190463 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-6e25cbc6-3c3c-4ae2-9aa4-c7fb34bfcb73 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:35.198385 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-6e25cbc6-3c3c-4ae2-9aa4-c7fb34bfcb73 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.086218 Jun 17 15:44:35.198943 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1370/3154] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:44:35 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:44:35.270682 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-3d7f84c9-3b7d-4700-a9b7-33284c1d73b2 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:35.271307 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-3d7f84c9-3b7d-4700-a9b7-33284c1d73b2 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:35.277785 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3d7f84c9-3b7d-4700-a9b7-33284c1d73b2 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:35.278239 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3d7f84c9-3b7d-4700-a9b7-33284c1d73b2 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:35.278997 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3d7f84c9-3b7d-4700-a9b7-33284c1d73b2 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:35.279437 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3d7f84c9-3b7d-4700-a9b7-33284c1d73b2 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:35.359565 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-47ffad4f-369a-431f-ba42-405334dba83d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:35.360105 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-47ffad4f-369a-431f-ba42-405334dba83d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:35.367032 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-47ffad4f-369a-431f-ba42-405334dba83d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:35.367476 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-47ffad4f-369a-431f-ba42-405334dba83d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:35.368228 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-47ffad4f-369a-431f-ba42-405334dba83d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:35.368689 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-47ffad4f-369a-431f-ba42-405334dba83d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:35.412196 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-3d7f84c9-3b7d-4700-a9b7-33284c1d73b2 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:35.420853 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-3d7f84c9-3b7d-4700-a9b7-33284c1d73b2 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.154353 Jun 17 15:44:35.421431 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1785/3155] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:44:35 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:44:35.430461 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-47ffad4f-369a-431f-ba42-405334dba83d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:35.439752 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-47ffad4f-369a-431f-ba42-405334dba83d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:35.441273 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-47ffad4f-369a-431f-ba42-405334dba83d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:35.442409 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-47ffad4f-369a-431f-ba42-405334dba83d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.086817 Jun 17 15:44:35.442963 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1371/3156] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:44:35 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 15:44:36.215688 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-702a7404-d864-44b1-a9f2-24392370c5db tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:36.216298 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-702a7404-d864-44b1-a9f2-24392370c5db tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:36.222409 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-702a7404-d864-44b1-a9f2-24392370c5db tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:36.222847 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-702a7404-d864-44b1-a9f2-24392370c5db tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:36.223597 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-702a7404-d864-44b1-a9f2-24392370c5db tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:36.224023 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-702a7404-d864-44b1-a9f2-24392370c5db tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:36.283307 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-702a7404-d864-44b1-a9f2-24392370c5db tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:36.291711 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-702a7404-d864-44b1-a9f2-24392370c5db tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.080519 Jun 17 15:44:36.292532 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1786/3157] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:44:36 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:44:36.438629 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-565ac5b0-c756-42e1-b43c-ce582553bdd0 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:36.439317 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-565ac5b0-c756-42e1-b43c-ce582553bdd0 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:36.446318 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-565ac5b0-c756-42e1-b43c-ce582553bdd0 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:36.446761 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-565ac5b0-c756-42e1-b43c-ce582553bdd0 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:36.447567 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-565ac5b0-c756-42e1-b43c-ce582553bdd0 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:36.447939 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-565ac5b0-c756-42e1-b43c-ce582553bdd0 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:36.460211 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-8e669f65-7999-468b-830c-0bade701af79 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:36.460881 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-8e669f65-7999-468b-830c-0bade701af79 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:36.467085 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8e669f65-7999-468b-830c-0bade701af79 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:36.467676 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8e669f65-7999-468b-830c-0bade701af79 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:36.468431 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8e669f65-7999-468b-830c-0bade701af79 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:36.469213 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8e669f65-7999-468b-830c-0bade701af79 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:36.531494 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-8e669f65-7999-468b-830c-0bade701af79 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:36.540089 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-8e669f65-7999-468b-830c-0bade701af79 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:36.541615 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-8e669f65-7999-468b-830c-0bade701af79 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:36.542775 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-8e669f65-7999-468b-830c-0bade701af79 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.086584 Jun 17 15:44:36.543343 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1787/3158] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:44:36 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 15:44:36.580148 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-565ac5b0-c756-42e1-b43c-ce582553bdd0 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:36.588077 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-565ac5b0-c756-42e1-b43c-ce582553bdd0 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.153329 Jun 17 15:44:36.588676 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1372/3159] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:44:36 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:44:37.308346 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-9eb0ae88-5394-4dca-9762-aa3c72004a61 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:37.308990 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-9eb0ae88-5394-4dca-9762-aa3c72004a61 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:37.315443 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9eb0ae88-5394-4dca-9762-aa3c72004a61 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:37.315890 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9eb0ae88-5394-4dca-9762-aa3c72004a61 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:37.316671 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9eb0ae88-5394-4dca-9762-aa3c72004a61 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:37.317101 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9eb0ae88-5394-4dca-9762-aa3c72004a61 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:37.382481 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-9eb0ae88-5394-4dca-9762-aa3c72004a61 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:37.391735 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-9eb0ae88-5394-4dca-9762-aa3c72004a61 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.087191 Jun 17 15:44:37.392359 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1788/3160] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:44:37 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:44:37.560774 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-c0d01fea-9deb-443a-835f-ddf889e4f011 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:37.561332 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-c0d01fea-9deb-443a-835f-ddf889e4f011 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:37.567701 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c0d01fea-9deb-443a-835f-ddf889e4f011 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:37.568143 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c0d01fea-9deb-443a-835f-ddf889e4f011 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:37.568938 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c0d01fea-9deb-443a-835f-ddf889e4f011 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:37.569376 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c0d01fea-9deb-443a-835f-ddf889e4f011 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:37.605643 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-f04c9361-65db-45ea-bdee-2faa4a4dbf6e tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:37.606350 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-f04c9361-65db-45ea-bdee-2faa4a4dbf6e tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:37.612568 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f04c9361-65db-45ea-bdee-2faa4a4dbf6e tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:37.613091 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f04c9361-65db-45ea-bdee-2faa4a4dbf6e tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:37.613913 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f04c9361-65db-45ea-bdee-2faa4a4dbf6e tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:37.614406 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f04c9361-65db-45ea-bdee-2faa4a4dbf6e tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:37.633977 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-c0d01fea-9deb-443a-835f-ddf889e4f011 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:37.642930 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-c0d01fea-9deb-443a-835f-ddf889e4f011 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:37.644448 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-c0d01fea-9deb-443a-835f-ddf889e4f011 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:37.645573 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-c0d01fea-9deb-443a-835f-ddf889e4f011 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.088862 Jun 17 15:44:37.646123 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1373/3161] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:44:37 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:44:37.747271 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-f04c9361-65db-45ea-bdee-2faa4a4dbf6e tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:37.755249 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-f04c9361-65db-45ea-bdee-2faa4a4dbf6e tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.153982 Jun 17 15:44:37.755827 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1789/3162] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:44:37 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:44:38.408718 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-2356daf8-42a6-418e-833b-fe991bfa0680 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:38.409325 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-2356daf8-42a6-418e-833b-fe991bfa0680 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:38.415404 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2356daf8-42a6-418e-833b-fe991bfa0680 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:38.415843 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2356daf8-42a6-418e-833b-fe991bfa0680 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:38.416617 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2356daf8-42a6-418e-833b-fe991bfa0680 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:38.417661 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2356daf8-42a6-418e-833b-fe991bfa0680 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:38.484929 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-2356daf8-42a6-418e-833b-fe991bfa0680 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:38.493039 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-2356daf8-42a6-418e-833b-fe991bfa0680 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.088064 Jun 17 15:44:38.493633 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1374/3163] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:44:38 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:44:38.664757 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-e463535d-8714-4e96-bee0-98dc1e1498b5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:38.665334 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-e463535d-8714-4e96-bee0-98dc1e1498b5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:38.672969 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e463535d-8714-4e96-bee0-98dc1e1498b5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:38.673424 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e463535d-8714-4e96-bee0-98dc1e1498b5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:38.674220 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e463535d-8714-4e96-bee0-98dc1e1498b5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:38.674658 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e463535d-8714-4e96-bee0-98dc1e1498b5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:38.746363 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-e463535d-8714-4e96-bee0-98dc1e1498b5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:38.755548 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-e463535d-8714-4e96-bee0-98dc1e1498b5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:38.757076 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-e463535d-8714-4e96-bee0-98dc1e1498b5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:38.758226 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-e463535d-8714-4e96-bee0-98dc1e1498b5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.097685 Jun 17 15:44:38.758787 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1790/3164] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:44:38 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:44:38.774729 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-d24252e4-8093-4019-9025-fe79b12b38fa tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:38.775628 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-d24252e4-8093-4019-9025-fe79b12b38fa tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:38.784061 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d24252e4-8093-4019-9025-fe79b12b38fa tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:38.784845 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d24252e4-8093-4019-9025-fe79b12b38fa tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:38.785804 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d24252e4-8093-4019-9025-fe79b12b38fa tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:38.786581 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d24252e4-8093-4019-9025-fe79b12b38fa tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:38.924988 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-d24252e4-8093-4019-9025-fe79b12b38fa tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:38.933186 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-d24252e4-8093-4019-9025-fe79b12b38fa tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.162483 Jun 17 15:44:38.933768 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1375/3165] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:44:38 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:44:39.511628 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-760c65e3-fa59-4331-b73f-8d396d5bab56 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:39.512238 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-760c65e3-fa59-4331-b73f-8d396d5bab56 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:39.518280 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-760c65e3-fa59-4331-b73f-8d396d5bab56 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:39.518765 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-760c65e3-fa59-4331-b73f-8d396d5bab56 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:39.519519 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-760c65e3-fa59-4331-b73f-8d396d5bab56 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:39.519950 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-760c65e3-fa59-4331-b73f-8d396d5bab56 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:39.579297 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-760c65e3-fa59-4331-b73f-8d396d5bab56 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:39.587099 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-760c65e3-fa59-4331-b73f-8d396d5bab56 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.079941 Jun 17 15:44:39.587659 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1791/3166] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:44:39 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:44:39.776388 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-5b24b5fb-4040-4807-922e-65876821c901 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:39.777077 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-5b24b5fb-4040-4807-922e-65876821c901 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:39.783448 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5b24b5fb-4040-4807-922e-65876821c901 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:39.783898 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5b24b5fb-4040-4807-922e-65876821c901 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:39.784672 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5b24b5fb-4040-4807-922e-65876821c901 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:39.785107 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5b24b5fb-4040-4807-922e-65876821c901 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:39.846208 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-5b24b5fb-4040-4807-922e-65876821c901 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:39.856742 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-5b24b5fb-4040-4807-922e-65876821c901 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:39.858242 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-5b24b5fb-4040-4807-922e-65876821c901 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:39.859372 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-5b24b5fb-4040-4807-922e-65876821c901 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.086991 Jun 17 15:44:39.859955 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1376/3167] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:44:39 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:44:39.950557 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-82b364fd-92b4-44d6-9158-8474273eeced tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:39.951175 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-82b364fd-92b4-44d6-9158-8474273eeced tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:39.957937 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-82b364fd-92b4-44d6-9158-8474273eeced tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:39.958390 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-82b364fd-92b4-44d6-9158-8474273eeced tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:39.959188 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-82b364fd-92b4-44d6-9158-8474273eeced tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:39.959619 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-82b364fd-92b4-44d6-9158-8474273eeced tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:40.178650 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-82b364fd-92b4-44d6-9158-8474273eeced tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:40.186671 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-82b364fd-92b4-44d6-9158-8474273eeced tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.239987 Jun 17 15:44:40.187248 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1792/3168] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:44:39 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:44:40.603361 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-100bd7a9-8a81-40fb-b354-f889eea501f4 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:40.603969 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-100bd7a9-8a81-40fb-b354-f889eea501f4 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:40.610082 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-100bd7a9-8a81-40fb-b354-f889eea501f4 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:40.610528 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-100bd7a9-8a81-40fb-b354-f889eea501f4 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:40.611281 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-100bd7a9-8a81-40fb-b354-f889eea501f4 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:40.611720 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-100bd7a9-8a81-40fb-b354-f889eea501f4 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:40.677606 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-100bd7a9-8a81-40fb-b354-f889eea501f4 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:40.685540 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-100bd7a9-8a81-40fb-b354-f889eea501f4 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.086349 Jun 17 15:44:40.686101 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1377/3169] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:44:40 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:44:40.877392 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-b13fc2fb-771a-42f7-99fd-27d88294008f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:40.877917 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-b13fc2fb-771a-42f7-99fd-27d88294008f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:40.883977 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b13fc2fb-771a-42f7-99fd-27d88294008f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:40.884471 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b13fc2fb-771a-42f7-99fd-27d88294008f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:40.885257 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b13fc2fb-771a-42f7-99fd-27d88294008f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:40.886264 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b13fc2fb-771a-42f7-99fd-27d88294008f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:40.946777 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-b13fc2fb-771a-42f7-99fd-27d88294008f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:40.956443 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-b13fc2fb-771a-42f7-99fd-27d88294008f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:40.957937 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-b13fc2fb-771a-42f7-99fd-27d88294008f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:40.959060 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-b13fc2fb-771a-42f7-99fd-27d88294008f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.085722 Jun 17 15:44:40.959606 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1793/3170] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:44:40 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:44:41.203809 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-8073f4ed-4f9a-4c9a-b200-26f0b08d3cab tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:41.204484 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-8073f4ed-4f9a-4c9a-b200-26f0b08d3cab tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:41.210827 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8073f4ed-4f9a-4c9a-b200-26f0b08d3cab tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:41.211270 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8073f4ed-4f9a-4c9a-b200-26f0b08d3cab tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:41.212014 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8073f4ed-4f9a-4c9a-b200-26f0b08d3cab tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:41.212469 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8073f4ed-4f9a-4c9a-b200-26f0b08d3cab tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:41.341056 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-8073f4ed-4f9a-4c9a-b200-26f0b08d3cab tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:41.349876 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-8073f4ed-4f9a-4c9a-b200-26f0b08d3cab tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.149829 Jun 17 15:44:41.350466 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1378/3171] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:44:41 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:44:41.702492 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-b975fe81-f31e-4572-bfbf-926fbef61fd7 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:41.703104 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-b975fe81-f31e-4572-bfbf-926fbef61fd7 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:41.709185 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b975fe81-f31e-4572-bfbf-926fbef61fd7 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:41.709628 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b975fe81-f31e-4572-bfbf-926fbef61fd7 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:41.710380 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b975fe81-f31e-4572-bfbf-926fbef61fd7 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:41.710842 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b975fe81-f31e-4572-bfbf-926fbef61fd7 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:41.773577 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-b975fe81-f31e-4572-bfbf-926fbef61fd7 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:41.786875 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-b975fe81-f31e-4572-bfbf-926fbef61fd7 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.088380 Jun 17 15:44:41.787455 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1794/3172] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:44:41 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:44:41.977549 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-6f0c25e3-ca56-45cf-be9b-701f20af211d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:41.978099 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-6f0c25e3-ca56-45cf-be9b-701f20af211d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:41.984251 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6f0c25e3-ca56-45cf-be9b-701f20af211d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:41.984728 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6f0c25e3-ca56-45cf-be9b-701f20af211d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:41.985617 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6f0c25e3-ca56-45cf-be9b-701f20af211d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:41.986081 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6f0c25e3-ca56-45cf-be9b-701f20af211d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:42.053164 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-6f0c25e3-ca56-45cf-be9b-701f20af211d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:42.061804 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-6f0c25e3-ca56-45cf-be9b-701f20af211d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:42.063304 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-6f0c25e3-ca56-45cf-be9b-701f20af211d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:42.064470 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-6f0c25e3-ca56-45cf-be9b-701f20af211d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.091133 Jun 17 15:44:42.065024 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1379/3173] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:44:41 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:44:42.368509 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-8e12743e-29a2-4327-8b02-0e0d64c6a8ff tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:42.369442 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-8e12743e-29a2-4327-8b02-0e0d64c6a8ff tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:42.376838 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8e12743e-29a2-4327-8b02-0e0d64c6a8ff tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:42.377282 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8e12743e-29a2-4327-8b02-0e0d64c6a8ff tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:42.378072 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8e12743e-29a2-4327-8b02-0e0d64c6a8ff tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:42.378501 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8e12743e-29a2-4327-8b02-0e0d64c6a8ff tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:42.518569 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-8e12743e-29a2-4327-8b02-0e0d64c6a8ff tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:42.526791 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-8e12743e-29a2-4327-8b02-0e0d64c6a8ff tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.162156 Jun 17 15:44:42.527360 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1795/3174] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:44:42 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:44:42.804870 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-cf486a9e-cf5f-42a0-97f3-d1aa87cab207 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:42.805420 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-cf486a9e-cf5f-42a0-97f3-d1aa87cab207 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:42.813195 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cf486a9e-cf5f-42a0-97f3-d1aa87cab207 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:42.813652 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cf486a9e-cf5f-42a0-97f3-d1aa87cab207 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:42.814582 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cf486a9e-cf5f-42a0-97f3-d1aa87cab207 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:42.815023 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cf486a9e-cf5f-42a0-97f3-d1aa87cab207 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:42.883995 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-cf486a9e-cf5f-42a0-97f3-d1aa87cab207 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:42.892274 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-cf486a9e-cf5f-42a0-97f3-d1aa87cab207 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.091418 Jun 17 15:44:42.892887 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1380/3175] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:44:42 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:44:43.083192 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-199b2d12-08a6-4dc4-8972-e9519c64f8d4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:43.083801 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-199b2d12-08a6-4dc4-8972-e9519c64f8d4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:43.090487 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-199b2d12-08a6-4dc4-8972-e9519c64f8d4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:43.090934 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-199b2d12-08a6-4dc4-8972-e9519c64f8d4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:43.091695 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-199b2d12-08a6-4dc4-8972-e9519c64f8d4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:43.092127 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-199b2d12-08a6-4dc4-8972-e9519c64f8d4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:43.155288 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-199b2d12-08a6-4dc4-8972-e9519c64f8d4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:43.165555 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-199b2d12-08a6-4dc4-8972-e9519c64f8d4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:43.167594 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-199b2d12-08a6-4dc4-8972-e9519c64f8d4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:43.168795 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-199b2d12-08a6-4dc4-8972-e9519c64f8d4 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.089544 Jun 17 15:44:43.169340 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1796/3176] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:44:43 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:44:43.544415 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-7de284c5-88a6-41ad-9ebf-d40acd0f5120 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:43.545031 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-7de284c5-88a6-41ad-9ebf-d40acd0f5120 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:43.551415 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7de284c5-88a6-41ad-9ebf-d40acd0f5120 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:43.551859 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7de284c5-88a6-41ad-9ebf-d40acd0f5120 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:43.552648 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7de284c5-88a6-41ad-9ebf-d40acd0f5120 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:43.553080 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7de284c5-88a6-41ad-9ebf-d40acd0f5120 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:43.685582 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-7de284c5-88a6-41ad-9ebf-d40acd0f5120 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:43.693803 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-7de284c5-88a6-41ad-9ebf-d40acd0f5120 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.153286 Jun 17 15:44:43.694369 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1381/3177] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:44:43 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:44:43.909523 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-086ae7b3-d6ad-4a64-9996-adbec7bcaad6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:43.910101 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-086ae7b3-d6ad-4a64-9996-adbec7bcaad6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:43.916446 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-086ae7b3-d6ad-4a64-9996-adbec7bcaad6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:43.916885 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-086ae7b3-d6ad-4a64-9996-adbec7bcaad6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:43.917637 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-086ae7b3-d6ad-4a64-9996-adbec7bcaad6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:43.918106 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-086ae7b3-d6ad-4a64-9996-adbec7bcaad6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:43.979906 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-086ae7b3-d6ad-4a64-9996-adbec7bcaad6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:43.987870 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-086ae7b3-d6ad-4a64-9996-adbec7bcaad6 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.082356 Jun 17 15:44:43.988453 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1797/3178] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:44:43 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:44:44.187502 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-b4124041-31eb-4055-a97b-cec836f5c036 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:44.188137 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-b4124041-31eb-4055-a97b-cec836f5c036 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:44.194608 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b4124041-31eb-4055-a97b-cec836f5c036 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:44.195055 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b4124041-31eb-4055-a97b-cec836f5c036 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:44.195804 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b4124041-31eb-4055-a97b-cec836f5c036 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:44.196243 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b4124041-31eb-4055-a97b-cec836f5c036 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:44.257434 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-b4124041-31eb-4055-a97b-cec836f5c036 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:44.266063 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-b4124041-31eb-4055-a97b-cec836f5c036 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:44.267562 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-b4124041-31eb-4055-a97b-cec836f5c036 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:44.268746 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-b4124041-31eb-4055-a97b-cec836f5c036 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.085190 Jun 17 15:44:44.269301 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1382/3179] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:44:44 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:44:44.710970 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-16941367-e4a8-4baf-9a20-6441b9ca672b tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:44.711576 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-16941367-e4a8-4baf-9a20-6441b9ca672b tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:44.718174 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-16941367-e4a8-4baf-9a20-6441b9ca672b tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:44.718612 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-16941367-e4a8-4baf-9a20-6441b9ca672b tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:44.719354 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-16941367-e4a8-4baf-9a20-6441b9ca672b tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:44.719781 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-16941367-e4a8-4baf-9a20-6441b9ca672b tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:44.849470 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-16941367-e4a8-4baf-9a20-6441b9ca672b tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:44.852017 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=100 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:44:44.859627 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-16941367-e4a8-4baf-9a20-6441b9ca672b tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.152444 Jun 17 15:44:44.860203 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1798/3180] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:44:44 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:44:45.005314 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-3a2a17dc-9577-43ba-adbc-83fa86333cf3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:45.005833 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-3a2a17dc-9577-43ba-adbc-83fa86333cf3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:45.012221 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3a2a17dc-9577-43ba-adbc-83fa86333cf3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:45.012698 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3a2a17dc-9577-43ba-adbc-83fa86333cf3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:45.013447 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3a2a17dc-9577-43ba-adbc-83fa86333cf3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:45.013875 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3a2a17dc-9577-43ba-adbc-83fa86333cf3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:45.077047 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-3a2a17dc-9577-43ba-adbc-83fa86333cf3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:45.085060 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-3a2a17dc-9577-43ba-adbc-83fa86333cf3 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.083813 Jun 17 15:44:45.085628 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1383/3181] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:44:45 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:44:45.286758 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-45ae3234-b162-4d07-8016-d2c284cab270 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:45.287356 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-45ae3234-b162-4d07-8016-d2c284cab270 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:45.294066 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-45ae3234-b162-4d07-8016-d2c284cab270 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:45.294494 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-45ae3234-b162-4d07-8016-d2c284cab270 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:45.295259 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-45ae3234-b162-4d07-8016-d2c284cab270 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:45.295692 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-45ae3234-b162-4d07-8016-d2c284cab270 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:45.359162 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-45ae3234-b162-4d07-8016-d2c284cab270 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:45.367749 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-45ae3234-b162-4d07-8016-d2c284cab270 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:45.369262 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-45ae3234-b162-4d07-8016-d2c284cab270 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:45.370407 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-45ae3234-b162-4d07-8016-d2c284cab270 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.087756 Jun 17 15:44:45.370960 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1799/3182] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:44:45 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:44:45.877217 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-ca3aa0ad-ead4-4864-b03a-64ad72c47b97 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:45.877828 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-ca3aa0ad-ead4-4864-b03a-64ad72c47b97 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:45.884180 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ca3aa0ad-ead4-4864-b03a-64ad72c47b97 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:45.884658 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ca3aa0ad-ead4-4864-b03a-64ad72c47b97 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:45.885414 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ca3aa0ad-ead4-4864-b03a-64ad72c47b97 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:45.886450 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ca3aa0ad-ead4-4864-b03a-64ad72c47b97 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:46.051298 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-ca3aa0ad-ead4-4864-b03a-64ad72c47b97 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:46.060716 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-ca3aa0ad-ead4-4864-b03a-64ad72c47b97 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.187266 Jun 17 15:44:46.061317 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1384/3183] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:44:45 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:44:46.103006 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-5c7de2dc-ba50-44e4-af55-1acfc6e71b1e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:46.103669 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-5c7de2dc-ba50-44e4-af55-1acfc6e71b1e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:46.110532 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5c7de2dc-ba50-44e4-af55-1acfc6e71b1e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:46.110968 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5c7de2dc-ba50-44e4-af55-1acfc6e71b1e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:46.111743 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5c7de2dc-ba50-44e4-af55-1acfc6e71b1e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:46.112167 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5c7de2dc-ba50-44e4-af55-1acfc6e71b1e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:46.174570 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-5c7de2dc-ba50-44e4-af55-1acfc6e71b1e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:46.183257 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-5c7de2dc-ba50-44e4-af55-1acfc6e71b1e tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.083974 Jun 17 15:44:46.183831 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1800/3184] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:44:46 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:44:46.389492 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-7ba711d9-879a-4176-a880-1bbf81365990 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:46.390108 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-7ba711d9-879a-4176-a880-1bbf81365990 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:46.396261 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7ba711d9-879a-4176-a880-1bbf81365990 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:46.396748 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7ba711d9-879a-4176-a880-1bbf81365990 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:46.397516 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7ba711d9-879a-4176-a880-1bbf81365990 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:46.397958 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7ba711d9-879a-4176-a880-1bbf81365990 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:46.400595 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell1:SELECT=100 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:44:46.466336 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-7ba711d9-879a-4176-a880-1bbf81365990 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:46.478034 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-7ba711d9-879a-4176-a880-1bbf81365990 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:46.479539 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-7ba711d9-879a-4176-a880-1bbf81365990 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:46.480864 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-7ba711d9-879a-4176-a880-1bbf81365990 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.095738 Jun 17 15:44:46.481437 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1385/3185] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:44:46 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:44:47.078098 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-e581c281-6647-4306-adfe-1b9f0f018858 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:47.078792 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-e581c281-6647-4306-adfe-1b9f0f018858 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:47.085255 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e581c281-6647-4306-adfe-1b9f0f018858 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:47.085699 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e581c281-6647-4306-adfe-1b9f0f018858 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:47.086452 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e581c281-6647-4306-adfe-1b9f0f018858 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:47.086880 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e581c281-6647-4306-adfe-1b9f0f018858 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:47.199993 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-66022a4d-9a5b-4d3a-a3c0-269ae12b7cd1 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:47.200641 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-66022a4d-9a5b-4d3a-a3c0-269ae12b7cd1 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:47.207052 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-66022a4d-9a5b-4d3a-a3c0-269ae12b7cd1 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:47.207494 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-66022a4d-9a5b-4d3a-a3c0-269ae12b7cd1 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:47.208261 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-66022a4d-9a5b-4d3a-a3c0-269ae12b7cd1 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:47.208732 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-66022a4d-9a5b-4d3a-a3c0-269ae12b7cd1 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:47.220845 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-e581c281-6647-4306-adfe-1b9f0f018858 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:47.229046 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-e581c281-6647-4306-adfe-1b9f0f018858 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.154812 Jun 17 15:44:47.230172 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1801/3186] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:44:47 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:44:47.271050 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-66022a4d-9a5b-4d3a-a3c0-269ae12b7cd1 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:47.279652 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-66022a4d-9a5b-4d3a-a3c0-269ae12b7cd1 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.083466 Jun 17 15:44:47.280221 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1386/3187] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:44:47 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:44:47.498783 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-f2a1cd0f-c373-48ca-96d4-c743576b2c9d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:47.499383 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-f2a1cd0f-c373-48ca-96d4-c743576b2c9d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:47.505408 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f2a1cd0f-c373-48ca-96d4-c743576b2c9d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:47.505849 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f2a1cd0f-c373-48ca-96d4-c743576b2c9d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:47.506592 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f2a1cd0f-c373-48ca-96d4-c743576b2c9d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:47.507019 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f2a1cd0f-c373-48ca-96d4-c743576b2c9d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:47.568830 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-f2a1cd0f-c373-48ca-96d4-c743576b2c9d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:47.578072 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-f2a1cd0f-c373-48ca-96d4-c743576b2c9d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:47.579563 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-f2a1cd0f-c373-48ca-96d4-c743576b2c9d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:47.580736 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-f2a1cd0f-c373-48ca-96d4-c743576b2c9d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.085917 Jun 17 15:44:47.581286 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1802/3188] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:44:47 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:44:48.248723 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-5772e9f2-a11d-4970-b0fa-aff6be2d9e5e tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:48.249682 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-5772e9f2-a11d-4970-b0fa-aff6be2d9e5e tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:48.259379 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5772e9f2-a11d-4970-b0fa-aff6be2d9e5e tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:48.260125 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5772e9f2-a11d-4970-b0fa-aff6be2d9e5e tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:48.261729 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5772e9f2-a11d-4970-b0fa-aff6be2d9e5e tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:48.262266 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5772e9f2-a11d-4970-b0fa-aff6be2d9e5e tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:48.298456 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-a4a93ba6-ff80-4b6b-b75e-226b473a6d25 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:48.299101 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-a4a93ba6-ff80-4b6b-b75e-226b473a6d25 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:48.306472 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a4a93ba6-ff80-4b6b-b75e-226b473a6d25 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:48.306947 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a4a93ba6-ff80-4b6b-b75e-226b473a6d25 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:48.308319 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a4a93ba6-ff80-4b6b-b75e-226b473a6d25 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:48.309026 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a4a93ba6-ff80-4b6b-b75e-226b473a6d25 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:48.374764 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-a4a93ba6-ff80-4b6b-b75e-226b473a6d25 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:48.382989 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-a4a93ba6-ff80-4b6b-b75e-226b473a6d25 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.089366 Jun 17 15:44:48.383570 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1803/3189] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:44:48 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:44:48.401758 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-5772e9f2-a11d-4970-b0fa-aff6be2d9e5e tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:48.409703 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-5772e9f2-a11d-4970-b0fa-aff6be2d9e5e tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.166546 Jun 17 15:44:48.410272 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1387/3190] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:44:48 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:44:48.599281 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-10ef270f-62a5-498d-abca-9891db004b8a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:48.599901 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-10ef270f-62a5-498d-abca-9891db004b8a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:48.607054 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-10ef270f-62a5-498d-abca-9891db004b8a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:48.607508 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-10ef270f-62a5-498d-abca-9891db004b8a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:48.608293 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-10ef270f-62a5-498d-abca-9891db004b8a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:48.608762 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-10ef270f-62a5-498d-abca-9891db004b8a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:48.679559 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-10ef270f-62a5-498d-abca-9891db004b8a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:48.688304 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-10ef270f-62a5-498d-abca-9891db004b8a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:48.689836 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-10ef270f-62a5-498d-abca-9891db004b8a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:48.690968 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-10ef270f-62a5-498d-abca-9891db004b8a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.095722 Jun 17 15:44:48.691523 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1804/3191] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:44:48 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:44:49.398955 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-ebcfc4d2-4901-4450-9c97-ae0bfefa3847 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:49.399571 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-ebcfc4d2-4901-4450-9c97-ae0bfefa3847 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:49.406082 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ebcfc4d2-4901-4450-9c97-ae0bfefa3847 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:49.406527 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ebcfc4d2-4901-4450-9c97-ae0bfefa3847 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:49.407269 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ebcfc4d2-4901-4450-9c97-ae0bfefa3847 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:49.407696 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ebcfc4d2-4901-4450-9c97-ae0bfefa3847 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:49.426814 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-a3555c0e-c32d-4475-a81d-4a2bd2a51fbb tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:49.427431 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-a3555c0e-c32d-4475-a81d-4a2bd2a51fbb tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:49.429719 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_api:SELECT=86 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:44:49.435709 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a3555c0e-c32d-4475-a81d-4a2bd2a51fbb tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:49.436145 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a3555c0e-c32d-4475-a81d-4a2bd2a51fbb tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:49.436937 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a3555c0e-c32d-4475-a81d-4a2bd2a51fbb tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:49.437366 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a3555c0e-c32d-4475-a81d-4a2bd2a51fbb tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:49.468441 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-ebcfc4d2-4901-4450-9c97-ae0bfefa3847 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:49.476635 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-ebcfc4d2-4901-4450-9c97-ae0bfefa3847 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.081229 Jun 17 15:44:49.477359 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1388/3192] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:44:49 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:44:49.568181 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-a3555c0e-c32d-4475-a81d-4a2bd2a51fbb tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:49.576912 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-a3555c0e-c32d-4475-a81d-4a2bd2a51fbb tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.153801 Jun 17 15:44:49.577486 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1805/3193] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:44:49 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:44:49.709340 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-207db7cc-0d50-48e4-ae2f-a39f033c3a35 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:49.709862 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-207db7cc-0d50-48e4-ae2f-a39f033c3a35 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:49.715812 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-207db7cc-0d50-48e4-ae2f-a39f033c3a35 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:49.716257 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-207db7cc-0d50-48e4-ae2f-a39f033c3a35 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:49.717042 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-207db7cc-0d50-48e4-ae2f-a39f033c3a35 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:49.717475 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-207db7cc-0d50-48e4-ae2f-a39f033c3a35 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:49.782025 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-207db7cc-0d50-48e4-ae2f-a39f033c3a35 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:49.790441 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-207db7cc-0d50-48e4-ae2f-a39f033c3a35 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:49.792504 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-207db7cc-0d50-48e4-ae2f-a39f033c3a35 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:49.793641 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-207db7cc-0d50-48e4-ae2f-a39f033c3a35 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.088301 Jun 17 15:44:49.794197 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1389/3194] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:44:49 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:44:50.493646 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-4390d4e9-e896-4cb9-8cae-54f6fc269981 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:50.494209 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-4390d4e9-e896-4cb9-8cae-54f6fc269981 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:50.500703 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4390d4e9-e896-4cb9-8cae-54f6fc269981 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:50.501145 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4390d4e9-e896-4cb9-8cae-54f6fc269981 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:50.501902 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4390d4e9-e896-4cb9-8cae-54f6fc269981 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:50.502333 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4390d4e9-e896-4cb9-8cae-54f6fc269981 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:50.566052 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-4390d4e9-e896-4cb9-8cae-54f6fc269981 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:50.575794 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-4390d4e9-e896-4cb9-8cae-54f6fc269981 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.086056 Jun 17 15:44:50.576441 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1806/3195] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:44:50 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:44:50.594655 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-2dd2c4e6-f3e5-459b-81cf-87c127bf3849 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:50.595337 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-2dd2c4e6-f3e5-459b-81cf-87c127bf3849 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:50.602340 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2dd2c4e6-f3e5-459b-81cf-87c127bf3849 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:50.602785 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2dd2c4e6-f3e5-459b-81cf-87c127bf3849 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:50.603553 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2dd2c4e6-f3e5-459b-81cf-87c127bf3849 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:50.603987 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2dd2c4e6-f3e5-459b-81cf-87c127bf3849 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:50.744576 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-2dd2c4e6-f3e5-459b-81cf-87c127bf3849 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:50.752774 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-2dd2c4e6-f3e5-459b-81cf-87c127bf3849 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.161890 Jun 17 15:44:50.753367 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1390/3196] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:44:50 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:44:50.811334 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-2be48ae1-7b61-4366-a306-a380ea8e79ca tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:50.811952 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-2be48ae1-7b61-4366-a306-a380ea8e79ca tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:50.818232 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2be48ae1-7b61-4366-a306-a380ea8e79ca tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:50.818676 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2be48ae1-7b61-4366-a306-a380ea8e79ca tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:50.819441 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2be48ae1-7b61-4366-a306-a380ea8e79ca tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:50.819868 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2be48ae1-7b61-4366-a306-a380ea8e79ca tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:50.886368 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-2be48ae1-7b61-4366-a306-a380ea8e79ca tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:50.896860 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-2be48ae1-7b61-4366-a306-a380ea8e79ca tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:50.898364 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-2be48ae1-7b61-4366-a306-a380ea8e79ca tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:50.899520 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-2be48ae1-7b61-4366-a306-a380ea8e79ca tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.092233 Jun 17 15:44:50.900068 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1807/3197] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:44:50 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:44:51.592792 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-077d0136-061f-461a-80b1-73f6e438b3b0 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:51.593392 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-077d0136-061f-461a-80b1-73f6e438b3b0 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:51.599927 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-077d0136-061f-461a-80b1-73f6e438b3b0 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:51.600571 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-077d0136-061f-461a-80b1-73f6e438b3b0 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:51.601136 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-077d0136-061f-461a-80b1-73f6e438b3b0 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:51.601816 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-077d0136-061f-461a-80b1-73f6e438b3b0 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:51.665286 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-077d0136-061f-461a-80b1-73f6e438b3b0 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:51.674016 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-077d0136-061f-461a-80b1-73f6e438b3b0 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.085011 Jun 17 15:44:51.674587 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1391/3198] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:44:51 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:44:51.770661 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-99114c2c-9e8c-496d-bfd5-4d0462f3279e tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:51.771272 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-99114c2c-9e8c-496d-bfd5-4d0462f3279e tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:51.778737 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-99114c2c-9e8c-496d-bfd5-4d0462f3279e tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:51.779187 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-99114c2c-9e8c-496d-bfd5-4d0462f3279e tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:51.779958 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-99114c2c-9e8c-496d-bfd5-4d0462f3279e tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:51.780431 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-99114c2c-9e8c-496d-bfd5-4d0462f3279e tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:51.915000 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-99114c2c-9e8c-496d-bfd5-4d0462f3279e tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:51.923936 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-99114c2c-9e8c-496d-bfd5-4d0462f3279e tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.157175 Jun 17 15:44:51.924744 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1808/3199] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:44:51 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:44:51.926528 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-01bd086d-763a-460a-906d-fe9bf4619a7e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:51.927140 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-01bd086d-763a-460a-906d-fe9bf4619a7e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:51.933248 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-01bd086d-763a-460a-906d-fe9bf4619a7e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:51.933695 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-01bd086d-763a-460a-906d-fe9bf4619a7e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:51.934482 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-01bd086d-763a-460a-906d-fe9bf4619a7e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:51.934924 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-01bd086d-763a-460a-906d-fe9bf4619a7e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:51.995751 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-01bd086d-763a-460a-906d-fe9bf4619a7e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:52.004106 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-01bd086d-763a-460a-906d-fe9bf4619a7e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:52.005618 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-01bd086d-763a-460a-906d-fe9bf4619a7e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:52.006773 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-01bd086d-763a-460a-906d-fe9bf4619a7e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.084375 Jun 17 15:44:52.007326 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1392/3200] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:44:51 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 15:44:52.691184 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-61c6a867-f249-4d49-8c26-9185ffd2a4fc tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:52.691708 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-61c6a867-f249-4d49-8c26-9185ffd2a4fc tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:52.701229 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-61c6a867-f249-4d49-8c26-9185ffd2a4fc tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:52.702316 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-61c6a867-f249-4d49-8c26-9185ffd2a4fc tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:52.702535 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-61c6a867-f249-4d49-8c26-9185ffd2a4fc tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:52.702866 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-61c6a867-f249-4d49-8c26-9185ffd2a4fc tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:52.765387 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-61c6a867-f249-4d49-8c26-9185ffd2a4fc tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:52.773767 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-61c6a867-f249-4d49-8c26-9185ffd2a4fc tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.086509 Jun 17 15:44:52.774459 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1809/3201] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:44:52 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:44:52.941101 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-eb04c8bc-ea5c-47a4-acb5-b94ea9d76a5d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:52.941744 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-eb04c8bc-ea5c-47a4-acb5-b94ea9d76a5d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:52.948808 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-eb04c8bc-ea5c-47a4-acb5-b94ea9d76a5d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:52.949249 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-eb04c8bc-ea5c-47a4-acb5-b94ea9d76a5d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:52.950010 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-eb04c8bc-ea5c-47a4-acb5-b94ea9d76a5d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:52.950441 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-eb04c8bc-ea5c-47a4-acb5-b94ea9d76a5d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:53.025386 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-58c03379-c1b6-41ed-915c-e303d124cf61 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:53.026035 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-58c03379-c1b6-41ed-915c-e303d124cf61 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:53.033135 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-58c03379-c1b6-41ed-915c-e303d124cf61 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:53.033583 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-58c03379-c1b6-41ed-915c-e303d124cf61 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:53.034349 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-58c03379-c1b6-41ed-915c-e303d124cf61 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:53.034775 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-58c03379-c1b6-41ed-915c-e303d124cf61 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:53.095481 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-eb04c8bc-ea5c-47a4-acb5-b94ea9d76a5d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:53.100804 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-58c03379-c1b6-41ed-915c-e303d124cf61 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:53.105523 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-eb04c8bc-ea5c-47a4-acb5-b94ea9d76a5d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.168114 Jun 17 15:44:53.106347 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1393/3202] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:44:52 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:44:53.112915 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-58c03379-c1b6-41ed-915c-e303d124cf61 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:53.114458 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-58c03379-c1b6-41ed-915c-e303d124cf61 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:53.115778 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-58c03379-c1b6-41ed-915c-e303d124cf61 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.094271 Jun 17 15:44:53.116366 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1810/3203] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:44:53 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 15:44:53.791218 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-78889f2c-a9ca-43c9-a557-f974cb092c36 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:53.791766 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-78889f2c-a9ca-43c9-a557-f974cb092c36 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:53.793918 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_api:SELECT=78 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:44:53.799330 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-78889f2c-a9ca-43c9-a557-f974cb092c36 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:53.799774 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-78889f2c-a9ca-43c9-a557-f974cb092c36 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:53.800563 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-78889f2c-a9ca-43c9-a557-f974cb092c36 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:53.800996 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-78889f2c-a9ca-43c9-a557-f974cb092c36 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:53.864965 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-78889f2c-a9ca-43c9-a557-f974cb092c36 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:53.873357 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-78889f2c-a9ca-43c9-a557-f974cb092c36 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.086126 Jun 17 15:44:53.873930 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1394/3204] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:44:53 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:44:54.125385 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-d2a6f8ce-55d1-4bea-8564-791bf36c991b tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:54.125978 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-d2a6f8ce-55d1-4bea-8564-791bf36c991b tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:54.132752 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d2a6f8ce-55d1-4bea-8564-791bf36c991b tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:54.133195 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d2a6f8ce-55d1-4bea-8564-791bf36c991b tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:54.133545 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-6f0b1263-bee4-4930-9d31-520f2bfdbeba tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:54.133986 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d2a6f8ce-55d1-4bea-8564-791bf36c991b tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:54.134154 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-6f0b1263-bee4-4930-9d31-520f2bfdbeba tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:54.134370 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d2a6f8ce-55d1-4bea-8564-791bf36c991b tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:54.141226 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6f0b1263-bee4-4930-9d31-520f2bfdbeba tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:54.141667 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6f0b1263-bee4-4930-9d31-520f2bfdbeba tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:54.142415 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6f0b1263-bee4-4930-9d31-520f2bfdbeba tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:54.142851 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6f0b1263-bee4-4930-9d31-520f2bfdbeba tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:54.204369 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-6f0b1263-bee4-4930-9d31-520f2bfdbeba tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:54.212783 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-6f0b1263-bee4-4930-9d31-520f2bfdbeba tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:54.214314 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-6f0b1263-bee4-4930-9d31-520f2bfdbeba tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:54.215482 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-6f0b1263-bee4-4930-9d31-520f2bfdbeba tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.085778 Jun 17 15:44:54.216376 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1395/3205] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:44:54 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 15:44:54.271094 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-d2a6f8ce-55d1-4bea-8564-791bf36c991b tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:54.282399 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-d2a6f8ce-55d1-4bea-8564-791bf36c991b tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.160787 Jun 17 15:44:54.282974 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1811/3206] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:44:54 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:44:54.890650 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-5a7f69c9-23f4-4d6f-8c3d-b8ffca558532 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:54.891261 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-5a7f69c9-23f4-4d6f-8c3d-b8ffca558532 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:54.897515 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5a7f69c9-23f4-4d6f-8c3d-b8ffca558532 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:54.897965 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5a7f69c9-23f4-4d6f-8c3d-b8ffca558532 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:54.898723 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5a7f69c9-23f4-4d6f-8c3d-b8ffca558532 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:54.899160 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5a7f69c9-23f4-4d6f-8c3d-b8ffca558532 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:54.961922 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-5a7f69c9-23f4-4d6f-8c3d-b8ffca558532 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:54.970467 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-5a7f69c9-23f4-4d6f-8c3d-b8ffca558532 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.083657 Jun 17 15:44:54.971042 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1396/3207] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:44:54 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:44:55.234237 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-52637a50-fac3-41e9-a2b4-7b5923a554c3 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:55.234799 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-52637a50-fac3-41e9-a2b4-7b5923a554c3 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:55.241267 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-52637a50-fac3-41e9-a2b4-7b5923a554c3 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:55.241731 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-52637a50-fac3-41e9-a2b4-7b5923a554c3 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:55.242479 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-52637a50-fac3-41e9-a2b4-7b5923a554c3 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:55.242917 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-52637a50-fac3-41e9-a2b4-7b5923a554c3 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:55.300094 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-04b9852b-1b28-4279-92a1-0cb632dc066d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:55.300759 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-04b9852b-1b28-4279-92a1-0cb632dc066d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 808f28e6-03bc-4b67-ab1f-f1ef13838924] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:55.307393 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-04b9852b-1b28-4279-92a1-0cb632dc066d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:55.307630 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-52637a50-fac3-41e9-a2b4-7b5923a554c3 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:55.307850 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-04b9852b-1b28-4279-92a1-0cb632dc066d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:55.308773 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-04b9852b-1b28-4279-92a1-0cb632dc066d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:55.309212 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-04b9852b-1b28-4279-92a1-0cb632dc066d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:55.316672 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-52637a50-fac3-41e9-a2b4-7b5923a554c3 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:55.318043 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-52637a50-fac3-41e9-a2b4-7b5923a554c3 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:55.319189 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-52637a50-fac3-41e9-a2b4-7b5923a554c3 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 200 len: 1443 microversion: 2.20 time: 0.088994 Jun 17 15:44:55.319743 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1812/3208] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:44:55 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:44:55.339172 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-0feb957c-4268-46c1-9701-e376d4a27c85 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '.version_select at 0x7faf54c70ca0>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:55.388412 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-0feb957c-4268-46c1-9701-e376d4a27c85 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-238480590" status: 204 len: 0 microversion: 2.20 time: 0.053552 Jun 17 15:44:55.393935 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1813/3209] 10.222.0.48 () {60 vars in 1258 bytes} [Fri Jun 17 15:44:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-238480590 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 17 15:44:55.508109 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-04b9852b-1b28-4279-92a1-0cb632dc066d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:55.517117 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-04b9852b-1b28-4279-92a1-0cb632dc066d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924" status: 200 len: 1560 microversion: 2.1 time: 0.220880 Jun 17 15:44:55.517701 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1397/3210] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:44:55 2022] GET /compute/v2.1/servers/808f28e6-03bc-4b67-ab1f-f1ef13838924 => generated 1560 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:44:55.992777 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-3da59345-b62e-4ba2-a709-c084b3d490c2 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:55.994217 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-3da59345-b62e-4ba2-a709-c084b3d490c2 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] [instance: 91408900-da01-4985-b392-111577935284] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:56.006610 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3da59345-b62e-4ba2-a709-c084b3d490c2 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:56.007320 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3da59345-b62e-4ba2-a709-c084b3d490c2 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:56.008762 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3da59345-b62e-4ba2-a709-c084b3d490c2 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:56.009568 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3da59345-b62e-4ba2-a709-c084b3d490c2 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:56.084209 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-3da59345-b62e-4ba2-a709-c084b3d490c2 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd3f00536bf479ab15bb968985ea32a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77979ae6c7c440fab7bbce5fbe452210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:56.092658 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-3da59345-b62e-4ba2-a709-c084b3d490c2 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284" status: 200 len: 1389 microversion: 2.1 time: 0.108254 Jun 17 15:44:56.093252 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1814/3211] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:44:55 2022] GET /compute/v2.1/servers/91408900-da01-4985-b392-111577935284 => generated 1389 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:44:56.110004 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-b3973487-236e-44a7-b363-0250cb728919 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] Calling method '.version_select at 0x7faf54c74700>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:56.133785 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-b3973487-236e-44a7-b363-0250cb728919 tempest-TestMinimumBasicScenario-188271543 tempest-TestMinimumBasicScenario-188271543-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1719715338" status: 202 len: 0 microversion: 2.1 time: 0.027770 Jun 17 15:44:56.134698 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1398/3212] 10.222.0.48 () {58 vars in 1271 bytes} [Fri Jun 17 15:44:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1719715338 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 15:44:56.285340 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-dcdbcfe7-d2ce-4cfd-b7ea-58130f8de883 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Action: 'create', calling method: .version_select at 0x7faf5018b160>, body: {"keypair": {"name": "tempest-keypair-1042959900", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE/xYuKHHzDuxRcjleqPfZdtq6nuioTeFTUPTWuIzOsr4viwajevZFk3Eea2D5crm51S0qRKh49nBzslRTRQmQCbe7ZMPMWpjpXy8zrB47KoAv9r08sFbpyyp6m2/31sgA=="}} {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:44:56.311630 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.quota [None req-dcdbcfe7-d2ce-4cfd-b7ea-58130f8de883 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Getting quotas for project 0c87a857ab3949459349d3528ed05775. Resources: {'key_pairs'} {{(pid=117650) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 15:44:56.318922 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.quota [None req-dcdbcfe7-d2ce-4cfd-b7ea-58130f8de883 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Getting quotas for user 9aaf800af45049739ed8f27979e90a9e and project 0c87a857ab3949459349d3528ed05775. Resources: {'key_pairs'} {{(pid=117650) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 15:44:56.353599 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-dcdbcfe7-d2ce-4cfd-b7ea-58130f8de883 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.074891 Jun 17 15:44:56.354682 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1815/3213] 10.222.0.48 () {62 vars in 1199 bytes} [Fri Jun 17 15:44:56 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 77 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 17 15:44:58.033340 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-4ef7158f-a164-4148-a3f0-54da45e5ecb8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-181911516", "imageRef": "8c105ca4-6fe3-4e70-af71-b03c64fe1efe", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9464a8d4-29ca-4ca6-886d-c4dd585ea876"}], "security_groups": [{"name": "tempest-securitygroup--340018338"}], "key_name": "tempest-keypair-1042959900", "user_data": "}} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:44:58.195872 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.network.neutron [None req-4ef7158f-a164-4148-a3f0-54da45e5ecb8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] validate_networks() for [('9464a8d4-29ca-4ca6-886d-c4dd585ea876', None, None, None, None, None)] {{(pid=117649) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 15:44:58.797184 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 15:44:58.797592 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Fri Jun 17 15:44:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.48) !!! Jun 17 15:44:58.982875 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-4ef7158f-a164-4148-a3f0-54da45e5ecb8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Flavor limits 0:0:0 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 15:44:58.983307 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-4ef7158f-a164-4148-a3f0-54da45e5ecb8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Image limits 0:0:0 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 15:44:58.983832 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-4ef7158f-a164-4148-a3f0-54da45e5ecb8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Flavor pref 0:0:0 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 15:44:58.984451 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-4ef7158f-a164-4148-a3f0-54da45e5ecb8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Image pref 0:0:0 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 15:44:58.984920 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-4ef7158f-a164-4148-a3f0-54da45e5ecb8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 15:44:58.996155 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4ef7158f-a164-4148-a3f0-54da45e5ecb8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:58.997140 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4ef7158f-a164-4148-a3f0-54da45e5ecb8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:58.998296 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4ef7158f-a164-4148-a3f0-54da45e5ecb8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:58.998981 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4ef7158f-a164-4148-a3f0-54da45e5ecb8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:59.004826 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-43a3ec1a-5525-47c7-b508-bfb2f965e632 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:59.005406 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-43a3ec1a-5525-47c7-b508-bfb2f965e632 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:59.013728 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-43a3ec1a-5525-47c7-b508-bfb2f965e632 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:59.014187 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-43a3ec1a-5525-47c7-b508-bfb2f965e632 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:59.014985 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-43a3ec1a-5525-47c7-b508-bfb2f965e632 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:59.015485 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-43a3ec1a-5525-47c7-b508-bfb2f965e632 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:59.021900 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.quota [None req-4ef7158f-a164-4148-a3f0-54da45e5ecb8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Getting quotas for project 0c87a857ab3949459349d3528ed05775. Resources: {'cores', 'ram', 'instances'} {{(pid=117649) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 15:44:59.027394 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.quota [None req-4ef7158f-a164-4148-a3f0-54da45e5ecb8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Getting quotas for user 9aaf800af45049739ed8f27979e90a9e and project 0c87a857ab3949459349d3528ed05775. Resources: {'cores', 'ram', 'instances'} {{(pid=117649) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 15:44:59.041288 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-4ef7158f-a164-4148-a3f0-54da45e5ecb8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Going to run 1 instances... {{(pid=117649) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 15:44:59.043978 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-4ef7158f-a164-4148-a3f0-54da45e5ecb8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: 031f230c-48e6-46bb-a549-3cb347946170] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c105ca4-6fe3-4e70-af71-b03c64fe1efe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117649) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 15:44:59.044393 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-43a3ec1a-5525-47c7-b508-bfb2f965e632 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Going to try to terminate instance {{(pid=117650) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 15:44:59.079669 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=100 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:44:59.099392 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-4ef7158f-a164-4148-a3f0-54da45e5ecb8 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.072137 Jun 17 15:44:59.100540 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1399/3214] 10.222.0.48 () {62 vars in 1187 bytes} [Fri Jun 17 15:44:58 2022] POST /compute/v2.1/servers => generated 401 bytes in 1075 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 17 15:44:59.114561 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-8fd2edf3-8d34-4654-82ef-8ce2ee6d34c7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:59.115981 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-8fd2edf3-8d34-4654-82ef-8ce2ee6d34c7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: 031f230c-48e6-46bb-a549-3cb347946170] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:59.171062 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-43a3ec1a-5525-47c7-b508-bfb2f965e632 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "DELETE /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 204 len: 0 microversion: 2.1 time: 0.171054 Jun 17 15:44:59.172079 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1816/3215] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jun 17 15:44:58 2022] DELETE /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 15:44:59.185134 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-0285bc82-9f22-4f41-bf23-edc6c4ced1d6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:44:59.186088 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-0285bc82-9f22-4f41-bf23-edc6c4ced1d6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:44:59.201643 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0285bc82-9f22-4f41-bf23-edc6c4ced1d6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:59.204599 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0285bc82-9f22-4f41-bf23-edc6c4ced1d6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:59.205663 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0285bc82-9f22-4f41-bf23-edc6c4ced1d6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:44:59.206111 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0285bc82-9f22-4f41-bf23-edc6c4ced1d6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:44:59.341954 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-8fd2edf3-8d34-4654-82ef-8ce2ee6d34c7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:59.355999 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-8fd2edf3-8d34-4654-82ef-8ce2ee6d34c7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:59.360654 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-8fd2edf3-8d34-4654-82ef-8ce2ee6d34c7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:59.362334 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-8fd2edf3-8d34-4654-82ef-8ce2ee6d34c7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170" status: 200 len: 1281 microversion: 2.20 time: 0.252348 Jun 17 15:44:59.363682 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1400/3216] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:44:59 2022] GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170 => generated 1281 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:44:59.432949 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-0285bc82-9f22-4f41-bf23-edc6c4ced1d6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:44:59.441247 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-0285bc82-9f22-4f41-bf23-edc6c4ced1d6 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1732 microversion: 2.1 time: 0.263077 Jun 17 15:44:59.442545 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1817/3217] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:44:59 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1732 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:45:00.382000 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-c7f09184-e770-4243-a1d2-8aad2e455a7a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:45:00.382725 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-c7f09184-e770-4243-a1d2-8aad2e455a7a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: 031f230c-48e6-46bb-a549-3cb347946170] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:45:00.390424 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c7f09184-e770-4243-a1d2-8aad2e455a7a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:00.391160 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c7f09184-e770-4243-a1d2-8aad2e455a7a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:00.392182 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c7f09184-e770-4243-a1d2-8aad2e455a7a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:00.392935 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c7f09184-e770-4243-a1d2-8aad2e455a7a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:00.459659 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-38f31c68-7ed9-4bd7-a4fb-6c15629c6d1f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:45:00.460289 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-38f31c68-7ed9-4bd7-a4fb-6c15629c6d1f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:45:00.473178 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-38f31c68-7ed9-4bd7-a4fb-6c15629c6d1f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:00.473635 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-38f31c68-7ed9-4bd7-a4fb-6c15629c6d1f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:00.474437 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-38f31c68-7ed9-4bd7-a4fb-6c15629c6d1f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:00.474881 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-38f31c68-7ed9-4bd7-a4fb-6c15629c6d1f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:00.569297 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-c7f09184-e770-4243-a1d2-8aad2e455a7a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:45:00.579127 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-c7f09184-e770-4243-a1d2-8aad2e455a7a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:45:00.583806 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-c7f09184-e770-4243-a1d2-8aad2e455a7a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:45:00.585471 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-c7f09184-e770-4243-a1d2-8aad2e455a7a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170" status: 200 len: 1351 microversion: 2.20 time: 0.207290 Jun 17 15:45:00.586613 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1401/3218] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:45:00 2022] GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170 => generated 1351 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 15:45:00.758084 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-38f31c68-7ed9-4bd7-a4fb-6c15629c6d1f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:45:00.771753 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-38f31c68-7ed9-4bd7-a4fb-6c15629c6d1f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1732 microversion: 2.1 time: 0.315834 Jun 17 15:45:00.772883 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1818/3219] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:45:00 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1732 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:45:01.609176 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-bcbe6d69-8f72-472f-b236-661170341244 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:45:01.610449 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-bcbe6d69-8f72-472f-b236-661170341244 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: 031f230c-48e6-46bb-a549-3cb347946170] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:45:01.617514 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bcbe6d69-8f72-472f-b236-661170341244 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:01.617966 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bcbe6d69-8f72-472f-b236-661170341244 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:01.618739 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bcbe6d69-8f72-472f-b236-661170341244 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:01.619181 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bcbe6d69-8f72-472f-b236-661170341244 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:01.782933 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-bcbe6d69-8f72-472f-b236-661170341244 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:45:01.791070 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-e2203b9b-5f57-4d41-86d0-75edb4053156 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:45:01.791893 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-e2203b9b-5f57-4d41-86d0-75edb4053156 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:45:01.801326 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-bcbe6d69-8f72-472f-b236-661170341244 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:45:01.803533 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-bcbe6d69-8f72-472f-b236-661170341244 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:45:01.804899 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e2203b9b-5f57-4d41-86d0-75edb4053156 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:01.805326 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-bcbe6d69-8f72-472f-b236-661170341244 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170" status: 200 len: 1406 microversion: 2.20 time: 0.201383 Jun 17 15:45:01.806127 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1402/3220] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:45:01 2022] GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170 => generated 1406 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:45:01.815305 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e2203b9b-5f57-4d41-86d0-75edb4053156 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:01.816826 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e2203b9b-5f57-4d41-86d0-75edb4053156 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:01.817970 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e2203b9b-5f57-4d41-86d0-75edb4053156 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:02.193993 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-e2203b9b-5f57-4d41-86d0-75edb4053156 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:45:02.202872 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-e2203b9b-5f57-4d41-86d0-75edb4053156 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1732 microversion: 2.1 time: 0.416040 Jun 17 15:45:02.203763 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1819/3221] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:45:01 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1732 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:45:02.824856 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-72d27195-1572-4978-96eb-12bc3dd1f162 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:45:02.826090 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-72d27195-1572-4978-96eb-12bc3dd1f162 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: 031f230c-48e6-46bb-a549-3cb347946170] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:45:02.833984 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-72d27195-1572-4978-96eb-12bc3dd1f162 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:02.834439 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-72d27195-1572-4978-96eb-12bc3dd1f162 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:02.835311 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-72d27195-1572-4978-96eb-12bc3dd1f162 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:02.835719 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-72d27195-1572-4978-96eb-12bc3dd1f162 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:03.042037 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-72d27195-1572-4978-96eb-12bc3dd1f162 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:45:03.059452 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-72d27195-1572-4978-96eb-12bc3dd1f162 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:45:03.061347 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-72d27195-1572-4978-96eb-12bc3dd1f162 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:45:03.062631 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-72d27195-1572-4978-96eb-12bc3dd1f162 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170" status: 200 len: 1406 microversion: 2.20 time: 0.242532 Jun 17 15:45:03.063375 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1403/3222] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:45:02 2022] GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170 => generated 1406 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:45:03.246274 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-bb5488ee-f7db-4269-9cb8-e43edc7a558e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:45:03.248742 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-bb5488ee-f7db-4269-9cb8-e43edc7a558e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:45:03.270224 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bb5488ee-f7db-4269-9cb8-e43edc7a558e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:03.270681 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bb5488ee-f7db-4269-9cb8-e43edc7a558e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:03.271484 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bb5488ee-f7db-4269-9cb8-e43edc7a558e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:03.272905 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bb5488ee-f7db-4269-9cb8-e43edc7a558e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:03.328060 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [req-012f7a0a-f88a-4e54-904b-44d5e9b2a165 req-d3359de5-f9ea-44aa-9063-cf6867d3d862 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "031f230c-48e6-46bb-a549-3cb347946170", "tag": "f36b91db-a750-4162-b57f-9c6ee752ebac"}]} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:45:03.338458 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-012f7a0a-f88a-4e54-904b-44d5e9b2a165 req-d3359de5-f9ea-44aa-9063-cf6867d3d862 service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:03.339051 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-012f7a0a-f88a-4e54-904b-44d5e9b2a165 req-d3359de5-f9ea-44aa-9063-cf6867d3d862 service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:03.354713 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.compute.server_external_events [req-012f7a0a-f88a-4e54-904b-44d5e9b2a165 req-d3359de5-f9ea-44aa-9063-cf6867d3d862 service nova] Creating event network-changed:f36b91db-a750-4162-b57f-9c6ee752ebac for instance 031f230c-48e6-46bb-a549-3cb347946170 on hv-cinder-82549 Jun 17 15:45:03.374968 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [req-012f7a0a-f88a-4e54-904b-44d5e9b2a165 req-d3359de5-f9ea-44aa-9063-cf6867d3d862 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.145818 Jun 17 15:45:03.376958 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1404/3223] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 15:45:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:45:03.676450 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-bb5488ee-f7db-4269-9cb8-e43edc7a558e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:45:03.697779 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-bb5488ee-f7db-4269-9cb8-e43edc7a558e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1732 microversion: 2.1 time: 0.464912 Jun 17 15:45:03.699030 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1820/3224] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:45:03 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1732 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:45:04.083840 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-12f320b8-d724-460b-880c-bb7e5687d272 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:45:04.084853 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-12f320b8-d724-460b-880c-bb7e5687d272 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: 031f230c-48e6-46bb-a549-3cb347946170] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:45:04.094912 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-12f320b8-d724-460b-880c-bb7e5687d272 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:04.095746 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-12f320b8-d724-460b-880c-bb7e5687d272 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:04.097266 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-12f320b8-d724-460b-880c-bb7e5687d272 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:04.098076 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-12f320b8-d724-460b-880c-bb7e5687d272 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:04.106398 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell1:SELECT=100 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:45:04.290589 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-12f320b8-d724-460b-880c-bb7e5687d272 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:45:04.307650 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-12f320b8-d724-460b-880c-bb7e5687d272 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:45:04.309885 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-12f320b8-d724-460b-880c-bb7e5687d272 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:45:04.311258 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-12f320b8-d724-460b-880c-bb7e5687d272 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170" status: 200 len: 1406 microversion: 2.20 time: 0.232557 Jun 17 15:45:04.311976 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1405/3225] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:45:04 2022] GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170 => generated 1406 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:45:04.724716 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-efe27621-5666-4b8a-89ff-ef00b370b0f4 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:45:04.726039 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-efe27621-5666-4b8a-89ff-ef00b370b0f4 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:45:04.733674 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-efe27621-5666-4b8a-89ff-ef00b370b0f4 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:04.734305 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-efe27621-5666-4b8a-89ff-ef00b370b0f4 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:04.735149 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-efe27621-5666-4b8a-89ff-ef00b370b0f4 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:04.735571 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-efe27621-5666-4b8a-89ff-ef00b370b0f4 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:04.924869 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-efe27621-5666-4b8a-89ff-ef00b370b0f4 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:45:04.941067 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-efe27621-5666-4b8a-89ff-ef00b370b0f4 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1732 microversion: 2.1 time: 0.225642 Jun 17 15:45:04.956139 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1821/3226] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:45:04 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1732 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:45:05.333352 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-57a240e5-ab03-485b-8e86-e2edc08a8f81 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:45:05.334628 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-57a240e5-ab03-485b-8e86-e2edc08a8f81 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: 031f230c-48e6-46bb-a549-3cb347946170] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:45:05.343686 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-57a240e5-ab03-485b-8e86-e2edc08a8f81 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:05.344299 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-57a240e5-ab03-485b-8e86-e2edc08a8f81 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:05.345289 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-57a240e5-ab03-485b-8e86-e2edc08a8f81 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:05.345859 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-57a240e5-ab03-485b-8e86-e2edc08a8f81 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:05.644892 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-57a240e5-ab03-485b-8e86-e2edc08a8f81 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:45:05.660310 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-57a240e5-ab03-485b-8e86-e2edc08a8f81 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:45:05.664646 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-57a240e5-ab03-485b-8e86-e2edc08a8f81 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:45:05.666114 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-57a240e5-ab03-485b-8e86-e2edc08a8f81 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170" status: 200 len: 1406 microversion: 2.20 time: 0.338670 Jun 17 15:45:05.666784 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1406/3227] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:45:05 2022] GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170 => generated 1406 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:45:05.976145 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-02a4240e-4aeb-4dd0-93cf-ec85b8c51760 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:45:05.978906 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-02a4240e-4aeb-4dd0-93cf-ec85b8c51760 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:45:05.996148 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-02a4240e-4aeb-4dd0-93cf-ec85b8c51760 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:05.997598 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-02a4240e-4aeb-4dd0-93cf-ec85b8c51760 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:05.999433 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-02a4240e-4aeb-4dd0-93cf-ec85b8c51760 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:06.000992 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-02a4240e-4aeb-4dd0-93cf-ec85b8c51760 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:06.210861 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-02a4240e-4aeb-4dd0-93cf-ec85b8c51760 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:45:06.223294 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-02a4240e-4aeb-4dd0-93cf-ec85b8c51760 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1732 microversion: 2.1 time: 0.259739 Jun 17 15:45:06.224214 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1822/3228] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:45:05 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1732 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:45:06.684961 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-31ece0c9-9a5c-4384-96a5-24e496a2b53c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:45:06.685583 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-31ece0c9-9a5c-4384-96a5-24e496a2b53c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: 031f230c-48e6-46bb-a549-3cb347946170] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:45:06.693558 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-31ece0c9-9a5c-4384-96a5-24e496a2b53c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:06.694135 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-31ece0c9-9a5c-4384-96a5-24e496a2b53c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:06.694993 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-31ece0c9-9a5c-4384-96a5-24e496a2b53c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:06.695436 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-31ece0c9-9a5c-4384-96a5-24e496a2b53c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:06.854297 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-31ece0c9-9a5c-4384-96a5-24e496a2b53c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:45:06.862859 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-31ece0c9-9a5c-4384-96a5-24e496a2b53c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:45:06.864416 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-31ece0c9-9a5c-4384-96a5-24e496a2b53c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:45:06.865569 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-31ece0c9-9a5c-4384-96a5-24e496a2b53c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170" status: 200 len: 1406 microversion: 2.20 time: 0.185040 Jun 17 15:45:06.866266 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1407/3229] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:45:06 2022] GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170 => generated 1406 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:45:07.241936 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-24f65082-d896-4845-a479-680aed50948c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:45:07.243224 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-24f65082-d896-4845-a479-680aed50948c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:45:07.245976 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell0:SELECT=4 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:45:07.252275 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-24f65082-d896-4845-a479-680aed50948c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:07.252788 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-24f65082-d896-4845-a479-680aed50948c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:07.253542 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-24f65082-d896-4845-a479-680aed50948c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:07.253978 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-24f65082-d896-4845-a479-680aed50948c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:07.414431 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-24f65082-d896-4845-a479-680aed50948c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:45:07.425398 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-24f65082-d896-4845-a479-680aed50948c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1732 microversion: 2.1 time: 0.187505 Jun 17 15:45:07.425999 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1823/3230] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:45:07 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1732 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:45:07.886101 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-b6453f56-feb5-4707-a9d9-ac7653f8119d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:45:07.886717 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-b6453f56-feb5-4707-a9d9-ac7653f8119d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: 031f230c-48e6-46bb-a549-3cb347946170] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:45:07.893585 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b6453f56-feb5-4707-a9d9-ac7653f8119d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:07.894032 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b6453f56-feb5-4707-a9d9-ac7653f8119d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:07.894815 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b6453f56-feb5-4707-a9d9-ac7653f8119d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:07.895248 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b6453f56-feb5-4707-a9d9-ac7653f8119d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:08.035442 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-b6453f56-feb5-4707-a9d9-ac7653f8119d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:45:08.043898 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-b6453f56-feb5-4707-a9d9-ac7653f8119d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:45:08.045438 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-b6453f56-feb5-4707-a9d9-ac7653f8119d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:45:08.046580 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-b6453f56-feb5-4707-a9d9-ac7653f8119d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170" status: 200 len: 1406 microversion: 2.20 time: 0.166060 Jun 17 15:45:08.047482 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1408/3231] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:45:07 2022] GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170 => generated 1406 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:45:08.370996 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [req-4b0d6963-b7ed-48a8-ba11-f3e2b4c6acd6 req-401e06b7-3856-42d5-ab0c-1a93abd511da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "031f230c-48e6-46bb-a549-3cb347946170", "name": "network-vif-plugged", "status": "completed", "tag": "f36b91db-a750-4162-b57f-9c6ee752ebac"}]} {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:45:08.381297 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [req-4b0d6963-b7ed-48a8-ba11-f3e2b4c6acd6 req-401e06b7-3856-42d5-ab0c-1a93abd511da service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:08.381737 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [req-4b0d6963-b7ed-48a8-ba11-f3e2b4c6acd6 req-401e06b7-3856-42d5-ab0c-1a93abd511da service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:08.393906 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.compute.server_external_events [req-4b0d6963-b7ed-48a8-ba11-f3e2b4c6acd6 req-401e06b7-3856-42d5-ab0c-1a93abd511da service nova] Creating event network-vif-plugged:f36b91db-a750-4162-b57f-9c6ee752ebac for instance 031f230c-48e6-46bb-a549-3cb347946170 on hv-cinder-82549 Jun 17 15:45:08.399400 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [req-4b0d6963-b7ed-48a8-ba11-f3e2b4c6acd6 req-401e06b7-3856-42d5-ab0c-1a93abd511da service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.256406 Jun 17 15:45:08.400123 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1824/3232] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 15:45:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:45:08.442873 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-df333781-66d0-471d-ba5c-b832db76818b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:45:08.443629 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-df333781-66d0-471d-ba5c-b832db76818b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:45:08.453245 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-df333781-66d0-471d-ba5c-b832db76818b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:08.453817 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-df333781-66d0-471d-ba5c-b832db76818b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:08.455130 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-df333781-66d0-471d-ba5c-b832db76818b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:08.455130 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-df333781-66d0-471d-ba5c-b832db76818b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:08.609355 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-df333781-66d0-471d-ba5c-b832db76818b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:45:08.617806 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-df333781-66d0-471d-ba5c-b832db76818b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1732 microversion: 2.1 time: 0.178775 Jun 17 15:45:08.618520 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1409/3233] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:45:08 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1732 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:45:09.065515 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-3474067f-f6e5-448e-bfbe-1812ed37c85a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:45:09.066216 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-3474067f-f6e5-448e-bfbe-1812ed37c85a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: 031f230c-48e6-46bb-a549-3cb347946170] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:45:09.072837 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3474067f-f6e5-448e-bfbe-1812ed37c85a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:09.073292 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3474067f-f6e5-448e-bfbe-1812ed37c85a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:09.074068 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3474067f-f6e5-448e-bfbe-1812ed37c85a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:09.074514 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3474067f-f6e5-448e-bfbe-1812ed37c85a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:09.224840 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-3474067f-f6e5-448e-bfbe-1812ed37c85a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:45:09.233848 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-3474067f-f6e5-448e-bfbe-1812ed37c85a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:45:09.235363 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-3474067f-f6e5-448e-bfbe-1812ed37c85a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:45:09.236502 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-3474067f-f6e5-448e-bfbe-1812ed37c85a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170" status: 200 len: 1406 microversion: 2.20 time: 0.175376 Jun 17 15:45:09.237071 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1825/3234] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:45:09 2022] GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170 => generated 1406 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:45:09.635788 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-ca5d1419-17c4-43a2-a717-c5672621c2b9 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:45:09.636456 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-ca5d1419-17c4-43a2-a717-c5672621c2b9 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:45:09.638747 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell0:SELECT=2 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:45:09.639428 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell0:SELECT=8 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:45:09.645751 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ca5d1419-17c4-43a2-a717-c5672621c2b9 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:09.646191 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ca5d1419-17c4-43a2-a717-c5672621c2b9 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:09.646952 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ca5d1419-17c4-43a2-a717-c5672621c2b9 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:09.647381 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ca5d1419-17c4-43a2-a717-c5672621c2b9 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:09.787921 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-ca5d1419-17c4-43a2-a717-c5672621c2b9 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:45:09.796363 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-ca5d1419-17c4-43a2-a717-c5672621c2b9 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1732 microversion: 2.1 time: 0.164809 Jun 17 15:45:09.797021 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1410/3235] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:45:09 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1732 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:45:10.255099 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-2d7842b2-5b87-430a-aea6-c564d73a8c53 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:45:10.255725 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-2d7842b2-5b87-430a-aea6-c564d73a8c53 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: 031f230c-48e6-46bb-a549-3cb347946170] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:45:10.263477 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2d7842b2-5b87-430a-aea6-c564d73a8c53 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:10.263477 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2d7842b2-5b87-430a-aea6-c564d73a8c53 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:10.264111 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2d7842b2-5b87-430a-aea6-c564d73a8c53 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:10.264655 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2d7842b2-5b87-430a-aea6-c564d73a8c53 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:10.394079 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-2d7842b2-5b87-430a-aea6-c564d73a8c53 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:45:10.402458 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-2d7842b2-5b87-430a-aea6-c564d73a8c53 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:45:10.403949 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-2d7842b2-5b87-430a-aea6-c564d73a8c53 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:45:10.405179 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-2d7842b2-5b87-430a-aea6-c564d73a8c53 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170" status: 200 len: 1598 microversion: 2.20 time: 0.154072 Jun 17 15:45:10.405753 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1826/3236] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:45:10 2022] GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170 => generated 1598 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:45:10.423092 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-fd172ada-3c43-4272-9829-ad03fda63fc1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:45:10.423586 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-fd172ada-3c43-4272-9829-ad03fda63fc1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: 031f230c-48e6-46bb-a549-3cb347946170] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:45:10.429816 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fd172ada-3c43-4272-9829-ad03fda63fc1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:10.430414 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fd172ada-3c43-4272-9829-ad03fda63fc1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:10.430983 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fd172ada-3c43-4272-9829-ad03fda63fc1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:10.431418 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fd172ada-3c43-4272-9829-ad03fda63fc1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:10.521372 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-fd172ada-3c43-4272-9829-ad03fda63fc1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.102219 Jun 17 15:45:10.521982 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1411/3237] 10.222.0.48 () {60 vars in 1315 bytes} [Fri Jun 17 15:45:10 2022] GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170/os-interface => generated 285 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 15:45:10.814584 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-dd97c1eb-8bb8-4d64-b9bf-dfd979880eaa tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:45:10.814965 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-dd97c1eb-8bb8-4d64-b9bf-dfd979880eaa tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:45:10.821520 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-dd97c1eb-8bb8-4d64-b9bf-dfd979880eaa tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:10.821967 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-dd97c1eb-8bb8-4d64-b9bf-dfd979880eaa tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:10.823403 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-dd97c1eb-8bb8-4d64-b9bf-dfd979880eaa tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:10.823848 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-dd97c1eb-8bb8-4d64-b9bf-dfd979880eaa tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:10.964626 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-dd97c1eb-8bb8-4d64-b9bf-dfd979880eaa tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:45:10.973247 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-dd97c1eb-8bb8-4d64-b9bf-dfd979880eaa tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1732 microversion: 2.1 time: 0.162875 Jun 17 15:45:10.973836 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1827/3238] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:45:10 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1732 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:45:11.765156 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [req-1220516c-1b20-4441-8913-4329333d1b65 req-d45600d2-9883-457f-824b-2a52307f7aa9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "031f230c-48e6-46bb-a549-3cb347946170", "tag": "f36b91db-a750-4162-b57f-9c6ee752ebac"}]} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:45:11.773475 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-1220516c-1b20-4441-8913-4329333d1b65 req-d45600d2-9883-457f-824b-2a52307f7aa9 service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:11.773916 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-1220516c-1b20-4441-8913-4329333d1b65 req-d45600d2-9883-457f-824b-2a52307f7aa9 service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:11.786213 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.compute.server_external_events [req-1220516c-1b20-4441-8913-4329333d1b65 req-d45600d2-9883-457f-824b-2a52307f7aa9 service nova] Creating event network-changed:f36b91db-a750-4162-b57f-9c6ee752ebac for instance 031f230c-48e6-46bb-a549-3cb347946170 on hv-cinder-82549 Jun 17 15:45:11.791917 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [req-1220516c-1b20-4441-8913-4329333d1b65 req-d45600d2-9883-457f-824b-2a52307f7aa9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090471 Jun 17 15:45:11.792562 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1412/3239] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 15:45:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:45:11.990870 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-9830c72e-4600-4540-abd6-e6b9af40f311 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:45:11.992140 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-9830c72e-4600-4540-abd6-e6b9af40f311 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:45:11.999530 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9830c72e-4600-4540-abd6-e6b9af40f311 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:11.999889 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9830c72e-4600-4540-abd6-e6b9af40f311 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:12.000697 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9830c72e-4600-4540-abd6-e6b9af40f311 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:12.001746 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9830c72e-4600-4540-abd6-e6b9af40f311 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:12.222080 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-9830c72e-4600-4540-abd6-e6b9af40f311 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:45:12.236899 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-9830c72e-4600-4540-abd6-e6b9af40f311 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1732 microversion: 2.1 time: 0.249616 Jun 17 15:45:12.238036 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1828/3240] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:45:11 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1732 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:45:13.258930 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-0cf4df63-4b6e-46c2-9006-5ac62702d17d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:45:13.259536 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-0cf4df63-4b6e-46c2-9006-5ac62702d17d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:45:13.266288 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0cf4df63-4b6e-46c2-9006-5ac62702d17d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:13.266734 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0cf4df63-4b6e-46c2-9006-5ac62702d17d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:13.267509 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0cf4df63-4b6e-46c2-9006-5ac62702d17d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:13.267943 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0cf4df63-4b6e-46c2-9006-5ac62702d17d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:13.417253 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-0cf4df63-4b6e-46c2-9006-5ac62702d17d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:45:13.425203 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-0cf4df63-4b6e-46c2-9006-5ac62702d17d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1732 microversion: 2.1 time: 0.171251 Jun 17 15:45:13.425771 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1413/3241] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:45:13 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1732 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:45:14.442626 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-22de26a7-2551-4bfa-9aab-04cd661c4449 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:45:14.443260 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-22de26a7-2551-4bfa-9aab-04cd661c4449 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:45:14.449865 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-22de26a7-2551-4bfa-9aab-04cd661c4449 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:14.450308 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-22de26a7-2551-4bfa-9aab-04cd661c4449 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:14.451083 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-22de26a7-2551-4bfa-9aab-04cd661c4449 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:14.451513 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-22de26a7-2551-4bfa-9aab-04cd661c4449 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:14.590169 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-22de26a7-2551-4bfa-9aab-04cd661c4449 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:45:14.599530 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-22de26a7-2551-4bfa-9aab-04cd661c4449 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1732 microversion: 2.1 time: 0.160828 Jun 17 15:45:14.600102 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1829/3242] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:45:14 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1732 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:45:15.617583 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-56ee2d25-45b3-4204-8029-b76efd70daba tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:45:15.618196 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-56ee2d25-45b3-4204-8029-b76efd70daba tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:45:15.625360 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-56ee2d25-45b3-4204-8029-b76efd70daba tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:15.625831 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-56ee2d25-45b3-4204-8029-b76efd70daba tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:15.626603 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-56ee2d25-45b3-4204-8029-b76efd70daba tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:15.627043 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-56ee2d25-45b3-4204-8029-b76efd70daba tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:15.762531 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-56ee2d25-45b3-4204-8029-b76efd70daba tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:45:15.770539 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-56ee2d25-45b3-4204-8029-b76efd70daba tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1732 microversion: 2.1 time: 0.156784 Jun 17 15:45:15.771112 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1414/3243] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:45:15 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1732 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:45:16.787207 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-dc7c88e0-93b2-467b-8aa2-e841fb0f080d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:45:16.787781 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-dc7c88e0-93b2-467b-8aa2-e841fb0f080d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:45:16.794508 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-dc7c88e0-93b2-467b-8aa2-e841fb0f080d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:16.794952 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-dc7c88e0-93b2-467b-8aa2-e841fb0f080d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:16.795714 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-dc7c88e0-93b2-467b-8aa2-e841fb0f080d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:16.796177 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-dc7c88e0-93b2-467b-8aa2-e841fb0f080d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:16.932658 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-dc7c88e0-93b2-467b-8aa2-e841fb0f080d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:45:16.942019 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-dc7c88e0-93b2-467b-8aa2-e841fb0f080d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1732 microversion: 2.1 time: 0.158736 Jun 17 15:45:16.942600 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1830/3244] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:45:16 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1732 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:45:17.959052 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-c470664b-f8fd-47a8-af79-e381872646b4 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:45:17.959663 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-c470664b-f8fd-47a8-af79-e381872646b4 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:45:17.966880 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c470664b-f8fd-47a8-af79-e381872646b4 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:17.967332 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c470664b-f8fd-47a8-af79-e381872646b4 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:17.968095 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c470664b-f8fd-47a8-af79-e381872646b4 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:17.968566 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c470664b-f8fd-47a8-af79-e381872646b4 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:18.108291 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-c470664b-f8fd-47a8-af79-e381872646b4 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:45:18.116562 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-c470664b-f8fd-47a8-af79-e381872646b4 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1732 microversion: 2.1 time: 0.161366 Jun 17 15:45:18.117146 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1415/3245] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:45:17 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1732 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:45:19.133833 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-556a5e1e-1241-4b9d-95f2-be57ea6a102a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:45:19.134469 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-556a5e1e-1241-4b9d-95f2-be57ea6a102a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:45:19.142116 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-556a5e1e-1241-4b9d-95f2-be57ea6a102a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:19.142563 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-556a5e1e-1241-4b9d-95f2-be57ea6a102a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:19.143344 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-556a5e1e-1241-4b9d-95f2-be57ea6a102a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:19.143775 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-556a5e1e-1241-4b9d-95f2-be57ea6a102a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:19.288114 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-556a5e1e-1241-4b9d-95f2-be57ea6a102a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:45:19.296630 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-556a5e1e-1241-4b9d-95f2-be57ea6a102a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1732 microversion: 2.1 time: 0.166693 Jun 17 15:45:19.297215 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1831/3246] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:45:19 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1732 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:45:20.313866 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-c4578728-b410-4105-aee1-606de88c61d8 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:45:20.314478 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-c4578728-b410-4105-aee1-606de88c61d8 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:45:20.321195 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c4578728-b410-4105-aee1-606de88c61d8 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:20.321643 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c4578728-b410-4105-aee1-606de88c61d8 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:20.322912 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c4578728-b410-4105-aee1-606de88c61d8 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:20.323351 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c4578728-b410-4105-aee1-606de88c61d8 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:20.455947 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-c4578728-b410-4105-aee1-606de88c61d8 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:45:20.464459 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-c4578728-b410-4105-aee1-606de88c61d8 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1732 microversion: 2.1 time: 0.154616 Jun 17 15:45:20.465024 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1416/3247] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:45:20 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1732 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:45:21.481855 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-8a231d7c-07b6-4fb1-bc89-68078fdd105b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:45:21.482421 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-8a231d7c-07b6-4fb1-bc89-68078fdd105b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:45:21.484859 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_api:SELECT=69,nova_api:DELETE=1,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:45:21.490165 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8a231d7c-07b6-4fb1-bc89-68078fdd105b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:21.490602 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8a231d7c-07b6-4fb1-bc89-68078fdd105b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:21.491351 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8a231d7c-07b6-4fb1-bc89-68078fdd105b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:21.491781 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8a231d7c-07b6-4fb1-bc89-68078fdd105b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:21.624002 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-8a231d7c-07b6-4fb1-bc89-68078fdd105b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:45:21.632002 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-8a231d7c-07b6-4fb1-bc89-68078fdd105b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1732 microversion: 2.1 time: 0.154133 Jun 17 15:45:21.632601 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1832/3248] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:45:21 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1732 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:45:22.649047 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-ce0e2cae-a109-498d-8010-4beafa23f425 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:45:22.649607 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-ce0e2cae-a109-498d-8010-4beafa23f425 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:45:22.656080 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ce0e2cae-a109-498d-8010-4beafa23f425 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:22.656556 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ce0e2cae-a109-498d-8010-4beafa23f425 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:22.657299 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ce0e2cae-a109-498d-8010-4beafa23f425 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:22.657731 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ce0e2cae-a109-498d-8010-4beafa23f425 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:22.786668 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-ce0e2cae-a109-498d-8010-4beafa23f425 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:45:22.795153 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-ce0e2cae-a109-498d-8010-4beafa23f425 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1732 microversion: 2.1 time: 0.150030 Jun 17 15:45:22.795716 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1417/3249] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:45:22 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1732 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:45:23.812884 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-b9e04a0c-42f1-43b4-a689-3399656fca8b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:45:23.813529 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-b9e04a0c-42f1-43b4-a689-3399656fca8b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:45:23.819859 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b9e04a0c-42f1-43b4-a689-3399656fca8b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:23.820302 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b9e04a0c-42f1-43b4-a689-3399656fca8b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:23.821131 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b9e04a0c-42f1-43b4-a689-3399656fca8b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:23.821499 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b9e04a0c-42f1-43b4-a689-3399656fca8b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:23.825905 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:45:23.955716 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-b9e04a0c-42f1-43b4-a689-3399656fca8b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:45:23.963749 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-b9e04a0c-42f1-43b4-a689-3399656fca8b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1732 microversion: 2.1 time: 0.155035 Jun 17 15:45:23.964311 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1833/3250] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:45:23 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1732 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:45:24.981213 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-fa061e05-166f-46c6-bce7-b8b297329e5c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:45:24.981845 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-fa061e05-166f-46c6-bce7-b8b297329e5c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:45:24.984177 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_api:SELECT=64,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:45:24.990528 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fa061e05-166f-46c6-bce7-b8b297329e5c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:24.990972 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fa061e05-166f-46c6-bce7-b8b297329e5c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:24.991724 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fa061e05-166f-46c6-bce7-b8b297329e5c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:24.992151 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fa061e05-166f-46c6-bce7-b8b297329e5c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:25.281221 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-fa061e05-166f-46c6-bce7-b8b297329e5c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:45:25.289257 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-fa061e05-166f-46c6-bce7-b8b297329e5c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1732 microversion: 2.1 time: 0.312042 Jun 17 15:45:25.289815 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1418/3251] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:45:24 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1732 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:45:26.307370 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-d7c83736-f287-4818-8d98-66ef8b1fc593 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:45:26.307983 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-d7c83736-f287-4818-8d98-66ef8b1fc593 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:45:26.313946 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d7c83736-f287-4818-8d98-66ef8b1fc593 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:26.314389 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d7c83736-f287-4818-8d98-66ef8b1fc593 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:26.315147 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d7c83736-f287-4818-8d98-66ef8b1fc593 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:26.315577 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d7c83736-f287-4818-8d98-66ef8b1fc593 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:26.457760 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-d7c83736-f287-4818-8d98-66ef8b1fc593 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:45:26.466269 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-d7c83736-f287-4818-8d98-66ef8b1fc593 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1732 microversion: 2.1 time: 0.163650 Jun 17 15:45:26.466846 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1834/3252] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:45:26 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1732 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:45:27.483221 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-bdf9d3e8-01af-4cee-a89d-7c8f89c39da0 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:45:27.483810 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-bdf9d3e8-01af-4cee-a89d-7c8f89c39da0 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:45:27.490217 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bdf9d3e8-01af-4cee-a89d-7c8f89c39da0 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:27.490658 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bdf9d3e8-01af-4cee-a89d-7c8f89c39da0 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:27.491397 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bdf9d3e8-01af-4cee-a89d-7c8f89c39da0 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:27.491823 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bdf9d3e8-01af-4cee-a89d-7c8f89c39da0 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:27.619225 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-bdf9d3e8-01af-4cee-a89d-7c8f89c39da0 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:45:27.628193 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-bdf9d3e8-01af-4cee-a89d-7c8f89c39da0 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1732 microversion: 2.1 time: 0.148704 Jun 17 15:45:27.628871 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1419/3253] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:45:27 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1732 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:45:28.645479 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-65a105c4-4897-48bc-a47b-00959841d265 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:45:28.646043 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-65a105c4-4897-48bc-a47b-00959841d265 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:45:28.653157 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-65a105c4-4897-48bc-a47b-00959841d265 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:28.653607 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-65a105c4-4897-48bc-a47b-00959841d265 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:28.654363 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-65a105c4-4897-48bc-a47b-00959841d265 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:28.654794 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-65a105c4-4897-48bc-a47b-00959841d265 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:29.020293 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-65a105c4-4897-48bc-a47b-00959841d265 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:45:29.028753 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-65a105c4-4897-48bc-a47b-00959841d265 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1732 microversion: 2.1 time: 0.387241 Jun 17 15:45:29.029318 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1835/3254] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:45:28 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1732 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:45:30.046572 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-fd0db578-85e7-4596-a2d8-ccf3aae9adbf tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:45:30.047201 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-fd0db578-85e7-4596-a2d8-ccf3aae9adbf tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:45:30.053799 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fd0db578-85e7-4596-a2d8-ccf3aae9adbf tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:30.054244 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fd0db578-85e7-4596-a2d8-ccf3aae9adbf tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:30.055004 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fd0db578-85e7-4596-a2d8-ccf3aae9adbf tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:30.055439 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fd0db578-85e7-4596-a2d8-ccf3aae9adbf tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:30.188871 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-fd0db578-85e7-4596-a2d8-ccf3aae9adbf tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:45:30.196626 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-fd0db578-85e7-4596-a2d8-ccf3aae9adbf tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1732 microversion: 2.1 time: 0.154399 Jun 17 15:45:30.197168 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1420/3255] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:45:30 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1732 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:45:31.213554 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-96648c6b-0b3c-45a4-b5de-e1858cf2ba5e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:45:31.214232 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-96648c6b-0b3c-45a4-b5de-e1858cf2ba5e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:45:31.220793 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-96648c6b-0b3c-45a4-b5de-e1858cf2ba5e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:31.221236 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-96648c6b-0b3c-45a4-b5de-e1858cf2ba5e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:31.221992 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-96648c6b-0b3c-45a4-b5de-e1858cf2ba5e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:31.222419 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-96648c6b-0b3c-45a4-b5de-e1858cf2ba5e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:31.348720 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-96648c6b-0b3c-45a4-b5de-e1858cf2ba5e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:45:31.357510 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-96648c6b-0b3c-45a4-b5de-e1858cf2ba5e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1732 microversion: 2.1 time: 0.147791 Jun 17 15:45:31.358086 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1836/3256] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:45:31 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1732 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:45:32.374343 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-6abc0df9-e1f3-4a67-8d2b-cf9482692d4a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:45:32.374936 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-6abc0df9-e1f3-4a67-8d2b-cf9482692d4a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:45:32.381665 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6abc0df9-e1f3-4a67-8d2b-cf9482692d4a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:32.382101 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6abc0df9-e1f3-4a67-8d2b-cf9482692d4a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:32.382852 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6abc0df9-e1f3-4a67-8d2b-cf9482692d4a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:32.383276 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6abc0df9-e1f3-4a67-8d2b-cf9482692d4a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:32.510221 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-6abc0df9-e1f3-4a67-8d2b-cf9482692d4a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:45:32.518464 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-6abc0df9-e1f3-4a67-8d2b-cf9482692d4a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1732 microversion: 2.1 time: 0.148409 Jun 17 15:45:32.519027 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1421/3257] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:45:32 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1732 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:45:33.535178 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-8f43ab32-bc0a-494d-850f-8cbf5d549c6d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:45:33.535828 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-8f43ab32-bc0a-494d-850f-8cbf5d549c6d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:45:33.543062 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8f43ab32-bc0a-494d-850f-8cbf5d549c6d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:33.543521 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8f43ab32-bc0a-494d-850f-8cbf5d549c6d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:33.544447 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8f43ab32-bc0a-494d-850f-8cbf5d549c6d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:33.544914 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8f43ab32-bc0a-494d-850f-8cbf5d549c6d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:33.675328 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-8f43ab32-bc0a-494d-850f-8cbf5d549c6d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:45:33.683223 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-8f43ab32-bc0a-494d-850f-8cbf5d549c6d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1732 microversion: 2.1 time: 0.151980 Jun 17 15:45:33.683814 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1837/3258] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:45:33 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1732 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:45:34.699956 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-5ec84dfa-b238-47a7-a72d-1a984c9a044a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:45:34.700640 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-5ec84dfa-b238-47a7-a72d-1a984c9a044a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:45:34.707436 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5ec84dfa-b238-47a7-a72d-1a984c9a044a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:34.707887 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5ec84dfa-b238-47a7-a72d-1a984c9a044a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:34.708663 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5ec84dfa-b238-47a7-a72d-1a984c9a044a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:34.709100 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5ec84dfa-b238-47a7-a72d-1a984c9a044a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:34.711585 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell1:SELECT=96 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:45:34.836010 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-5ec84dfa-b238-47a7-a72d-1a984c9a044a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:45:34.844746 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-5ec84dfa-b238-47a7-a72d-1a984c9a044a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1732 microversion: 2.1 time: 0.148569 Jun 17 15:45:34.845310 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1422/3259] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:45:34 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1732 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:45:35.862279 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-3f6a5867-c5d1-4212-a551-2d6b0777dee3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:45:35.862904 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-3f6a5867-c5d1-4212-a551-2d6b0777dee3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:45:35.869348 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3f6a5867-c5d1-4212-a551-2d6b0777dee3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:35.869796 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3f6a5867-c5d1-4212-a551-2d6b0777dee3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:35.870541 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3f6a5867-c5d1-4212-a551-2d6b0777dee3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:35.871612 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3f6a5867-c5d1-4212-a551-2d6b0777dee3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:36.002338 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-3f6a5867-c5d1-4212-a551-2d6b0777dee3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:45:36.010189 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-3f6a5867-c5d1-4212-a551-2d6b0777dee3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1732 microversion: 2.1 time: 0.151855 Jun 17 15:45:36.010751 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1838/3260] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:45:35 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1732 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:45:37.027064 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-bdd850fc-782b-4e79-98d4-5ba6d6c4dd3f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:45:37.027725 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-bdd850fc-782b-4e79-98d4-5ba6d6c4dd3f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:45:37.034452 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bdd850fc-782b-4e79-98d4-5ba6d6c4dd3f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:37.034897 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bdd850fc-782b-4e79-98d4-5ba6d6c4dd3f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:37.035683 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bdd850fc-782b-4e79-98d4-5ba6d6c4dd3f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:37.036111 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bdd850fc-782b-4e79-98d4-5ba6d6c4dd3f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:37.173812 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-bdd850fc-782b-4e79-98d4-5ba6d6c4dd3f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:45:37.181707 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-bdd850fc-782b-4e79-98d4-5ba6d6c4dd3f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1732 microversion: 2.1 time: 0.158564 Jun 17 15:45:37.182266 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1423/3261] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:45:37 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1732 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:45:38.199192 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-bab411a0-fc5f-4a16-9817-c7406582dab2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:45:38.199796 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-bab411a0-fc5f-4a16-9817-c7406582dab2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:45:38.206319 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bab411a0-fc5f-4a16-9817-c7406582dab2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:38.206761 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bab411a0-fc5f-4a16-9817-c7406582dab2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:38.207518 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bab411a0-fc5f-4a16-9817-c7406582dab2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:38.207951 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bab411a0-fc5f-4a16-9817-c7406582dab2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:38.346717 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-bab411a0-fc5f-4a16-9817-c7406582dab2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:45:38.355600 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-bab411a0-fc5f-4a16-9817-c7406582dab2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1732 microversion: 2.1 time: 0.160119 Jun 17 15:45:38.356219 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1839/3262] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:45:38 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1732 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:45:39.373009 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-f01546fd-8a47-4c8b-8fbf-029197a9312e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:45:39.373645 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-f01546fd-8a47-4c8b-8fbf-029197a9312e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:45:39.380055 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f01546fd-8a47-4c8b-8fbf-029197a9312e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:39.380533 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f01546fd-8a47-4c8b-8fbf-029197a9312e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:39.381285 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f01546fd-8a47-4c8b-8fbf-029197a9312e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:39.381715 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f01546fd-8a47-4c8b-8fbf-029197a9312e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:39.508008 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-f01546fd-8a47-4c8b-8fbf-029197a9312e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:45:39.515932 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-f01546fd-8a47-4c8b-8fbf-029197a9312e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1732 microversion: 2.1 time: 0.146764 Jun 17 15:45:39.516523 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1424/3263] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:45:39 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1732 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:45:40.532937 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-a4c5f068-9c13-41b3-8cdb-61707230ff40 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:45:40.533537 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-a4c5f068-9c13-41b3-8cdb-61707230ff40 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:45:40.540123 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a4c5f068-9c13-41b3-8cdb-61707230ff40 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:40.540613 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a4c5f068-9c13-41b3-8cdb-61707230ff40 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:40.541369 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a4c5f068-9c13-41b3-8cdb-61707230ff40 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:40.541800 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a4c5f068-9c13-41b3-8cdb-61707230ff40 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:40.668729 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-a4c5f068-9c13-41b3-8cdb-61707230ff40 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:45:40.676573 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-a4c5f068-9c13-41b3-8cdb-61707230ff40 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1732 microversion: 2.1 time: 0.147561 Jun 17 15:45:40.677133 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1840/3264] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:45:40 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1732 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:45:41.694154 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-eb803d0e-4b9d-4729-8d27-5bfcc782b950 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:45:41.694757 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-eb803d0e-4b9d-4729-8d27-5bfcc782b950 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:45:41.701259 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-eb803d0e-4b9d-4729-8d27-5bfcc782b950 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:41.701700 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-eb803d0e-4b9d-4729-8d27-5bfcc782b950 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:41.702447 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-eb803d0e-4b9d-4729-8d27-5bfcc782b950 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:41.702898 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-eb803d0e-4b9d-4729-8d27-5bfcc782b950 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:41.838579 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-eb803d0e-4b9d-4729-8d27-5bfcc782b950 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:45:41.847367 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-eb803d0e-4b9d-4729-8d27-5bfcc782b950 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1732 microversion: 2.1 time: 0.157042 Jun 17 15:45:41.847995 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1425/3265] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:45:41 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1732 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:45:42.865592 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-9faf5ab6-414e-4136-a045-0390893dae4c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:45:42.866200 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-9faf5ab6-414e-4136-a045-0390893dae4c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:45:42.873447 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9faf5ab6-414e-4136-a045-0390893dae4c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:42.873890 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9faf5ab6-414e-4136-a045-0390893dae4c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:42.874636 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9faf5ab6-414e-4136-a045-0390893dae4c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:42.875397 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9faf5ab6-414e-4136-a045-0390893dae4c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:43.010612 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-9faf5ab6-414e-4136-a045-0390893dae4c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:45:43.022251 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-9faf5ab6-414e-4136-a045-0390893dae4c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1732 microversion: 2.1 time: 0.160433 Jun 17 15:45:43.022847 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1841/3266] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:45:42 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1732 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:45:44.047459 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-6ad05fac-3d91-4068-adb4-c815ec6cab15 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:45:44.048054 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-6ad05fac-3d91-4068-adb4-c815ec6cab15 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:45:44.054740 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6ad05fac-3d91-4068-adb4-c815ec6cab15 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:44.055187 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6ad05fac-3d91-4068-adb4-c815ec6cab15 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:44.055950 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6ad05fac-3d91-4068-adb4-c815ec6cab15 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:44.056402 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6ad05fac-3d91-4068-adb4-c815ec6cab15 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:44.185352 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-6ad05fac-3d91-4068-adb4-c815ec6cab15 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:45:44.193439 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-6ad05fac-3d91-4068-adb4-c815ec6cab15 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1732 microversion: 2.1 time: 0.150430 Jun 17 15:45:44.194000 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1426/3267] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:45:44 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1732 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:45:45.210789 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-1d0b1ffd-da85-443f-bb73-afd5b148e1ca tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:45:45.211398 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-1d0b1ffd-da85-443f-bb73-afd5b148e1ca tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:45:45.218094 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1d0b1ffd-da85-443f-bb73-afd5b148e1ca tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:45.218542 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1d0b1ffd-da85-443f-bb73-afd5b148e1ca tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:45.219347 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1d0b1ffd-da85-443f-bb73-afd5b148e1ca tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:45.219777 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1d0b1ffd-da85-443f-bb73-afd5b148e1ca tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:45.348588 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-1d0b1ffd-da85-443f-bb73-afd5b148e1ca tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:45:45.357799 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-1d0b1ffd-da85-443f-bb73-afd5b148e1ca tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1732 microversion: 2.1 time: 0.150815 Jun 17 15:45:45.358289 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1842/3268] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:45:45 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1732 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:45:46.375471 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-aae277a9-54cf-42b6-bc6a-dc562b04135a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:45:46.376200 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-aae277a9-54cf-42b6-bc6a-dc562b04135a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:45:46.382301 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-aae277a9-54cf-42b6-bc6a-dc562b04135a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:46.382754 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-aae277a9-54cf-42b6-bc6a-dc562b04135a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:46.383528 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-aae277a9-54cf-42b6-bc6a-dc562b04135a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:46.383970 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-aae277a9-54cf-42b6-bc6a-dc562b04135a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:46.522998 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-aae277a9-54cf-42b6-bc6a-dc562b04135a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:45:46.530917 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-aae277a9-54cf-42b6-bc6a-dc562b04135a tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1732 microversion: 2.1 time: 0.160158 Jun 17 15:45:46.531488 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1427/3269] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:45:46 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1732 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:45:46.642623 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-7f7a943c-8670-4bb6-97e4-851a8a591fea tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:45:46.643180 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-7f7a943c-8670-4bb6-97e4-851a8a591fea tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: 031f230c-48e6-46bb-a549-3cb347946170] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:45:46.649577 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7f7a943c-8670-4bb6-97e4-851a8a591fea tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:46.650028 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7f7a943c-8670-4bb6-97e4-851a8a591fea tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:46.650816 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7f7a943c-8670-4bb6-97e4-851a8a591fea tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:46.651253 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7f7a943c-8670-4bb6-97e4-851a8a591fea tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:46.674271 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-7f7a943c-8670-4bb6-97e4-851a8a591fea tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170/ips" status: 200 len: 151 microversion: 2.20 time: 0.035665 Jun 17 15:45:46.674840 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1843/3270] 10.222.0.48 () {60 vars in 1288 bytes} [Fri Jun 17 15:45:46 2022] GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170/ips => generated 151 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 17 15:45:47.547991 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-194e4524-5321-49ed-824a-15691bb7992e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:45:47.548627 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-194e4524-5321-49ed-824a-15691bb7992e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:45:47.555077 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-194e4524-5321-49ed-824a-15691bb7992e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:47.555522 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-194e4524-5321-49ed-824a-15691bb7992e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:47.556273 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-194e4524-5321-49ed-824a-15691bb7992e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:47.556731 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-194e4524-5321-49ed-824a-15691bb7992e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:47.688075 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-194e4524-5321-49ed-824a-15691bb7992e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:45:47.695951 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-194e4524-5321-49ed-824a-15691bb7992e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1732 microversion: 2.1 time: 0.151889 Jun 17 15:45:47.696535 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1428/3271] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:45:47 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1732 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:45:48.713832 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-aea6f51c-5114-43eb-ac49-af5203880536 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:45:48.714387 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-aea6f51c-5114-43eb-ac49-af5203880536 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:45:48.720902 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-aea6f51c-5114-43eb-ac49-af5203880536 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:48.721350 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-aea6f51c-5114-43eb-ac49-af5203880536 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:48.722110 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-aea6f51c-5114-43eb-ac49-af5203880536 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:48.722542 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-aea6f51c-5114-43eb-ac49-af5203880536 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:48.849493 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-aea6f51c-5114-43eb-ac49-af5203880536 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:45:48.858349 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-aea6f51c-5114-43eb-ac49-af5203880536 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1732 microversion: 2.1 time: 0.148498 Jun 17 15:45:48.858898 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1844/3272] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:45:48 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1732 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:45:49.875300 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-2ee609e0-d968-4080-907c-ffc0f6c06394 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:45:49.875913 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-2ee609e0-d968-4080-907c-ffc0f6c06394 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:45:49.882357 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2ee609e0-d968-4080-907c-ffc0f6c06394 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:49.882801 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2ee609e0-d968-4080-907c-ffc0f6c06394 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:49.883580 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2ee609e0-d968-4080-907c-ffc0f6c06394 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:49.884014 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2ee609e0-d968-4080-907c-ffc0f6c06394 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:50.009988 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-2ee609e0-d968-4080-907c-ffc0f6c06394 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:45:50.018059 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-2ee609e0-d968-4080-907c-ffc0f6c06394 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1732 microversion: 2.1 time: 0.146646 Jun 17 15:45:50.018624 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1429/3273] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:45:49 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1732 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:45:51.035745 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-fe8e01ad-9338-48b0-9545-3d4ada618652 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:45:51.036300 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-fe8e01ad-9338-48b0-9545-3d4ada618652 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:45:51.042856 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fe8e01ad-9338-48b0-9545-3d4ada618652 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:51.043305 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fe8e01ad-9338-48b0-9545-3d4ada618652 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:51.044070 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fe8e01ad-9338-48b0-9545-3d4ada618652 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:51.044550 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fe8e01ad-9338-48b0-9545-3d4ada618652 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:51.179294 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-fe8e01ad-9338-48b0-9545-3d4ada618652 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:45:51.187687 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-fe8e01ad-9338-48b0-9545-3d4ada618652 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1732 microversion: 2.1 time: 0.155869 Jun 17 15:45:51.188269 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1845/3274] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:45:51 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1732 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:45:52.206053 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-a1550c9b-b236-4d2c-b04e-46b2dc6e3a45 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:45:52.206688 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-a1550c9b-b236-4d2c-b04e-46b2dc6e3a45 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:45:52.213098 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a1550c9b-b236-4d2c-b04e-46b2dc6e3a45 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:52.213538 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a1550c9b-b236-4d2c-b04e-46b2dc6e3a45 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:52.214285 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a1550c9b-b236-4d2c-b04e-46b2dc6e3a45 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:52.214714 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a1550c9b-b236-4d2c-b04e-46b2dc6e3a45 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:52.347196 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-a1550c9b-b236-4d2c-b04e-46b2dc6e3a45 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:45:52.355902 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-a1550c9b-b236-4d2c-b04e-46b2dc6e3a45 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1732 microversion: 2.1 time: 0.153658 Jun 17 15:45:52.356479 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1430/3275] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:45:52 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1732 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:45:53.373093 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-e8a866d3-4bde-4a36-a429-2fc892c2b84e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:45:53.373721 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-e8a866d3-4bde-4a36-a429-2fc892c2b84e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:45:53.376132 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_api:SELECT=28 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:45:53.381670 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e8a866d3-4bde-4a36-a429-2fc892c2b84e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:53.382116 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e8a866d3-4bde-4a36-a429-2fc892c2b84e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:53.382885 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e8a866d3-4bde-4a36-a429-2fc892c2b84e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:53.383319 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e8a866d3-4bde-4a36-a429-2fc892c2b84e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:53.509810 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-e8a866d3-4bde-4a36-a429-2fc892c2b84e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:45:53.517787 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-e8a866d3-4bde-4a36-a429-2fc892c2b84e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1732 microversion: 2.1 time: 0.149485 Jun 17 15:45:53.518344 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1846/3276] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:45:53 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1732 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:45:54.536988 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-6ec45f4c-6fde-447d-8184-fb2b7fe04422 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:45:54.538130 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-6ec45f4c-6fde-447d-8184-fb2b7fe04422 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:45:54.550181 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6ec45f4c-6fde-447d-8184-fb2b7fe04422 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:54.550638 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6ec45f4c-6fde-447d-8184-fb2b7fe04422 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:54.551424 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6ec45f4c-6fde-447d-8184-fb2b7fe04422 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:54.551865 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6ec45f4c-6fde-447d-8184-fb2b7fe04422 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:54.684829 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-6ec45f4c-6fde-447d-8184-fb2b7fe04422 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:45:54.692675 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-6ec45f4c-6fde-447d-8184-fb2b7fe04422 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1732 microversion: 2.1 time: 0.161299 Jun 17 15:45:54.693236 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1431/3277] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:45:54 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1732 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:45:55.710826 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-3a4103bf-8f28-44b0-bb61-df0db21422c9 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:45:55.711393 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-3a4103bf-8f28-44b0-bb61-df0db21422c9 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:45:55.718149 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3a4103bf-8f28-44b0-bb61-df0db21422c9 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:55.718594 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3a4103bf-8f28-44b0-bb61-df0db21422c9 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:55.719347 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3a4103bf-8f28-44b0-bb61-df0db21422c9 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:55.719775 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3a4103bf-8f28-44b0-bb61-df0db21422c9 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:55.723683 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=82 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:45:55.851217 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-3a4103bf-8f28-44b0-bb61-df0db21422c9 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:45:55.859417 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-3a4103bf-8f28-44b0-bb61-df0db21422c9 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1732 microversion: 2.1 time: 0.153031 Jun 17 15:45:55.860257 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1847/3278] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:45:55 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1732 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:45:56.876507 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-caf47fb4-ecca-4763-baf5-b72547fd1cd2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:45:56.877130 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-caf47fb4-ecca-4763-baf5-b72547fd1cd2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:45:56.879466 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_api:SELECT=28 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:45:56.885132 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-caf47fb4-ecca-4763-baf5-b72547fd1cd2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:56.885583 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-caf47fb4-ecca-4763-baf5-b72547fd1cd2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:56.886838 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-caf47fb4-ecca-4763-baf5-b72547fd1cd2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:56.887270 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-caf47fb4-ecca-4763-baf5-b72547fd1cd2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:57.028166 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-caf47fb4-ecca-4763-baf5-b72547fd1cd2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:45:57.036225 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-caf47fb4-ecca-4763-baf5-b72547fd1cd2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1732 microversion: 2.1 time: 0.163640 Jun 17 15:45:57.036865 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1432/3279] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:45:56 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1732 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:45:58.053340 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-1a3ad8d9-db33-4826-ab30-020fd685fca8 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:45:58.053994 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-1a3ad8d9-db33-4826-ab30-020fd685fca8 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:45:58.061231 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1a3ad8d9-db33-4826-ab30-020fd685fca8 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:58.061683 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1a3ad8d9-db33-4826-ab30-020fd685fca8 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:58.062437 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1a3ad8d9-db33-4826-ab30-020fd685fca8 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:58.062866 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1a3ad8d9-db33-4826-ab30-020fd685fca8 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:58.213837 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-1a3ad8d9-db33-4826-ab30-020fd685fca8 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:45:58.222134 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-1a3ad8d9-db33-4826-ab30-020fd685fca8 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1732 microversion: 2.1 time: 0.172608 Jun 17 15:45:58.222735 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1848/3280] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:45:58 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1732 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:45:59.239025 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-0bfc68e3-6c57-47a7-b089-8c06b6cd2011 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:45:59.239645 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-0bfc68e3-6c57-47a7-b089-8c06b6cd2011 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:45:59.246070 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0bfc68e3-6c57-47a7-b089-8c06b6cd2011 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:59.246516 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0bfc68e3-6c57-47a7-b089-8c06b6cd2011 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:59.247264 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0bfc68e3-6c57-47a7-b089-8c06b6cd2011 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:45:59.247692 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0bfc68e3-6c57-47a7-b089-8c06b6cd2011 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:45:59.379882 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-0bfc68e3-6c57-47a7-b089-8c06b6cd2011 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:45:59.388258 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-0bfc68e3-6c57-47a7-b089-8c06b6cd2011 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1732 microversion: 2.1 time: 0.153062 Jun 17 15:45:59.388859 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1433/3281] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:45:59 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1732 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:46:00.405834 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-dc29a838-2efe-4356-9d98-c7da544bfa63 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:46:00.406429 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-dc29a838-2efe-4356-9d98-c7da544bfa63 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:46:00.412983 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-dc29a838-2efe-4356-9d98-c7da544bfa63 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:00.413424 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-dc29a838-2efe-4356-9d98-c7da544bfa63 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:00.414175 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-dc29a838-2efe-4356-9d98-c7da544bfa63 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:00.414603 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-dc29a838-2efe-4356-9d98-c7da544bfa63 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:00.551044 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-dc29a838-2efe-4356-9d98-c7da544bfa63 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:46:00.559691 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-dc29a838-2efe-4356-9d98-c7da544bfa63 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1732 microversion: 2.1 time: 0.158078 Jun 17 15:46:00.560276 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1849/3282] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:46:00 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1732 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:46:01.577046 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-34ab987d-9dbd-447e-9678-96dd0a47f976 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:46:01.577662 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-34ab987d-9dbd-447e-9678-96dd0a47f976 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:46:01.584659 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-34ab987d-9dbd-447e-9678-96dd0a47f976 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:01.585110 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-34ab987d-9dbd-447e-9678-96dd0a47f976 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:01.585878 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-34ab987d-9dbd-447e-9678-96dd0a47f976 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:01.586318 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-34ab987d-9dbd-447e-9678-96dd0a47f976 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:01.729591 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-34ab987d-9dbd-447e-9678-96dd0a47f976 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:46:01.738770 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-34ab987d-9dbd-447e-9678-96dd0a47f976 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1732 microversion: 2.1 time: 0.165510 Jun 17 15:46:01.739363 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1434/3283] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:46:01 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1732 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:46:02.756573 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-3044f620-248f-4c15-896f-cd5718e22aa9 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:46:02.757152 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-3044f620-248f-4c15-896f-cd5718e22aa9 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:46:02.764388 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3044f620-248f-4c15-896f-cd5718e22aa9 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:02.764837 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3044f620-248f-4c15-896f-cd5718e22aa9 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:02.765603 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3044f620-248f-4c15-896f-cd5718e22aa9 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:02.766038 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3044f620-248f-4c15-896f-cd5718e22aa9 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:02.905814 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-3044f620-248f-4c15-896f-cd5718e22aa9 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:46:02.914111 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-3044f620-248f-4c15-896f-cd5718e22aa9 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1732 microversion: 2.1 time: 0.161525 Jun 17 15:46:02.916275 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1850/3284] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:46:02 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1732 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:46:03.931027 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-47fbf2c2-0f5a-48e4-8513-af58b6d37ed5 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:46:03.931672 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-47fbf2c2-0f5a-48e4-8513-af58b6d37ed5 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:46:03.938871 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-47fbf2c2-0f5a-48e4-8513-af58b6d37ed5 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:03.939319 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-47fbf2c2-0f5a-48e4-8513-af58b6d37ed5 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:03.940077 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-47fbf2c2-0f5a-48e4-8513-af58b6d37ed5 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:03.940539 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-47fbf2c2-0f5a-48e4-8513-af58b6d37ed5 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:04.078855 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-47fbf2c2-0f5a-48e4-8513-af58b6d37ed5 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:46:04.087016 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-47fbf2c2-0f5a-48e4-8513-af58b6d37ed5 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1732 microversion: 2.1 time: 0.159823 Jun 17 15:46:04.087595 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1435/3285] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:46:03 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1732 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:46:05.105640 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-4728421d-cf3e-4055-b7cc-e93b53c5eef7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:46:05.106264 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-4728421d-cf3e-4055-b7cc-e93b53c5eef7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:46:05.112996 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4728421d-cf3e-4055-b7cc-e93b53c5eef7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:05.113473 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4728421d-cf3e-4055-b7cc-e93b53c5eef7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:05.114241 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4728421d-cf3e-4055-b7cc-e93b53c5eef7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:05.114667 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4728421d-cf3e-4055-b7cc-e93b53c5eef7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:05.244042 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-4728421d-cf3e-4055-b7cc-e93b53c5eef7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:46:05.252691 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-4728421d-cf3e-4055-b7cc-e93b53c5eef7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1732 microversion: 2.1 time: 0.151684 Jun 17 15:46:05.253254 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1851/3286] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:46:05 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1732 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:46:06.270183 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-d0a0e6d0-1a58-4301-9cbc-e9472cdcbe31 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:46:06.270760 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-d0a0e6d0-1a58-4301-9cbc-e9472cdcbe31 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:46:06.277360 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d0a0e6d0-1a58-4301-9cbc-e9472cdcbe31 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:06.277812 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d0a0e6d0-1a58-4301-9cbc-e9472cdcbe31 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:06.278574 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d0a0e6d0-1a58-4301-9cbc-e9472cdcbe31 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:06.279007 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d0a0e6d0-1a58-4301-9cbc-e9472cdcbe31 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:06.281663 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell1:SELECT=84 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:46:06.412174 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-d0a0e6d0-1a58-4301-9cbc-e9472cdcbe31 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:46:06.420743 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-d0a0e6d0-1a58-4301-9cbc-e9472cdcbe31 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1732 microversion: 2.1 time: 0.154650 Jun 17 15:46:06.421308 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1436/3287] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:46:06 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1732 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:46:07.438514 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-d208f636-2869-4d78-8d89-e2cace69cffc tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:46:07.439169 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-d208f636-2869-4d78-8d89-e2cace69cffc tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:46:07.446131 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d208f636-2869-4d78-8d89-e2cace69cffc tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:07.446580 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d208f636-2869-4d78-8d89-e2cace69cffc tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:07.447356 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d208f636-2869-4d78-8d89-e2cace69cffc tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:07.447792 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d208f636-2869-4d78-8d89-e2cace69cffc tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:07.589006 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-d208f636-2869-4d78-8d89-e2cace69cffc tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:46:07.597468 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-d208f636-2869-4d78-8d89-e2cace69cffc tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1732 microversion: 2.1 time: 0.162858 Jun 17 15:46:07.598044 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1852/3288] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:46:07 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1732 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:46:08.615639 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-e2a12f4a-b4c7-42aa-b7e0-9b0ecb1cc212 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:46:08.616271 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-e2a12f4a-b4c7-42aa-b7e0-9b0ecb1cc212 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:46:08.623570 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e2a12f4a-b4c7-42aa-b7e0-9b0ecb1cc212 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:08.624011 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e2a12f4a-b4c7-42aa-b7e0-9b0ecb1cc212 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:08.624805 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e2a12f4a-b4c7-42aa-b7e0-9b0ecb1cc212 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:08.625234 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e2a12f4a-b4c7-42aa-b7e0-9b0ecb1cc212 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:08.766011 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-e2a12f4a-b4c7-42aa-b7e0-9b0ecb1cc212 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:46:08.773871 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-e2a12f4a-b4c7-42aa-b7e0-9b0ecb1cc212 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1732 microversion: 2.1 time: 0.162191 Jun 17 15:46:08.774437 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1437/3289] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:46:08 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1732 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:46:09.791175 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-36d6cebc-a93e-431a-9037-f78b66a300cf tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:46:09.791766 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-36d6cebc-a93e-431a-9037-f78b66a300cf tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:46:09.798524 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-36d6cebc-a93e-431a-9037-f78b66a300cf tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:09.798974 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-36d6cebc-a93e-431a-9037-f78b66a300cf tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:09.799749 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-36d6cebc-a93e-431a-9037-f78b66a300cf tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:09.800189 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-36d6cebc-a93e-431a-9037-f78b66a300cf tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:09.935853 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-36d6cebc-a93e-431a-9037-f78b66a300cf tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:46:09.943822 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-36d6cebc-a93e-431a-9037-f78b66a300cf tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1732 microversion: 2.1 time: 0.156655 Jun 17 15:46:09.944411 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1853/3290] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:46:09 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1732 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:46:10.961472 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-850cc938-845b-4051-90b2-fb3264d221e3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:46:10.962091 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-850cc938-845b-4051-90b2-fb3264d221e3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:46:10.969245 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-850cc938-845b-4051-90b2-fb3264d221e3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:10.969767 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-850cc938-845b-4051-90b2-fb3264d221e3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:10.970633 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-850cc938-845b-4051-90b2-fb3264d221e3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:10.971070 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-850cc938-845b-4051-90b2-fb3264d221e3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:11.220541 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-850cc938-845b-4051-90b2-fb3264d221e3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:46:11.229264 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-850cc938-845b-4051-90b2-fb3264d221e3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1732 microversion: 2.1 time: 0.271717 Jun 17 15:46:11.229828 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1438/3291] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:46:10 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1732 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:46:12.247456 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-226b4dcb-0384-4fc0-9a45-c08791f62c18 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:46:12.248020 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-226b4dcb-0384-4fc0-9a45-c08791f62c18 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:46:12.254919 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-226b4dcb-0384-4fc0-9a45-c08791f62c18 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:12.255363 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-226b4dcb-0384-4fc0-9a45-c08791f62c18 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:12.256117 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-226b4dcb-0384-4fc0-9a45-c08791f62c18 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:12.256570 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-226b4dcb-0384-4fc0-9a45-c08791f62c18 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:12.391941 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-226b4dcb-0384-4fc0-9a45-c08791f62c18 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:46:12.401919 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-226b4dcb-0384-4fc0-9a45-c08791f62c18 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1732 microversion: 2.1 time: 0.159014 Jun 17 15:46:12.402583 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1854/3292] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:46:12 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1732 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:46:13.420726 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-49feef9b-3a61-4af4-94f5-203a1adbd4ec tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:46:13.421329 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-49feef9b-3a61-4af4-94f5-203a1adbd4ec tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:46:13.427871 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-49feef9b-3a61-4af4-94f5-203a1adbd4ec tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:13.428313 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-49feef9b-3a61-4af4-94f5-203a1adbd4ec tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:13.429093 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-49feef9b-3a61-4af4-94f5-203a1adbd4ec tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:13.429522 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-49feef9b-3a61-4af4-94f5-203a1adbd4ec tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:13.566293 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-49feef9b-3a61-4af4-94f5-203a1adbd4ec tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:46:13.574391 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-49feef9b-3a61-4af4-94f5-203a1adbd4ec tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1732 microversion: 2.1 time: 0.158147 Jun 17 15:46:13.574962 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1439/3293] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:46:13 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1732 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:46:14.592020 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-5db0f01e-cea1-48e5-b455-a55d5ffade0b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:46:14.592644 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-5db0f01e-cea1-48e5-b455-a55d5ffade0b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:46:14.599120 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5db0f01e-cea1-48e5-b455-a55d5ffade0b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:14.599570 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5db0f01e-cea1-48e5-b455-a55d5ffade0b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:14.600346 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5db0f01e-cea1-48e5-b455-a55d5ffade0b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:14.600803 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5db0f01e-cea1-48e5-b455-a55d5ffade0b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:14.733388 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-5db0f01e-cea1-48e5-b455-a55d5ffade0b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:46:14.741601 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-5db0f01e-cea1-48e5-b455-a55d5ffade0b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1732 microversion: 2.1 time: 0.153970 Jun 17 15:46:14.742188 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1855/3294] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:46:14 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1732 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:46:15.759116 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-7ee875e2-d85a-440b-ab5b-f52d87abb310 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:46:15.759712 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-7ee875e2-d85a-440b-ab5b-f52d87abb310 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:46:15.766349 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7ee875e2-d85a-440b-ab5b-f52d87abb310 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:15.766792 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7ee875e2-d85a-440b-ab5b-f52d87abb310 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:15.767549 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7ee875e2-d85a-440b-ab5b-f52d87abb310 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:15.767984 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7ee875e2-d85a-440b-ab5b-f52d87abb310 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:15.902050 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-7ee875e2-d85a-440b-ab5b-f52d87abb310 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:46:15.910128 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-7ee875e2-d85a-440b-ab5b-f52d87abb310 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1732 microversion: 2.1 time: 0.155143 Jun 17 15:46:15.910707 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1440/3295] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:46:15 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1732 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:46:16.836727 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 15:46:16.837348 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Fri Jun 17 15:46:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 15:46:16.927034 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-08ece260-bcee-4245-889b-25cef59eb4f4 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:46:16.927635 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-08ece260-bcee-4245-889b-25cef59eb4f4 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:46:16.934417 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-08ece260-bcee-4245-889b-25cef59eb4f4 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:16.934860 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-08ece260-bcee-4245-889b-25cef59eb4f4 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:16.935623 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-08ece260-bcee-4245-889b-25cef59eb4f4 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:16.936050 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-08ece260-bcee-4245-889b-25cef59eb4f4 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:17.078173 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-08ece260-bcee-4245-889b-25cef59eb4f4 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:46:17.086520 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-08ece260-bcee-4245-889b-25cef59eb4f4 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1732 microversion: 2.1 time: 0.163271 Jun 17 15:46:17.087162 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1856/3296] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:46:16 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1732 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:46:18.105601 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-b895f137-bcae-4b30-af38-79bad9337e2c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:46:18.106211 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-b895f137-bcae-4b30-af38-79bad9337e2c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:46:18.112915 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b895f137-bcae-4b30-af38-79bad9337e2c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:18.113296 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b895f137-bcae-4b30-af38-79bad9337e2c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:18.114059 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b895f137-bcae-4b30-af38-79bad9337e2c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:18.114498 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b895f137-bcae-4b30-af38-79bad9337e2c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:18.242648 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-b895f137-bcae-4b30-af38-79bad9337e2c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:46:18.251101 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-b895f137-bcae-4b30-af38-79bad9337e2c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1732 microversion: 2.1 time: 0.149815 Jun 17 15:46:18.251678 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1441/3297] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:46:18 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1732 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:46:19.268310 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-7469d1df-8366-4a56-85b9-9aa66b2b5b66 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:46:19.268964 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-7469d1df-8366-4a56-85b9-9aa66b2b5b66 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:46:19.275596 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7469d1df-8366-4a56-85b9-9aa66b2b5b66 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:19.276047 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7469d1df-8366-4a56-85b9-9aa66b2b5b66 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:19.277333 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7469d1df-8366-4a56-85b9-9aa66b2b5b66 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:19.277767 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7469d1df-8366-4a56-85b9-9aa66b2b5b66 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:19.419747 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-7469d1df-8366-4a56-85b9-9aa66b2b5b66 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:46:19.428163 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-7469d1df-8366-4a56-85b9-9aa66b2b5b66 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1732 microversion: 2.1 time: 0.163737 Jun 17 15:46:19.428772 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1857/3298] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:46:19 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1732 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:46:20.444858 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-e2477b55-3715-4d41-8d33-60f1bb799ad3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:46:20.445423 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-e2477b55-3715-4d41-8d33-60f1bb799ad3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:46:20.452426 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e2477b55-3715-4d41-8d33-60f1bb799ad3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:20.452878 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e2477b55-3715-4d41-8d33-60f1bb799ad3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:20.453646 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e2477b55-3715-4d41-8d33-60f1bb799ad3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:20.454086 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e2477b55-3715-4d41-8d33-60f1bb799ad3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:20.593374 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-e2477b55-3715-4d41-8d33-60f1bb799ad3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:46:20.602039 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-e2477b55-3715-4d41-8d33-60f1bb799ad3 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1732 microversion: 2.1 time: 0.160820 Jun 17 15:46:20.602623 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1442/3299] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:46:20 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1732 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:46:21.619752 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-0284ba4a-71e8-471b-9cf5-0a764b69966c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:46:21.621084 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-0284ba4a-71e8-471b-9cf5-0a764b69966c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:46:21.627780 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0284ba4a-71e8-471b-9cf5-0a764b69966c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:21.628224 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0284ba4a-71e8-471b-9cf5-0a764b69966c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:21.629109 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0284ba4a-71e8-471b-9cf5-0a764b69966c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:21.629466 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0284ba4a-71e8-471b-9cf5-0a764b69966c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:21.763253 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-0284ba4a-71e8-471b-9cf5-0a764b69966c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:46:21.771643 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-0284ba4a-71e8-471b-9cf5-0a764b69966c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1732 microversion: 2.1 time: 0.155667 Jun 17 15:46:21.772245 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1858/3300] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:46:21 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1732 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:46:22.789397 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-aff914ee-6376-4a6a-bb5a-139cee30ba5d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:46:22.789990 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-aff914ee-6376-4a6a-bb5a-139cee30ba5d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:46:22.796530 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-aff914ee-6376-4a6a-bb5a-139cee30ba5d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:22.796975 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-aff914ee-6376-4a6a-bb5a-139cee30ba5d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:22.797729 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-aff914ee-6376-4a6a-bb5a-139cee30ba5d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:22.798157 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-aff914ee-6376-4a6a-bb5a-139cee30ba5d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:22.929478 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-aff914ee-6376-4a6a-bb5a-139cee30ba5d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:46:22.938529 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-aff914ee-6376-4a6a-bb5a-139cee30ba5d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1732 microversion: 2.1 time: 0.153044 Jun 17 15:46:22.939104 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1443/3301] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:46:22 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1732 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:46:23.955280 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-19ea2494-3b71-4e4c-a9de-08a15c941259 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:46:23.955869 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-19ea2494-3b71-4e4c-a9de-08a15c941259 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:46:23.958202 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_api:SELECT=26 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:46:23.963506 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-19ea2494-3b71-4e4c-a9de-08a15c941259 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:23.963949 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-19ea2494-3b71-4e4c-a9de-08a15c941259 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:23.964751 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-19ea2494-3b71-4e4c-a9de-08a15c941259 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:23.965256 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-19ea2494-3b71-4e4c-a9de-08a15c941259 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:24.101546 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-19ea2494-3b71-4e4c-a9de-08a15c941259 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:46:24.110991 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-19ea2494-3b71-4e4c-a9de-08a15c941259 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1732 microversion: 2.1 time: 0.159513 Jun 17 15:46:24.111571 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1859/3302] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:46:23 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1732 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:46:25.128603 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-fdf3f92c-c651-400e-a0ce-78f27f96b546 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:46:25.129328 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-fdf3f92c-c651-400e-a0ce-78f27f96b546 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:46:25.136510 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fdf3f92c-c651-400e-a0ce-78f27f96b546 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:25.137071 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fdf3f92c-c651-400e-a0ce-78f27f96b546 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:25.137832 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fdf3f92c-c651-400e-a0ce-78f27f96b546 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:25.138266 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fdf3f92c-c651-400e-a0ce-78f27f96b546 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:25.272978 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-fdf3f92c-c651-400e-a0ce-78f27f96b546 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:46:25.281087 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-fdf3f92c-c651-400e-a0ce-78f27f96b546 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1732 microversion: 2.1 time: 0.156379 Jun 17 15:46:25.281960 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1444/3303] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:46:25 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1732 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:46:26.298199 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-e1130bf7-efbe-4783-a56b-bb31466d0e80 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:46:26.298782 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-e1130bf7-efbe-4783-a56b-bb31466d0e80 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:46:26.305147 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e1130bf7-efbe-4783-a56b-bb31466d0e80 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:26.305602 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e1130bf7-efbe-4783-a56b-bb31466d0e80 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:26.306394 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e1130bf7-efbe-4783-a56b-bb31466d0e80 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:26.306832 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e1130bf7-efbe-4783-a56b-bb31466d0e80 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:26.309803 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=78 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:46:26.439743 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-e1130bf7-efbe-4783-a56b-bb31466d0e80 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:46:26.447754 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-e1130bf7-efbe-4783-a56b-bb31466d0e80 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1732 microversion: 2.1 time: 0.153562 Jun 17 15:46:26.448833 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1860/3304] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:46:26 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1732 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:46:27.465610 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-8295a192-fc26-4501-8482-31153259fa53 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:46:27.466237 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-8295a192-fc26-4501-8482-31153259fa53 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:46:27.468504 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_api:SELECT=26 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:46:27.473624 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8295a192-fc26-4501-8482-31153259fa53 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:27.474064 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8295a192-fc26-4501-8482-31153259fa53 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:27.474810 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8295a192-fc26-4501-8482-31153259fa53 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:27.475240 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8295a192-fc26-4501-8482-31153259fa53 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:27.602494 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-8295a192-fc26-4501-8482-31153259fa53 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:46:27.610876 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-8295a192-fc26-4501-8482-31153259fa53 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1732 microversion: 2.1 time: 0.149605 Jun 17 15:46:27.611441 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1445/3305] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:46:27 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1732 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:46:28.628662 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-f5a7e6b5-df35-45e3-8830-b034d83f2c6b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:46:28.629243 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-f5a7e6b5-df35-45e3-8830-b034d83f2c6b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:46:28.635666 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f5a7e6b5-df35-45e3-8830-b034d83f2c6b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:28.636106 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f5a7e6b5-df35-45e3-8830-b034d83f2c6b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:28.636889 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f5a7e6b5-df35-45e3-8830-b034d83f2c6b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:28.637315 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f5a7e6b5-df35-45e3-8830-b034d83f2c6b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:28.765052 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-f5a7e6b5-df35-45e3-8830-b034d83f2c6b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:46:28.772973 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-f5a7e6b5-df35-45e3-8830-b034d83f2c6b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1732 microversion: 2.1 time: 0.148265 Jun 17 15:46:28.773536 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1861/3306] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:46:28 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1732 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:46:29.789877 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-f26c6161-c90c-4486-b2e6-7a2fc6fdfde2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:46:29.790491 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-f26c6161-c90c-4486-b2e6-7a2fc6fdfde2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:46:29.797116 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f26c6161-c90c-4486-b2e6-7a2fc6fdfde2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:29.797570 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f26c6161-c90c-4486-b2e6-7a2fc6fdfde2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:29.798336 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f26c6161-c90c-4486-b2e6-7a2fc6fdfde2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:29.798769 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f26c6161-c90c-4486-b2e6-7a2fc6fdfde2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:29.939206 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-f26c6161-c90c-4486-b2e6-7a2fc6fdfde2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:46:29.947218 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-f26c6161-c90c-4486-b2e6-7a2fc6fdfde2 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1732 microversion: 2.1 time: 0.161411 Jun 17 15:46:29.947794 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1446/3307] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:46:29 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1732 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:46:30.964941 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-fd384e3d-8768-4f7b-98c2-ec544521cd1c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:46:30.965555 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-fd384e3d-8768-4f7b-98c2-ec544521cd1c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:46:30.972293 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fd384e3d-8768-4f7b-98c2-ec544521cd1c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:30.972773 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fd384e3d-8768-4f7b-98c2-ec544521cd1c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:30.973539 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fd384e3d-8768-4f7b-98c2-ec544521cd1c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:30.973970 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fd384e3d-8768-4f7b-98c2-ec544521cd1c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:31.109830 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-fd384e3d-8768-4f7b-98c2-ec544521cd1c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:46:31.118014 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-fd384e3d-8768-4f7b-98c2-ec544521cd1c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1732 microversion: 2.1 time: 0.157577 Jun 17 15:46:31.118584 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1862/3308] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:46:30 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1732 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:46:32.136586 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-d204b19a-ce80-4a55-a0b3-5e09599e41a1 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:46:32.137219 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-d204b19a-ce80-4a55-a0b3-5e09599e41a1 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:46:32.143623 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d204b19a-ce80-4a55-a0b3-5e09599e41a1 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:32.144069 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d204b19a-ce80-4a55-a0b3-5e09599e41a1 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:32.144867 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d204b19a-ce80-4a55-a0b3-5e09599e41a1 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:32.145307 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d204b19a-ce80-4a55-a0b3-5e09599e41a1 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:32.274330 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-d204b19a-ce80-4a55-a0b3-5e09599e41a1 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:46:32.283102 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-d204b19a-ce80-4a55-a0b3-5e09599e41a1 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1732 microversion: 2.1 time: 0.151199 Jun 17 15:46:32.283688 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1447/3309] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:46:32 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1732 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:46:33.300785 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-3725fab8-53f9-4e25-a463-a4ed97c59c96 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:46:33.301399 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-3725fab8-53f9-4e25-a463-a4ed97c59c96 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:46:33.307742 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3725fab8-53f9-4e25-a463-a4ed97c59c96 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:33.308185 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3725fab8-53f9-4e25-a463-a4ed97c59c96 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:33.309502 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3725fab8-53f9-4e25-a463-a4ed97c59c96 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:33.309930 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3725fab8-53f9-4e25-a463-a4ed97c59c96 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:33.441789 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-3725fab8-53f9-4e25-a463-a4ed97c59c96 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:46:33.450333 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-3725fab8-53f9-4e25-a463-a4ed97c59c96 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1732 microversion: 2.1 time: 0.153390 Jun 17 15:46:33.450890 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1863/3310] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:46:33 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1732 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:46:34.467897 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-a42cff77-9d3e-4c79-8499-3ba4fe7f90f5 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:46:34.468557 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-a42cff77-9d3e-4c79-8499-3ba4fe7f90f5 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:46:34.475273 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a42cff77-9d3e-4c79-8499-3ba4fe7f90f5 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:34.475729 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a42cff77-9d3e-4c79-8499-3ba4fe7f90f5 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:34.476537 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a42cff77-9d3e-4c79-8499-3ba4fe7f90f5 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:34.477230 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a42cff77-9d3e-4c79-8499-3ba4fe7f90f5 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:34.630708 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-a42cff77-9d3e-4c79-8499-3ba4fe7f90f5 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:46:34.639315 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-a42cff77-9d3e-4c79-8499-3ba4fe7f90f5 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1732 microversion: 2.1 time: 0.175841 Jun 17 15:46:34.639886 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1448/3311] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:46:34 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1732 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:46:35.657207 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-6da93429-ef48-403b-8a10-b3fd6542fc90 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:46:35.657779 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-6da93429-ef48-403b-8a10-b3fd6542fc90 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:46:35.664853 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6da93429-ef48-403b-8a10-b3fd6542fc90 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:35.665295 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6da93429-ef48-403b-8a10-b3fd6542fc90 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:35.666063 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6da93429-ef48-403b-8a10-b3fd6542fc90 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:35.666493 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6da93429-ef48-403b-8a10-b3fd6542fc90 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:35.822757 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-6da93429-ef48-403b-8a10-b3fd6542fc90 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:46:35.831864 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-6da93429-ef48-403b-8a10-b3fd6542fc90 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1732 microversion: 2.1 time: 0.178582 Jun 17 15:46:35.832451 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1864/3312] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:46:35 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1732 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:46:36.850486 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-4a1f92dd-1c27-4efb-ac6a-946961da6d76 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:46:36.851104 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-4a1f92dd-1c27-4efb-ac6a-946961da6d76 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:46:36.858846 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4a1f92dd-1c27-4efb-ac6a-946961da6d76 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:36.859295 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4a1f92dd-1c27-4efb-ac6a-946961da6d76 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:36.860082 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4a1f92dd-1c27-4efb-ac6a-946961da6d76 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:36.860566 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4a1f92dd-1c27-4efb-ac6a-946961da6d76 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:36.863451 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell1:SELECT=78 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:46:37.001676 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-4a1f92dd-1c27-4efb-ac6a-946961da6d76 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:46:37.009956 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-4a1f92dd-1c27-4efb-ac6a-946961da6d76 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1732 microversion: 2.1 time: 0.163374 Jun 17 15:46:37.010548 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1449/3313] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:46:36 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1732 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:46:38.027691 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-219e5be1-235a-4d34-8004-699131d8c8b1 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:46:38.028353 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-219e5be1-235a-4d34-8004-699131d8c8b1 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:46:38.035334 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-219e5be1-235a-4d34-8004-699131d8c8b1 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:38.035779 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-219e5be1-235a-4d34-8004-699131d8c8b1 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:38.036591 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-219e5be1-235a-4d34-8004-699131d8c8b1 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:38.037023 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-219e5be1-235a-4d34-8004-699131d8c8b1 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:38.175530 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-219e5be1-235a-4d34-8004-699131d8c8b1 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:46:38.182321 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-219e5be1-235a-4d34-8004-699131d8c8b1 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1732 microversion: 2.1 time: 0.158925 Jun 17 15:46:38.182909 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1865/3314] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:46:38 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1732 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:46:39.201195 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-13adbe61-6a18-4301-ad26-71e4b2590d30 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:46:39.201853 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-13adbe61-6a18-4301-ad26-71e4b2590d30 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:46:39.209115 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-13adbe61-6a18-4301-ad26-71e4b2590d30 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:39.209560 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-13adbe61-6a18-4301-ad26-71e4b2590d30 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:39.210336 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-13adbe61-6a18-4301-ad26-71e4b2590d30 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:39.210848 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-13adbe61-6a18-4301-ad26-71e4b2590d30 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:39.365550 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-13adbe61-6a18-4301-ad26-71e4b2590d30 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:46:39.374244 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-13adbe61-6a18-4301-ad26-71e4b2590d30 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1732 microversion: 2.1 time: 0.176978 Jun 17 15:46:39.374853 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1450/3315] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:46:39 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1732 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:46:40.392881 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-6c7d4ab6-43bf-44f6-95ee-2bd43b9661dc tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:46:40.393527 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-6c7d4ab6-43bf-44f6-95ee-2bd43b9661dc tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:46:40.400596 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6c7d4ab6-43bf-44f6-95ee-2bd43b9661dc tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:40.401039 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6c7d4ab6-43bf-44f6-95ee-2bd43b9661dc tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:40.401806 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6c7d4ab6-43bf-44f6-95ee-2bd43b9661dc tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:40.402787 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6c7d4ab6-43bf-44f6-95ee-2bd43b9661dc tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:40.547972 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-6c7d4ab6-43bf-44f6-95ee-2bd43b9661dc tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:46:40.556157 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-6c7d4ab6-43bf-44f6-95ee-2bd43b9661dc tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1732 microversion: 2.1 time: 0.167189 Jun 17 15:46:40.556771 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1866/3316] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:46:40 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1732 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:46:41.573801 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-779fafdf-c991-4b3f-8042-4df45a4c44a7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:46:41.574489 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-779fafdf-c991-4b3f-8042-4df45a4c44a7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:46:41.581539 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-779fafdf-c991-4b3f-8042-4df45a4c44a7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:41.581995 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-779fafdf-c991-4b3f-8042-4df45a4c44a7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:41.582771 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-779fafdf-c991-4b3f-8042-4df45a4c44a7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:41.583208 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-779fafdf-c991-4b3f-8042-4df45a4c44a7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:41.722213 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-779fafdf-c991-4b3f-8042-4df45a4c44a7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:46:41.731647 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-779fafdf-c991-4b3f-8042-4df45a4c44a7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1732 microversion: 2.1 time: 0.161728 Jun 17 15:46:41.732239 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1451/3317] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:46:41 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1732 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:46:42.751938 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-eb3aba51-704a-48bc-8488-df2ee7236be8 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:46:42.752544 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-eb3aba51-704a-48bc-8488-df2ee7236be8 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:46:42.759616 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-eb3aba51-704a-48bc-8488-df2ee7236be8 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:42.760065 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-eb3aba51-704a-48bc-8488-df2ee7236be8 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:42.760890 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-eb3aba51-704a-48bc-8488-df2ee7236be8 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:42.761319 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-eb3aba51-704a-48bc-8488-df2ee7236be8 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:42.903690 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-eb3aba51-704a-48bc-8488-df2ee7236be8 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:46:42.912145 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-eb3aba51-704a-48bc-8488-df2ee7236be8 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1732 microversion: 2.1 time: 0.164126 Jun 17 15:46:42.912754 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1867/3318] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:46:42 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1732 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:46:43.930192 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-069e1f6c-1c00-45d6-aaac-5e72ddfef34f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:46:43.930857 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-069e1f6c-1c00-45d6-aaac-5e72ddfef34f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:46:43.938374 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-069e1f6c-1c00-45d6-aaac-5e72ddfef34f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:43.938819 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-069e1f6c-1c00-45d6-aaac-5e72ddfef34f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:43.939586 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-069e1f6c-1c00-45d6-aaac-5e72ddfef34f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:43.940018 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-069e1f6c-1c00-45d6-aaac-5e72ddfef34f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:44.075484 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-069e1f6c-1c00-45d6-aaac-5e72ddfef34f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:46:44.084020 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-069e1f6c-1c00-45d6-aaac-5e72ddfef34f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1732 microversion: 2.1 time: 0.157684 Jun 17 15:46:44.084643 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1452/3319] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:46:43 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1732 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:46:45.102008 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-ff682931-9a7b-4fd5-8f16-44ee2e7da21b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:46:45.102623 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-ff682931-9a7b-4fd5-8f16-44ee2e7da21b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:46:45.109904 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ff682931-9a7b-4fd5-8f16-44ee2e7da21b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:45.110357 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ff682931-9a7b-4fd5-8f16-44ee2e7da21b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:45.111129 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ff682931-9a7b-4fd5-8f16-44ee2e7da21b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:45.111554 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ff682931-9a7b-4fd5-8f16-44ee2e7da21b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:45.269061 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-ff682931-9a7b-4fd5-8f16-44ee2e7da21b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:46:45.277327 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-ff682931-9a7b-4fd5-8f16-44ee2e7da21b tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1732 microversion: 2.1 time: 0.179880 Jun 17 15:46:45.277907 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1868/3320] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:46:45 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1732 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:46:46.295222 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-24be79bd-6f3f-485c-b9c1-86258699d1bf tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:46:46.296619 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-24be79bd-6f3f-485c-b9c1-86258699d1bf tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:46:46.303984 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-24be79bd-6f3f-485c-b9c1-86258699d1bf tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:46.304739 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-24be79bd-6f3f-485c-b9c1-86258699d1bf tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:46.305530 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-24be79bd-6f3f-485c-b9c1-86258699d1bf tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:46.305993 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-24be79bd-6f3f-485c-b9c1-86258699d1bf tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:46.517210 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-24be79bd-6f3f-485c-b9c1-86258699d1bf tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:46:46.526250 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-24be79bd-6f3f-485c-b9c1-86258699d1bf tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1686 microversion: 2.1 time: 0.235719 Jun 17 15:46:46.526832 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1453/3321] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:46:46 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1686 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:46:47.544022 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-0d7a30ea-dc40-4331-8ab9-4f76dfc8187e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:46:47.544650 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-0d7a30ea-dc40-4331-8ab9-4f76dfc8187e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:46:47.551237 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0d7a30ea-dc40-4331-8ab9-4f76dfc8187e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:47.551683 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0d7a30ea-dc40-4331-8ab9-4f76dfc8187e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:47.552479 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0d7a30ea-dc40-4331-8ab9-4f76dfc8187e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:47.552913 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0d7a30ea-dc40-4331-8ab9-4f76dfc8187e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:47.695881 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-0d7a30ea-dc40-4331-8ab9-4f76dfc8187e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:46:47.703415 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-0d7a30ea-dc40-4331-8ab9-4f76dfc8187e tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1686 microversion: 2.1 time: 0.163980 Jun 17 15:46:47.703988 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1869/3322] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:46:47 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1686 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:46:48.720415 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-f3b46a8b-7ddd-462e-97a9-7664540e55c7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:46:48.721053 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-f3b46a8b-7ddd-462e-97a9-7664540e55c7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:46:48.727909 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f3b46a8b-7ddd-462e-97a9-7664540e55c7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:48.728372 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f3b46a8b-7ddd-462e-97a9-7664540e55c7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:48.729119 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f3b46a8b-7ddd-462e-97a9-7664540e55c7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:48.729550 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f3b46a8b-7ddd-462e-97a9-7664540e55c7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:48.866072 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-f3b46a8b-7ddd-462e-97a9-7664540e55c7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:46:48.874257 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-f3b46a8b-7ddd-462e-97a9-7664540e55c7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1686 microversion: 2.1 time: 0.157725 Jun 17 15:46:48.874822 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1454/3323] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:46:48 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1686 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:46:49.891702 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-9d91e83a-23fc-4436-916c-10ce02004bfd tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:46:49.892313 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-9d91e83a-23fc-4436-916c-10ce02004bfd tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:46:49.898999 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9d91e83a-23fc-4436-916c-10ce02004bfd tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:49.899442 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9d91e83a-23fc-4436-916c-10ce02004bfd tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:49.900205 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9d91e83a-23fc-4436-916c-10ce02004bfd tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:49.900658 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9d91e83a-23fc-4436-916c-10ce02004bfd tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:50.036716 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-9d91e83a-23fc-4436-916c-10ce02004bfd tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:46:50.044129 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-9d91e83a-23fc-4436-916c-10ce02004bfd tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1686 microversion: 2.1 time: 0.156354 Jun 17 15:46:50.044720 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1870/3324] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:46:49 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1686 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:46:51.062332 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-627ee9b7-a746-4086-b98c-1859000bc4e4 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:46:51.062954 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-627ee9b7-a746-4086-b98c-1859000bc4e4 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:46:51.071955 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-627ee9b7-a746-4086-b98c-1859000bc4e4 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:51.071955 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-627ee9b7-a746-4086-b98c-1859000bc4e4 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:51.071955 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-627ee9b7-a746-4086-b98c-1859000bc4e4 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:51.071955 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-627ee9b7-a746-4086-b98c-1859000bc4e4 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:51.206055 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-627ee9b7-a746-4086-b98c-1859000bc4e4 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:46:51.214207 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-627ee9b7-a746-4086-b98c-1859000bc4e4 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1686 microversion: 2.1 time: 0.156482 Jun 17 15:46:51.215259 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1455/3325] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:46:51 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1686 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:46:52.232063 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-ba11968a-b34c-4288-a9bd-9efafb597d73 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:46:52.232700 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-ba11968a-b34c-4288-a9bd-9efafb597d73 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:46:52.239446 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ba11968a-b34c-4288-a9bd-9efafb597d73 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:52.239892 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ba11968a-b34c-4288-a9bd-9efafb597d73 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:52.240702 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ba11968a-b34c-4288-a9bd-9efafb597d73 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:52.241137 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ba11968a-b34c-4288-a9bd-9efafb597d73 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:52.393016 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-ba11968a-b34c-4288-a9bd-9efafb597d73 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:46:52.404014 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-ba11968a-b34c-4288-a9bd-9efafb597d73 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1686 microversion: 2.1 time: 0.175819 Jun 17 15:46:52.404860 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1871/3326] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:46:52 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1686 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:46:52.681371 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-bfc6972d-0ae6-4081-a8ca-bb3c61001295 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2076719014", "imageRef": "8c105ca4-6fe3-4e70-af71-b03c64fe1efe", "flavorRef": "452", "networks": [{"uuid": "d35faa71-7887-4fdd-af5e-ab1ead5747a1"}]}} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:46:52.755768 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.network.neutron [None req-bfc6972d-0ae6-4081-a8ca-bb3c61001295 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] validate_networks() for [('d35faa71-7887-4fdd-af5e-ab1ead5747a1', None, None, None, None, None)] {{(pid=117649) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 15:46:53.187354 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-bfc6972d-0ae6-4081-a8ca-bb3c61001295 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Flavor limits 0:0:0 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 15:46:53.187858 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-bfc6972d-0ae6-4081-a8ca-bb3c61001295 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Image limits 0:0:0 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 15:46:53.188440 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-bfc6972d-0ae6-4081-a8ca-bb3c61001295 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Flavor pref 0:0:0 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 15:46:53.188942 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-bfc6972d-0ae6-4081-a8ca-bb3c61001295 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Image pref 0:0:0 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 15:46:53.189361 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-bfc6972d-0ae6-4081-a8ca-bb3c61001295 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 15:46:53.199794 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bfc6972d-0ae6-4081-a8ca-bb3c61001295 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:53.200379 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bfc6972d-0ae6-4081-a8ca-bb3c61001295 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:53.201288 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bfc6972d-0ae6-4081-a8ca-bb3c61001295 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:53.201798 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bfc6972d-0ae6-4081-a8ca-bb3c61001295 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:53.221224 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.quota [None req-bfc6972d-0ae6-4081-a8ca-bb3c61001295 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Getting quotas for project 42b42320bc424a19b4ac5e35dae7afb3. Resources: {'cores', 'ram', 'instances'} {{(pid=117649) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 15:46:53.225708 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.quota [None req-bfc6972d-0ae6-4081-a8ca-bb3c61001295 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Getting quotas for user b6ac8cbc7c6d4cce9d2b0a1289846a3d and project 42b42320bc424a19b4ac5e35dae7afb3. Resources: {'cores', 'ram', 'instances'} {{(pid=117649) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 15:46:53.237968 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-bfc6972d-0ae6-4081-a8ca-bb3c61001295 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Going to run 1 instances... {{(pid=117649) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 15:46:53.240281 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-bfc6972d-0ae6-4081-a8ca-bb3c61001295 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 60a2d899-438a-438a-becd-c04e645f10d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c105ca4-6fe3-4e70-af71-b03c64fe1efe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117649) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 15:46:53.287405 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-bfc6972d-0ae6-4081-a8ca-bb3c61001295 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.612331 Jun 17 15:46:53.288381 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1456/3327] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Jun 17 15:46:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 614 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 15:46:53.298056 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-a0e896fa-0049-437f-80ad-9742d531ecba tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:46:53.298922 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-a0e896fa-0049-437f-80ad-9742d531ecba tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 60a2d899-438a-438a-becd-c04e645f10d9] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:46:53.384748 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-a0e896fa-0049-437f-80ad-9742d531ecba tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:46:53.397228 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-a0e896fa-0049-437f-80ad-9742d531ecba tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/60a2d899-438a-438a-becd-c04e645f10d9" status: 200 len: 1219 microversion: 2.1 time: 0.102382 Jun 17 15:46:53.398438 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1872/3328] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:46:53 2022] GET /compute/v2.1/servers/60a2d899-438a-438a-becd-c04e645f10d9 => generated 1219 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:46:53.421264 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-2f196a5d-2b0b-4865-8829-e84aee751e53 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:46:53.421888 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-2f196a5d-2b0b-4865-8829-e84aee751e53 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:46:53.429765 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2f196a5d-2b0b-4865-8829-e84aee751e53 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:53.430165 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2f196a5d-2b0b-4865-8829-e84aee751e53 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:53.430855 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2f196a5d-2b0b-4865-8829-e84aee751e53 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:53.431475 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2f196a5d-2b0b-4865-8829-e84aee751e53 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:53.472247 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-305bf08c-afb4-4398-af01-11a451e79239 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:46:53.473209 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-305bf08c-afb4-4398-af01-11a451e79239 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: 031f230c-48e6-46bb-a549-3cb347946170] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:46:53.483497 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-305bf08c-afb4-4398-af01-11a451e79239 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:53.484371 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-305bf08c-afb4-4398-af01-11a451e79239 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:53.485633 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-305bf08c-afb4-4398-af01-11a451e79239 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:53.486542 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-305bf08c-afb4-4398-af01-11a451e79239 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:53.520858 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.objects.instance [None req-305bf08c-afb4-4398-af01-11a451e79239 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lazy-loading 'flavor' on Instance uuid 031f230c-48e6-46bb-a549-3cb347946170 {{(pid=117650) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 15:46:53.598558 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-2f196a5d-2b0b-4865-8829-e84aee751e53 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:46:53.607978 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-2f196a5d-2b0b-4865-8829-e84aee751e53 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1686 microversion: 2.1 time: 0.190598 Jun 17 15:46:53.609447 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1457/3329] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:46:53 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1686 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:46:53.818951 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-305bf08c-afb4-4398-af01-11a451e79239 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "POST /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170/action" status: 202 len: 0 microversion: 2.20 time: 0.351334 Jun 17 15:46:53.819926 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1873/3330] 10.222.0.48 () {62 vars in 1318 bytes} [Fri Jun 17 15:46:53 2022] POST /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170/action => generated 0 bytes in 353 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 17 15:46:53.830102 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-d74de8f1-3e1b-42ae-9561-ff4dde7c2465 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:46:53.830779 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-d74de8f1-3e1b-42ae-9561-ff4dde7c2465 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: 031f230c-48e6-46bb-a549-3cb347946170] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:46:53.837542 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d74de8f1-3e1b-42ae-9561-ff4dde7c2465 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:53.837987 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d74de8f1-3e1b-42ae-9561-ff4dde7c2465 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:53.838743 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d74de8f1-3e1b-42ae-9561-ff4dde7c2465 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:53.839176 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d74de8f1-3e1b-42ae-9561-ff4dde7c2465 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:53.955723 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [req-6f887e13-3e2e-4914-a3f6-9040b3e52bc6 req-94f1e359-06ce-4fc9-b9af-c1ec987d96c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba5d3180-d42a-4678-af13-c99282e054bf", "name": "network-vif-deleted", "tag": "06e8bb11-060d-47aa-9950-9bdbeda221ff"}]} {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:46:53.967727 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [req-6f887e13-3e2e-4914-a3f6-9040b3e52bc6 req-94f1e359-06ce-4fc9-b9af-c1ec987d96c9 service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:53.968534 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [req-6f887e13-3e2e-4914-a3f6-9040b3e52bc6 req-94f1e359-06ce-4fc9-b9af-c1ec987d96c9 service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:53.984952 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.compute.server_external_events [req-6f887e13-3e2e-4914-a3f6-9040b3e52bc6 req-94f1e359-06ce-4fc9-b9af-c1ec987d96c9 service nova] Creating event network-vif-deleted:06e8bb11-060d-47aa-9950-9bdbeda221ff for instance ba5d3180-d42a-4678-af13-c99282e054bf on hv-cinder-82549 Jun 17 15:46:53.990384 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [req-6f887e13-3e2e-4914-a3f6-9040b3e52bc6 req-94f1e359-06ce-4fc9-b9af-c1ec987d96c9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039847 Jun 17 15:46:53.990975 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1874/3331] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 15:46:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:46:54.023576 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-d74de8f1-3e1b-42ae-9561-ff4dde7c2465 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:46:54.032816 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-d74de8f1-3e1b-42ae-9561-ff4dde7c2465 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:46:54.035258 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-d74de8f1-3e1b-42ae-9561-ff4dde7c2465 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:46:54.037071 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-d74de8f1-3e1b-42ae-9561-ff4dde7c2465 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170" status: 200 len: 1722 microversion: 2.20 time: 0.211455 Jun 17 15:46:54.038462 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1458/3332] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:46:53 2022] GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170 => generated 1722 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 15:46:54.415916 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-b055d0c4-4877-499f-8257-87ba6bc19934 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:46:54.416806 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-b055d0c4-4877-499f-8257-87ba6bc19934 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 60a2d899-438a-438a-becd-c04e645f10d9] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:46:54.420055 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_api:SELECT=34 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:46:54.426243 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b055d0c4-4877-499f-8257-87ba6bc19934 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:54.426697 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b055d0c4-4877-499f-8257-87ba6bc19934 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:54.427476 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b055d0c4-4877-499f-8257-87ba6bc19934 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:54.427913 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b055d0c4-4877-499f-8257-87ba6bc19934 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:54.515399 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-b055d0c4-4877-499f-8257-87ba6bc19934 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:46:54.523185 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-b055d0c4-4877-499f-8257-87ba6bc19934 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/60a2d899-438a-438a-becd-c04e645f10d9" status: 200 len: 1271 microversion: 2.1 time: 0.111793 Jun 17 15:46:54.523805 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1875/3333] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:46:54 2022] GET /compute/v2.1/servers/60a2d899-438a-438a-becd-c04e645f10d9 => generated 1271 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:46:54.626251 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-9423b2b2-1270-41de-a0c8-5d38ca52b307 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:46:54.626856 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-9423b2b2-1270-41de-a0c8-5d38ca52b307 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:46:54.632971 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9423b2b2-1270-41de-a0c8-5d38ca52b307 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:54.633418 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9423b2b2-1270-41de-a0c8-5d38ca52b307 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:54.634167 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9423b2b2-1270-41de-a0c8-5d38ca52b307 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:54.634788 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9423b2b2-1270-41de-a0c8-5d38ca52b307 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:54.673190 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9423b2b2-1270-41de-a0c8-5d38ca52b307 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:54.673719 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9423b2b2-1270-41de-a0c8-5d38ca52b307 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:54.674326 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.objects.instance [None req-9423b2b2-1270-41de-a0c8-5d38ca52b307 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lazy-loading 'fault' on Instance uuid ba5d3180-d42a-4678-af13-c99282e054bf {{(pid=117649) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 15:46:54.729178 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-9423b2b2-1270-41de-a0c8-5d38ca52b307 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:46:54.737957 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-9423b2b2-1270-41de-a0c8-5d38ca52b307 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 200 len: 1334 microversion: 2.1 time: 0.115518 Jun 17 15:46:54.739017 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1459/3334] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:46:54 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 1334 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:46:55.061962 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-c9bb5fd6-07f8-46ce-b263-7039e9151bfe tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:46:55.062961 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-c9bb5fd6-07f8-46ce-b263-7039e9151bfe tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: 031f230c-48e6-46bb-a549-3cb347946170] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:46:55.071185 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c9bb5fd6-07f8-46ce-b263-7039e9151bfe tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:55.072038 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c9bb5fd6-07f8-46ce-b263-7039e9151bfe tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:55.073141 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c9bb5fd6-07f8-46ce-b263-7039e9151bfe tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:55.073846 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c9bb5fd6-07f8-46ce-b263-7039e9151bfe tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:55.303104 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:46:55.490740 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-c9bb5fd6-07f8-46ce-b263-7039e9151bfe tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:46:55.498679 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-c9bb5fd6-07f8-46ce-b263-7039e9151bfe tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:46:55.500180 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-c9bb5fd6-07f8-46ce-b263-7039e9151bfe tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:46:55.501367 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-c9bb5fd6-07f8-46ce-b263-7039e9151bfe tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170" status: 200 len: 1722 microversion: 2.20 time: 0.446850 Jun 17 15:46:55.501914 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1876/3335] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:46:55 2022] GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170 => generated 1722 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:46:55.539653 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-7b528788-262e-49cb-b957-3f0670d431c4 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:46:55.540226 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-7b528788-262e-49cb-b957-3f0670d431c4 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 60a2d899-438a-438a-becd-c04e645f10d9] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:46:55.546577 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7b528788-262e-49cb-b957-3f0670d431c4 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:55.547026 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7b528788-262e-49cb-b957-3f0670d431c4 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:55.547781 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7b528788-262e-49cb-b957-3f0670d431c4 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:55.548214 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7b528788-262e-49cb-b957-3f0670d431c4 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:55.615795 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-7b528788-262e-49cb-b957-3f0670d431c4 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:46:55.623064 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-7b528788-262e-49cb-b957-3f0670d431c4 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/60a2d899-438a-438a-becd-c04e645f10d9" status: 200 len: 1277 microversion: 2.1 time: 0.087392 Jun 17 15:46:55.624076 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1460/3336] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:46:55 2022] GET /compute/v2.1/servers/60a2d899-438a-438a-becd-c04e645f10d9 => generated 1277 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:46:55.756849 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-17f3b20e-06ae-4a58-8c11-97b6f7d50981 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:46:55.757455 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-17f3b20e-06ae-4a58-8c11-97b6f7d50981 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: ba5d3180-d42a-4678-af13-c99282e054bf] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:46:55.765039 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-17f3b20e-06ae-4a58-8c11-97b6f7d50981 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:55.766112 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-17f3b20e-06ae-4a58-8c11-97b6f7d50981 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:55.767105 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-17f3b20e-06ae-4a58-8c11-97b6f7d50981 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:55.767638 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-17f3b20e-06ae-4a58-8c11-97b6f7d50981 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:55.784223 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.wsgi [None req-17f3b20e-06ae-4a58-8c11-97b6f7d50981 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] HTTP exception thrown: Instance ba5d3180-d42a-4678-af13-c99282e054bf could not be found. Jun 17 15:46:55.787321 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-17f3b20e-06ae-4a58-8c11-97b6f7d50981 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Request method failure captured: Jun 17 15:46:55.787321 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: request: GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf HTTP/1.1 Jun 17 15:46:55.787321 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Accept: application/json Jun 17 15:46:55.787321 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Accept-Encoding: identity Jun 17 15:46:55.787321 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Connection: close Jun 17 15:46:55.787321 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Content-Length: 0 Jun 17 15:46:55.787321 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Content-Type: application/json Jun 17 15:46:55.787321 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Host: 10.222.0.48 Jun 17 15:46:55.787321 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Openstack-System-Scope: None Jun 17 15:46:55.787321 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: User-Agent: python-urllib3/1.26.9 Jun 17 15:46:55.787321 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Auth-Token: gAAAAABirJmQC7m757v9yyJD0BsI2MhqMNm1yc2WpkBWgAGOwCYW524pgy_6_7F6gBQez89A-LSNviRE5zDFwqgj2BZoXTsMX0NmzFHDYuHo31ibepKT71785ic3IrIvGY4IglQk81nqgsevYUUWYR-s69vMdAmv9JQXTwFMOwaCzN_3w4dwj6k Jun 17 15:46:55.787321 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Domain-Id: None Jun 17 15:46:55.787321 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Domain-Name: None Jun 17 15:46:55.787321 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Identity-Status: Confirmed Jun 17 15:46:55.787321 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Is-Admin-Project: True Jun 17 15:46:55.787321 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Domain-Id: default Jun 17 15:46:55.787321 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Domain-Name: Default Jun 17 15:46:55.787321 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Id: 50408ec18fa04036a0abb6236343e258 Jun 17 15:46:55.787321 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1478734135 Jun 17 15:46:55.787321 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Role: reader,member Jun 17 15:46:55.787321 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Roles: reader,member Jun 17 15:46:55.789247 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_50408ec18fa04036a0abb6236343e258", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/50408ec18fa04036a0abb6236343e258"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/50408ec18fa04036a0abb6236343e258"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/50408ec18fa04036a0abb6236343e258"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Jun 17 15:46:55.789247 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1478734135 Jun 17 15:46:55.789247 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant-Id: 50408ec18fa04036a0abb6236343e258 Jun 17 15:46:55.789247 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1478734135 Jun 17 15:46:55.789247 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User: tempest-ServerRescueNegativeTestJSON-1478734135-project Jun 17 15:46:55.789247 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Domain-Id: default Jun 17 15:46:55.789247 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Domain-Name: Default Jun 17 15:46:55.789247 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Id: 562485deaf214fa29eac132464ef93e3 Jun 17 15:46:55.789247 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1478734135-project Jun 17 15:46:55.789247 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: method: > Jun 17 15:46:55.789247 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: exception: Instance ba5d3180-d42a-4678-af13-c99282e054bf could not be found. Jun 17 15:46:55.789247 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: action_args: {'id': 'ba5d3180-d42a-4678-af13-c99282e054bf'} Jun 17 15:46:55.790387 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 15:46:55.790387 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:46:55.790387 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 15:46:55.790387 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 15:46:55.790387 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 15:46:55.790387 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 15:46:55.790387 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 15:46:55.790387 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 15:46:55.790387 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 15:46:55.790387 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 15:46:55.790387 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba5d3180-d42a-4678-af13-c99282e054bf could not be found. Jun 17 15:46:55.790387 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:46:55.790387 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:46:55.790387 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:46:55.790387 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:46:55.790387 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:46:55.790387 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:46:55.790387 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 15:46:55.790387 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 15:46:55.790387 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 15:46:55.792243 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 15:46:55.792243 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 15:46:55.792243 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 15:46:55.792243 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 15:46:55.792243 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 15:46:55.792243 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 15:46:55.792243 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 15:46:55.792243 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba5d3180-d42a-4678-af13-c99282e054bf could not be found. Jun 17 15:46:55.792243 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:46:55.792243 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:46:55.792243 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:46:55.792243 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:46:55.792243 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:46:55.792243 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:46:55.792243 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 15:46:55.792243 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 15:46:55.792243 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba5d3180-d42a-4678-af13-c99282e054bf could not be found. Jun 17 15:46:55.792243 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:46:55.795102 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-17f3b20e-06ae-4a58-8c11-97b6f7d50981 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Returning 404 to user: Instance ba5d3180-d42a-4678-af13-c99282e054bf could not be found. {{(pid=117650) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 15:46:55.795102 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-17f3b20e-06ae-4a58-8c11-97b6f7d50981 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf" status: 404 len: 111 microversion: 2.1 time: 0.036589 Jun 17 15:46:55.795102 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1877/3337] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:46:55 2022] GET /compute/v2.1/servers/ba5d3180-d42a-4678-af13-c99282e054bf => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 15:46:55.802721 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-3261e564-f0f2-4f08-b8f6-a762b498e80c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '.version_select at 0x7faf54c27550>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:46:55.827032 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-3261e564-f0f2-4f08-b8f6-a762b498e80c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-840291724" status: 202 len: 0 microversion: 2.1 time: 0.030423 Jun 17 15:46:55.827615 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1461/3338] 10.222.0.48 () {58 vars in 1217 bytes} [Fri Jun 17 15:46:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-840291724 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 15:46:56.007687 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [req-a7df5154-f68b-45a8-9d1f-561dba1e422d req-cd7671b1-65b5-46d1-9586-631ed7d12886 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "808f28e6-03bc-4b67-ab1f-f1ef13838924", "name": "network-vif-deleted", "tag": "6f21e069-6aab-4e06-9e07-c0ccc170bbac"}]} {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:46:56.019352 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [req-a7df5154-f68b-45a8-9d1f-561dba1e422d req-cd7671b1-65b5-46d1-9586-631ed7d12886 service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:56.019920 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [req-a7df5154-f68b-45a8-9d1f-561dba1e422d req-cd7671b1-65b5-46d1-9586-631ed7d12886 service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:56.046826 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.compute.server_external_events [req-a7df5154-f68b-45a8-9d1f-561dba1e422d req-cd7671b1-65b5-46d1-9586-631ed7d12886 service nova] Creating event network-vif-deleted:6f21e069-6aab-4e06-9e07-c0ccc170bbac for instance 808f28e6-03bc-4b67-ab1f-f1ef13838924 on hv-cinder-82549 Jun 17 15:46:56.052896 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [req-a7df5154-f68b-45a8-9d1f-561dba1e422d req-cd7671b1-65b5-46d1-9586-631ed7d12886 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048834 Jun 17 15:46:56.053683 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1878/3339] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 15:46:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:46:56.520852 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-c4f5e6bb-406e-48da-8e95-de79beb2ccdf tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:46:56.521538 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-c4f5e6bb-406e-48da-8e95-de79beb2ccdf tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: 031f230c-48e6-46bb-a549-3cb347946170] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:46:56.528216 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c4f5e6bb-406e-48da-8e95-de79beb2ccdf tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:56.529014 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c4f5e6bb-406e-48da-8e95-de79beb2ccdf tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:56.530008 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c4f5e6bb-406e-48da-8e95-de79beb2ccdf tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:56.530569 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c4f5e6bb-406e-48da-8e95-de79beb2ccdf tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:56.641467 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-c2e8b1e9-ee4d-4ce9-9ef6-4d82d84c1144 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:46:56.642823 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-c2e8b1e9-ee4d-4ce9-9ef6-4d82d84c1144 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 60a2d899-438a-438a-becd-c04e645f10d9] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:46:56.649615 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c2e8b1e9-ee4d-4ce9-9ef6-4d82d84c1144 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:56.650070 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c2e8b1e9-ee4d-4ce9-9ef6-4d82d84c1144 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:56.651304 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c2e8b1e9-ee4d-4ce9-9ef6-4d82d84c1144 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:56.651304 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c2e8b1e9-ee4d-4ce9-9ef6-4d82d84c1144 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:56.683928 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-c4f5e6bb-406e-48da-8e95-de79beb2ccdf tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:46:56.692022 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-c4f5e6bb-406e-48da-8e95-de79beb2ccdf tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:46:56.693635 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-c4f5e6bb-406e-48da-8e95-de79beb2ccdf tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:46:56.694782 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-c4f5e6bb-406e-48da-8e95-de79beb2ccdf tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170" status: 200 len: 1722 microversion: 2.20 time: 0.178319 Jun 17 15:46:56.695391 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1462/3340] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:46:56 2022] GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170 => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:46:56.877105 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-c2e8b1e9-ee4d-4ce9-9ef6-4d82d84c1144 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:46:56.884858 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-c2e8b1e9-ee4d-4ce9-9ef6-4d82d84c1144 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/60a2d899-438a-438a-becd-c04e645f10d9" status: 200 len: 1319 microversion: 2.1 time: 0.247457 Jun 17 15:46:56.885438 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1879/3341] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:46:56 2022] GET /compute/v2.1/servers/60a2d899-438a-438a-becd-c04e645f10d9 => generated 1319 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:46:57.713968 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-404c8e72-7bc1-423c-9d09-e9fc2120cff0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:46:57.714580 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-404c8e72-7bc1-423c-9d09-e9fc2120cff0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: 031f230c-48e6-46bb-a549-3cb347946170] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:46:57.717213 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:46:57.722774 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-404c8e72-7bc1-423c-9d09-e9fc2120cff0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:57.723270 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-404c8e72-7bc1-423c-9d09-e9fc2120cff0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:57.724097 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-404c8e72-7bc1-423c-9d09-e9fc2120cff0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:57.724563 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-404c8e72-7bc1-423c-9d09-e9fc2120cff0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:57.856720 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-404c8e72-7bc1-423c-9d09-e9fc2120cff0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:46:57.864739 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-404c8e72-7bc1-423c-9d09-e9fc2120cff0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:46:57.866261 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-404c8e72-7bc1-423c-9d09-e9fc2120cff0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:46:57.867464 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-404c8e72-7bc1-423c-9d09-e9fc2120cff0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170" status: 200 len: 1722 microversion: 2.20 time: 0.157752 Jun 17 15:46:57.868019 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1463/3342] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:46:57 2022] GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:46:57.901773 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-31d4e690-e7a9-454c-bba6-dbaceb5a7135 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:46:57.902345 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-31d4e690-e7a9-454c-bba6-dbaceb5a7135 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 60a2d899-438a-438a-becd-c04e645f10d9] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:46:57.908821 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-31d4e690-e7a9-454c-bba6-dbaceb5a7135 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:57.909311 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-31d4e690-e7a9-454c-bba6-dbaceb5a7135 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:57.910137 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-31d4e690-e7a9-454c-bba6-dbaceb5a7135 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:57.910570 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-31d4e690-e7a9-454c-bba6-dbaceb5a7135 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:58.047128 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-31d4e690-e7a9-454c-bba6-dbaceb5a7135 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:46:58.054631 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-31d4e690-e7a9-454c-bba6-dbaceb5a7135 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/60a2d899-438a-438a-becd-c04e645f10d9" status: 200 len: 1319 microversion: 2.1 time: 0.156826 Jun 17 15:46:58.055193 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1880/3343] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:46:57 2022] GET /compute/v2.1/servers/60a2d899-438a-438a-becd-c04e645f10d9 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:46:58.097564 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [req-a533c61d-6334-40bc-9ce6-64f9f5b74476 req-dc5462c1-4c1b-4b0d-9e27-80c5b01dd52a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60a2d899-438a-438a-becd-c04e645f10d9", "tag": "7a65a48b-ba13-46ee-af09-af818126298d"}]} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:46:58.107454 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-a533c61d-6334-40bc-9ce6-64f9f5b74476 req-dc5462c1-4c1b-4b0d-9e27-80c5b01dd52a service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:58.107775 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-a533c61d-6334-40bc-9ce6-64f9f5b74476 req-dc5462c1-4c1b-4b0d-9e27-80c5b01dd52a service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:58.119714 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.compute.server_external_events [req-a533c61d-6334-40bc-9ce6-64f9f5b74476 req-dc5462c1-4c1b-4b0d-9e27-80c5b01dd52a service nova] Creating event network-changed:7a65a48b-ba13-46ee-af09-af818126298d for instance 60a2d899-438a-438a-becd-c04e645f10d9 on hv-cinder-82549 Jun 17 15:46:58.124981 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [req-a533c61d-6334-40bc-9ce6-64f9f5b74476 req-dc5462c1-4c1b-4b0d-9e27-80c5b01dd52a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030967 Jun 17 15:46:58.125567 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1464/3344] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 15:46:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:46:58.768726 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-d31400bd-a115-4b85-b9ed-1265fe76bdd7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:46:58.769310 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-d31400bd-a115-4b85-b9ed-1265fe76bdd7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: 335fa25e-3f5c-45f0-9f85-f9c4681728b8] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:46:58.775617 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d31400bd-a115-4b85-b9ed-1265fe76bdd7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:58.776161 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d31400bd-a115-4b85-b9ed-1265fe76bdd7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:58.777053 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d31400bd-a115-4b85-b9ed-1265fe76bdd7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:58.777563 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d31400bd-a115-4b85-b9ed-1265fe76bdd7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:58.802716 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-d31400bd-a115-4b85-b9ed-1265fe76bdd7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: 335fa25e-3f5c-45f0-9f85-f9c4681728b8] Going to try to terminate instance {{(pid=117650) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 15:46:58.879772 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-d31400bd-a115-4b85-b9ed-1265fe76bdd7 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "DELETE /compute/v2.1/servers/335fa25e-3f5c-45f0-9f85-f9c4681728b8" status: 204 len: 0 microversion: 2.1 time: 0.114611 Jun 17 15:46:58.880390 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1881/3345] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jun 17 15:46:58 2022] DELETE /compute/v2.1/servers/335fa25e-3f5c-45f0-9f85-f9c4681728b8 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 15:46:58.887048 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-f745d32b-52ed-482d-9306-c3aabbd65bcc tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:46:58.887746 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-f745d32b-52ed-482d-9306-c3aabbd65bcc tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: 031f230c-48e6-46bb-a549-3cb347946170] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:46:58.890309 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-3cacd54f-c6f1-4a70-bfc5-6b0b595b632c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:46:58.890963 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-3cacd54f-c6f1-4a70-bfc5-6b0b595b632c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: 335fa25e-3f5c-45f0-9f85-f9c4681728b8] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:46:58.894576 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f745d32b-52ed-482d-9306-c3aabbd65bcc tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:58.895009 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f745d32b-52ed-482d-9306-c3aabbd65bcc tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:58.895774 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f745d32b-52ed-482d-9306-c3aabbd65bcc tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:58.896438 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f745d32b-52ed-482d-9306-c3aabbd65bcc tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:58.897104 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3cacd54f-c6f1-4a70-bfc5-6b0b595b632c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:58.897553 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3cacd54f-c6f1-4a70-bfc5-6b0b595b632c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:58.898328 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3cacd54f-c6f1-4a70-bfc5-6b0b595b632c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:58.898767 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3cacd54f-c6f1-4a70-bfc5-6b0b595b632c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:59.035675 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-f745d32b-52ed-482d-9306-c3aabbd65bcc tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:46:59.043957 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-f745d32b-52ed-482d-9306-c3aabbd65bcc tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:46:59.045266 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-f745d32b-52ed-482d-9306-c3aabbd65bcc tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:46:59.046419 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-f745d32b-52ed-482d-9306-c3aabbd65bcc tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170" status: 200 len: 1722 microversion: 2.20 time: 0.164238 Jun 17 15:46:59.046917 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-3cacd54f-c6f1-4a70-bfc5-6b0b595b632c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:46:59.047393 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1465/3346] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:46:58 2022] GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:46:59.054820 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-3cacd54f-c6f1-4a70-bfc5-6b0b595b632c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/335fa25e-3f5c-45f0-9f85-f9c4681728b8" status: 200 len: 1504 microversion: 2.1 time: 0.169559 Jun 17 15:46:59.055387 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1882/3347] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:46:58 2022] GET /compute/v2.1/servers/335fa25e-3f5c-45f0-9f85-f9c4681728b8 => generated 1504 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:46:59.070680 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-ee44360d-6e0a-428c-958d-ff75298737ce tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:46:59.071287 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-ee44360d-6e0a-428c-958d-ff75298737ce tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 60a2d899-438a-438a-becd-c04e645f10d9] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:46:59.077966 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ee44360d-6e0a-428c-958d-ff75298737ce tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:59.078408 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ee44360d-6e0a-428c-958d-ff75298737ce tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:59.079179 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ee44360d-6e0a-428c-958d-ff75298737ce tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:46:59.079605 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ee44360d-6e0a-428c-958d-ff75298737ce tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:46:59.212777 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-ee44360d-6e0a-428c-958d-ff75298737ce tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:46:59.220152 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-ee44360d-6e0a-428c-958d-ff75298737ce tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/60a2d899-438a-438a-becd-c04e645f10d9" status: 200 len: 1319 microversion: 2.1 time: 0.153251 Jun 17 15:46:59.220744 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1466/3348] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:46:59 2022] GET /compute/v2.1/servers/60a2d899-438a-438a-becd-c04e645f10d9 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:47:00.064638 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-bdf52c4f-672f-4812-b568-3b38c38b7913 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:47:00.065174 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-bdf52c4f-672f-4812-b568-3b38c38b7913 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: 031f230c-48e6-46bb-a549-3cb347946170] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:47:00.071819 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bdf52c4f-672f-4812-b568-3b38c38b7913 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:00.072088 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-046fdb41-8cd7-4ea9-a448-347e1255ce6f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:47:00.072567 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bdf52c4f-672f-4812-b568-3b38c38b7913 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:00.072695 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-046fdb41-8cd7-4ea9-a448-347e1255ce6f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: 335fa25e-3f5c-45f0-9f85-f9c4681728b8] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:47:00.074803 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bdf52c4f-672f-4812-b568-3b38c38b7913 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:00.075255 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bdf52c4f-672f-4812-b568-3b38c38b7913 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:00.079695 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-046fdb41-8cd7-4ea9-a448-347e1255ce6f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:00.080254 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-046fdb41-8cd7-4ea9-a448-347e1255ce6f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:00.081110 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-046fdb41-8cd7-4ea9-a448-347e1255ce6f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:00.081550 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-046fdb41-8cd7-4ea9-a448-347e1255ce6f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:00.113209 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-046fdb41-8cd7-4ea9-a448-347e1255ce6f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:00.113589 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-046fdb41-8cd7-4ea9-a448-347e1255ce6f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:00.114046 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.objects.instance [None req-046fdb41-8cd7-4ea9-a448-347e1255ce6f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lazy-loading 'fault' on Instance uuid 335fa25e-3f5c-45f0-9f85-f9c4681728b8 {{(pid=117649) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 15:47:00.117819 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell1:SELECT=100 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:47:00.162666 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-046fdb41-8cd7-4ea9-a448-347e1255ce6f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:00.170408 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-046fdb41-8cd7-4ea9-a448-347e1255ce6f tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/335fa25e-3f5c-45f0-9f85-f9c4681728b8" status: 200 len: 1311 microversion: 2.1 time: 0.102074 Jun 17 15:47:00.171047 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1467/3349] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:47:00 2022] GET /compute/v2.1/servers/335fa25e-3f5c-45f0-9f85-f9c4681728b8 => generated 1311 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:47:00.185796 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [req-e2ce1ef3-b4ad-4036-803c-75a4344b59eb req-0955ea2e-7856-4c24-bcbb-688e33138793 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "335fa25e-3f5c-45f0-9f85-f9c4681728b8", "name": "network-vif-deleted", "tag": "a005990c-f75a-4864-aa74-da43c2a3e0a6"}]} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:47:00.194095 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-e2ce1ef3-b4ad-4036-803c-75a4344b59eb req-0955ea2e-7856-4c24-bcbb-688e33138793 service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:00.194538 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-e2ce1ef3-b4ad-4036-803c-75a4344b59eb req-0955ea2e-7856-4c24-bcbb-688e33138793 service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:00.206673 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.compute.server_external_events [req-e2ce1ef3-b4ad-4036-803c-75a4344b59eb req-0955ea2e-7856-4c24-bcbb-688e33138793 service nova] Creating event network-vif-deleted:a005990c-f75a-4864-aa74-da43c2a3e0a6 for instance 335fa25e-3f5c-45f0-9f85-f9c4681728b8 on hv-cinder-82549 Jun 17 15:47:00.211915 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [req-e2ce1ef3-b4ad-4036-803c-75a4344b59eb req-0955ea2e-7856-4c24-bcbb-688e33138793 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030705 Jun 17 15:47:00.212553 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1468/3350] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 15:47:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:47:00.224078 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-bdf52c4f-672f-4812-b568-3b38c38b7913 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:00.233135 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-bdf52c4f-672f-4812-b568-3b38c38b7913 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:00.234679 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-bdf52c4f-672f-4812-b568-3b38c38b7913 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:00.235879 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-bdf52c4f-672f-4812-b568-3b38c38b7913 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170" status: 200 len: 1722 microversion: 2.20 time: 0.175332 Jun 17 15:47:00.236749 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1883/3351] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:47:00 2022] GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170 => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:47:00.238220 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-fad8ebd3-accb-4b8a-bcfc-d05d58fc1677 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:47:00.238918 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-fad8ebd3-accb-4b8a-bcfc-d05d58fc1677 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 60a2d899-438a-438a-becd-c04e645f10d9] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:47:00.245931 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fad8ebd3-accb-4b8a-bcfc-d05d58fc1677 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:00.246378 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fad8ebd3-accb-4b8a-bcfc-d05d58fc1677 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:00.247146 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fad8ebd3-accb-4b8a-bcfc-d05d58fc1677 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:00.247582 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fad8ebd3-accb-4b8a-bcfc-d05d58fc1677 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:00.390860 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-fad8ebd3-accb-4b8a-bcfc-d05d58fc1677 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:00.398609 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-fad8ebd3-accb-4b8a-bcfc-d05d58fc1677 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/60a2d899-438a-438a-becd-c04e645f10d9" status: 200 len: 1319 microversion: 2.1 time: 0.164619 Jun 17 15:47:00.399189 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1469/3352] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:47:00 2022] GET /compute/v2.1/servers/60a2d899-438a-438a-becd-c04e645f10d9 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:47:01.187441 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-b3d9e421-6b35-4e1f-aa77-241745e53d69 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:47:01.188057 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-b3d9e421-6b35-4e1f-aa77-241745e53d69 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: 335fa25e-3f5c-45f0-9f85-f9c4681728b8] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:47:01.194834 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b3d9e421-6b35-4e1f-aa77-241745e53d69 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:01.195275 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b3d9e421-6b35-4e1f-aa77-241745e53d69 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:01.196025 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b3d9e421-6b35-4e1f-aa77-241745e53d69 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:01.196484 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b3d9e421-6b35-4e1f-aa77-241745e53d69 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:01.210365 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.wsgi [None req-b3d9e421-6b35-4e1f-aa77-241745e53d69 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] HTTP exception thrown: Instance 335fa25e-3f5c-45f0-9f85-f9c4681728b8 could not be found. Jun 17 15:47:01.211990 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-b3d9e421-6b35-4e1f-aa77-241745e53d69 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Request method failure captured: Jun 17 15:47:01.211990 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: request: GET /compute/v2.1/servers/335fa25e-3f5c-45f0-9f85-f9c4681728b8 HTTP/1.1 Jun 17 15:47:01.211990 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Accept: application/json Jun 17 15:47:01.211990 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Accept-Encoding: identity Jun 17 15:47:01.211990 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Connection: close Jun 17 15:47:01.211990 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Content-Length: 0 Jun 17 15:47:01.211990 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Content-Type: application/json Jun 17 15:47:01.211990 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Host: 10.222.0.48 Jun 17 15:47:01.211990 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Openstack-System-Scope: None Jun 17 15:47:01.211990 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: User-Agent: python-urllib3/1.26.9 Jun 17 15:47:01.211990 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Auth-Token: gAAAAABirJmQC7m757v9yyJD0BsI2MhqMNm1yc2WpkBWgAGOwCYW524pgy_6_7F6gBQez89A-LSNviRE5zDFwqgj2BZoXTsMX0NmzFHDYuHo31ibepKT71785ic3IrIvGY4IglQk81nqgsevYUUWYR-s69vMdAmv9JQXTwFMOwaCzN_3w4dwj6k Jun 17 15:47:01.211990 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Domain-Id: None Jun 17 15:47:01.211990 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Domain-Name: None Jun 17 15:47:01.211990 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Identity-Status: Confirmed Jun 17 15:47:01.211990 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Is-Admin-Project: True Jun 17 15:47:01.211990 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Domain-Id: default Jun 17 15:47:01.211990 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Domain-Name: Default Jun 17 15:47:01.211990 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Id: 50408ec18fa04036a0abb6236343e258 Jun 17 15:47:01.211990 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1478734135 Jun 17 15:47:01.211990 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Role: reader,member Jun 17 15:47:01.211990 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Roles: reader,member Jun 17 15:47:01.213799 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_50408ec18fa04036a0abb6236343e258", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/50408ec18fa04036a0abb6236343e258"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/50408ec18fa04036a0abb6236343e258"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/50408ec18fa04036a0abb6236343e258"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Jun 17 15:47:01.213799 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1478734135 Jun 17 15:47:01.213799 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant-Id: 50408ec18fa04036a0abb6236343e258 Jun 17 15:47:01.213799 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1478734135 Jun 17 15:47:01.213799 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User: tempest-ServerRescueNegativeTestJSON-1478734135-project Jun 17 15:47:01.213799 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Domain-Id: default Jun 17 15:47:01.213799 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Domain-Name: Default Jun 17 15:47:01.213799 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Id: 562485deaf214fa29eac132464ef93e3 Jun 17 15:47:01.213799 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1478734135-project Jun 17 15:47:01.213799 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: method: > Jun 17 15:47:01.213799 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: exception: Instance 335fa25e-3f5c-45f0-9f85-f9c4681728b8 could not be found. Jun 17 15:47:01.213799 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: action_args: {'id': '335fa25e-3f5c-45f0-9f85-f9c4681728b8'} Jun 17 15:47:01.214783 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 15:47:01.214783 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:47:01.214783 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 15:47:01.214783 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 15:47:01.214783 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 15:47:01.214783 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 15:47:01.214783 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 15:47:01.214783 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 15:47:01.214783 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 15:47:01.214783 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 15:47:01.214783 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 335fa25e-3f5c-45f0-9f85-f9c4681728b8 could not be found. Jun 17 15:47:01.214783 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:47:01.214783 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:47:01.214783 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:47:01.214783 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:47:01.214783 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:47:01.214783 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:47:01.214783 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 15:47:01.214783 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 15:47:01.214783 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 15:47:01.216453 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 15:47:01.216453 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 15:47:01.216453 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 15:47:01.216453 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 15:47:01.216453 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 15:47:01.216453 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 15:47:01.216453 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 15:47:01.216453 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 335fa25e-3f5c-45f0-9f85-f9c4681728b8 could not be found. Jun 17 15:47:01.216453 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:47:01.216453 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:47:01.216453 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:47:01.216453 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:47:01.216453 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:47:01.216453 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:47:01.216453 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 15:47:01.216453 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 15:47:01.216453 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 335fa25e-3f5c-45f0-9f85-f9c4681728b8 could not be found. Jun 17 15:47:01.216453 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:47:01.218043 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-b3d9e421-6b35-4e1f-aa77-241745e53d69 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Returning 404 to user: Instance 335fa25e-3f5c-45f0-9f85-f9c4681728b8 could not be found. {{(pid=117650) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 15:47:01.218043 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-b3d9e421-6b35-4e1f-aa77-241745e53d69 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/335fa25e-3f5c-45f0-9f85-f9c4681728b8" status: 404 len: 111 microversion: 2.1 time: 0.030375 Jun 17 15:47:01.218043 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1884/3353] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:47:01 2022] GET /compute/v2.1/servers/335fa25e-3f5c-45f0-9f85-f9c4681728b8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 15:47:01.221895 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-c2a1d616-3496-478f-bba3-d4dfc94f907d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:47:01.222370 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-c2a1d616-3496-478f-bba3-d4dfc94f907d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: 8f90be07-f969-4dc7-b8ab-a5a41f850645] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:47:01.229088 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c2a1d616-3496-478f-bba3-d4dfc94f907d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:01.229531 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c2a1d616-3496-478f-bba3-d4dfc94f907d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:01.230305 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c2a1d616-3496-478f-bba3-d4dfc94f907d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:01.230743 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c2a1d616-3496-478f-bba3-d4dfc94f907d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:01.254562 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-9201f121-7043-4d3f-b114-057394bb7a47 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:47:01.255167 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-9201f121-7043-4d3f-b114-057394bb7a47 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: 031f230c-48e6-46bb-a549-3cb347946170] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:47:01.255379 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-c2a1d616-3496-478f-bba3-d4dfc94f907d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: 8f90be07-f969-4dc7-b8ab-a5a41f850645] Going to try to terminate instance {{(pid=117649) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 15:47:01.261824 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9201f121-7043-4d3f-b114-057394bb7a47 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:01.262266 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9201f121-7043-4d3f-b114-057394bb7a47 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:01.263024 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9201f121-7043-4d3f-b114-057394bb7a47 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:01.263452 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9201f121-7043-4d3f-b114-057394bb7a47 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:01.332055 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-c2a1d616-3496-478f-bba3-d4dfc94f907d tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "DELETE /compute/v2.1/servers/8f90be07-f969-4dc7-b8ab-a5a41f850645" status: 204 len: 0 microversion: 2.1 time: 0.113777 Jun 17 15:47:01.332679 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1470/3354] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jun 17 15:47:01 2022] DELETE /compute/v2.1/servers/8f90be07-f969-4dc7-b8ab-a5a41f850645 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 15:47:01.341336 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-377d4cb9-e019-4b7a-a52a-30ccc5e00f4c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:47:01.342208 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-377d4cb9-e019-4b7a-a52a-30ccc5e00f4c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: 8f90be07-f969-4dc7-b8ab-a5a41f850645] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:47:01.348230 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-377d4cb9-e019-4b7a-a52a-30ccc5e00f4c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:01.348712 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-377d4cb9-e019-4b7a-a52a-30ccc5e00f4c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:01.349519 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-377d4cb9-e019-4b7a-a52a-30ccc5e00f4c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:01.350034 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-377d4cb9-e019-4b7a-a52a-30ccc5e00f4c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:01.404968 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-9201f121-7043-4d3f-b114-057394bb7a47 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:01.413422 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-9201f121-7043-4d3f-b114-057394bb7a47 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:01.414943 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-9201f121-7043-4d3f-b114-057394bb7a47 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:01.416101 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-9201f121-7043-4d3f-b114-057394bb7a47 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170" status: 200 len: 1722 microversion: 2.20 time: 0.165468 Jun 17 15:47:01.416696 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1885/3355] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:47:01 2022] GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 15:47:01.421881 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-0d027a8f-66ff-434b-97ff-1e276b70d192 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:47:01.422458 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-0d027a8f-66ff-434b-97ff-1e276b70d192 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 60a2d899-438a-438a-becd-c04e645f10d9] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:47:01.428318 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0d027a8f-66ff-434b-97ff-1e276b70d192 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:01.428796 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0d027a8f-66ff-434b-97ff-1e276b70d192 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:01.429556 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0d027a8f-66ff-434b-97ff-1e276b70d192 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:01.429989 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0d027a8f-66ff-434b-97ff-1e276b70d192 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:01.485782 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-377d4cb9-e019-4b7a-a52a-30ccc5e00f4c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:01.493339 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-377d4cb9-e019-4b7a-a52a-30ccc5e00f4c tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/8f90be07-f969-4dc7-b8ab-a5a41f850645" status: 200 len: 1519 microversion: 2.1 time: 0.156415 Jun 17 15:47:01.493912 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1471/3356] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:47:01 2022] GET /compute/v2.1/servers/8f90be07-f969-4dc7-b8ab-a5a41f850645 => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:47:01.562601 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-0d027a8f-66ff-434b-97ff-1e276b70d192 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:01.570284 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-0d027a8f-66ff-434b-97ff-1e276b70d192 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/60a2d899-438a-438a-becd-c04e645f10d9" status: 200 len: 1319 microversion: 2.1 time: 0.152086 Jun 17 15:47:01.570833 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1886/3357] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:47:01 2022] GET /compute/v2.1/servers/60a2d899-438a-438a-becd-c04e645f10d9 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:47:02.435313 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-489f0945-5c1c-4934-bea7-65e15f6884f1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:47:02.436141 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-489f0945-5c1c-4934-bea7-65e15f6884f1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: 031f230c-48e6-46bb-a549-3cb347946170] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:47:02.441598 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [req-e84124ef-6fec-4a7c-9f27-abd3d38e681f req-e10f4cd0-dad1-4056-9595-2fe018e0873f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f90be07-f969-4dc7-b8ab-a5a41f850645", "name": "network-vif-deleted", "tag": "8f8f8dbb-e00e-4a7d-91ca-f20e554d9b8c"}]} {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:47:02.444671 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-489f0945-5c1c-4934-bea7-65e15f6884f1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:02.445262 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-489f0945-5c1c-4934-bea7-65e15f6884f1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:02.446439 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-489f0945-5c1c-4934-bea7-65e15f6884f1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:02.446930 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-489f0945-5c1c-4934-bea7-65e15f6884f1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:02.451857 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [req-e84124ef-6fec-4a7c-9f27-abd3d38e681f req-e10f4cd0-dad1-4056-9595-2fe018e0873f service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:02.452310 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [req-e84124ef-6fec-4a7c-9f27-abd3d38e681f req-e10f4cd0-dad1-4056-9595-2fe018e0873f service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:02.464570 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.compute.server_external_events [req-e84124ef-6fec-4a7c-9f27-abd3d38e681f req-e10f4cd0-dad1-4056-9595-2fe018e0873f service nova] Creating event network-vif-deleted:8f8f8dbb-e00e-4a7d-91ca-f20e554d9b8c for instance 8f90be07-f969-4dc7-b8ab-a5a41f850645 on hv-cinder-82549 Jun 17 15:47:02.469793 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [req-e84124ef-6fec-4a7c-9f27-abd3d38e681f req-e10f4cd0-dad1-4056-9595-2fe018e0873f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031938 Jun 17 15:47:02.470401 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1887/3358] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 15:47:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:47:02.512291 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-b31eef03-942d-46c0-986f-07c9b56611cb tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:47:02.513328 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-b31eef03-942d-46c0-986f-07c9b56611cb tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: 8f90be07-f969-4dc7-b8ab-a5a41f850645] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:47:02.524310 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b31eef03-942d-46c0-986f-07c9b56611cb tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:02.524791 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b31eef03-942d-46c0-986f-07c9b56611cb tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:02.525580 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b31eef03-942d-46c0-986f-07c9b56611cb tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:02.526023 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b31eef03-942d-46c0-986f-07c9b56611cb tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:02.597039 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-489f0945-5c1c-4934-bea7-65e15f6884f1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:02.606983 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-489f0945-5c1c-4934-bea7-65e15f6884f1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:02.608083 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-b31eef03-942d-46c0-986f-07c9b56611cb tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '562485deaf214fa29eac132464ef93e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50408ec18fa04036a0abb6236343e258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:02.608690 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-489f0945-5c1c-4934-bea7-65e15f6884f1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:02.610248 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-489f0945-5c1c-4934-bea7-65e15f6884f1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170" status: 200 len: 1722 microversion: 2.20 time: 0.179382 Jun 17 15:47:02.610859 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1472/3359] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:47:02 2022] GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170 => generated 1722 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:47:02.618061 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-b31eef03-942d-46c0-986f-07c9b56611cb tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/8f90be07-f969-4dc7-b8ab-a5a41f850645" status: 200 len: 1307 microversion: 2.1 time: 0.110636 Jun 17 15:47:02.618964 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1888/3360] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:47:02 2022] GET /compute/v2.1/servers/8f90be07-f969-4dc7-b8ab-a5a41f850645 => generated 1307 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:47:02.628449 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-4438ba78-48f8-471d-aff4-b401643621e5 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:47:02.629075 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-4438ba78-48f8-471d-aff4-b401643621e5 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 60a2d899-438a-438a-becd-c04e645f10d9] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:47:02.635292 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4438ba78-48f8-471d-aff4-b401643621e5 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:02.635745 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4438ba78-48f8-471d-aff4-b401643621e5 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:02.637119 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4438ba78-48f8-471d-aff4-b401643621e5 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:02.637545 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4438ba78-48f8-471d-aff4-b401643621e5 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:02.691834 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [req-0b0b9523-6f98-43cc-aa78-475e0d735686 req-3687f776-1517-4bcb-b447-1e53182bdf25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60a2d899-438a-438a-becd-c04e645f10d9", "name": "network-vif-plugged", "status": "completed", "tag": "7a65a48b-ba13-46ee-af09-af818126298d"}]} {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:47:02.700656 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [req-0b0b9523-6f98-43cc-aa78-475e0d735686 req-3687f776-1517-4bcb-b447-1e53182bdf25 service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:02.701110 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [req-0b0b9523-6f98-43cc-aa78-475e0d735686 req-3687f776-1517-4bcb-b447-1e53182bdf25 service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:02.714568 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.compute.server_external_events [req-0b0b9523-6f98-43cc-aa78-475e0d735686 req-3687f776-1517-4bcb-b447-1e53182bdf25 service nova] Creating event network-vif-plugged:7a65a48b-ba13-46ee-af09-af818126298d for instance 60a2d899-438a-438a-becd-c04e645f10d9 on hv-cinder-82549 Jun 17 15:47:02.725676 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [req-0b0b9523-6f98-43cc-aa78-475e0d735686 req-3687f776-1517-4bcb-b447-1e53182bdf25 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036967 Jun 17 15:47:02.727885 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1889/3361] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 15:47:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:47:02.785183 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-4438ba78-48f8-471d-aff4-b401643621e5 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:02.792747 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-4438ba78-48f8-471d-aff4-b401643621e5 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/60a2d899-438a-438a-becd-c04e645f10d9" status: 200 len: 1319 microversion: 2.1 time: 0.175046 Jun 17 15:47:02.793335 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1473/3362] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:47:02 2022] GET /compute/v2.1/servers/60a2d899-438a-438a-becd-c04e645f10d9 => generated 1319 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:47:03.626595 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell0:SELECT=2 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:47:03.631518 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-d79910e0-06ea-4d8e-808b-cfe52db4f155 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:47:03.632147 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-d79910e0-06ea-4d8e-808b-cfe52db4f155 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: 031f230c-48e6-46bb-a549-3cb347946170] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:47:03.635339 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-64958a8f-b6a5-4864-ad8a-32c9cd8fb750 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:47:03.636488 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-64958a8f-b6a5-4864-ad8a-32c9cd8fb750 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] [instance: 8f90be07-f969-4dc7-b8ab-a5a41f850645] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:47:03.638416 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell0:SELECT=2 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:47:03.639085 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell0:SELECT=6 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:47:03.639232 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d79910e0-06ea-4d8e-808b-cfe52db4f155 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:03.639728 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d79910e0-06ea-4d8e-808b-cfe52db4f155 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:03.640672 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d79910e0-06ea-4d8e-808b-cfe52db4f155 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:03.641242 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d79910e0-06ea-4d8e-808b-cfe52db4f155 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:03.645290 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-64958a8f-b6a5-4864-ad8a-32c9cd8fb750 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:03.645740 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-64958a8f-b6a5-4864-ad8a-32c9cd8fb750 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:03.646497 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-64958a8f-b6a5-4864-ad8a-32c9cd8fb750 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:03.646941 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-64958a8f-b6a5-4864-ad8a-32c9cd8fb750 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:03.661198 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.wsgi [None req-64958a8f-b6a5-4864-ad8a-32c9cd8fb750 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] HTTP exception thrown: Instance 8f90be07-f969-4dc7-b8ab-a5a41f850645 could not be found. Jun 17 15:47:03.662879 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-64958a8f-b6a5-4864-ad8a-32c9cd8fb750 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Request method failure captured: Jun 17 15:47:03.662879 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: request: GET /compute/v2.1/servers/8f90be07-f969-4dc7-b8ab-a5a41f850645 HTTP/1.1 Jun 17 15:47:03.662879 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Accept: application/json Jun 17 15:47:03.662879 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Accept-Encoding: identity Jun 17 15:47:03.662879 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Connection: close Jun 17 15:47:03.662879 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Content-Length: 0 Jun 17 15:47:03.662879 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Content-Type: application/json Jun 17 15:47:03.662879 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Host: 10.222.0.48 Jun 17 15:47:03.662879 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Openstack-System-Scope: None Jun 17 15:47:03.662879 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: User-Agent: python-urllib3/1.26.9 Jun 17 15:47:03.662879 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Auth-Token: gAAAAABirJmQC7m757v9yyJD0BsI2MhqMNm1yc2WpkBWgAGOwCYW524pgy_6_7F6gBQez89A-LSNviRE5zDFwqgj2BZoXTsMX0NmzFHDYuHo31ibepKT71785ic3IrIvGY4IglQk81nqgsevYUUWYR-s69vMdAmv9JQXTwFMOwaCzN_3w4dwj6k Jun 17 15:47:03.662879 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Domain-Id: None Jun 17 15:47:03.662879 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Domain-Name: None Jun 17 15:47:03.662879 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Identity-Status: Confirmed Jun 17 15:47:03.662879 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Is-Admin-Project: True Jun 17 15:47:03.662879 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Domain-Id: default Jun 17 15:47:03.662879 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Domain-Name: Default Jun 17 15:47:03.662879 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Id: 50408ec18fa04036a0abb6236343e258 Jun 17 15:47:03.662879 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1478734135 Jun 17 15:47:03.662879 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Role: reader,member Jun 17 15:47:03.662879 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Roles: reader,member Jun 17 15:47:03.664719 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_50408ec18fa04036a0abb6236343e258", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/50408ec18fa04036a0abb6236343e258"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/50408ec18fa04036a0abb6236343e258"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/50408ec18fa04036a0abb6236343e258"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Jun 17 15:47:03.664719 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1478734135 Jun 17 15:47:03.664719 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant-Id: 50408ec18fa04036a0abb6236343e258 Jun 17 15:47:03.664719 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1478734135 Jun 17 15:47:03.664719 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User: tempest-ServerRescueNegativeTestJSON-1478734135-project Jun 17 15:47:03.664719 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Domain-Id: default Jun 17 15:47:03.664719 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Domain-Name: Default Jun 17 15:47:03.664719 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Id: 562485deaf214fa29eac132464ef93e3 Jun 17 15:47:03.664719 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1478734135-project Jun 17 15:47:03.664719 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: method: > Jun 17 15:47:03.664719 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: exception: Instance 8f90be07-f969-4dc7-b8ab-a5a41f850645 could not be found. Jun 17 15:47:03.664719 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: action_args: {'id': '8f90be07-f969-4dc7-b8ab-a5a41f850645'} Jun 17 15:47:03.665841 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 15:47:03.665841 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:47:03.665841 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 15:47:03.665841 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 15:47:03.665841 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 15:47:03.665841 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 15:47:03.665841 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 15:47:03.665841 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 15:47:03.665841 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 15:47:03.665841 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 15:47:03.665841 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f90be07-f969-4dc7-b8ab-a5a41f850645 could not be found. Jun 17 15:47:03.665841 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:47:03.665841 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:47:03.665841 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:47:03.665841 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:47:03.665841 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:47:03.665841 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:47:03.665841 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 15:47:03.665841 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 15:47:03.665841 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 15:47:03.667277 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 15:47:03.667277 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 15:47:03.667277 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 15:47:03.667277 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 15:47:03.667277 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 15:47:03.667277 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 15:47:03.667277 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 15:47:03.667277 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f90be07-f969-4dc7-b8ab-a5a41f850645 could not be found. Jun 17 15:47:03.667277 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:47:03.667277 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:47:03.667277 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:47:03.667277 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:47:03.667277 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:47:03.667277 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:47:03.667277 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 15:47:03.667277 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 15:47:03.667277 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f90be07-f969-4dc7-b8ab-a5a41f850645 could not be found. Jun 17 15:47:03.667277 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:47:03.668695 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-64958a8f-b6a5-4864-ad8a-32c9cd8fb750 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] Returning 404 to user: Instance 8f90be07-f969-4dc7-b8ab-a5a41f850645 could not be found. {{(pid=117649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 15:47:03.668695 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-64958a8f-b6a5-4864-ad8a-32c9cd8fb750 tempest-ServerRescueNegativeTestJSON-1478734135 tempest-ServerRescueNegativeTestJSON-1478734135-project] 10.222.0.48 "GET /compute/v2.1/servers/8f90be07-f969-4dc7-b8ab-a5a41f850645" status: 404 len: 111 microversion: 2.1 time: 0.032706 Jun 17 15:47:03.668695 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1474/3363] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:47:03 2022] GET /compute/v2.1/servers/8f90be07-f969-4dc7-b8ab-a5a41f850645 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 17 15:47:03.784555 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-d79910e0-06ea-4d8e-808b-cfe52db4f155 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:03.792518 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-d79910e0-06ea-4d8e-808b-cfe52db4f155 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:03.794035 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-d79910e0-06ea-4d8e-808b-cfe52db4f155 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:03.795196 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-d79910e0-06ea-4d8e-808b-cfe52db4f155 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170" status: 200 len: 1722 microversion: 2.20 time: 0.169596 Jun 17 15:47:03.796011 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1890/3364] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:47:03 2022] GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:47:03.809395 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-1ae6801a-eb6b-4edd-b97d-fbe86b39cf09 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:47:03.810004 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-1ae6801a-eb6b-4edd-b97d-fbe86b39cf09 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 60a2d899-438a-438a-becd-c04e645f10d9] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:47:03.816158 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1ae6801a-eb6b-4edd-b97d-fbe86b39cf09 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:03.816642 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1ae6801a-eb6b-4edd-b97d-fbe86b39cf09 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:03.817399 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1ae6801a-eb6b-4edd-b97d-fbe86b39cf09 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:03.817830 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1ae6801a-eb6b-4edd-b97d-fbe86b39cf09 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:04.299941 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-1ae6801a-eb6b-4edd-b97d-fbe86b39cf09 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:04.307224 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-1ae6801a-eb6b-4edd-b97d-fbe86b39cf09 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/60a2d899-438a-438a-becd-c04e645f10d9" status: 200 len: 1319 microversion: 2.1 time: 0.501679 Jun 17 15:47:04.308277 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1475/3365] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:47:03 2022] GET /compute/v2.1/servers/60a2d899-438a-438a-becd-c04e645f10d9 => generated 1319 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:47:04.813964 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-6a236284-10fd-42af-bc7d-90e33801154b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:47:04.814572 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-6a236284-10fd-42af-bc7d-90e33801154b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: 031f230c-48e6-46bb-a549-3cb347946170] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:47:04.821020 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6a236284-10fd-42af-bc7d-90e33801154b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:04.821465 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6a236284-10fd-42af-bc7d-90e33801154b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:04.822224 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6a236284-10fd-42af-bc7d-90e33801154b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:04.822655 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6a236284-10fd-42af-bc7d-90e33801154b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:04.965687 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-6a236284-10fd-42af-bc7d-90e33801154b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:04.974383 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-6a236284-10fd-42af-bc7d-90e33801154b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:04.975886 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-6a236284-10fd-42af-bc7d-90e33801154b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:04.977334 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-6a236284-10fd-42af-bc7d-90e33801154b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170" status: 200 len: 1722 microversion: 2.20 time: 0.167008 Jun 17 15:47:04.988315 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1891/3366] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:47:04 2022] GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170 => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:47:05.324542 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-7db6fefc-ddb0-4c9e-b1f5-7ed9465d653d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:47:05.325201 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-7db6fefc-ddb0-4c9e-b1f5-7ed9465d653d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 60a2d899-438a-438a-becd-c04e645f10d9] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:47:05.331866 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7db6fefc-ddb0-4c9e-b1f5-7ed9465d653d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:05.332337 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7db6fefc-ddb0-4c9e-b1f5-7ed9465d653d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:05.333107 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7db6fefc-ddb0-4c9e-b1f5-7ed9465d653d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:05.333548 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7db6fefc-ddb0-4c9e-b1f5-7ed9465d653d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:05.550108 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-7db6fefc-ddb0-4c9e-b1f5-7ed9465d653d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:05.560726 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-7db6fefc-ddb0-4c9e-b1f5-7ed9465d653d tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/60a2d899-438a-438a-becd-c04e645f10d9" status: 200 len: 1508 microversion: 2.1 time: 0.240065 Jun 17 15:47:05.561305 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1476/3367] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:47:05 2022] GET /compute/v2.1/servers/60a2d899-438a-438a-becd-c04e645f10d9 => generated 1508 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:47:05.578289 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-94263709-5fcb-46ad-b386-422ac1f07add tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "85a22134-39c1-4cce-a7b9-cd85d62e6638", "device": "/dev/sdb"}} {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:47:05.578289 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-94263709-5fcb-46ad-b386-422ac1f07add tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 60a2d899-438a-438a-becd-c04e645f10d9] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:47:05.584188 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-94263709-5fcb-46ad-b386-422ac1f07add tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:05.584702 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-94263709-5fcb-46ad-b386-422ac1f07add tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:05.585472 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-94263709-5fcb-46ad-b386-422ac1f07add tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:05.585921 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-94263709-5fcb-46ad-b386-422ac1f07add tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:05.867871 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-94263709-5fcb-46ad-b386-422ac1f07add tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "POST /compute/v2.1/servers/60a2d899-438a-438a-becd-c04e645f10d9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.294662 Jun 17 15:47:05.875151 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1892/3368] 10.222.0.48 () {60 vars in 1322 bytes} [Fri Jun 17 15:47:05 2022] POST /compute/v2.1/servers/60a2d899-438a-438a-becd-c04e645f10d9/os-volume_attachments => generated 194 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:47:05.997522 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-217437fb-0312-4bbf-ad47-a4b709e43856 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:47:05.999170 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-217437fb-0312-4bbf-ad47-a4b709e43856 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: 031f230c-48e6-46bb-a549-3cb347946170] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:47:06.008657 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-217437fb-0312-4bbf-ad47-a4b709e43856 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:06.009104 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-217437fb-0312-4bbf-ad47-a4b709e43856 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:06.009873 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-217437fb-0312-4bbf-ad47-a4b709e43856 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:06.010652 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-217437fb-0312-4bbf-ad47-a4b709e43856 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:06.196864 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-217437fb-0312-4bbf-ad47-a4b709e43856 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:06.205521 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-217437fb-0312-4bbf-ad47-a4b709e43856 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:06.207061 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-217437fb-0312-4bbf-ad47-a4b709e43856 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:06.208242 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-217437fb-0312-4bbf-ad47-a4b709e43856 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170" status: 200 len: 1743 microversion: 2.20 time: 0.216111 Jun 17 15:47:06.208841 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1477/3369] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:47:05 2022] GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170 => generated 1743 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:47:07.231418 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-caaa4d75-fb93-4573-a28c-710741b63e7b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:47:07.232196 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-caaa4d75-fb93-4573-a28c-710741b63e7b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: 031f230c-48e6-46bb-a549-3cb347946170] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:47:07.239939 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-caaa4d75-fb93-4573-a28c-710741b63e7b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:07.240999 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-caaa4d75-fb93-4573-a28c-710741b63e7b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:07.243392 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-caaa4d75-fb93-4573-a28c-710741b63e7b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:07.243999 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-caaa4d75-fb93-4573-a28c-710741b63e7b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:07.265315 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:47:07.426449 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-caaa4d75-fb93-4573-a28c-710741b63e7b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:07.438595 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-caaa4d75-fb93-4573-a28c-710741b63e7b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:07.440163 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-caaa4d75-fb93-4573-a28c-710741b63e7b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:07.441521 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-caaa4d75-fb93-4573-a28c-710741b63e7b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170" status: 200 len: 1738 microversion: 2.20 time: 0.218536 Jun 17 15:47:07.442075 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1893/3370] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:47:07 2022] GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170 => generated 1738 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:47:08.460035 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-ab8946d5-4f2b-407c-b7f9-25d75a1eff7f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:47:08.460721 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-ab8946d5-4f2b-407c-b7f9-25d75a1eff7f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: 031f230c-48e6-46bb-a549-3cb347946170] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:47:08.473244 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ab8946d5-4f2b-407c-b7f9-25d75a1eff7f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:08.473707 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ab8946d5-4f2b-407c-b7f9-25d75a1eff7f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:08.474462 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ab8946d5-4f2b-407c-b7f9-25d75a1eff7f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:08.474891 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ab8946d5-4f2b-407c-b7f9-25d75a1eff7f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:08.694973 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-ab8946d5-4f2b-407c-b7f9-25d75a1eff7f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:08.707630 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-ab8946d5-4f2b-407c-b7f9-25d75a1eff7f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:08.713005 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-ab8946d5-4f2b-407c-b7f9-25d75a1eff7f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:08.714248 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-ab8946d5-4f2b-407c-b7f9-25d75a1eff7f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170" status: 200 len: 1738 microversion: 2.20 time: 0.258368 Jun 17 15:47:08.714817 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1478/3371] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:47:08 2022] GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170 => generated 1738 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:47:09.735553 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-e634d457-8dde-4848-ae9c-b3ffd14348f9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:47:09.737322 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-e634d457-8dde-4848-ae9c-b3ffd14348f9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: 031f230c-48e6-46bb-a549-3cb347946170] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:47:09.751024 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e634d457-8dde-4848-ae9c-b3ffd14348f9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:09.751478 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e634d457-8dde-4848-ae9c-b3ffd14348f9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:09.752266 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e634d457-8dde-4848-ae9c-b3ffd14348f9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:09.752730 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e634d457-8dde-4848-ae9c-b3ffd14348f9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:09.989593 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-e634d457-8dde-4848-ae9c-b3ffd14348f9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:09.999192 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-e634d457-8dde-4848-ae9c-b3ffd14348f9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:10.000741 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-e634d457-8dde-4848-ae9c-b3ffd14348f9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:10.001927 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-e634d457-8dde-4848-ae9c-b3ffd14348f9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170" status: 200 len: 1738 microversion: 2.20 time: 0.272249 Jun 17 15:47:10.002495 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1894/3372] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:47:09 2022] GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170 => generated 1738 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 15:47:10.930705 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [req-bee06903-aa50-4e9d-b1a3-5be3d0634a06 req-1232dfda-ff98-4c66-877c-0a19b5fbfaf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "031f230c-48e6-46bb-a549-3cb347946170", "name": "network-vif-plugged", "status": "completed", "tag": "f36b91db-a750-4162-b57f-9c6ee752ebac"}]} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:47:10.986630 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-bee06903-aa50-4e9d-b1a3-5be3d0634a06 req-1232dfda-ff98-4c66-877c-0a19b5fbfaf1 service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:10.987081 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-bee06903-aa50-4e9d-b1a3-5be3d0634a06 req-1232dfda-ff98-4c66-877c-0a19b5fbfaf1 service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:11.009755 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.compute.server_external_events [req-bee06903-aa50-4e9d-b1a3-5be3d0634a06 req-1232dfda-ff98-4c66-877c-0a19b5fbfaf1 service nova] Creating event network-vif-plugged:f36b91db-a750-4162-b57f-9c6ee752ebac for instance 031f230c-48e6-46bb-a549-3cb347946170 on hv-cinder-82549 Jun 17 15:47:11.019659 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-af1c63f4-b5c8-4f54-86d3-5a28b60a2773 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:47:11.020255 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-af1c63f4-b5c8-4f54-86d3-5a28b60a2773 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: 031f230c-48e6-46bb-a549-3cb347946170] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:47:11.033190 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [req-bee06903-aa50-4e9d-b1a3-5be3d0634a06 req-1232dfda-ff98-4c66-877c-0a19b5fbfaf1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104594 Jun 17 15:47:11.042600 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-af1c63f4-b5c8-4f54-86d3-5a28b60a2773 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:11.042600 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-af1c63f4-b5c8-4f54-86d3-5a28b60a2773 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:11.042600 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-af1c63f4-b5c8-4f54-86d3-5a28b60a2773 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:11.042600 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-af1c63f4-b5c8-4f54-86d3-5a28b60a2773 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:11.043111 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1479/3373] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 15:47:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:47:11.332496 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-af1c63f4-b5c8-4f54-86d3-5a28b60a2773 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:11.358677 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-af1c63f4-b5c8-4f54-86d3-5a28b60a2773 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:11.360765 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-af1c63f4-b5c8-4f54-86d3-5a28b60a2773 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:11.363005 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-af1c63f4-b5c8-4f54-86d3-5a28b60a2773 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170" status: 200 len: 1738 microversion: 2.20 time: 0.347443 Jun 17 15:47:11.365404 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1895/3374] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:47:11 2022] GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170 => generated 1738 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 15:47:12.386825 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-23ec9d5e-a57b-480f-a843-7869ed3daf8a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:47:12.388208 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-23ec9d5e-a57b-480f-a843-7869ed3daf8a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: 031f230c-48e6-46bb-a549-3cb347946170] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:47:12.396529 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-23ec9d5e-a57b-480f-a843-7869ed3daf8a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:12.397338 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-23ec9d5e-a57b-480f-a843-7869ed3daf8a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:12.398332 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-23ec9d5e-a57b-480f-a843-7869ed3daf8a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:12.398986 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-23ec9d5e-a57b-480f-a843-7869ed3daf8a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:12.684666 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-23ec9d5e-a57b-480f-a843-7869ed3daf8a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:12.699838 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-23ec9d5e-a57b-480f-a843-7869ed3daf8a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:12.703735 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-23ec9d5e-a57b-480f-a843-7869ed3daf8a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:12.712217 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-23ec9d5e-a57b-480f-a843-7869ed3daf8a tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170" status: 200 len: 1738 microversion: 2.20 time: 0.326412 Jun 17 15:47:12.713811 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1480/3375] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:47:12 2022] GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170 => generated 1738 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 15:47:13.737058 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-9453587d-6cd2-4b0c-871e-8bd5df7007ff tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:47:13.739660 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-9453587d-6cd2-4b0c-871e-8bd5df7007ff tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: 031f230c-48e6-46bb-a549-3cb347946170] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:47:13.750558 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9453587d-6cd2-4b0c-871e-8bd5df7007ff tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:13.751216 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9453587d-6cd2-4b0c-871e-8bd5df7007ff tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:13.753247 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9453587d-6cd2-4b0c-871e-8bd5df7007ff tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:13.753882 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9453587d-6cd2-4b0c-871e-8bd5df7007ff tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:13.936580 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-9453587d-6cd2-4b0c-871e-8bd5df7007ff tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:13.947047 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-9453587d-6cd2-4b0c-871e-8bd5df7007ff tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:13.949713 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-9453587d-6cd2-4b0c-871e-8bd5df7007ff tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:13.951299 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-9453587d-6cd2-4b0c-871e-8bd5df7007ff tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170" status: 200 len: 1738 microversion: 2.20 time: 0.223964 Jun 17 15:47:13.952222 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1896/3376] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:47:13 2022] GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170 => generated 1738 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:47:14.975800 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-2b1ad6f4-90fe-414c-b824-34aec4980d87 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:47:14.977739 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-2b1ad6f4-90fe-414c-b824-34aec4980d87 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: 031f230c-48e6-46bb-a549-3cb347946170] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:47:15.002258 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2b1ad6f4-90fe-414c-b824-34aec4980d87 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:15.003131 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2b1ad6f4-90fe-414c-b824-34aec4980d87 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:15.005090 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2b1ad6f4-90fe-414c-b824-34aec4980d87 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:15.006376 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2b1ad6f4-90fe-414c-b824-34aec4980d87 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:15.171933 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-50ecca57-af20-4d54-b206-0f260344d6be tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Action: 'create', calling method: .version_select at 0x7faf5063d280>, body: {"keypair": {"name": "tempest-keypair-980914522", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOPTCTfx2idKuUCidkN9hZS1uukNdjtYfNwzjnpLFRphjx3THIp4HrcvC+TmXk2grV9ANPYGNqU6S2l53nFCw/00a+5WgeEDuJYXRcTk5ik1PaRTxyWPQ5cnX+ADgGgVjg=="}} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:47:15.206543 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.quota [None req-50ecca57-af20-4d54-b206-0f260344d6be tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Getting quotas for project 79efe2b5db31498c81c59b086e5c6f84. Resources: {'key_pairs'} {{(pid=117649) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 15:47:15.211955 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.quota [None req-50ecca57-af20-4d54-b206-0f260344d6be tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Getting quotas for user 8ab3130962a6456bbbcb1c96aba3506d and project 79efe2b5db31498c81c59b086e5c6f84. Resources: {'key_pairs'} {{(pid=117649) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 15:47:15.216585 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-2b1ad6f4-90fe-414c-b824-34aec4980d87 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:15.226187 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-2b1ad6f4-90fe-414c-b824-34aec4980d87 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:15.233565 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-2b1ad6f4-90fe-414c-b824-34aec4980d87 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:15.235818 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-2b1ad6f4-90fe-414c-b824-34aec4980d87 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170" status: 200 len: 1738 microversion: 2.20 time: 0.267082 Jun 17 15:47:15.249521 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1897/3377] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:47:14 2022] GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170 => generated 1738 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:47:15.254607 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-50ecca57-af20-4d54-b206-0f260344d6be tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.352111 Jun 17 15:47:15.255410 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1481/3378] 10.222.0.48 () {60 vars in 1158 bytes} [Fri Jun 17 15:47:14 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:47:16.258844 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-421d1271-b147-4dbe-9a6e-c2948b79422b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:47:16.259468 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-421d1271-b147-4dbe-9a6e-c2948b79422b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: 031f230c-48e6-46bb-a549-3cb347946170] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:47:16.282579 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-421d1271-b147-4dbe-9a6e-c2948b79422b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:16.283021 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-421d1271-b147-4dbe-9a6e-c2948b79422b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:16.283992 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-421d1271-b147-4dbe-9a6e-c2948b79422b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:16.285916 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-421d1271-b147-4dbe-9a6e-c2948b79422b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:16.579892 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-421d1271-b147-4dbe-9a6e-c2948b79422b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:16.591030 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-421d1271-b147-4dbe-9a6e-c2948b79422b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:16.594032 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-421d1271-b147-4dbe-9a6e-c2948b79422b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:16.596386 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-421d1271-b147-4dbe-9a6e-c2948b79422b tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170" status: 200 len: 1738 microversion: 2.20 time: 0.341298 Jun 17 15:47:16.597742 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1898/3379] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:47:16 2022] GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170 => generated 1738 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:47:17.440117 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-12a037f7-b2de-4e53-9004-054589afdb1d tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1525509579", "imageRef": "8c105ca4-6fe3-4e70-af71-b03c64fe1efe", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "288b7261-f0bd-4510-ab2e-0de2bc8999e0"}], "security_groups": [{"name": "tempest-securitygroup--1025842457"}], "key_name": "tempest-keypair-980914522", "user_data": "}} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:47:17.591155 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.network.neutron [None req-12a037f7-b2de-4e53-9004-054589afdb1d tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] validate_networks() for [('288b7261-f0bd-4510-ab2e-0de2bc8999e0', None, None, None, None, None)] {{(pid=117649) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 15:47:17.618975 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-a73797ae-c08a-4174-a16f-0af87ca789c1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:47:17.619576 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-a73797ae-c08a-4174-a16f-0af87ca789c1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: 031f230c-48e6-46bb-a549-3cb347946170] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:47:17.628497 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a73797ae-c08a-4174-a16f-0af87ca789c1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:17.629554 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a73797ae-c08a-4174-a16f-0af87ca789c1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:17.630951 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a73797ae-c08a-4174-a16f-0af87ca789c1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:17.631626 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a73797ae-c08a-4174-a16f-0af87ca789c1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:17.842348 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-a73797ae-c08a-4174-a16f-0af87ca789c1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:17.859161 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-a73797ae-c08a-4174-a16f-0af87ca789c1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:17.864850 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-a73797ae-c08a-4174-a16f-0af87ca789c1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:17.866176 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-a73797ae-c08a-4174-a16f-0af87ca789c1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170" status: 200 len: 1738 microversion: 2.20 time: 0.254211 Jun 17 15:47:17.869012 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1899/3380] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:47:17 2022] GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170 => generated 1738 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 15:47:18.211517 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-12a037f7-b2de-4e53-9004-054589afdb1d tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Flavor limits 0:0:0 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 15:47:18.212052 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-12a037f7-b2de-4e53-9004-054589afdb1d tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Image limits 0:0:0 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 15:47:18.212957 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-12a037f7-b2de-4e53-9004-054589afdb1d tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Flavor pref 0:0:0 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 15:47:18.214625 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-12a037f7-b2de-4e53-9004-054589afdb1d tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Image pref 0:0:0 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 15:47:18.215627 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-12a037f7-b2de-4e53-9004-054589afdb1d tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 15:47:18.233697 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-12a037f7-b2de-4e53-9004-054589afdb1d tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:18.234147 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-12a037f7-b2de-4e53-9004-054589afdb1d tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:18.237546 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-12a037f7-b2de-4e53-9004-054589afdb1d tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:18.237992 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-12a037f7-b2de-4e53-9004-054589afdb1d tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:18.282681 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.quota [None req-12a037f7-b2de-4e53-9004-054589afdb1d tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Getting quotas for project 79efe2b5db31498c81c59b086e5c6f84. Resources: {'cores', 'ram', 'instances'} {{(pid=117649) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 15:47:18.290058 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.quota [None req-12a037f7-b2de-4e53-9004-054589afdb1d tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Getting quotas for user 8ab3130962a6456bbbcb1c96aba3506d and project 79efe2b5db31498c81c59b086e5c6f84. Resources: {'cores', 'ram', 'instances'} {{(pid=117649) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 15:47:18.320497 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-12a037f7-b2de-4e53-9004-054589afdb1d tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Going to run 1 instances... {{(pid=117649) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 15:47:18.323048 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-12a037f7-b2de-4e53-9004-054589afdb1d tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] [instance: e4173cb9-999f-41f4-ade9-b521fc218a2b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c105ca4-6fe3-4e70-af71-b03c64fe1efe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117649) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 15:47:18.428460 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-12a037f7-b2de-4e53-9004-054589afdb1d tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.001667 Jun 17 15:47:18.430273 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1482/3381] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Jun 17 15:47:17 2022] POST /compute/v2.1/servers => generated 402 bytes in 1005 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 15:47:18.439847 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-00d76e1c-aef2-44ab-9b5c-fe3239885b1f tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:47:18.440797 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-00d76e1c-aef2-44ab-9b5c-fe3239885b1f tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] [instance: e4173cb9-999f-41f4-ade9-b521fc218a2b] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:47:18.569562 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-00d76e1c-aef2-44ab-9b5c-fe3239885b1f tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab3130962a6456bbbcb1c96aba3506d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79efe2b5db31498c81c59b086e5c6f84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:18.580741 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-00d76e1c-aef2-44ab-9b5c-fe3239885b1f tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] 10.222.0.48 "GET /compute/v2.1/servers/e4173cb9-999f-41f4-ade9-b521fc218a2b" status: 200 len: 1241 microversion: 2.1 time: 0.144518 Jun 17 15:47:18.591762 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1900/3382] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:47:18 2022] GET /compute/v2.1/servers/e4173cb9-999f-41f4-ade9-b521fc218a2b => generated 1241 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:47:18.899456 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-fa36eddd-d182-437e-b2e5-dada740355b1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:47:18.901861 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-fa36eddd-d182-437e-b2e5-dada740355b1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: 031f230c-48e6-46bb-a549-3cb347946170] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:47:18.912736 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fa36eddd-d182-437e-b2e5-dada740355b1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:18.913296 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fa36eddd-d182-437e-b2e5-dada740355b1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:18.915034 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fa36eddd-d182-437e-b2e5-dada740355b1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:18.915658 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fa36eddd-d182-437e-b2e5-dada740355b1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:19.149334 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-fa36eddd-d182-437e-b2e5-dada740355b1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:19.164253 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-fa36eddd-d182-437e-b2e5-dada740355b1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:19.166802 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-fa36eddd-d182-437e-b2e5-dada740355b1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:19.169814 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-fa36eddd-d182-437e-b2e5-dada740355b1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170" status: 200 len: 1738 microversion: 2.20 time: 0.276019 Jun 17 15:47:19.172070 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1483/3383] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:47:18 2022] GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170 => generated 1738 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:47:19.600499 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-2d060d30-6920-4f60-b0d3-ead9a05cda70 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:47:19.602361 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-2d060d30-6920-4f60-b0d3-ead9a05cda70 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] [instance: e4173cb9-999f-41f4-ade9-b521fc218a2b] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:47:19.675926 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-2d060d30-6920-4f60-b0d3-ead9a05cda70 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab3130962a6456bbbcb1c96aba3506d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79efe2b5db31498c81c59b086e5c6f84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:19.688031 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-2d060d30-6920-4f60-b0d3-ead9a05cda70 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] 10.222.0.48 "GET /compute/v2.1/servers/e4173cb9-999f-41f4-ade9-b521fc218a2b" status: 200 len: 1241 microversion: 2.1 time: 0.090967 Jun 17 15:47:19.689330 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1901/3384] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:47:19 2022] GET /compute/v2.1/servers/e4173cb9-999f-41f4-ade9-b521fc218a2b => generated 1241 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:47:20.190940 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-7d4e6a78-9fb5-4d07-84e4-db39043a1c21 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:47:20.192012 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-7d4e6a78-9fb5-4d07-84e4-db39043a1c21 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: 031f230c-48e6-46bb-a549-3cb347946170] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:47:20.199140 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7d4e6a78-9fb5-4d07-84e4-db39043a1c21 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:20.199588 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7d4e6a78-9fb5-4d07-84e4-db39043a1c21 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:20.200367 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7d4e6a78-9fb5-4d07-84e4-db39043a1c21 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:20.200799 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7d4e6a78-9fb5-4d07-84e4-db39043a1c21 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:20.336808 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-7d4e6a78-9fb5-4d07-84e4-db39043a1c21 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:20.346178 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-7d4e6a78-9fb5-4d07-84e4-db39043a1c21 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:20.347684 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-7d4e6a78-9fb5-4d07-84e4-db39043a1c21 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:20.348918 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-7d4e6a78-9fb5-4d07-84e4-db39043a1c21 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170" status: 200 len: 1738 microversion: 2.20 time: 0.162844 Jun 17 15:47:20.349471 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1484/3385] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:47:20 2022] GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170 => generated 1738 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:47:20.705108 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-bd3139fc-93ea-4d88-bf29-d1fb743250c1 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:47:20.705655 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-bd3139fc-93ea-4d88-bf29-d1fb743250c1 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] [instance: e4173cb9-999f-41f4-ade9-b521fc218a2b] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:47:20.712204 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bd3139fc-93ea-4d88-bf29-d1fb743250c1 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:20.712677 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bd3139fc-93ea-4d88-bf29-d1fb743250c1 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:20.713976 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bd3139fc-93ea-4d88-bf29-d1fb743250c1 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:20.714467 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bd3139fc-93ea-4d88-bf29-d1fb743250c1 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:20.780260 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-bd3139fc-93ea-4d88-bf29-d1fb743250c1 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab3130962a6456bbbcb1c96aba3506d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79efe2b5db31498c81c59b086e5c6f84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:20.788308 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-bd3139fc-93ea-4d88-bf29-d1fb743250c1 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] 10.222.0.48 "GET /compute/v2.1/servers/e4173cb9-999f-41f4-ade9-b521fc218a2b" status: 200 len: 1245 microversion: 2.1 time: 0.087112 Jun 17 15:47:20.788914 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1902/3386] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:47:20 2022] GET /compute/v2.1/servers/e4173cb9-999f-41f4-ade9-b521fc218a2b => generated 1245 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:47:21.368648 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-42bff304-33b5-4763-a963-25dcd4c1fdcd tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:47:21.369263 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-42bff304-33b5-4763-a963-25dcd4c1fdcd tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: 031f230c-48e6-46bb-a549-3cb347946170] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:47:21.376691 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-42bff304-33b5-4763-a963-25dcd4c1fdcd tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:21.377139 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-42bff304-33b5-4763-a963-25dcd4c1fdcd tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:21.377899 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-42bff304-33b5-4763-a963-25dcd4c1fdcd tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:21.378326 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-42bff304-33b5-4763-a963-25dcd4c1fdcd tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:21.526439 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-42bff304-33b5-4763-a963-25dcd4c1fdcd tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:21.535247 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-42bff304-33b5-4763-a963-25dcd4c1fdcd tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:21.536803 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-42bff304-33b5-4763-a963-25dcd4c1fdcd tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:21.538171 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-42bff304-33b5-4763-a963-25dcd4c1fdcd tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170" status: 200 len: 1738 microversion: 2.20 time: 0.173551 Jun 17 15:47:21.538737 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1485/3387] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:47:21 2022] GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170 => generated 1738 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:47:21.805878 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-ff78d95e-d3cd-4d4e-98db-b1333d799685 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:47:21.806484 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-ff78d95e-d3cd-4d4e-98db-b1333d799685 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] [instance: e4173cb9-999f-41f4-ade9-b521fc218a2b] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:47:21.813546 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ff78d95e-d3cd-4d4e-98db-b1333d799685 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:21.813991 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ff78d95e-d3cd-4d4e-98db-b1333d799685 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:21.814744 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ff78d95e-d3cd-4d4e-98db-b1333d799685 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:21.815181 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ff78d95e-d3cd-4d4e-98db-b1333d799685 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:21.875213 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-ff78d95e-d3cd-4d4e-98db-b1333d799685 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab3130962a6456bbbcb1c96aba3506d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79efe2b5db31498c81c59b086e5c6f84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:21.882510 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-ff78d95e-d3cd-4d4e-98db-b1333d799685 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] 10.222.0.48 "GET /compute/v2.1/servers/e4173cb9-999f-41f4-ade9-b521fc218a2b" status: 200 len: 1245 microversion: 2.1 time: 0.080548 Jun 17 15:47:21.883070 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1903/3388] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:47:21 2022] GET /compute/v2.1/servers/e4173cb9-999f-41f4-ade9-b521fc218a2b => generated 1245 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:47:22.559177 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-c71d8b02-ece5-43cb-9181-97cc393d71b1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:47:22.559790 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-c71d8b02-ece5-43cb-9181-97cc393d71b1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: 031f230c-48e6-46bb-a549-3cb347946170] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:47:22.566557 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c71d8b02-ece5-43cb-9181-97cc393d71b1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:22.567007 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c71d8b02-ece5-43cb-9181-97cc393d71b1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:22.567775 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c71d8b02-ece5-43cb-9181-97cc393d71b1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:22.568208 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c71d8b02-ece5-43cb-9181-97cc393d71b1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:22.571066 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:47:22.708005 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-c71d8b02-ece5-43cb-9181-97cc393d71b1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:22.717213 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-c71d8b02-ece5-43cb-9181-97cc393d71b1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:22.718743 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-c71d8b02-ece5-43cb-9181-97cc393d71b1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:22.719888 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-c71d8b02-ece5-43cb-9181-97cc393d71b1 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170" status: 200 len: 1738 microversion: 2.20 time: 0.164697 Jun 17 15:47:22.720469 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1486/3389] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:47:22 2022] GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170 => generated 1738 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:47:22.899407 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-f17a736d-ef7c-4e02-93ed-9f405c2e69a0 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:47:22.899955 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-f17a736d-ef7c-4e02-93ed-9f405c2e69a0 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] [instance: e4173cb9-999f-41f4-ade9-b521fc218a2b] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:47:22.906414 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f17a736d-ef7c-4e02-93ed-9f405c2e69a0 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:22.906925 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f17a736d-ef7c-4e02-93ed-9f405c2e69a0 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:22.907685 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f17a736d-ef7c-4e02-93ed-9f405c2e69a0 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:22.908121 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f17a736d-ef7c-4e02-93ed-9f405c2e69a0 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:22.970274 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-f17a736d-ef7c-4e02-93ed-9f405c2e69a0 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab3130962a6456bbbcb1c96aba3506d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79efe2b5db31498c81c59b086e5c6f84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:22.978151 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-f17a736d-ef7c-4e02-93ed-9f405c2e69a0 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] 10.222.0.48 "GET /compute/v2.1/servers/e4173cb9-999f-41f4-ade9-b521fc218a2b" status: 200 len: 1293 microversion: 2.1 time: 0.082657 Jun 17 15:47:22.978719 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1904/3390] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:47:22 2022] GET /compute/v2.1/servers/e4173cb9-999f-41f4-ade9-b521fc218a2b => generated 1293 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:47:23.739386 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-e91a9140-11c4-4074-a672-772f46d8e0c3 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:47:23.740015 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-e91a9140-11c4-4074-a672-772f46d8e0c3 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: 031f230c-48e6-46bb-a549-3cb347946170] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:47:23.748943 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e91a9140-11c4-4074-a672-772f46d8e0c3 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:23.749715 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e91a9140-11c4-4074-a672-772f46d8e0c3 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:23.750730 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e91a9140-11c4-4074-a672-772f46d8e0c3 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:23.751405 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e91a9140-11c4-4074-a672-772f46d8e0c3 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:23.947188 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-e91a9140-11c4-4074-a672-772f46d8e0c3 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:23.956206 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-e91a9140-11c4-4074-a672-772f46d8e0c3 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:23.957835 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-e91a9140-11c4-4074-a672-772f46d8e0c3 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:23.959406 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-e91a9140-11c4-4074-a672-772f46d8e0c3 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170" status: 200 len: 1720 microversion: 2.20 time: 0.224630 Jun 17 15:47:23.966308 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1487/3391] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:47:23 2022] GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170 => generated 1720 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 15:47:23.996539 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-9e424311-c824-4443-871e-b74e27cbef89 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:47:23.997288 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-9e424311-c824-4443-871e-b74e27cbef89 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] [instance: e4173cb9-999f-41f4-ade9-b521fc218a2b] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:47:24.004409 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9e424311-c824-4443-871e-b74e27cbef89 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:24.005240 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9e424311-c824-4443-871e-b74e27cbef89 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:24.006271 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9e424311-c824-4443-871e-b74e27cbef89 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:24.006952 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9e424311-c824-4443-871e-b74e27cbef89 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:24.096469 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-9e424311-c824-4443-871e-b74e27cbef89 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab3130962a6456bbbcb1c96aba3506d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79efe2b5db31498c81c59b086e5c6f84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:24.105967 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-9e424311-c824-4443-871e-b74e27cbef89 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] 10.222.0.48 "GET /compute/v2.1/servers/e4173cb9-999f-41f4-ade9-b521fc218a2b" status: 200 len: 1299 microversion: 2.1 time: 0.114560 Jun 17 15:47:24.115681 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1905/3392] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:47:23 2022] GET /compute/v2.1/servers/e4173cb9-999f-41f4-ade9-b521fc218a2b => generated 1299 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:47:24.989720 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-a2288c60-6bdd-4f43-aedc-30b593bbc1dd tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:47:24.990471 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-a2288c60-6bdd-4f43-aedc-30b593bbc1dd tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: 031f230c-48e6-46bb-a549-3cb347946170] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:47:24.997399 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a2288c60-6bdd-4f43-aedc-30b593bbc1dd tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:24.997771 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a2288c60-6bdd-4f43-aedc-30b593bbc1dd tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:24.998523 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a2288c60-6bdd-4f43-aedc-30b593bbc1dd tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:24.998954 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a2288c60-6bdd-4f43-aedc-30b593bbc1dd tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:25.123809 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-df8ee058-6b49-44bb-8eee-a45688ebaeac tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:47:25.124494 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-df8ee058-6b49-44bb-8eee-a45688ebaeac tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] [instance: e4173cb9-999f-41f4-ade9-b521fc218a2b] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:47:25.127004 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:47:25.132909 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-df8ee058-6b49-44bb-8eee-a45688ebaeac tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:25.133410 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-df8ee058-6b49-44bb-8eee-a45688ebaeac tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:25.134330 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-df8ee058-6b49-44bb-8eee-a45688ebaeac tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:25.135096 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-df8ee058-6b49-44bb-8eee-a45688ebaeac tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:25.149254 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-a2288c60-6bdd-4f43-aedc-30b593bbc1dd tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:25.160505 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-a2288c60-6bdd-4f43-aedc-30b593bbc1dd tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:25.162069 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-a2288c60-6bdd-4f43-aedc-30b593bbc1dd tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:25.163490 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-a2288c60-6bdd-4f43-aedc-30b593bbc1dd tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170" status: 200 len: 1720 microversion: 2.20 time: 0.177943 Jun 17 15:47:25.164048 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1488/3393] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:47:24 2022] GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170 => generated 1720 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:47:25.272088 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-df8ee058-6b49-44bb-8eee-a45688ebaeac tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab3130962a6456bbbcb1c96aba3506d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79efe2b5db31498c81c59b086e5c6f84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:25.280271 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-df8ee058-6b49-44bb-8eee-a45688ebaeac tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] 10.222.0.48 "GET /compute/v2.1/servers/e4173cb9-999f-41f4-ade9-b521fc218a2b" status: 200 len: 1367 microversion: 2.1 time: 0.160830 Jun 17 15:47:25.280885 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1906/3394] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:47:25 2022] GET /compute/v2.1/servers/e4173cb9-999f-41f4-ade9-b521fc218a2b => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:47:26.184014 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-bbcc3948-e4a6-45c1-9a79-2fb007f81ad6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:47:26.185222 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-bbcc3948-e4a6-45c1-9a79-2fb007f81ad6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: 031f230c-48e6-46bb-a549-3cb347946170] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:47:26.193813 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bbcc3948-e4a6-45c1-9a79-2fb007f81ad6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:26.194502 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bbcc3948-e4a6-45c1-9a79-2fb007f81ad6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:26.195463 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bbcc3948-e4a6-45c1-9a79-2fb007f81ad6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:26.196010 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bbcc3948-e4a6-45c1-9a79-2fb007f81ad6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:26.301595 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-e31258d0-4894-42aa-a0d9-6fecfd081053 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:47:26.314606 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-e31258d0-4894-42aa-a0d9-6fecfd081053 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] [instance: e4173cb9-999f-41f4-ade9-b521fc218a2b] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:47:26.322141 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e31258d0-4894-42aa-a0d9-6fecfd081053 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:26.322667 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e31258d0-4894-42aa-a0d9-6fecfd081053 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:26.323458 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e31258d0-4894-42aa-a0d9-6fecfd081053 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:26.324102 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e31258d0-4894-42aa-a0d9-6fecfd081053 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:26.428942 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-bbcc3948-e4a6-45c1-9a79-2fb007f81ad6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:26.438950 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-bbcc3948-e4a6-45c1-9a79-2fb007f81ad6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:26.447335 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-bbcc3948-e4a6-45c1-9a79-2fb007f81ad6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:26.448830 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-bbcc3948-e4a6-45c1-9a79-2fb007f81ad6 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170" status: 200 len: 1723 microversion: 2.20 time: 0.270218 Jun 17 15:47:26.449474 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1489/3395] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:47:26 2022] GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170 => generated 1723 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 15:47:26.470154 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-117b9933-eb1f-485c-8895-430844d39801 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7b5d86d8-c9dd-4662-bf33-3ffc012744cd"}} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:47:26.471293 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-117b9933-eb1f-485c-8895-430844d39801 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: 031f230c-48e6-46bb-a549-3cb347946170] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:47:26.478510 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-117b9933-eb1f-485c-8895-430844d39801 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:26.478510 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-117b9933-eb1f-485c-8895-430844d39801 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:26.479902 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-117b9933-eb1f-485c-8895-430844d39801 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:26.480367 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-117b9933-eb1f-485c-8895-430844d39801 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:26.544149 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-e31258d0-4894-42aa-a0d9-6fecfd081053 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab3130962a6456bbbcb1c96aba3506d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79efe2b5db31498c81c59b086e5c6f84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:26.557740 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-e31258d0-4894-42aa-a0d9-6fecfd081053 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] 10.222.0.48 "GET /compute/v2.1/servers/e4173cb9-999f-41f4-ade9-b521fc218a2b" status: 200 len: 1367 microversion: 2.1 time: 0.261959 Jun 17 15:47:26.559135 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1907/3396] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:47:26 2022] GET /compute/v2.1/servers/e4173cb9-999f-41f4-ade9-b521fc218a2b => generated 1367 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:47:26.565001 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [req-09a15b80-7362-4f90-bccd-597062e29036 req-13e37e44-0f97-4d19-9401-54eb9fea9a18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4173cb9-999f-41f4-ade9-b521fc218a2b", "tag": "43096010-9b78-424f-89a3-0da3cacf6d65"}]} {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:47:26.576229 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [req-09a15b80-7362-4f90-bccd-597062e29036 req-13e37e44-0f97-4d19-9401-54eb9fea9a18 service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:26.577015 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [req-09a15b80-7362-4f90-bccd-597062e29036 req-13e37e44-0f97-4d19-9401-54eb9fea9a18 service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:26.593905 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.compute.server_external_events [req-09a15b80-7362-4f90-bccd-597062e29036 req-13e37e44-0f97-4d19-9401-54eb9fea9a18 service nova] Creating event network-changed:43096010-9b78-424f-89a3-0da3cacf6d65 for instance e4173cb9-999f-41f4-ade9-b521fc218a2b on hv-cinder-82549 Jun 17 15:47:26.599507 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [req-09a15b80-7362-4f90-bccd-597062e29036 req-13e37e44-0f97-4d19-9401-54eb9fea9a18 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038631 Jun 17 15:47:26.600526 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1908/3397] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 15:47:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:47:26.719633 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [req-f0bca1f7-a785-47f5-a9e8-efaa907243be req-8d108394-af60-4ca4-bcee-b8f3b9a3f559 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "031f230c-48e6-46bb-a549-3cb347946170", "name": "network-vif-unplugged", "status": "completed", "tag": "f36b91db-a750-4162-b57f-9c6ee752ebac"}]} {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:47:26.741249 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [req-f0bca1f7-a785-47f5-a9e8-efaa907243be req-8d108394-af60-4ca4-bcee-b8f3b9a3f559 service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:26.743571 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [req-f0bca1f7-a785-47f5-a9e8-efaa907243be req-8d108394-af60-4ca4-bcee-b8f3b9a3f559 service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:26.780428 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.compute.server_external_events [req-f0bca1f7-a785-47f5-a9e8-efaa907243be req-8d108394-af60-4ca4-bcee-b8f3b9a3f559 service nova] Unable to find a host for instance 031f230c-48e6-46bb-a549-3cb347946170. Dropping event network-vif-unplugged {{(pid=117650) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 17 15:47:26.781338 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [req-f0bca1f7-a785-47f5-a9e8-efaa907243be req-8d108394-af60-4ca4-bcee-b8f3b9a3f559 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.066387 Jun 17 15:47:26.782247 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1909/3398] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 15:47:26 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 68 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 17 15:47:26.862461 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-117b9933-eb1f-485c-8895-430844d39801 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "POST /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.396484 Jun 17 15:47:26.864381 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1490/3399] 10.222.0.48 () {62 vars in 1363 bytes} [Fri Jun 17 15:47:26 2022] POST /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170/os-volume_attachments => generated 188 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 17 15:47:26.980025 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-707fd1dd-06fe-4e36-b70f-9ead70efeb08 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:47:26.980672 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-707fd1dd-06fe-4e36-b70f-9ead70efeb08 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: 031f230c-48e6-46bb-a549-3cb347946170] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:47:26.986643 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-707fd1dd-06fe-4e36-b70f-9ead70efeb08 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:26.987080 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-707fd1dd-06fe-4e36-b70f-9ead70efeb08 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:26.987835 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-707fd1dd-06fe-4e36-b70f-9ead70efeb08 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:26.988266 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-707fd1dd-06fe-4e36-b70f-9ead70efeb08 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:27.045281 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-23bf7241-37bd-49a3-99d2-f53a979330c9 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:47:27.045785 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-23bf7241-37bd-49a3-99d2-f53a979330c9 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 60a2d899-438a-438a-becd-c04e645f10d9] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:47:27.053787 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-23bf7241-37bd-49a3-99d2-f53a979330c9 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:27.054241 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-23bf7241-37bd-49a3-99d2-f53a979330c9 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:27.055014 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-23bf7241-37bd-49a3-99d2-f53a979330c9 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:27.055448 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-23bf7241-37bd-49a3-99d2-f53a979330c9 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:27.139130 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.objects.instance [None req-23bf7241-37bd-49a3-99d2-f53a979330c9 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lazy-loading 'services' on Instance uuid 60a2d899-438a-438a-becd-c04e645f10d9 {{(pid=117649) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 15:47:27.221574 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-23bf7241-37bd-49a3-99d2-f53a979330c9 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "DELETE /compute/v2.1/servers/60a2d899-438a-438a-becd-c04e645f10d9/os-volume_attachments/85a22134-39c1-4cce-a7b9-cd85d62e6638" status: 202 len: 0 microversion: 2.1 time: 0.180573 Jun 17 15:47:27.222317 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1491/3400] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Jun 17 15:47:27 2022] DELETE /compute/v2.1/servers/60a2d899-438a-438a-becd-c04e645f10d9/os-volume_attachments/85a22134-39c1-4cce-a7b9-cd85d62e6638 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 17 15:47:27.289657 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:47:27.295663 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-707fd1dd-06fe-4e36-b70f-9ead70efeb08 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "DELETE /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170/os-volume_attachments/7b5d86d8-c9dd-4662-bf33-3ffc012744cd" status: 202 len: 0 microversion: 2.20 time: 0.320305 Jun 17 15:47:27.296491 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1910/3401] 10.222.0.48 () {60 vars in 1456 bytes} [Fri Jun 17 15:47:26 2022] DELETE /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170/os-volume_attachments/7b5d86d8-c9dd-4662-bf33-3ffc012744cd => generated 0 bytes in 322 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 17 15:47:27.357832 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-c132a7c9-e4ee-4d22-9483-d97b470ae8dd tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:47:27.358718 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-c132a7c9-e4ee-4d22-9483-d97b470ae8dd tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: 031f230c-48e6-46bb-a549-3cb347946170] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:47:27.366454 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c132a7c9-e4ee-4d22-9483-d97b470ae8dd tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:27.366897 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c132a7c9-e4ee-4d22-9483-d97b470ae8dd tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:27.367659 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c132a7c9-e4ee-4d22-9483-d97b470ae8dd tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:27.368091 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c132a7c9-e4ee-4d22-9483-d97b470ae8dd tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:27.463025 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-c132a7c9-e4ee-4d22-9483-d97b470ae8dd tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "POST /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170/action" status: 202 len: 0 microversion: 2.20 time: 0.109874 Jun 17 15:47:27.463864 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1492/3402] 10.222.0.48 () {62 vars in 1318 bytes} [Fri Jun 17 15:47:27 2022] POST /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 17 15:47:27.472068 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-d1d3a862-adb7-4717-8b8c-a8782feeb1ce tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:47:27.472718 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-d1d3a862-adb7-4717-8b8c-a8782feeb1ce tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: 031f230c-48e6-46bb-a549-3cb347946170] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:47:27.480490 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d1d3a862-adb7-4717-8b8c-a8782feeb1ce tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:27.481080 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d1d3a862-adb7-4717-8b8c-a8782feeb1ce tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:27.481857 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d1d3a862-adb7-4717-8b8c-a8782feeb1ce tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:27.482297 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d1d3a862-adb7-4717-8b8c-a8782feeb1ce tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:27.577166 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-7ae7b11a-d0ab-41ff-b50a-cba0fcce5638 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:47:27.577793 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-7ae7b11a-d0ab-41ff-b50a-cba0fcce5638 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] [instance: e4173cb9-999f-41f4-ade9-b521fc218a2b] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:47:27.584449 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7ae7b11a-d0ab-41ff-b50a-cba0fcce5638 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:27.585114 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7ae7b11a-d0ab-41ff-b50a-cba0fcce5638 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:27.586263 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7ae7b11a-d0ab-41ff-b50a-cba0fcce5638 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:27.586767 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7ae7b11a-d0ab-41ff-b50a-cba0fcce5638 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:27.647047 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-d1d3a862-adb7-4717-8b8c-a8782feeb1ce tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:27.656948 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-d1d3a862-adb7-4717-8b8c-a8782feeb1ce tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:27.659641 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-d1d3a862-adb7-4717-8b8c-a8782feeb1ce tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:27.661614 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-d1d3a862-adb7-4717-8b8c-a8782feeb1ce tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170" status: 200 len: 1671 microversion: 2.20 time: 0.193769 Jun 17 15:47:27.664385 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1911/3403] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:47:27 2022] GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170 => generated 1671 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:47:27.742026 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-7ae7b11a-d0ab-41ff-b50a-cba0fcce5638 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab3130962a6456bbbcb1c96aba3506d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79efe2b5db31498c81c59b086e5c6f84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:27.756623 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-7ae7b11a-d0ab-41ff-b50a-cba0fcce5638 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] 10.222.0.48 "GET /compute/v2.1/servers/e4173cb9-999f-41f4-ade9-b521fc218a2b" status: 200 len: 1367 microversion: 2.1 time: 0.184292 Jun 17 15:47:27.757827 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1493/3404] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:47:27 2022] GET /compute/v2.1/servers/e4173cb9-999f-41f4-ade9-b521fc218a2b => generated 1367 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:47:28.685451 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-6c1f7a11-8d1e-48ad-8d8b-8b52d7873c20 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:47:28.686880 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-6c1f7a11-8d1e-48ad-8d8b-8b52d7873c20 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: 031f230c-48e6-46bb-a549-3cb347946170] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:47:28.694912 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6c1f7a11-8d1e-48ad-8d8b-8b52d7873c20 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:28.695356 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6c1f7a11-8d1e-48ad-8d8b-8b52d7873c20 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:28.696142 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6c1f7a11-8d1e-48ad-8d8b-8b52d7873c20 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:28.696597 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6c1f7a11-8d1e-48ad-8d8b-8b52d7873c20 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:28.782719 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-5ff91cbc-4b5f-4f4c-bbda-1db62c563366 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:47:28.783320 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-5ff91cbc-4b5f-4f4c-bbda-1db62c563366 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] [instance: e4173cb9-999f-41f4-ade9-b521fc218a2b] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:47:28.786038 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell0:SELECT=2 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:47:28.787100 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell0:SELECT=10 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:47:28.787969 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:47:28.794454 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5ff91cbc-4b5f-4f4c-bbda-1db62c563366 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:28.795189 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5ff91cbc-4b5f-4f4c-bbda-1db62c563366 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:28.796218 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5ff91cbc-4b5f-4f4c-bbda-1db62c563366 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:28.796910 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5ff91cbc-4b5f-4f4c-bbda-1db62c563366 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:28.849191 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-6c1f7a11-8d1e-48ad-8d8b-8b52d7873c20 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:28.859496 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-6c1f7a11-8d1e-48ad-8d8b-8b52d7873c20 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:28.861125 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-6c1f7a11-8d1e-48ad-8d8b-8b52d7873c20 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:28.862481 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-6c1f7a11-8d1e-48ad-8d8b-8b52d7873c20 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170" status: 200 len: 1673 microversion: 2.20 time: 0.183507 Jun 17 15:47:28.863275 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1912/3405] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:47:28 2022] GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170 => generated 1673 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:47:28.964614 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-5ff91cbc-4b5f-4f4c-bbda-1db62c563366 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab3130962a6456bbbcb1c96aba3506d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79efe2b5db31498c81c59b086e5c6f84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:28.972881 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-5ff91cbc-4b5f-4f4c-bbda-1db62c563366 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] 10.222.0.48 "GET /compute/v2.1/servers/e4173cb9-999f-41f4-ade9-b521fc218a2b" status: 200 len: 1367 microversion: 2.1 time: 0.194175 Jun 17 15:47:28.973460 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1494/3406] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:47:28 2022] GET /compute/v2.1/servers/e4173cb9-999f-41f4-ade9-b521fc218a2b => generated 1367 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:47:29.400313 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-b31b827b-dec6-4d59-93f2-899870be37b4 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:47:29.400749 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-b31b827b-dec6-4d59-93f2-899870be37b4 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 60a2d899-438a-438a-becd-c04e645f10d9] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:47:29.407281 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b31b827b-dec6-4d59-93f2-899870be37b4 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:29.407512 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b31b827b-dec6-4d59-93f2-899870be37b4 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:29.408183 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b31b827b-dec6-4d59-93f2-899870be37b4 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:29.408927 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b31b827b-dec6-4d59-93f2-899870be37b4 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:29.434992 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-b31b827b-dec6-4d59-93f2-899870be37b4 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 60a2d899-438a-438a-becd-c04e645f10d9] Going to try to terminate instance {{(pid=117650) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 15:47:29.528110 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-b31b827b-dec6-4d59-93f2-899870be37b4 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "DELETE /compute/v2.1/servers/60a2d899-438a-438a-becd-c04e645f10d9" status: 204 len: 0 microversion: 2.1 time: 0.131361 Jun 17 15:47:29.528799 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1913/3407] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jun 17 15:47:29 2022] DELETE /compute/v2.1/servers/60a2d899-438a-438a-becd-c04e645f10d9 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 15:47:29.537609 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-5cb38c42-c407-4a4e-886a-1c6cd79f86d5 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:47:29.538219 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-5cb38c42-c407-4a4e-886a-1c6cd79f86d5 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 60a2d899-438a-438a-becd-c04e645f10d9] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:47:29.545040 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5cb38c42-c407-4a4e-886a-1c6cd79f86d5 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:29.545488 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5cb38c42-c407-4a4e-886a-1c6cd79f86d5 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:29.546245 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5cb38c42-c407-4a4e-886a-1c6cd79f86d5 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:29.546680 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5cb38c42-c407-4a4e-886a-1c6cd79f86d5 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:29.678632 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-5cb38c42-c407-4a4e-886a-1c6cd79f86d5 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:29.686159 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-5cb38c42-c407-4a4e-886a-1c6cd79f86d5 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/60a2d899-438a-438a-becd-c04e645f10d9" status: 200 len: 1514 microversion: 2.1 time: 0.152374 Jun 17 15:47:29.686699 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1495/3408] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:47:29 2022] GET /compute/v2.1/servers/60a2d899-438a-438a-becd-c04e645f10d9 => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:47:29.883461 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-1ebaa9f6-78aa-4d49-ba1b-71d2f041408c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:47:29.884165 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-1ebaa9f6-78aa-4d49-ba1b-71d2f041408c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: 031f230c-48e6-46bb-a549-3cb347946170] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:47:29.886706 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell0:SELECT=4 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:47:29.892792 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1ebaa9f6-78aa-4d49-ba1b-71d2f041408c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:29.893240 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1ebaa9f6-78aa-4d49-ba1b-71d2f041408c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:29.894015 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1ebaa9f6-78aa-4d49-ba1b-71d2f041408c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:29.894450 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1ebaa9f6-78aa-4d49-ba1b-71d2f041408c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:29.995136 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-1c79ed21-67db-4276-abe9-fc2b5b3e8550 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:47:29.996404 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-1c79ed21-67db-4276-abe9-fc2b5b3e8550 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] [instance: e4173cb9-999f-41f4-ade9-b521fc218a2b] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:47:30.008671 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1c79ed21-67db-4276-abe9-fc2b5b3e8550 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:30.009512 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1c79ed21-67db-4276-abe9-fc2b5b3e8550 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:30.011630 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1c79ed21-67db-4276-abe9-fc2b5b3e8550 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:30.012296 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1c79ed21-67db-4276-abe9-fc2b5b3e8550 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:30.045350 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-1ebaa9f6-78aa-4d49-ba1b-71d2f041408c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:30.053965 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-1ebaa9f6-78aa-4d49-ba1b-71d2f041408c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:30.055488 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-1ebaa9f6-78aa-4d49-ba1b-71d2f041408c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:30.056696 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-1ebaa9f6-78aa-4d49-ba1b-71d2f041408c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170" status: 200 len: 1729 microversion: 2.20 time: 0.177830 Jun 17 15:47:30.057261 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1914/3409] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:47:29 2022] GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170 => generated 1729 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:47:30.166314 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-1c79ed21-67db-4276-abe9-fc2b5b3e8550 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab3130962a6456bbbcb1c96aba3506d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79efe2b5db31498c81c59b086e5c6f84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:30.174114 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-1c79ed21-67db-4276-abe9-fc2b5b3e8550 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] 10.222.0.48 "GET /compute/v2.1/servers/e4173cb9-999f-41f4-ade9-b521fc218a2b" status: 200 len: 1367 microversion: 2.1 time: 0.186836 Jun 17 15:47:30.174700 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1496/3410] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:47:29 2022] GET /compute/v2.1/servers/e4173cb9-999f-41f4-ade9-b521fc218a2b => generated 1367 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:47:30.703656 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-7518d770-43b8-44a4-a6a0-5b69d30657d6 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:47:30.704299 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-7518d770-43b8-44a4-a6a0-5b69d30657d6 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 60a2d899-438a-438a-becd-c04e645f10d9] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:47:30.710466 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7518d770-43b8-44a4-a6a0-5b69d30657d6 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:30.711057 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7518d770-43b8-44a4-a6a0-5b69d30657d6 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:30.711693 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7518d770-43b8-44a4-a6a0-5b69d30657d6 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:30.712123 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7518d770-43b8-44a4-a6a0-5b69d30657d6 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:30.878073 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-7518d770-43b8-44a4-a6a0-5b69d30657d6 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:30.887104 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-7518d770-43b8-44a4-a6a0-5b69d30657d6 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/60a2d899-438a-438a-becd-c04e645f10d9" status: 200 len: 1514 microversion: 2.1 time: 0.187227 Jun 17 15:47:30.887906 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1915/3411] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:47:30 2022] GET /compute/v2.1/servers/60a2d899-438a-438a-becd-c04e645f10d9 => generated 1514 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:47:31.075724 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-3177742a-8981-4b5e-a437-616f8f5e3a59 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:47:31.076465 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-3177742a-8981-4b5e-a437-616f8f5e3a59 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: 031f230c-48e6-46bb-a549-3cb347946170] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:47:31.083085 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3177742a-8981-4b5e-a437-616f8f5e3a59 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:31.083552 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3177742a-8981-4b5e-a437-616f8f5e3a59 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:31.084302 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3177742a-8981-4b5e-a437-616f8f5e3a59 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:31.084910 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3177742a-8981-4b5e-a437-616f8f5e3a59 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:31.197421 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-47973996-db32-42f1-8600-09fdf4860ce8 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:47:31.200138 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-47973996-db32-42f1-8600-09fdf4860ce8 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] [instance: e4173cb9-999f-41f4-ade9-b521fc218a2b] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:47:31.210295 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-47973996-db32-42f1-8600-09fdf4860ce8 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:31.211183 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-47973996-db32-42f1-8600-09fdf4860ce8 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:31.212228 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-47973996-db32-42f1-8600-09fdf4860ce8 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:31.212966 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-47973996-db32-42f1-8600-09fdf4860ce8 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:31.363862 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-3177742a-8981-4b5e-a437-616f8f5e3a59 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:31.383235 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-3177742a-8981-4b5e-a437-616f8f5e3a59 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:31.384892 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-3177742a-8981-4b5e-a437-616f8f5e3a59 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:31.386760 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-3177742a-8981-4b5e-a437-616f8f5e3a59 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170" status: 200 len: 1729 microversion: 2.20 time: 0.315204 Jun 17 15:47:31.387609 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1497/3412] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:47:31 2022] GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170 => generated 1729 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:47:31.458775 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-47973996-db32-42f1-8600-09fdf4860ce8 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab3130962a6456bbbcb1c96aba3506d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79efe2b5db31498c81c59b086e5c6f84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:31.469954 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-47973996-db32-42f1-8600-09fdf4860ce8 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] 10.222.0.48 "GET /compute/v2.1/servers/e4173cb9-999f-41f4-ade9-b521fc218a2b" status: 200 len: 1367 microversion: 2.1 time: 0.281093 Jun 17 15:47:31.470760 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1916/3413] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:47:31 2022] GET /compute/v2.1/servers/e4173cb9-999f-41f4-ade9-b521fc218a2b => generated 1367 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:47:31.865775 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [req-831f5e4d-d8f6-48b7-aa4a-6888165b5122 req-436c7d3c-fb6e-480f-a1de-4c2d23fdd967 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60a2d899-438a-438a-becd-c04e645f10d9", "name": "network-vif-deleted", "tag": "7a65a48b-ba13-46ee-af09-af818126298d"}]} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:47:31.875361 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-831f5e4d-d8f6-48b7-aa4a-6888165b5122 req-436c7d3c-fb6e-480f-a1de-4c2d23fdd967 service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:31.875831 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-831f5e4d-d8f6-48b7-aa4a-6888165b5122 req-436c7d3c-fb6e-480f-a1de-4c2d23fdd967 service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:31.888223 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.compute.server_external_events [req-831f5e4d-d8f6-48b7-aa4a-6888165b5122 req-436c7d3c-fb6e-480f-a1de-4c2d23fdd967 service nova] Creating event network-vif-deleted:7a65a48b-ba13-46ee-af09-af818126298d for instance 60a2d899-438a-438a-becd-c04e645f10d9 on hv-cinder-82549 Jun 17 15:47:31.894714 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [req-831f5e4d-d8f6-48b7-aa4a-6888165b5122 req-436c7d3c-fb6e-480f-a1de-4c2d23fdd967 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034661 Jun 17 15:47:31.896107 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1498/3414] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 15:47:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:47:31.907735 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-2e0b9990-308a-4a27-a647-985f63d05bf8 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:47:31.908365 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-2e0b9990-308a-4a27-a647-985f63d05bf8 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 60a2d899-438a-438a-becd-c04e645f10d9] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:47:31.915176 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2e0b9990-308a-4a27-a647-985f63d05bf8 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:31.915654 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2e0b9990-308a-4a27-a647-985f63d05bf8 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:31.924728 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2e0b9990-308a-4a27-a647-985f63d05bf8 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:31.925750 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2e0b9990-308a-4a27-a647-985f63d05bf8 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:32.023231 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-2e0b9990-308a-4a27-a647-985f63d05bf8 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:32.049959 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-2e0b9990-308a-4a27-a647-985f63d05bf8 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/60a2d899-438a-438a-becd-c04e645f10d9" status: 200 len: 1304 microversion: 2.1 time: 0.147670 Jun 17 15:47:32.051881 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1917/3415] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:47:31 2022] GET /compute/v2.1/servers/60a2d899-438a-438a-becd-c04e645f10d9 => generated 1304 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:47:32.413303 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-b06562bd-0e18-4b09-9a67-ef27634428e9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:47:32.414722 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-b06562bd-0e18-4b09-9a67-ef27634428e9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: 031f230c-48e6-46bb-a549-3cb347946170] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:47:32.428801 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b06562bd-0e18-4b09-9a67-ef27634428e9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:32.429442 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b06562bd-0e18-4b09-9a67-ef27634428e9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:32.430424 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b06562bd-0e18-4b09-9a67-ef27634428e9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:32.431001 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b06562bd-0e18-4b09-9a67-ef27634428e9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:32.435030 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=5,nova_cell1:UPDATE=5 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:47:32.488310 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-403a5403-0631-4169-8ca3-d7a48dc43001 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:47:32.489873 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-403a5403-0631-4169-8ca3-d7a48dc43001 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] [instance: e4173cb9-999f-41f4-ade9-b521fc218a2b] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:47:32.502096 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-403a5403-0631-4169-8ca3-d7a48dc43001 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:32.502825 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-403a5403-0631-4169-8ca3-d7a48dc43001 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:32.505864 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-403a5403-0631-4169-8ca3-d7a48dc43001 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:32.506789 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-403a5403-0631-4169-8ca3-d7a48dc43001 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:32.684185 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-403a5403-0631-4169-8ca3-d7a48dc43001 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab3130962a6456bbbcb1c96aba3506d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79efe2b5db31498c81c59b086e5c6f84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:32.694473 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-b06562bd-0e18-4b09-9a67-ef27634428e9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:32.695409 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-403a5403-0631-4169-8ca3-d7a48dc43001 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] 10.222.0.48 "GET /compute/v2.1/servers/e4173cb9-999f-41f4-ade9-b521fc218a2b" status: 200 len: 1367 microversion: 2.1 time: 0.211255 Jun 17 15:47:32.696792 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1918/3416] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:47:32 2022] GET /compute/v2.1/servers/e4173cb9-999f-41f4-ade9-b521fc218a2b => generated 1367 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:47:32.707621 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-b06562bd-0e18-4b09-9a67-ef27634428e9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:32.709803 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-b06562bd-0e18-4b09-9a67-ef27634428e9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:32.713990 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-b06562bd-0e18-4b09-9a67-ef27634428e9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170" status: 200 len: 1729 microversion: 2.20 time: 0.310028 Jun 17 15:47:32.715146 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1499/3417] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:47:32 2022] GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170 => generated 1729 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:47:32.797706 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [req-cf737581-bcb4-4002-aa00-9d6e38d4adfa req-be5d7a94-6fa4-4961-b042-a3cb997e03bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4173cb9-999f-41f4-ade9-b521fc218a2b", "name": "network-vif-plugged", "status": "completed", "tag": "43096010-9b78-424f-89a3-0da3cacf6d65"}]} {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:47:32.820640 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [req-cf737581-bcb4-4002-aa00-9d6e38d4adfa req-be5d7a94-6fa4-4961-b042-a3cb997e03bf service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:32.821635 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [req-cf737581-bcb4-4002-aa00-9d6e38d4adfa req-be5d7a94-6fa4-4961-b042-a3cb997e03bf service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:32.841751 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.compute.server_external_events [req-cf737581-bcb4-4002-aa00-9d6e38d4adfa req-be5d7a94-6fa4-4961-b042-a3cb997e03bf service nova] Creating event network-vif-plugged:43096010-9b78-424f-89a3-0da3cacf6d65 for instance e4173cb9-999f-41f4-ade9-b521fc218a2b on hv-cinder-82549 Jun 17 15:47:32.848517 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [req-cf737581-bcb4-4002-aa00-9d6e38d4adfa req-be5d7a94-6fa4-4961-b042-a3cb997e03bf service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056571 Jun 17 15:47:32.850321 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1919/3418] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 15:47:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:47:33.069681 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-5da47fbc-5c4e-48b7-ba58-7c10bf03a9e6 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:47:33.070471 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-5da47fbc-5c4e-48b7-ba58-7c10bf03a9e6 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 60a2d899-438a-438a-becd-c04e645f10d9] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:47:33.078082 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5da47fbc-5c4e-48b7-ba58-7c10bf03a9e6 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:33.078619 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5da47fbc-5c4e-48b7-ba58-7c10bf03a9e6 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:33.079460 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5da47fbc-5c4e-48b7-ba58-7c10bf03a9e6 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:33.079964 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5da47fbc-5c4e-48b7-ba58-7c10bf03a9e6 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:33.115652 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5da47fbc-5c4e-48b7-ba58-7c10bf03a9e6 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:33.116085 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5da47fbc-5c4e-48b7-ba58-7c10bf03a9e6 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:33.116570 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.objects.instance [None req-5da47fbc-5c4e-48b7-ba58-7c10bf03a9e6 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lazy-loading 'fault' on Instance uuid 60a2d899-438a-438a-becd-c04e645f10d9 {{(pid=117649) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 15:47:33.162914 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-5da47fbc-5c4e-48b7-ba58-7c10bf03a9e6 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:33.170764 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-5da47fbc-5c4e-48b7-ba58-7c10bf03a9e6 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/60a2d899-438a-438a-becd-c04e645f10d9" status: 200 len: 1309 microversion: 2.1 time: 0.105746 Jun 17 15:47:33.171334 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1500/3419] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:47:33 2022] GET /compute/v2.1/servers/60a2d899-438a-438a-becd-c04e645f10d9 => generated 1309 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:47:33.714152 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-ff7e9391-1f94-431f-816b-5a8db09c322b tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:47:33.715198 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-ff7e9391-1f94-431f-816b-5a8db09c322b tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] [instance: e4173cb9-999f-41f4-ade9-b521fc218a2b] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:47:33.722638 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ff7e9391-1f94-431f-816b-5a8db09c322b tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:33.723216 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ff7e9391-1f94-431f-816b-5a8db09c322b tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:33.723997 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ff7e9391-1f94-431f-816b-5a8db09c322b tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:33.724544 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ff7e9391-1f94-431f-816b-5a8db09c322b tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:33.738900 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-7e00ea97-a368-458b-a3ac-e93949d65187 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:47:33.741028 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-7e00ea97-a368-458b-a3ac-e93949d65187 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: 031f230c-48e6-46bb-a549-3cb347946170] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:47:33.752923 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7e00ea97-a368-458b-a3ac-e93949d65187 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:33.754210 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7e00ea97-a368-458b-a3ac-e93949d65187 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:33.755692 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7e00ea97-a368-458b-a3ac-e93949d65187 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:33.756423 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7e00ea97-a368-458b-a3ac-e93949d65187 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:33.929597 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-7e00ea97-a368-458b-a3ac-e93949d65187 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:33.940675 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-7e00ea97-a368-458b-a3ac-e93949d65187 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:33.942937 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-7e00ea97-a368-458b-a3ac-e93949d65187 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:33.944276 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-7e00ea97-a368-458b-a3ac-e93949d65187 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170" status: 200 len: 1729 microversion: 2.20 time: 0.215173 Jun 17 15:47:33.944534 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-ff7e9391-1f94-431f-816b-5a8db09c322b tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab3130962a6456bbbcb1c96aba3506d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79efe2b5db31498c81c59b086e5c6f84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:33.956098 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1501/3420] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:47:33 2022] GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170 => generated 1729 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 15:47:33.961591 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-ff7e9391-1f94-431f-816b-5a8db09c322b tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] 10.222.0.48 "GET /compute/v2.1/servers/e4173cb9-999f-41f4-ade9-b521fc218a2b" status: 200 len: 1367 microversion: 2.1 time: 0.252532 Jun 17 15:47:33.962495 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1920/3421] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:47:33 2022] GET /compute/v2.1/servers/e4173cb9-999f-41f4-ade9-b521fc218a2b => generated 1367 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:47:34.189549 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-9c47a551-0dc1-4c98-97a1-45d5ae2bb85b tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:47:34.190395 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-9c47a551-0dc1-4c98-97a1-45d5ae2bb85b tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 60a2d899-438a-438a-becd-c04e645f10d9] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:47:34.198205 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9c47a551-0dc1-4c98-97a1-45d5ae2bb85b tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:34.198205 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9c47a551-0dc1-4c98-97a1-45d5ae2bb85b tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:34.198629 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9c47a551-0dc1-4c98-97a1-45d5ae2bb85b tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:34.199013 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9c47a551-0dc1-4c98-97a1-45d5ae2bb85b tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:34.233963 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9c47a551-0dc1-4c98-97a1-45d5ae2bb85b tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:34.234391 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9c47a551-0dc1-4c98-97a1-45d5ae2bb85b tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:34.234851 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.objects.instance [None req-9c47a551-0dc1-4c98-97a1-45d5ae2bb85b tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lazy-loading 'fault' on Instance uuid 60a2d899-438a-438a-becd-c04e645f10d9 {{(pid=117649) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 15:47:34.276785 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-9c47a551-0dc1-4c98-97a1-45d5ae2bb85b tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:34.284387 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-9c47a551-0dc1-4c98-97a1-45d5ae2bb85b tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/60a2d899-438a-438a-becd-c04e645f10d9" status: 200 len: 1309 microversion: 2.1 time: 0.100202 Jun 17 15:47:34.284965 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1502/3422] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:47:34 2022] GET /compute/v2.1/servers/60a2d899-438a-438a-becd-c04e645f10d9 => generated 1309 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:47:34.963121 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-28389406-8a86-4b79-af36-81fcbbb928de tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:47:34.963847 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-28389406-8a86-4b79-af36-81fcbbb928de tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: 031f230c-48e6-46bb-a549-3cb347946170] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:47:34.970722 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-28389406-8a86-4b79-af36-81fcbbb928de tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:34.971180 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-28389406-8a86-4b79-af36-81fcbbb928de tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:34.971997 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-28389406-8a86-4b79-af36-81fcbbb928de tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:34.973128 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-28389406-8a86-4b79-af36-81fcbbb928de tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:34.979175 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-70125826-f51b-4e75-903e-6ca447b6576c tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:47:34.979884 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-70125826-f51b-4e75-903e-6ca447b6576c tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] [instance: e4173cb9-999f-41f4-ade9-b521fc218a2b] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:47:34.986806 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-70125826-f51b-4e75-903e-6ca447b6576c tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:34.987248 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-70125826-f51b-4e75-903e-6ca447b6576c tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:34.988009 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-70125826-f51b-4e75-903e-6ca447b6576c tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:34.988464 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-70125826-f51b-4e75-903e-6ca447b6576c tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:35.150340 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-70125826-f51b-4e75-903e-6ca447b6576c tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab3130962a6456bbbcb1c96aba3506d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79efe2b5db31498c81c59b086e5c6f84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:35.160404 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-70125826-f51b-4e75-903e-6ca447b6576c tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] 10.222.0.48 "GET /compute/v2.1/servers/e4173cb9-999f-41f4-ade9-b521fc218a2b" status: 200 len: 1367 microversion: 2.1 time: 0.185189 Jun 17 15:47:35.161424 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1503/3423] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:47:34 2022] GET /compute/v2.1/servers/e4173cb9-999f-41f4-ade9-b521fc218a2b => generated 1367 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:47:35.302776 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-47cc8736-e1df-4651-931a-a6c664749263 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:47:35.303252 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-47cc8736-e1df-4651-931a-a6c664749263 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 60a2d899-438a-438a-becd-c04e645f10d9] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:47:35.317342 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-47cc8736-e1df-4651-931a-a6c664749263 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:35.317833 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-47cc8736-e1df-4651-931a-a6c664749263 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:35.321502 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-47cc8736-e1df-4651-931a-a6c664749263 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:35.322136 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-47cc8736-e1df-4651-931a-a6c664749263 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:35.381626 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-47cc8736-e1df-4651-931a-a6c664749263 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:35.382082 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-47cc8736-e1df-4651-931a-a6c664749263 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:35.382544 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.objects.instance [None req-47cc8736-e1df-4651-931a-a6c664749263 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lazy-loading 'fault' on Instance uuid 60a2d899-438a-438a-becd-c04e645f10d9 {{(pid=117649) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 15:47:35.424944 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-47cc8736-e1df-4651-931a-a6c664749263 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:35.425144 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-28389406-8a86-4b79-af36-81fcbbb928de tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:35.433227 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-47cc8736-e1df-4651-931a-a6c664749263 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/60a2d899-438a-438a-becd-c04e645f10d9" status: 200 len: 1309 microversion: 2.1 time: 0.134820 Jun 17 15:47:35.434087 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1504/3424] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:47:35 2022] GET /compute/v2.1/servers/60a2d899-438a-438a-becd-c04e645f10d9 => generated 1309 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:47:35.435974 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-28389406-8a86-4b79-af36-81fcbbb928de tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:35.437648 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-28389406-8a86-4b79-af36-81fcbbb928de tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:35.438900 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-28389406-8a86-4b79-af36-81fcbbb928de tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170" status: 200 len: 1729 microversion: 2.20 time: 0.479765 Jun 17 15:47:35.439465 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1921/3425] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:47:34 2022] GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170 => generated 1729 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:47:36.179214 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-4b9a5b0f-c8a8-411a-8073-b839ae57dd5b tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:47:36.179827 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-4b9a5b0f-c8a8-411a-8073-b839ae57dd5b tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] [instance: e4173cb9-999f-41f4-ade9-b521fc218a2b] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:47:36.186961 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4b9a5b0f-c8a8-411a-8073-b839ae57dd5b tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:36.187404 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4b9a5b0f-c8a8-411a-8073-b839ae57dd5b tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:36.188171 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4b9a5b0f-c8a8-411a-8073-b839ae57dd5b tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:36.188627 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4b9a5b0f-c8a8-411a-8073-b839ae57dd5b tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:36.388628 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-4b9a5b0f-c8a8-411a-8073-b839ae57dd5b tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab3130962a6456bbbcb1c96aba3506d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79efe2b5db31498c81c59b086e5c6f84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:36.402722 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-4b9a5b0f-c8a8-411a-8073-b839ae57dd5b tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] 10.222.0.48 "GET /compute/v2.1/servers/e4173cb9-999f-41f4-ade9-b521fc218a2b" status: 200 len: 1367 microversion: 2.1 time: 0.227271 Jun 17 15:47:36.403536 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1505/3426] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:47:36 2022] GET /compute/v2.1/servers/e4173cb9-999f-41f4-ade9-b521fc218a2b => generated 1367 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:47:36.450951 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-956e25fa-48b5-4d63-95a3-e7bca32d1ae2 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:47:36.451844 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-956e25fa-48b5-4d63-95a3-e7bca32d1ae2 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 60a2d899-438a-438a-becd-c04e645f10d9] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:47:36.458667 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-956e25fa-48b5-4d63-95a3-e7bca32d1ae2 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:36.459114 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-956e25fa-48b5-4d63-95a3-e7bca32d1ae2 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:36.459736 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-d0b07c62-c2c2-4fb4-9f68-bf825c69b48f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:47:36.459917 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-956e25fa-48b5-4d63-95a3-e7bca32d1ae2 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:36.460318 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-956e25fa-48b5-4d63-95a3-e7bca32d1ae2 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:36.460931 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-d0b07c62-c2c2-4fb4-9f68-bf825c69b48f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: 031f230c-48e6-46bb-a549-3cb347946170] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:47:36.470026 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d0b07c62-c2c2-4fb4-9f68-bf825c69b48f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:36.470667 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d0b07c62-c2c2-4fb4-9f68-bf825c69b48f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:36.471769 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d0b07c62-c2c2-4fb4-9f68-bf825c69b48f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:36.472478 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d0b07c62-c2c2-4fb4-9f68-bf825c69b48f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:36.498272 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-956e25fa-48b5-4d63-95a3-e7bca32d1ae2 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:36.498729 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-956e25fa-48b5-4d63-95a3-e7bca32d1ae2 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:36.499186 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.objects.instance [None req-956e25fa-48b5-4d63-95a3-e7bca32d1ae2 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lazy-loading 'fault' on Instance uuid 60a2d899-438a-438a-becd-c04e645f10d9 {{(pid=117650) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 15:47:36.562980 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-956e25fa-48b5-4d63-95a3-e7bca32d1ae2 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:36.571882 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-956e25fa-48b5-4d63-95a3-e7bca32d1ae2 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/60a2d899-438a-438a-becd-c04e645f10d9" status: 200 len: 1309 microversion: 2.1 time: 0.125407 Jun 17 15:47:36.573070 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1922/3427] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:47:36 2022] GET /compute/v2.1/servers/60a2d899-438a-438a-becd-c04e645f10d9 => generated 1309 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:47:36.902968 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-d0b07c62-c2c2-4fb4-9f68-bf825c69b48f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:36.911568 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-d0b07c62-c2c2-4fb4-9f68-bf825c69b48f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:36.913136 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-d0b07c62-c2c2-4fb4-9f68-bf825c69b48f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:36.914334 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-d0b07c62-c2c2-4fb4-9f68-bf825c69b48f tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170" status: 200 len: 1729 microversion: 2.20 time: 0.460763 Jun 17 15:47:36.914891 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1506/3428] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:47:36 2022] GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170 => generated 1729 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 15:47:37.421075 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-6135b21a-6d17-4018-a3f0-9edcd2b1fccb tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:47:37.421685 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-6135b21a-6d17-4018-a3f0-9edcd2b1fccb tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] [instance: e4173cb9-999f-41f4-ade9-b521fc218a2b] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:47:37.427923 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6135b21a-6d17-4018-a3f0-9edcd2b1fccb tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:37.428406 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6135b21a-6d17-4018-a3f0-9edcd2b1fccb tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:37.429425 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6135b21a-6d17-4018-a3f0-9edcd2b1fccb tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:37.430032 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6135b21a-6d17-4018-a3f0-9edcd2b1fccb tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:37.585140 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-6135b21a-6d17-4018-a3f0-9edcd2b1fccb tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab3130962a6456bbbcb1c96aba3506d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79efe2b5db31498c81c59b086e5c6f84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:37.594493 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-6135b21a-6d17-4018-a3f0-9edcd2b1fccb tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] 10.222.0.48 "GET /compute/v2.1/servers/e4173cb9-999f-41f4-ade9-b521fc218a2b" status: 200 len: 1367 microversion: 2.1 time: 0.177871 Jun 17 15:47:37.604402 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1923/3429] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:47:37 2022] GET /compute/v2.1/servers/e4173cb9-999f-41f4-ade9-b521fc218a2b => generated 1367 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:47:37.604675 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-2bc0f24b-09ab-4ad7-be33-310c1c064048 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:47:37.604675 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-2bc0f24b-09ab-4ad7-be33-310c1c064048 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 60a2d899-438a-438a-becd-c04e645f10d9] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:47:37.605358 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2bc0f24b-09ab-4ad7-be33-310c1c064048 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:37.605835 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2bc0f24b-09ab-4ad7-be33-310c1c064048 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:37.606903 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2bc0f24b-09ab-4ad7-be33-310c1c064048 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:37.607678 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2bc0f24b-09ab-4ad7-be33-310c1c064048 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:37.650367 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2bc0f24b-09ab-4ad7-be33-310c1c064048 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:37.650858 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2bc0f24b-09ab-4ad7-be33-310c1c064048 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:37.651427 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.objects.instance [None req-2bc0f24b-09ab-4ad7-be33-310c1c064048 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lazy-loading 'fault' on Instance uuid 60a2d899-438a-438a-becd-c04e645f10d9 {{(pid=117649) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 15:47:37.696496 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-2bc0f24b-09ab-4ad7-be33-310c1c064048 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:37.706198 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-2bc0f24b-09ab-4ad7-be33-310c1c064048 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/60a2d899-438a-438a-becd-c04e645f10d9" status: 200 len: 1309 microversion: 2.1 time: 0.114312 Jun 17 15:47:37.706784 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1507/3430] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:47:37 2022] GET /compute/v2.1/servers/60a2d899-438a-438a-becd-c04e645f10d9 => generated 1309 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:47:37.934041 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-902908af-653f-457f-a31a-0a1c190faddc tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:47:37.934548 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-902908af-653f-457f-a31a-0a1c190faddc tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: 031f230c-48e6-46bb-a549-3cb347946170] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:47:37.941377 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-902908af-653f-457f-a31a-0a1c190faddc tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:37.941831 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-902908af-653f-457f-a31a-0a1c190faddc tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:37.942611 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-902908af-653f-457f-a31a-0a1c190faddc tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:37.943039 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-902908af-653f-457f-a31a-0a1c190faddc tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:38.101891 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-902908af-653f-457f-a31a-0a1c190faddc tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:38.120387 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-902908af-653f-457f-a31a-0a1c190faddc tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:38.123547 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-902908af-653f-457f-a31a-0a1c190faddc tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:38.126006 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-902908af-653f-457f-a31a-0a1c190faddc tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170" status: 200 len: 1729 microversion: 2.20 time: 0.195823 Jun 17 15:47:38.127322 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1924/3431] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:47:37 2022] GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170 => generated 1729 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:47:38.615905 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-8405e93e-c3a5-4a70-b493-fdb912983717 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:47:38.616804 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-8405e93e-c3a5-4a70-b493-fdb912983717 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] [instance: e4173cb9-999f-41f4-ade9-b521fc218a2b] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:47:38.624046 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8405e93e-c3a5-4a70-b493-fdb912983717 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:38.624552 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8405e93e-c3a5-4a70-b493-fdb912983717 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:38.625354 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8405e93e-c3a5-4a70-b493-fdb912983717 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:38.625798 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8405e93e-c3a5-4a70-b493-fdb912983717 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:38.733159 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-30457282-1781-403b-ba2e-2e762ba6df72 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:47:38.738653 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-30457282-1781-403b-ba2e-2e762ba6df72 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 60a2d899-438a-438a-becd-c04e645f10d9] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:47:38.764728 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-30457282-1781-403b-ba2e-2e762ba6df72 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:38.767295 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-30457282-1781-403b-ba2e-2e762ba6df72 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:38.768572 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-30457282-1781-403b-ba2e-2e762ba6df72 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:38.769743 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-30457282-1781-403b-ba2e-2e762ba6df72 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:38.841102 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-8405e93e-c3a5-4a70-b493-fdb912983717 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab3130962a6456bbbcb1c96aba3506d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79efe2b5db31498c81c59b086e5c6f84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:38.843974 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-30457282-1781-403b-ba2e-2e762ba6df72 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:38.844829 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-30457282-1781-403b-ba2e-2e762ba6df72 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:38.845677 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.objects.instance [None req-30457282-1781-403b-ba2e-2e762ba6df72 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lazy-loading 'fault' on Instance uuid 60a2d899-438a-438a-becd-c04e645f10d9 {{(pid=117650) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 15:47:38.854849 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-8405e93e-c3a5-4a70-b493-fdb912983717 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] 10.222.0.48 "GET /compute/v2.1/servers/e4173cb9-999f-41f4-ade9-b521fc218a2b" status: 200 len: 1367 microversion: 2.1 time: 0.242886 Jun 17 15:47:38.868949 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1508/3432] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:47:38 2022] GET /compute/v2.1/servers/e4173cb9-999f-41f4-ade9-b521fc218a2b => generated 1367 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:47:38.923668 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-30457282-1781-403b-ba2e-2e762ba6df72 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:38.930873 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:47:38.950794 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-30457282-1781-403b-ba2e-2e762ba6df72 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/60a2d899-438a-438a-becd-c04e645f10d9" status: 200 len: 1309 microversion: 2.1 time: 0.228450 Jun 17 15:47:38.951955 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1925/3433] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:47:38 2022] GET /compute/v2.1/servers/60a2d899-438a-438a-becd-c04e645f10d9 => generated 1309 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:47:39.158682 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-2332e328-6e7b-446a-97dc-2e0d2824ce1c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:47:39.159730 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-2332e328-6e7b-446a-97dc-2e0d2824ce1c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: 031f230c-48e6-46bb-a549-3cb347946170] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:47:39.186565 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2332e328-6e7b-446a-97dc-2e0d2824ce1c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:39.187332 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2332e328-6e7b-446a-97dc-2e0d2824ce1c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:39.196897 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2332e328-6e7b-446a-97dc-2e0d2824ce1c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:39.197833 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2332e328-6e7b-446a-97dc-2e0d2824ce1c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:39.398015 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-2332e328-6e7b-446a-97dc-2e0d2824ce1c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:39.410169 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-2332e328-6e7b-446a-97dc-2e0d2824ce1c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:39.411934 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-2332e328-6e7b-446a-97dc-2e0d2824ce1c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:39.413144 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-2332e328-6e7b-446a-97dc-2e0d2824ce1c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170" status: 200 len: 1729 microversion: 2.20 time: 0.262287 Jun 17 15:47:39.413898 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1509/3434] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:47:39 2022] GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170 => generated 1729 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 15:47:39.878127 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-2715ac0c-ce61-4552-9248-2a8f946b279b tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:47:39.878864 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-2715ac0c-ce61-4552-9248-2a8f946b279b tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] [instance: e4173cb9-999f-41f4-ade9-b521fc218a2b] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:47:39.890063 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2715ac0c-ce61-4552-9248-2a8f946b279b tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:39.890509 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2715ac0c-ce61-4552-9248-2a8f946b279b tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:39.891288 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2715ac0c-ce61-4552-9248-2a8f946b279b tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:39.891717 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2715ac0c-ce61-4552-9248-2a8f946b279b tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:39.978123 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-a98f70d7-19ec-4492-ba23-b3f8c92e0006 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:47:39.979462 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-a98f70d7-19ec-4492-ba23-b3f8c92e0006 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 60a2d899-438a-438a-becd-c04e645f10d9] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:47:39.986826 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a98f70d7-19ec-4492-ba23-b3f8c92e0006 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:39.987275 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a98f70d7-19ec-4492-ba23-b3f8c92e0006 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:39.988048 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a98f70d7-19ec-4492-ba23-b3f8c92e0006 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:39.988513 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a98f70d7-19ec-4492-ba23-b3f8c92e0006 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:40.063347 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a98f70d7-19ec-4492-ba23-b3f8c92e0006 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:40.064190 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a98f70d7-19ec-4492-ba23-b3f8c92e0006 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:40.065031 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.objects.instance [None req-a98f70d7-19ec-4492-ba23-b3f8c92e0006 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lazy-loading 'fault' on Instance uuid 60a2d899-438a-438a-becd-c04e645f10d9 {{(pid=117649) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 15:47:40.069546 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-2715ac0c-ce61-4552-9248-2a8f946b279b tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab3130962a6456bbbcb1c96aba3506d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79efe2b5db31498c81c59b086e5c6f84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:40.078603 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-2715ac0c-ce61-4552-9248-2a8f946b279b tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] 10.222.0.48 "GET /compute/v2.1/servers/e4173cb9-999f-41f4-ade9-b521fc218a2b" status: 200 len: 1367 microversion: 2.1 time: 0.205545 Jun 17 15:47:40.079609 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1926/3435] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:47:39 2022] GET /compute/v2.1/servers/e4173cb9-999f-41f4-ade9-b521fc218a2b => generated 1367 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:47:40.143332 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-a98f70d7-19ec-4492-ba23-b3f8c92e0006 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:40.153889 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-a98f70d7-19ec-4492-ba23-b3f8c92e0006 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/60a2d899-438a-438a-becd-c04e645f10d9" status: 200 len: 1309 microversion: 2.1 time: 0.180017 Jun 17 15:47:40.154768 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1510/3436] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:47:39 2022] GET /compute/v2.1/servers/60a2d899-438a-438a-becd-c04e645f10d9 => generated 1309 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:47:40.434319 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-8a1a2d4d-cc18-40a6-9057-d08aa445391c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:47:40.435050 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-8a1a2d4d-cc18-40a6-9057-d08aa445391c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: 031f230c-48e6-46bb-a549-3cb347946170] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:47:40.443892 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8a1a2d4d-cc18-40a6-9057-d08aa445391c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:40.444564 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8a1a2d4d-cc18-40a6-9057-d08aa445391c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:40.445794 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8a1a2d4d-cc18-40a6-9057-d08aa445391c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:40.446154 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8a1a2d4d-cc18-40a6-9057-d08aa445391c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:40.616972 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-8a1a2d4d-cc18-40a6-9057-d08aa445391c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:40.627570 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-8a1a2d4d-cc18-40a6-9057-d08aa445391c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:40.629184 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-8a1a2d4d-cc18-40a6-9057-d08aa445391c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:40.630505 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-8a1a2d4d-cc18-40a6-9057-d08aa445391c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170" status: 200 len: 1729 microversion: 2.20 time: 0.201402 Jun 17 15:47:40.631072 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1927/3437] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:47:40 2022] GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170 => generated 1729 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:47:41.105956 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-9da4ac12-35ad-4f5b-bb8f-d25a4366ed05 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:47:41.106911 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-9da4ac12-35ad-4f5b-bb8f-d25a4366ed05 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] [instance: e4173cb9-999f-41f4-ade9-b521fc218a2b] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:47:41.113787 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9da4ac12-35ad-4f5b-bb8f-d25a4366ed05 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:41.114232 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9da4ac12-35ad-4f5b-bb8f-d25a4366ed05 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:41.114995 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9da4ac12-35ad-4f5b-bb8f-d25a4366ed05 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:41.115434 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9da4ac12-35ad-4f5b-bb8f-d25a4366ed05 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:41.173957 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-60a5f8ef-8b70-4066-aea7-a165e311f675 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:47:41.174742 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-60a5f8ef-8b70-4066-aea7-a165e311f675 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 60a2d899-438a-438a-becd-c04e645f10d9] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:47:41.189969 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-60a5f8ef-8b70-4066-aea7-a165e311f675 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:41.190921 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-60a5f8ef-8b70-4066-aea7-a165e311f675 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:41.198411 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-60a5f8ef-8b70-4066-aea7-a165e311f675 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:41.199215 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-60a5f8ef-8b70-4066-aea7-a165e311f675 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:41.266002 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-60a5f8ef-8b70-4066-aea7-a165e311f675 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:41.266572 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-60a5f8ef-8b70-4066-aea7-a165e311f675 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:41.267367 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.objects.instance [None req-60a5f8ef-8b70-4066-aea7-a165e311f675 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lazy-loading 'fault' on Instance uuid 60a2d899-438a-438a-becd-c04e645f10d9 {{(pid=117650) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 15:47:41.296603 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-9da4ac12-35ad-4f5b-bb8f-d25a4366ed05 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab3130962a6456bbbcb1c96aba3506d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79efe2b5db31498c81c59b086e5c6f84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:41.320448 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-9da4ac12-35ad-4f5b-bb8f-d25a4366ed05 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] 10.222.0.48 "GET /compute/v2.1/servers/e4173cb9-999f-41f4-ade9-b521fc218a2b" status: 200 len: 1367 microversion: 2.1 time: 0.219116 Jun 17 15:47:41.321837 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1511/3438] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:47:41 2022] GET /compute/v2.1/servers/e4173cb9-999f-41f4-ade9-b521fc218a2b => generated 1367 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:47:41.354052 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-60a5f8ef-8b70-4066-aea7-a165e311f675 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:41.371914 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-60a5f8ef-8b70-4066-aea7-a165e311f675 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/60a2d899-438a-438a-becd-c04e645f10d9" status: 200 len: 1309 microversion: 2.1 time: 0.201500 Jun 17 15:47:41.373554 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1928/3439] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:47:41 2022] GET /compute/v2.1/servers/60a2d899-438a-438a-becd-c04e645f10d9 => generated 1309 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:47:41.655845 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-41ceb525-5741-45e9-8208-6edad4c0ba8e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:47:41.656543 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-41ceb525-5741-45e9-8208-6edad4c0ba8e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: 031f230c-48e6-46bb-a549-3cb347946170] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:47:41.665613 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-41ceb525-5741-45e9-8208-6edad4c0ba8e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:41.666899 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-41ceb525-5741-45e9-8208-6edad4c0ba8e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:41.668204 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-41ceb525-5741-45e9-8208-6edad4c0ba8e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:41.668980 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-41ceb525-5741-45e9-8208-6edad4c0ba8e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:41.830870 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-41ceb525-5741-45e9-8208-6edad4c0ba8e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:41.842595 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-41ceb525-5741-45e9-8208-6edad4c0ba8e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:41.844115 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-41ceb525-5741-45e9-8208-6edad4c0ba8e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:41.845380 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-41ceb525-5741-45e9-8208-6edad4c0ba8e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170" status: 200 len: 1729 microversion: 2.20 time: 0.197631 Jun 17 15:47:41.845952 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1512/3440] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:47:41 2022] GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170 => generated 1729 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:47:42.361460 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-90cb9835-13eb-4b09-85b5-a90f14c4e944 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:47:42.362632 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-90cb9835-13eb-4b09-85b5-a90f14c4e944 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] [instance: e4173cb9-999f-41f4-ade9-b521fc218a2b] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:47:42.376256 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-90cb9835-13eb-4b09-85b5-a90f14c4e944 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:42.377106 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-90cb9835-13eb-4b09-85b5-a90f14c4e944 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:42.378477 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-90cb9835-13eb-4b09-85b5-a90f14c4e944 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:42.379122 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-90cb9835-13eb-4b09-85b5-a90f14c4e944 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:42.403017 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-3c218cbb-8c73-44b5-9298-e7e2b20d1de7 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:47:42.404072 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-3c218cbb-8c73-44b5-9298-e7e2b20d1de7 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 60a2d899-438a-438a-becd-c04e645f10d9] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:47:42.418076 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3c218cbb-8c73-44b5-9298-e7e2b20d1de7 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:42.420578 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3c218cbb-8c73-44b5-9298-e7e2b20d1de7 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:42.422010 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3c218cbb-8c73-44b5-9298-e7e2b20d1de7 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:42.422851 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3c218cbb-8c73-44b5-9298-e7e2b20d1de7 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:42.493291 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3c218cbb-8c73-44b5-9298-e7e2b20d1de7 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:42.494228 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3c218cbb-8c73-44b5-9298-e7e2b20d1de7 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:42.495107 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.objects.instance [None req-3c218cbb-8c73-44b5-9298-e7e2b20d1de7 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lazy-loading 'fault' on Instance uuid 60a2d899-438a-438a-becd-c04e645f10d9 {{(pid=117649) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 15:47:42.560502 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-3c218cbb-8c73-44b5-9298-e7e2b20d1de7 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:42.567033 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell1:SELECT=100 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:47:42.583948 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-3c218cbb-8c73-44b5-9298-e7e2b20d1de7 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/60a2d899-438a-438a-becd-c04e645f10d9" status: 200 len: 1309 microversion: 2.1 time: 0.191232 Jun 17 15:47:42.593049 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1513/3441] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:47:42 2022] GET /compute/v2.1/servers/60a2d899-438a-438a-becd-c04e645f10d9 => generated 1309 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:47:42.642850 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-90cb9835-13eb-4b09-85b5-a90f14c4e944 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab3130962a6456bbbcb1c96aba3506d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79efe2b5db31498c81c59b086e5c6f84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:42.658832 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-90cb9835-13eb-4b09-85b5-a90f14c4e944 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] 10.222.0.48 "GET /compute/v2.1/servers/e4173cb9-999f-41f4-ade9-b521fc218a2b" status: 200 len: 1367 microversion: 2.1 time: 0.313598 Jun 17 15:47:42.660116 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1929/3442] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:47:42 2022] GET /compute/v2.1/servers/e4173cb9-999f-41f4-ade9-b521fc218a2b => generated 1367 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:47:42.879732 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-651fe161-a0eb-403f-94d5-bb727ffb6888 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:47:42.881530 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-651fe161-a0eb-403f-94d5-bb727ffb6888 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: 031f230c-48e6-46bb-a549-3cb347946170] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:47:42.895637 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-651fe161-a0eb-403f-94d5-bb727ffb6888 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:42.896743 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-651fe161-a0eb-403f-94d5-bb727ffb6888 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:42.898306 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-651fe161-a0eb-403f-94d5-bb727ffb6888 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:42.899459 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-651fe161-a0eb-403f-94d5-bb727ffb6888 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:43.093005 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-651fe161-a0eb-403f-94d5-bb727ffb6888 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:43.104814 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-651fe161-a0eb-403f-94d5-bb727ffb6888 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:43.107278 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-651fe161-a0eb-403f-94d5-bb727ffb6888 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:43.109504 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-651fe161-a0eb-403f-94d5-bb727ffb6888 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170" status: 200 len: 1729 microversion: 2.20 time: 0.241689 Jun 17 15:47:43.110364 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1514/3443] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:47:42 2022] GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170 => generated 1729 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:47:43.611379 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-b0748c14-2118-4f90-8e22-72377d7683ca tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:47:43.612339 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-b0748c14-2118-4f90-8e22-72377d7683ca tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 60a2d899-438a-438a-becd-c04e645f10d9] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:47:43.619988 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b0748c14-2118-4f90-8e22-72377d7683ca tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:43.620461 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b0748c14-2118-4f90-8e22-72377d7683ca tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:43.621230 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b0748c14-2118-4f90-8e22-72377d7683ca tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:43.621658 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b0748c14-2118-4f90-8e22-72377d7683ca tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:43.652540 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b0748c14-2118-4f90-8e22-72377d7683ca tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:43.652982 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b0748c14-2118-4f90-8e22-72377d7683ca tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:43.653429 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.objects.instance [None req-b0748c14-2118-4f90-8e22-72377d7683ca tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lazy-loading 'fault' on Instance uuid 60a2d899-438a-438a-becd-c04e645f10d9 {{(pid=117650) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 15:47:43.676427 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-bebdf5b3-1e10-4b3e-9fa9-e6be8b1b34c7 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:47:43.677052 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-bebdf5b3-1e10-4b3e-9fa9-e6be8b1b34c7 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] [instance: e4173cb9-999f-41f4-ade9-b521fc218a2b] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:47:43.684519 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bebdf5b3-1e10-4b3e-9fa9-e6be8b1b34c7 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:43.684961 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bebdf5b3-1e10-4b3e-9fa9-e6be8b1b34c7 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:43.685792 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bebdf5b3-1e10-4b3e-9fa9-e6be8b1b34c7 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:43.686172 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bebdf5b3-1e10-4b3e-9fa9-e6be8b1b34c7 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:43.694756 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-b0748c14-2118-4f90-8e22-72377d7683ca tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:43.702280 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-b0748c14-2118-4f90-8e22-72377d7683ca tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/60a2d899-438a-438a-becd-c04e645f10d9" status: 200 len: 1309 microversion: 2.1 time: 0.095460 Jun 17 15:47:43.703083 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1930/3444] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:47:43 2022] GET /compute/v2.1/servers/60a2d899-438a-438a-becd-c04e645f10d9 => generated 1309 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:47:43.821141 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-bebdf5b3-1e10-4b3e-9fa9-e6be8b1b34c7 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab3130962a6456bbbcb1c96aba3506d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79efe2b5db31498c81c59b086e5c6f84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:43.828634 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-bebdf5b3-1e10-4b3e-9fa9-e6be8b1b34c7 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] 10.222.0.48 "GET /compute/v2.1/servers/e4173cb9-999f-41f4-ade9-b521fc218a2b" status: 200 len: 1367 microversion: 2.1 time: 0.156441 Jun 17 15:47:43.829195 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1515/3445] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:47:43 2022] GET /compute/v2.1/servers/e4173cb9-999f-41f4-ade9-b521fc218a2b => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:47:44.129944 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-8e70ca1d-9fbf-402b-b606-7d56f71ae87c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:47:44.130596 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-8e70ca1d-9fbf-402b-b606-7d56f71ae87c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: 031f230c-48e6-46bb-a549-3cb347946170] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:47:44.136693 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8e70ca1d-9fbf-402b-b606-7d56f71ae87c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:44.137165 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8e70ca1d-9fbf-402b-b606-7d56f71ae87c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:44.137915 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8e70ca1d-9fbf-402b-b606-7d56f71ae87c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:44.138341 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8e70ca1d-9fbf-402b-b606-7d56f71ae87c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:44.268652 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-8e70ca1d-9fbf-402b-b606-7d56f71ae87c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:44.277390 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-8e70ca1d-9fbf-402b-b606-7d56f71ae87c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:44.278895 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-8e70ca1d-9fbf-402b-b606-7d56f71ae87c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:44.280066 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-8e70ca1d-9fbf-402b-b606-7d56f71ae87c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170" status: 200 len: 1729 microversion: 2.20 time: 0.154062 Jun 17 15:47:44.280655 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1931/3446] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:47:44 2022] GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170 => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:47:44.719880 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-7f8801a0-74f3-4467-9952-93aa4f290564 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:47:44.720474 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-7f8801a0-74f3-4467-9952-93aa4f290564 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 60a2d899-438a-438a-becd-c04e645f10d9] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:47:44.726924 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7f8801a0-74f3-4467-9952-93aa4f290564 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:44.727618 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7f8801a0-74f3-4467-9952-93aa4f290564 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:44.728401 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7f8801a0-74f3-4467-9952-93aa4f290564 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:44.729561 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7f8801a0-74f3-4467-9952-93aa4f290564 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:44.760306 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7f8801a0-74f3-4467-9952-93aa4f290564 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:44.760779 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7f8801a0-74f3-4467-9952-93aa4f290564 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:44.761230 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.objects.instance [None req-7f8801a0-74f3-4467-9952-93aa4f290564 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lazy-loading 'fault' on Instance uuid 60a2d899-438a-438a-becd-c04e645f10d9 {{(pid=117649) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 15:47:44.803404 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-7f8801a0-74f3-4467-9952-93aa4f290564 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:44.811345 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-7f8801a0-74f3-4467-9952-93aa4f290564 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/60a2d899-438a-438a-becd-c04e645f10d9" status: 200 len: 1309 microversion: 2.1 time: 0.095311 Jun 17 15:47:44.811933 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1516/3447] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:47:44 2022] GET /compute/v2.1/servers/60a2d899-438a-438a-becd-c04e645f10d9 => generated 1309 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:47:44.845682 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-4bf976cb-b5e9-4c26-8596-1ec54e9fa1ef tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:47:44.846282 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-4bf976cb-b5e9-4c26-8596-1ec54e9fa1ef tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] [instance: e4173cb9-999f-41f4-ade9-b521fc218a2b] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:47:44.853602 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4bf976cb-b5e9-4c26-8596-1ec54e9fa1ef tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:44.854098 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4bf976cb-b5e9-4c26-8596-1ec54e9fa1ef tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:44.855121 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4bf976cb-b5e9-4c26-8596-1ec54e9fa1ef tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:44.855564 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4bf976cb-b5e9-4c26-8596-1ec54e9fa1ef tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:44.991444 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-4bf976cb-b5e9-4c26-8596-1ec54e9fa1ef tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab3130962a6456bbbcb1c96aba3506d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79efe2b5db31498c81c59b086e5c6f84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:44.999358 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-4bf976cb-b5e9-4c26-8596-1ec54e9fa1ef tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] 10.222.0.48 "GET /compute/v2.1/servers/e4173cb9-999f-41f4-ade9-b521fc218a2b" status: 200 len: 1367 microversion: 2.1 time: 0.157751 Jun 17 15:47:44.999955 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1932/3448] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:47:44 2022] GET /compute/v2.1/servers/e4173cb9-999f-41f4-ade9-b521fc218a2b => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:47:45.298511 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-eab99e56-0741-4b18-84ae-0a8d5e85f3ca tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:47:45.299039 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-eab99e56-0741-4b18-84ae-0a8d5e85f3ca tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: 031f230c-48e6-46bb-a549-3cb347946170] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:47:45.305006 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-eab99e56-0741-4b18-84ae-0a8d5e85f3ca tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:45.305452 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-eab99e56-0741-4b18-84ae-0a8d5e85f3ca tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:45.306204 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-eab99e56-0741-4b18-84ae-0a8d5e85f3ca tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:45.306632 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-eab99e56-0741-4b18-84ae-0a8d5e85f3ca tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:45.465466 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-eab99e56-0741-4b18-84ae-0a8d5e85f3ca tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:45.474825 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-eab99e56-0741-4b18-84ae-0a8d5e85f3ca tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:45.476738 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-eab99e56-0741-4b18-84ae-0a8d5e85f3ca tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:45.479015 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-eab99e56-0741-4b18-84ae-0a8d5e85f3ca tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170" status: 200 len: 1729 microversion: 2.20 time: 0.184049 Jun 17 15:47:45.479682 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1517/3449] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:47:45 2022] GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170 => generated 1729 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:47:45.829463 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-c93c2509-2752-4a25-8d9d-9fb8b9378377 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:47:45.830076 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-c93c2509-2752-4a25-8d9d-9fb8b9378377 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 60a2d899-438a-438a-becd-c04e645f10d9] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:47:45.836106 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c93c2509-2752-4a25-8d9d-9fb8b9378377 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:45.836595 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c93c2509-2752-4a25-8d9d-9fb8b9378377 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:45.837385 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c93c2509-2752-4a25-8d9d-9fb8b9378377 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:45.837819 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c93c2509-2752-4a25-8d9d-9fb8b9378377 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:45.868287 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c93c2509-2752-4a25-8d9d-9fb8b9378377 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:45.868951 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c93c2509-2752-4a25-8d9d-9fb8b9378377 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:45.869204 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.objects.instance [None req-c93c2509-2752-4a25-8d9d-9fb8b9378377 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lazy-loading 'fault' on Instance uuid 60a2d899-438a-438a-becd-c04e645f10d9 {{(pid=117650) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 15:47:45.909144 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-c93c2509-2752-4a25-8d9d-9fb8b9378377 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ac8cbc7c6d4cce9d2b0a1289846a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b42320bc424a19b4ac5e35dae7afb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:45.916463 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-c93c2509-2752-4a25-8d9d-9fb8b9378377 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/60a2d899-438a-438a-becd-c04e645f10d9" status: 200 len: 1309 microversion: 2.1 time: 0.090863 Jun 17 15:47:45.917061 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1933/3450] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:47:45 2022] GET /compute/v2.1/servers/60a2d899-438a-438a-becd-c04e645f10d9 => generated 1309 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:47:46.015623 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-202e5159-f6ef-418e-af5b-ca0b68b6cc43 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:47:46.016225 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-202e5159-f6ef-418e-af5b-ca0b68b6cc43 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] [instance: e4173cb9-999f-41f4-ade9-b521fc218a2b] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:47:46.022616 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-202e5159-f6ef-418e-af5b-ca0b68b6cc43 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:46.023054 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-202e5159-f6ef-418e-af5b-ca0b68b6cc43 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:46.023799 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-202e5159-f6ef-418e-af5b-ca0b68b6cc43 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:46.024226 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-202e5159-f6ef-418e-af5b-ca0b68b6cc43 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:46.176663 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-202e5159-f6ef-418e-af5b-ca0b68b6cc43 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab3130962a6456bbbcb1c96aba3506d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79efe2b5db31498c81c59b086e5c6f84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:46.186494 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-202e5159-f6ef-418e-af5b-ca0b68b6cc43 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] 10.222.0.48 "GET /compute/v2.1/servers/e4173cb9-999f-41f4-ade9-b521fc218a2b" status: 200 len: 1367 microversion: 2.1 time: 0.175276 Jun 17 15:47:46.189731 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1518/3451] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:47:46 2022] GET /compute/v2.1/servers/e4173cb9-999f-41f4-ade9-b521fc218a2b => generated 1367 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:47:46.501402 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-9225a7c0-f4ea-43a9-a94d-ad2fcbc4dd6e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:47:46.502024 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-9225a7c0-f4ea-43a9-a94d-ad2fcbc4dd6e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: 031f230c-48e6-46bb-a549-3cb347946170] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:47:46.513995 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9225a7c0-f4ea-43a9-a94d-ad2fcbc4dd6e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:46.514450 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9225a7c0-f4ea-43a9-a94d-ad2fcbc4dd6e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:46.515275 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9225a7c0-f4ea-43a9-a94d-ad2fcbc4dd6e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:46.515707 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9225a7c0-f4ea-43a9-a94d-ad2fcbc4dd6e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:46.701018 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-9225a7c0-f4ea-43a9-a94d-ad2fcbc4dd6e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:46.708951 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-9225a7c0-f4ea-43a9-a94d-ad2fcbc4dd6e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:46.710451 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-9225a7c0-f4ea-43a9-a94d-ad2fcbc4dd6e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:46.711601 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-9225a7c0-f4ea-43a9-a94d-ad2fcbc4dd6e tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170" status: 200 len: 1729 microversion: 2.20 time: 0.214603 Jun 17 15:47:46.712178 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1934/3452] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:47:46 2022] GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170 => generated 1729 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:47:46.933718 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-d27a46b6-2120-48a1-8cbb-ddf3522e0699 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:47:46.934259 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-d27a46b6-2120-48a1-8cbb-ddf3522e0699 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] [instance: 60a2d899-438a-438a-becd-c04e645f10d9] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:47:46.940773 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d27a46b6-2120-48a1-8cbb-ddf3522e0699 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:46.941281 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d27a46b6-2120-48a1-8cbb-ddf3522e0699 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:46.942004 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d27a46b6-2120-48a1-8cbb-ddf3522e0699 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:46.942449 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d27a46b6-2120-48a1-8cbb-ddf3522e0699 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:46.956504 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.wsgi [None req-d27a46b6-2120-48a1-8cbb-ddf3522e0699 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] HTTP exception thrown: Instance 60a2d899-438a-438a-becd-c04e645f10d9 could not be found. Jun 17 15:47:46.958200 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-d27a46b6-2120-48a1-8cbb-ddf3522e0699 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Request method failure captured: Jun 17 15:47:46.958200 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: request: GET /compute/v2.1/servers/60a2d899-438a-438a-becd-c04e645f10d9 HTTP/1.1 Jun 17 15:47:46.958200 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Accept: application/json Jun 17 15:47:46.958200 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Accept-Encoding: identity Jun 17 15:47:46.958200 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Connection: close Jun 17 15:47:46.958200 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Content-Length: 0 Jun 17 15:47:46.958200 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Content-Type: application/json Jun 17 15:47:46.958200 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Host: 10.222.0.48 Jun 17 15:47:46.958200 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Openstack-System-Scope: None Jun 17 15:47:46.958200 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: User-Agent: python-urllib3/1.26.9 Jun 17 15:47:46.958200 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Auth-Token: gAAAAABirJpPRELvo50oKxdbD2bQ6GGouzj8i1DebBt1zfB7fX0V-PDU7hlPCfVEJbYQ9PsMuU2ZA4JvqklZ9Y9hD2QbIWtBnNkd8fMsMcOzOLJcX5MT958XBAGaNkW3F9LEBjk4LnqtyEbVGNYjmbh2tqH5UI9WDRv0xJagRknfyHTSn0wpzG0 Jun 17 15:47:46.958200 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Domain-Id: None Jun 17 15:47:46.958200 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Domain-Name: None Jun 17 15:47:46.958200 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Identity-Status: Confirmed Jun 17 15:47:46.958200 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Is-Admin-Project: True Jun 17 15:47:46.958200 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Domain-Id: default Jun 17 15:47:46.958200 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Domain-Name: Default Jun 17 15:47:46.958200 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Id: 42b42320bc424a19b4ac5e35dae7afb3 Jun 17 15:47:46.958200 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1590813198 Jun 17 15:47:46.958200 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Role: reader,member Jun 17 15:47:46.958200 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Roles: reader,member Jun 17 15:47:46.960027 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_42b42320bc424a19b4ac5e35dae7afb3", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/42b42320bc424a19b4ac5e35dae7afb3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/42b42320bc424a19b4ac5e35dae7afb3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/42b42320bc424a19b4ac5e35dae7afb3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Jun 17 15:47:46.960027 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant: tempest-VolumesSnapshotTestJSON-1590813198 Jun 17 15:47:46.960027 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant-Id: 42b42320bc424a19b4ac5e35dae7afb3 Jun 17 15:47:46.960027 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1590813198 Jun 17 15:47:46.960027 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User: tempest-VolumesSnapshotTestJSON-1590813198-project Jun 17 15:47:46.960027 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Domain-Id: default Jun 17 15:47:46.960027 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Domain-Name: Default Jun 17 15:47:46.960027 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Id: b6ac8cbc7c6d4cce9d2b0a1289846a3d Jun 17 15:47:46.960027 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Name: tempest-VolumesSnapshotTestJSON-1590813198-project Jun 17 15:47:46.960027 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: method: > Jun 17 15:47:46.960027 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: exception: Instance 60a2d899-438a-438a-becd-c04e645f10d9 could not be found. Jun 17 15:47:46.960027 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: action_args: {'id': '60a2d899-438a-438a-becd-c04e645f10d9'} Jun 17 15:47:46.961099 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 15:47:46.961099 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:47:46.961099 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 15:47:46.961099 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 15:47:46.961099 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 15:47:46.961099 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 15:47:46.961099 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 15:47:46.961099 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 15:47:46.961099 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 15:47:46.961099 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 15:47:46.961099 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60a2d899-438a-438a-becd-c04e645f10d9 could not be found. Jun 17 15:47:46.961099 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:47:46.961099 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:47:46.961099 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:47:46.961099 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:47:46.961099 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:47:46.961099 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:47:46.961099 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 15:47:46.961099 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 15:47:46.961099 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 15:47:46.962778 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 15:47:46.962778 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 15:47:46.962778 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 15:47:46.962778 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 15:47:46.962778 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 15:47:46.962778 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 15:47:46.962778 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 15:47:46.962778 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60a2d899-438a-438a-becd-c04e645f10d9 could not be found. Jun 17 15:47:46.962778 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:47:46.962778 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:47:46.962778 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:47:46.962778 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:47:46.962778 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:47:46.962778 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:47:46.962778 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 15:47:46.962778 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 15:47:46.962778 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60a2d899-438a-438a-becd-c04e645f10d9 could not be found. Jun 17 15:47:46.962778 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:47:46.965422 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-d27a46b6-2120-48a1-8cbb-ddf3522e0699 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] Returning 404 to user: Instance 60a2d899-438a-438a-becd-c04e645f10d9 could not be found. {{(pid=117649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 15:47:46.965422 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-d27a46b6-2120-48a1-8cbb-ddf3522e0699 tempest-VolumesSnapshotTestJSON-1590813198 tempest-VolumesSnapshotTestJSON-1590813198-project] 10.222.0.48 "GET /compute/v2.1/servers/60a2d899-438a-438a-becd-c04e645f10d9" status: 404 len: 111 microversion: 2.1 time: 0.030015 Jun 17 15:47:46.965422 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1519/3453] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:47:46 2022] GET /compute/v2.1/servers/60a2d899-438a-438a-becd-c04e645f10d9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 15:47:47.204280 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-097f477d-bc6a-4646-b3d8-d22965c75243 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:47:47.204924 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-097f477d-bc6a-4646-b3d8-d22965c75243 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] [instance: e4173cb9-999f-41f4-ade9-b521fc218a2b] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:47:47.212188 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-097f477d-bc6a-4646-b3d8-d22965c75243 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:47.213048 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-097f477d-bc6a-4646-b3d8-d22965c75243 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:47.214735 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-097f477d-bc6a-4646-b3d8-d22965c75243 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:47.215412 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-097f477d-bc6a-4646-b3d8-d22965c75243 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:47.351226 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-097f477d-bc6a-4646-b3d8-d22965c75243 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab3130962a6456bbbcb1c96aba3506d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79efe2b5db31498c81c59b086e5c6f84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:47.360359 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-097f477d-bc6a-4646-b3d8-d22965c75243 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] 10.222.0.48 "GET /compute/v2.1/servers/e4173cb9-999f-41f4-ade9-b521fc218a2b" status: 200 len: 1367 microversion: 2.1 time: 0.159972 Jun 17 15:47:47.360977 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1935/3454] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:47:47 2022] GET /compute/v2.1/servers/e4173cb9-999f-41f4-ade9-b521fc218a2b => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:47:47.730468 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-aba72c56-2da9-4c5d-87f2-2d0e4a41c023 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:47:47.731082 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-aba72c56-2da9-4c5d-87f2-2d0e4a41c023 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: 031f230c-48e6-46bb-a549-3cb347946170] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:47:47.738330 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-aba72c56-2da9-4c5d-87f2-2d0e4a41c023 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:47.738883 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-aba72c56-2da9-4c5d-87f2-2d0e4a41c023 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:47.739799 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-aba72c56-2da9-4c5d-87f2-2d0e4a41c023 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:47.740436 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-aba72c56-2da9-4c5d-87f2-2d0e4a41c023 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:47.890242 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-aba72c56-2da9-4c5d-87f2-2d0e4a41c023 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:47.898198 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-aba72c56-2da9-4c5d-87f2-2d0e4a41c023 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:47.899688 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-aba72c56-2da9-4c5d-87f2-2d0e4a41c023 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:47.900878 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-aba72c56-2da9-4c5d-87f2-2d0e4a41c023 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170" status: 200 len: 1729 microversion: 2.20 time: 0.174624 Jun 17 15:47:47.901432 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1520/3455] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:47:47 2022] GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170 => generated 1729 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:47:48.378850 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-0134f19d-ee92-4c09-b6ac-2e443c805d9a tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:47:48.379412 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-0134f19d-ee92-4c09-b6ac-2e443c805d9a tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] [instance: e4173cb9-999f-41f4-ade9-b521fc218a2b] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:47:48.386309 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0134f19d-ee92-4c09-b6ac-2e443c805d9a tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:48.387037 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0134f19d-ee92-4c09-b6ac-2e443c805d9a tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:48.388124 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0134f19d-ee92-4c09-b6ac-2e443c805d9a tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:48.388622 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0134f19d-ee92-4c09-b6ac-2e443c805d9a tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:48.535056 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-0134f19d-ee92-4c09-b6ac-2e443c805d9a tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab3130962a6456bbbcb1c96aba3506d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79efe2b5db31498c81c59b086e5c6f84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:48.543329 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-0134f19d-ee92-4c09-b6ac-2e443c805d9a tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] 10.222.0.48 "GET /compute/v2.1/servers/e4173cb9-999f-41f4-ade9-b521fc218a2b" status: 200 len: 1557 microversion: 2.1 time: 0.168756 Jun 17 15:47:48.543891 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1936/3456] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:47:48 2022] GET /compute/v2.1/servers/e4173cb9-999f-41f4-ade9-b521fc218a2b => generated 1557 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:47:48.559514 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-16655142-d3b3-42c8-88de-a94997445c9b tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:47:48.560035 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-16655142-d3b3-42c8-88de-a94997445c9b tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] [instance: e4173cb9-999f-41f4-ade9-b521fc218a2b] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:47:48.566306 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-16655142-d3b3-42c8-88de-a94997445c9b tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:48.566681 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-16655142-d3b3-42c8-88de-a94997445c9b tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:48.567442 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-16655142-d3b3-42c8-88de-a94997445c9b tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:48.567878 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-16655142-d3b3-42c8-88de-a94997445c9b tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:48.646503 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-16655142-d3b3-42c8-88de-a94997445c9b tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] 10.222.0.48 "GET /compute/v2.1/servers/e4173cb9-999f-41f4-ade9-b521fc218a2b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090884 Jun 17 15:47:48.647106 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1521/3457] 10.222.0.48 () {58 vars in 1274 bytes} [Fri Jun 17 15:47:48 2022] GET /compute/v2.1/servers/e4173cb9-999f-41f4-ade9-b521fc218a2b/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:47:48.918718 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-884a08b7-97b1-41d2-8c3d-2a8a9ab2db5d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:47:48.919325 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-884a08b7-97b1-41d2-8c3d-2a8a9ab2db5d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: 031f230c-48e6-46bb-a549-3cb347946170] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:47:48.925370 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-884a08b7-97b1-41d2-8c3d-2a8a9ab2db5d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:48.925810 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-884a08b7-97b1-41d2-8c3d-2a8a9ab2db5d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:48.926571 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-884a08b7-97b1-41d2-8c3d-2a8a9ab2db5d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:48.927003 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-884a08b7-97b1-41d2-8c3d-2a8a9ab2db5d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:49.063296 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-884a08b7-97b1-41d2-8c3d-2a8a9ab2db5d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:49.071415 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-884a08b7-97b1-41d2-8c3d-2a8a9ab2db5d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:49.073772 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-884a08b7-97b1-41d2-8c3d-2a8a9ab2db5d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:49.074909 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-884a08b7-97b1-41d2-8c3d-2a8a9ab2db5d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170" status: 200 len: 1729 microversion: 2.20 time: 0.160245 Jun 17 15:47:49.075547 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1937/3458] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:47:48 2022] GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170 => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:47:49.594074 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [req-e47a0d96-c350-485f-8ae0-0829e28bbdc8 req-9cadc9a8-a103-4fab-9077-30ba51151e95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4173cb9-999f-41f4-ade9-b521fc218a2b", "tag": "43096010-9b78-424f-89a3-0da3cacf6d65"}]} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:47:49.603543 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-e47a0d96-c350-485f-8ae0-0829e28bbdc8 req-9cadc9a8-a103-4fab-9077-30ba51151e95 service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:49.604078 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-e47a0d96-c350-485f-8ae0-0829e28bbdc8 req-9cadc9a8-a103-4fab-9077-30ba51151e95 service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:49.617548 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.compute.server_external_events [req-e47a0d96-c350-485f-8ae0-0829e28bbdc8 req-9cadc9a8-a103-4fab-9077-30ba51151e95 service nova] Creating event network-changed:43096010-9b78-424f-89a3-0da3cacf6d65 for instance e4173cb9-999f-41f4-ade9-b521fc218a2b on hv-cinder-82549 Jun 17 15:47:49.624260 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [req-e47a0d96-c350-485f-8ae0-0829e28bbdc8 req-9cadc9a8-a103-4fab-9077-30ba51151e95 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034489 Jun 17 15:47:49.625042 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1522/3459] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 15:47:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:47:50.093347 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-234ee4a1-bbaf-4830-8616-1c4f4837217d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:47:50.093959 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-234ee4a1-bbaf-4830-8616-1c4f4837217d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: 031f230c-48e6-46bb-a549-3cb347946170] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:47:50.100894 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-234ee4a1-bbaf-4830-8616-1c4f4837217d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:50.101341 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-234ee4a1-bbaf-4830-8616-1c4f4837217d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:50.102386 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-234ee4a1-bbaf-4830-8616-1c4f4837217d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:50.102818 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-234ee4a1-bbaf-4830-8616-1c4f4837217d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:50.238168 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-234ee4a1-bbaf-4830-8616-1c4f4837217d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:50.246973 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-234ee4a1-bbaf-4830-8616-1c4f4837217d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:50.248542 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-234ee4a1-bbaf-4830-8616-1c4f4837217d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:50.249714 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-234ee4a1-bbaf-4830-8616-1c4f4837217d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170" status: 200 len: 1729 microversion: 2.20 time: 0.160320 Jun 17 15:47:50.250273 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1938/3460] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:47:50 2022] GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170 => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:47:51.268507 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-ae38a215-7862-4b21-ba45-e5c881777d14 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:47:51.269248 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-ae38a215-7862-4b21-ba45-e5c881777d14 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: 031f230c-48e6-46bb-a549-3cb347946170] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:47:51.276619 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ae38a215-7862-4b21-ba45-e5c881777d14 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:51.277070 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ae38a215-7862-4b21-ba45-e5c881777d14 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:51.277829 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ae38a215-7862-4b21-ba45-e5c881777d14 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:51.278303 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ae38a215-7862-4b21-ba45-e5c881777d14 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:51.413867 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-ae38a215-7862-4b21-ba45-e5c881777d14 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:51.425482 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-ae38a215-7862-4b21-ba45-e5c881777d14 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:51.426980 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-ae38a215-7862-4b21-ba45-e5c881777d14 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:51.428166 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-ae38a215-7862-4b21-ba45-e5c881777d14 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170" status: 200 len: 1729 microversion: 2.20 time: 0.163959 Jun 17 15:47:51.428756 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1523/3461] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:47:51 2022] GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170 => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:47:52.446281 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-829a0ff7-a00c-44d6-9072-e1940d2d7b71 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:47:52.446891 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-829a0ff7-a00c-44d6-9072-e1940d2d7b71 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: 031f230c-48e6-46bb-a549-3cb347946170] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:47:52.454050 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-829a0ff7-a00c-44d6-9072-e1940d2d7b71 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:52.454497 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-829a0ff7-a00c-44d6-9072-e1940d2d7b71 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:52.455259 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-829a0ff7-a00c-44d6-9072-e1940d2d7b71 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:52.455688 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-829a0ff7-a00c-44d6-9072-e1940d2d7b71 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:52.589745 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-829a0ff7-a00c-44d6-9072-e1940d2d7b71 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:52.598247 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-829a0ff7-a00c-44d6-9072-e1940d2d7b71 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:52.599742 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-829a0ff7-a00c-44d6-9072-e1940d2d7b71 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:52.600922 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-829a0ff7-a00c-44d6-9072-e1940d2d7b71 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170" status: 200 len: 1729 microversion: 2.20 time: 0.158594 Jun 17 15:47:52.601633 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1939/3462] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:47:52 2022] GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170 => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:47:53.619064 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-42783802-8fa1-4d6b-9b78-df7af50416f2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:47:53.619666 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-42783802-8fa1-4d6b-9b78-df7af50416f2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: 031f230c-48e6-46bb-a549-3cb347946170] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:47:53.626892 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-42783802-8fa1-4d6b-9b78-df7af50416f2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:53.627340 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-42783802-8fa1-4d6b-9b78-df7af50416f2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:53.628107 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-42783802-8fa1-4d6b-9b78-df7af50416f2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:53.628576 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-42783802-8fa1-4d6b-9b78-df7af50416f2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:53.694376 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [req-70f7535b-ec3c-41e0-a607-6cba3584e371 req-c574f92e-93a6-4ef2-8144-b6ac36e4bda7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "031f230c-48e6-46bb-a549-3cb347946170", "name": "network-vif-plugged", "status": "completed", "tag": "f36b91db-a750-4162-b57f-9c6ee752ebac"}]} {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:47:53.704162 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [req-70f7535b-ec3c-41e0-a607-6cba3584e371 req-c574f92e-93a6-4ef2-8144-b6ac36e4bda7 service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:53.704704 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [req-70f7535b-ec3c-41e0-a607-6cba3584e371 req-c574f92e-93a6-4ef2-8144-b6ac36e4bda7 service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:53.721306 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.compute.server_external_events [req-70f7535b-ec3c-41e0-a607-6cba3584e371 req-c574f92e-93a6-4ef2-8144-b6ac36e4bda7 service nova] Creating event network-vif-plugged:f36b91db-a750-4162-b57f-9c6ee752ebac for instance 031f230c-48e6-46bb-a549-3cb347946170 on hv-cinder-82549 Jun 17 15:47:53.726427 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [req-70f7535b-ec3c-41e0-a607-6cba3584e371 req-c574f92e-93a6-4ef2-8144-b6ac36e4bda7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035730 Jun 17 15:47:53.727446 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1940/3463] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 15:47:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:47:53.765100 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-42783802-8fa1-4d6b-9b78-df7af50416f2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:53.773267 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-42783802-8fa1-4d6b-9b78-df7af50416f2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:53.774770 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-42783802-8fa1-4d6b-9b78-df7af50416f2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:53.775925 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-42783802-8fa1-4d6b-9b78-df7af50416f2 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170" status: 200 len: 1729 microversion: 2.20 time: 0.160813 Jun 17 15:47:53.777052 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1524/3464] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:47:53 2022] GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170 => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:47:54.795799 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-070a0c9b-4819-4a4d-a7b6-8f44ced65ada tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:47:54.796446 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-070a0c9b-4819-4a4d-a7b6-8f44ced65ada tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: 031f230c-48e6-46bb-a549-3cb347946170] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:47:54.802546 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-070a0c9b-4819-4a4d-a7b6-8f44ced65ada tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:54.802988 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-070a0c9b-4819-4a4d-a7b6-8f44ced65ada tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:54.803737 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-070a0c9b-4819-4a4d-a7b6-8f44ced65ada tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:54.804164 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-070a0c9b-4819-4a4d-a7b6-8f44ced65ada tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:54.930671 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-070a0c9b-4819-4a4d-a7b6-8f44ced65ada tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:54.939352 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-070a0c9b-4819-4a4d-a7b6-8f44ced65ada tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:54.940936 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-070a0c9b-4819-4a4d-a7b6-8f44ced65ada tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:54.942086 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-070a0c9b-4819-4a4d-a7b6-8f44ced65ada tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170" status: 200 len: 1729 microversion: 2.20 time: 0.151195 Jun 17 15:47:54.942672 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1941/3465] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:47:54 2022] GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170 => generated 1729 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:47:55.439806 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 15:47:55.440052 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Fri Jun 17 15:47:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 15:47:55.960829 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-0e3b35fc-debe-4eab-ba6d-29cdf7cab299 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:47:55.961503 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-0e3b35fc-debe-4eab-ba6d-29cdf7cab299 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: 031f230c-48e6-46bb-a549-3cb347946170] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:47:55.968734 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0e3b35fc-debe-4eab-ba6d-29cdf7cab299 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:55.969219 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0e3b35fc-debe-4eab-ba6d-29cdf7cab299 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:55.969965 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0e3b35fc-debe-4eab-ba6d-29cdf7cab299 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:55.970411 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0e3b35fc-debe-4eab-ba6d-29cdf7cab299 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:56.103970 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-0e3b35fc-debe-4eab-ba6d-29cdf7cab299 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:56.112446 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-0e3b35fc-debe-4eab-ba6d-29cdf7cab299 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:56.114059 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-0e3b35fc-debe-4eab-ba6d-29cdf7cab299 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:56.115284 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-0e3b35fc-debe-4eab-ba6d-29cdf7cab299 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170" status: 200 len: 1729 microversion: 2.20 time: 0.158382 Jun 17 15:47:56.115926 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1525/3466] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:47:55 2022] GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170 => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:47:57.133977 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-8a7b42a0-e365-4396-a772-7882c337048d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:47:57.134586 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-8a7b42a0-e365-4396-a772-7882c337048d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: 031f230c-48e6-46bb-a549-3cb347946170] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:47:57.137263 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:47:57.142703 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8a7b42a0-e365-4396-a772-7882c337048d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:57.143153 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8a7b42a0-e365-4396-a772-7882c337048d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:57.143913 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8a7b42a0-e365-4396-a772-7882c337048d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:47:57.144367 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8a7b42a0-e365-4396-a772-7882c337048d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:47:57.149133 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=100 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:47:57.274403 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-8a7b42a0-e365-4396-a772-7882c337048d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:57.282859 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-8a7b42a0-e365-4396-a772-7882c337048d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:57.284385 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-8a7b42a0-e365-4396-a772-7882c337048d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:47:57.285539 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-8a7b42a0-e365-4396-a772-7882c337048d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170" status: 200 len: 1716 microversion: 2.20 time: 0.155574 Jun 17 15:47:57.286093 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1942/3467] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:47:57 2022] GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170 => generated 1716 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:48:25.860041 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-52ddcb55-f7e7-42a9-a88a-06a1900e6b5a tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:48:25.860771 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-52ddcb55-f7e7-42a9-a88a-06a1900e6b5a tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] [instance: e4173cb9-999f-41f4-ade9-b521fc218a2b] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:48:25.862792 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_api:SELECT=77 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:48:25.863444 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell1:SELECT=65 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:48:25.869459 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-52ddcb55-f7e7-42a9-a88a-06a1900e6b5a tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:48:25.869960 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-52ddcb55-f7e7-42a9-a88a-06a1900e6b5a tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:48:25.871242 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-52ddcb55-f7e7-42a9-a88a-06a1900e6b5a tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:48:25.871669 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-52ddcb55-f7e7-42a9-a88a-06a1900e6b5a tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:48:25.897913 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-52ddcb55-f7e7-42a9-a88a-06a1900e6b5a tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] 10.222.0.48 "GET /compute/v2.1/servers/e4173cb9-999f-41f4-ade9-b521fc218a2b/ips" status: 200 len: 150 microversion: 2.1 time: 0.041877 Jun 17 15:48:25.898493 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1526/3468] 10.222.0.48 () {58 vars in 1247 bytes} [Fri Jun 17 15:48:25 2022] GET /compute/v2.1/servers/e4173cb9-999f-41f4-ade9-b521fc218a2b/ips => generated 150 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:48:27.294200 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-ad35fb83-3259-4071-a06c-c9c076995b01 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aeef2dd7-c9da-4155-9117-f0eb7109a0b9"}} {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:48:27.295336 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-ad35fb83-3259-4071-a06c-c9c076995b01 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] [instance: e4173cb9-999f-41f4-ade9-b521fc218a2b] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:48:27.297648 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_api:SELECT=1 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:48:27.298286 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=4 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:48:27.304270 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ad35fb83-3259-4071-a06c-c9c076995b01 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:48:27.304738 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ad35fb83-3259-4071-a06c-c9c076995b01 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:48:27.305498 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ad35fb83-3259-4071-a06c-c9c076995b01 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:48:27.305927 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ad35fb83-3259-4071-a06c-c9c076995b01 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:48:27.812136 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-ad35fb83-3259-4071-a06c-c9c076995b01 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] 10.222.0.48 "POST /compute/v2.1/servers/e4173cb9-999f-41f4-ade9-b521fc218a2b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.521752 Jun 17 15:48:27.812967 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1943/3469] 10.222.0.48 () {60 vars in 1322 bytes} [Fri Jun 17 15:48:27 2022] POST /compute/v2.1/servers/e4173cb9-999f-41f4-ade9-b521fc218a2b/os-volume_attachments => generated 194 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:48:30.407328 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-9883b45d-637f-42e5-9c43-52dde747db71 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:48:30.408286 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-9883b45d-637f-42e5-9c43-52dde747db71 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: 031f230c-48e6-46bb-a549-3cb347946170] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:48:30.415107 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9883b45d-637f-42e5-9c43-52dde747db71 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:48:30.415549 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9883b45d-637f-42e5-9c43-52dde747db71 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:48:30.416309 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9883b45d-637f-42e5-9c43-52dde747db71 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:48:30.416762 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9883b45d-637f-42e5-9c43-52dde747db71 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:48:30.447345 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-9883b45d-637f-42e5-9c43-52dde747db71 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043914 Jun 17 15:48:30.447926 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1527/3470] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 17 15:48:30 2022] GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:48:30.513443 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-10e2b1d5-d48a-4a87-81ee-34d9b60fd35d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:48:30.514054 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-10e2b1d5-d48a-4a87-81ee-34d9b60fd35d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: 031f230c-48e6-46bb-a549-3cb347946170] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:48:30.520901 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-10e2b1d5-d48a-4a87-81ee-34d9b60fd35d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:48:30.521352 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-10e2b1d5-d48a-4a87-81ee-34d9b60fd35d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:48:30.522174 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-10e2b1d5-d48a-4a87-81ee-34d9b60fd35d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:48:30.522614 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-10e2b1d5-d48a-4a87-81ee-34d9b60fd35d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:48:30.549834 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-10e2b1d5-d48a-4a87-81ee-34d9b60fd35d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: 031f230c-48e6-46bb-a549-3cb347946170] Going to try to terminate instance {{(pid=117650) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 15:48:30.636116 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-10e2b1d5-d48a-4a87-81ee-34d9b60fd35d tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "DELETE /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170" status: 204 len: 0 microversion: 2.20 time: 0.127605 Jun 17 15:48:30.637853 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1944/3471] 10.222.0.48 () {60 vars in 1279 bytes} [Fri Jun 17 15:48:30 2022] DELETE /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 17 15:48:30.647848 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-eb9c6a28-dddd-4736-bbef-6490beec1657 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:48:30.648523 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-eb9c6a28-dddd-4736-bbef-6490beec1657 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: 031f230c-48e6-46bb-a549-3cb347946170] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:48:30.655133 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-eb9c6a28-dddd-4736-bbef-6490beec1657 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:48:30.655582 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-eb9c6a28-dddd-4736-bbef-6490beec1657 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:48:30.656452 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-eb9c6a28-dddd-4736-bbef-6490beec1657 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:48:30.656885 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-eb9c6a28-dddd-4736-bbef-6490beec1657 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:48:30.801697 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-eb9c6a28-dddd-4736-bbef-6490beec1657 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:48:30.810913 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-eb9c6a28-dddd-4736-bbef-6490beec1657 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:48:30.812671 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-eb9c6a28-dddd-4736-bbef-6490beec1657 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:48:30.813862 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-eb9c6a28-dddd-4736-bbef-6490beec1657 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170" status: 200 len: 1722 microversion: 2.20 time: 0.171501 Jun 17 15:48:30.814416 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1528/3472] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:48:30 2022] GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 17 15:48:31.833589 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-14aa51c8-89c9-4a08-a733-6db28a78b4e0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:48:31.834283 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-14aa51c8-89c9-4a08-a733-6db28a78b4e0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: 031f230c-48e6-46bb-a549-3cb347946170] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:48:31.841565 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-14aa51c8-89c9-4a08-a733-6db28a78b4e0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:48:31.842003 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-14aa51c8-89c9-4a08-a733-6db28a78b4e0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:48:31.842775 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-14aa51c8-89c9-4a08-a733-6db28a78b4e0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:48:31.843200 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-14aa51c8-89c9-4a08-a733-6db28a78b4e0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:48:31.983674 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-14aa51c8-89c9-4a08-a733-6db28a78b4e0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:48:31.991659 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-14aa51c8-89c9-4a08-a733-6db28a78b4e0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:48:31.993203 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-14aa51c8-89c9-4a08-a733-6db28a78b4e0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:48:31.994373 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-14aa51c8-89c9-4a08-a733-6db28a78b4e0 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170" status: 200 len: 1722 microversion: 2.20 time: 0.165272 Jun 17 15:48:31.994933 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1945/3473] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:48:31 2022] GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:48:32.968515 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [req-a3651b02-02dc-40a9-be4b-fc40464b9f75 req-f27ba547-d159-4522-9b9e-57c27dc79169 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "031f230c-48e6-46bb-a549-3cb347946170", "name": "network-vif-deleted", "tag": "f36b91db-a750-4162-b57f-9c6ee752ebac"}]} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:48:32.984727 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-a3651b02-02dc-40a9-be4b-fc40464b9f75 req-f27ba547-d159-4522-9b9e-57c27dc79169 service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:48:32.984727 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-a3651b02-02dc-40a9-be4b-fc40464b9f75 req-f27ba547-d159-4522-9b9e-57c27dc79169 service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:48:32.990883 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.compute.server_external_events [req-a3651b02-02dc-40a9-be4b-fc40464b9f75 req-f27ba547-d159-4522-9b9e-57c27dc79169 service nova] Creating event network-vif-deleted:f36b91db-a750-4162-b57f-9c6ee752ebac for instance 031f230c-48e6-46bb-a549-3cb347946170 on hv-cinder-82549 Jun 17 15:48:32.996262 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [req-a3651b02-02dc-40a9-be4b-fc40464b9f75 req-f27ba547-d159-4522-9b9e-57c27dc79169 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032733 Jun 17 15:48:33.000234 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1529/3474] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 15:48:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:48:33.012927 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-f454e1ce-da4d-4878-8475-7a8ccaea9fcf tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:48:33.013631 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-f454e1ce-da4d-4878-8475-7a8ccaea9fcf tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: 031f230c-48e6-46bb-a549-3cb347946170] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:48:33.023560 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f454e1ce-da4d-4878-8475-7a8ccaea9fcf tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:48:33.024019 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f454e1ce-da4d-4878-8475-7a8ccaea9fcf tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:48:33.024976 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f454e1ce-da4d-4878-8475-7a8ccaea9fcf tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:48:33.025473 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f454e1ce-da4d-4878-8475-7a8ccaea9fcf tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:48:33.103528 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-f454e1ce-da4d-4878-8475-7a8ccaea9fcf tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:48:33.113604 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-f454e1ce-da4d-4878-8475-7a8ccaea9fcf tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:48:33.116706 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-f454e1ce-da4d-4878-8475-7a8ccaea9fcf tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9aaf800af45049739ed8f27979e90a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c87a857ab3949459349d3528ed05775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:48:33.118262 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-f454e1ce-da4d-4878-8475-7a8ccaea9fcf tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170" status: 200 len: 1366 microversion: 2.20 time: 0.109555 Jun 17 15:48:33.119051 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1946/3475] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:48:33 2022] GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170 => generated 1366 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 17 15:48:34.137855 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-af9928b2-d8f7-4b93-8f94-3f0fc29d8fe9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:48:34.138576 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-af9928b2-d8f7-4b93-8f94-3f0fc29d8fe9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: 031f230c-48e6-46bb-a549-3cb347946170] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:48:34.144806 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-af9928b2-d8f7-4b93-8f94-3f0fc29d8fe9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:48:34.145252 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-af9928b2-d8f7-4b93-8f94-3f0fc29d8fe9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:48:34.146006 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-af9928b2-d8f7-4b93-8f94-3f0fc29d8fe9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:48:34.146442 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-af9928b2-d8f7-4b93-8f94-3f0fc29d8fe9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:48:34.159410 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.wsgi [None req-af9928b2-d8f7-4b93-8f94-3f0fc29d8fe9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] HTTP exception thrown: Instance 031f230c-48e6-46bb-a549-3cb347946170 could not be found. Jun 17 15:48:34.161077 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-af9928b2-d8f7-4b93-8f94-3f0fc29d8fe9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Request method failure captured: Jun 17 15:48:34.161077 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: request: GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170 HTTP/1.1 Jun 17 15:48:34.161077 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Accept: application/json Jun 17 15:48:34.161077 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Accept-Encoding: identity Jun 17 15:48:34.161077 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Connection: close Jun 17 15:48:34.161077 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Content-Length: 0 Jun 17 15:48:34.161077 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Content-Type: application/json Jun 17 15:48:34.161077 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Host: 10.222.0.48 Jun 17 15:48:34.161077 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Openstack-System-Scope: None Jun 17 15:48:34.161077 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: User-Agent: python-urllib3/1.26.9 Jun 17 15:48:34.161077 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Auth-Token: gAAAAABirJmO3gewNbY2JAtBQxglGsurvITXhZlkGTsg43wun2kJZbFQGSoVsmC3VGO1z23mPWmvq_Y_3EEeB-Aw2MbGAcD-Az4iu2ZACX2WxOshE0a1P7-Ocv1lN0wl0jq784UJBFq3ONukPhr9i3g6WpzviRQc0W-LqW9ZkEJq8SfAJsVlcy8 Jun 17 15:48:34.161077 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Domain-Id: None Jun 17 15:48:34.161077 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Domain-Name: None Jun 17 15:48:34.161077 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Identity-Status: Confirmed Jun 17 15:48:34.161077 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Is-Admin-Project: True Jun 17 15:48:34.161077 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Openstack-Nova-Api-Version: 2.20 Jun 17 15:48:34.161077 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Domain-Id: default Jun 17 15:48:34.161077 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Domain-Name: Default Jun 17 15:48:34.161077 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Id: 0c87a857ab3949459349d3528ed05775 Jun 17 15:48:34.161077 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-774557148 Jun 17 15:48:34.161077 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Role: reader,member Jun 17 15:48:34.161077 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Roles: reader,member Jun 17 15:48:34.162805 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0c87a857ab3949459349d3528ed05775", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0c87a857ab3949459349d3528ed05775"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0c87a857ab3949459349d3528ed05775"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0c87a857ab3949459349d3528ed05775"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Jun 17 15:48:34.162805 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant: tempest-AttachVolumeShelveTestJSON-774557148 Jun 17 15:48:34.162805 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant-Id: 0c87a857ab3949459349d3528ed05775 Jun 17 15:48:34.162805 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-774557148 Jun 17 15:48:34.162805 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User: tempest-AttachVolumeShelveTestJSON-774557148-project Jun 17 15:48:34.162805 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Domain-Id: default Jun 17 15:48:34.162805 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Domain-Name: Default Jun 17 15:48:34.162805 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Id: 9aaf800af45049739ed8f27979e90a9e Jun 17 15:48:34.162805 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Name: tempest-AttachVolumeShelveTestJSON-774557148-project Jun 17 15:48:34.162805 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: method: > Jun 17 15:48:34.162805 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: exception: Instance 031f230c-48e6-46bb-a549-3cb347946170 could not be found. Jun 17 15:48:34.162805 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: action_args: {'id': '031f230c-48e6-46bb-a549-3cb347946170'} Jun 17 15:48:34.164085 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 15:48:34.164085 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:48:34.164085 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 15:48:34.164085 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 15:48:34.164085 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 15:48:34.164085 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 15:48:34.164085 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 15:48:34.164085 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 15:48:34.164085 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 15:48:34.164085 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 15:48:34.164085 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 031f230c-48e6-46bb-a549-3cb347946170 could not be found. Jun 17 15:48:34.164085 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:48:34.164085 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:48:34.164085 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:48:34.164085 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:48:34.164085 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:48:34.164085 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:48:34.164085 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 15:48:34.164085 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 15:48:34.164085 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 15:48:34.165824 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 15:48:34.165824 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 15:48:34.165824 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 15:48:34.165824 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 15:48:34.165824 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 15:48:34.165824 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 15:48:34.165824 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 15:48:34.165824 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 031f230c-48e6-46bb-a549-3cb347946170 could not be found. Jun 17 15:48:34.165824 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:48:34.165824 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:48:34.165824 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:48:34.165824 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:48:34.165824 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:48:34.165824 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:48:34.165824 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 15:48:34.165824 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 15:48:34.165824 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 031f230c-48e6-46bb-a549-3cb347946170 could not be found. Jun 17 15:48:34.165824 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:48:34.167961 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-af9928b2-d8f7-4b93-8f94-3f0fc29d8fe9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Returning 404 to user: Instance 031f230c-48e6-46bb-a549-3cb347946170 could not be found. {{(pid=117649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 15:48:34.167961 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-af9928b2-d8f7-4b93-8f94-3f0fc29d8fe9 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170" status: 404 len: 111 microversion: 2.20 time: 0.029413 Jun 17 15:48:34.167961 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1530/3476] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:48:34 2022] GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 17 15:48:34.173450 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-f02ca58a-536d-43e1-afe7-2eb85d39e3eb tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '.version_select at 0x7faf50c92e50>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:48:34.197476 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-f02ca58a-536d-43e1-afe7-2eb85d39e3eb tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1042959900" status: 204 len: 0 microversion: 2.20 time: 0.027667 Jun 17 15:48:34.197782 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1947/3477] 10.222.0.48 () {60 vars in 1261 bytes} [Fri Jun 17 15:48:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1042959900 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 17 15:48:35.351695 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-e32a41c3-630c-4562-b5a6-13a8d65b32bd tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Action: 'create', calling method: .version_select at 0x7faf54b59040>, body: {"keypair": {"name": "tempest-keypair-373040118", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNtEsXU9Zd72sPTLnuhOGrLIuVitCzwJCJwQoKNAem88YwLHuLF6hH6pnM5HUDvqhWw2OmCVmu74Ouz4UMVtW/MMHuY08pJXU4q0TuKrzD6dKunyFHOzx3n10AsbRpIFlQ=="}} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:48:35.366145 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.quota [None req-e32a41c3-630c-4562-b5a6-13a8d65b32bd tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Getting quotas for project 79efe2b5db31498c81c59b086e5c6f84. Resources: {'key_pairs'} {{(pid=117649) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 15:48:35.369981 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.quota [None req-e32a41c3-630c-4562-b5a6-13a8d65b32bd tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Getting quotas for user 8ab3130962a6456bbbcb1c96aba3506d and project 79efe2b5db31498c81c59b086e5c6f84. Resources: {'key_pairs'} {{(pid=117649) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 15:48:35.392700 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-e32a41c3-630c-4562-b5a6-13a8d65b32bd tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.044694 Jun 17 15:48:35.393383 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1531/3478] 10.222.0.48 () {60 vars in 1158 bytes} [Fri Jun 17 15:48:35 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:48:35.976039 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-fc7659b6-a482-46c2-9747-1baef39e0fbf tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:48:35.976628 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-fc7659b6-a482-46c2-9747-1baef39e0fbf tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: 031f230c-48e6-46bb-a549-3cb347946170] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:48:35.984131 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fc7659b6-a482-46c2-9747-1baef39e0fbf tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:48:35.984601 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fc7659b6-a482-46c2-9747-1baef39e0fbf tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:48:35.985363 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fc7659b6-a482-46c2-9747-1baef39e0fbf tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:48:35.985792 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-fc7659b6-a482-46c2-9747-1baef39e0fbf tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:48:35.998816 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.wsgi [None req-fc7659b6-a482-46c2-9747-1baef39e0fbf tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] HTTP exception thrown: Instance 031f230c-48e6-46bb-a549-3cb347946170 could not be found. Jun 17 15:48:36.000535 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-fc7659b6-a482-46c2-9747-1baef39e0fbf tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Request method failure captured: Jun 17 15:48:36.000535 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: request: DELETE /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170 HTTP/1.1 Jun 17 15:48:36.000535 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Accept: application/json Jun 17 15:48:36.000535 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Accept-Encoding: identity Jun 17 15:48:36.000535 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Connection: close Jun 17 15:48:36.000535 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Content-Length: 0 Jun 17 15:48:36.000535 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Content-Type: application/json Jun 17 15:48:36.000535 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Host: 10.222.0.48 Jun 17 15:48:36.000535 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Openstack-System-Scope: None Jun 17 15:48:36.000535 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: User-Agent: python-urllib3/1.26.9 Jun 17 15:48:36.000535 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Auth-Token: gAAAAABirJmO3gewNbY2JAtBQxglGsurvITXhZlkGTsg43wun2kJZbFQGSoVsmC3VGO1z23mPWmvq_Y_3EEeB-Aw2MbGAcD-Az4iu2ZACX2WxOshE0a1P7-Ocv1lN0wl0jq784UJBFq3ONukPhr9i3g6WpzviRQc0W-LqW9ZkEJq8SfAJsVlcy8 Jun 17 15:48:36.000535 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Domain-Id: None Jun 17 15:48:36.000535 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Domain-Name: None Jun 17 15:48:36.000535 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Identity-Status: Confirmed Jun 17 15:48:36.000535 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Is-Admin-Project: True Jun 17 15:48:36.000535 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Openstack-Nova-Api-Version: 2.20 Jun 17 15:48:36.000535 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Domain-Id: default Jun 17 15:48:36.000535 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Domain-Name: Default Jun 17 15:48:36.000535 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Id: 0c87a857ab3949459349d3528ed05775 Jun 17 15:48:36.000535 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-774557148 Jun 17 15:48:36.000535 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Role: reader,member Jun 17 15:48:36.000535 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Roles: reader,member Jun 17 15:48:36.002157 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0c87a857ab3949459349d3528ed05775", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0c87a857ab3949459349d3528ed05775"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0c87a857ab3949459349d3528ed05775"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0c87a857ab3949459349d3528ed05775"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Jun 17 15:48:36.002157 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant: tempest-AttachVolumeShelveTestJSON-774557148 Jun 17 15:48:36.002157 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant-Id: 0c87a857ab3949459349d3528ed05775 Jun 17 15:48:36.002157 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-774557148 Jun 17 15:48:36.002157 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User: tempest-AttachVolumeShelveTestJSON-774557148-project Jun 17 15:48:36.002157 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Domain-Id: default Jun 17 15:48:36.002157 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Domain-Name: Default Jun 17 15:48:36.002157 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Id: 9aaf800af45049739ed8f27979e90a9e Jun 17 15:48:36.002157 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Name: tempest-AttachVolumeShelveTestJSON-774557148-project Jun 17 15:48:36.002157 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: method: > Jun 17 15:48:36.002157 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: exception: Instance 031f230c-48e6-46bb-a549-3cb347946170 could not be found. Jun 17 15:48:36.002157 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: action_args: {'id': '031f230c-48e6-46bb-a549-3cb347946170'} Jun 17 15:48:36.003077 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 15:48:36.003077 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:48:36.003077 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 15:48:36.003077 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 15:48:36.003077 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 15:48:36.003077 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 15:48:36.003077 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 15:48:36.003077 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 15:48:36.003077 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 15:48:36.003077 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 15:48:36.003077 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 031f230c-48e6-46bb-a549-3cb347946170 could not be found. Jun 17 15:48:36.003077 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:48:36.003077 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:48:36.003077 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:48:36.003077 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:48:36.003077 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:48:36.003077 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:48:36.003077 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 15:48:36.003077 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 15:48:36.003077 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 15:48:36.004478 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 15:48:36.004478 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 17 15:48:36.004478 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 17 15:48:36.004478 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 17 15:48:36.004478 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 17 15:48:36.004478 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 15:48:36.004478 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 15:48:36.004478 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 15:48:36.004478 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 15:48:36.004478 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 031f230c-48e6-46bb-a549-3cb347946170 could not be found. Jun 17 15:48:36.004478 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:48:36.004478 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:48:36.004478 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:48:36.004478 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:48:36.004478 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:48:36.004478 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:48:36.004478 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 15:48:36.004478 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 15:48:36.004478 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 031f230c-48e6-46bb-a549-3cb347946170 could not be found. Jun 17 15:48:36.004478 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:48:36.006943 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-fc7659b6-a482-46c2-9747-1baef39e0fbf tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Returning 404 to user: Instance 031f230c-48e6-46bb-a549-3cb347946170 could not be found. {{(pid=117650) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 15:48:36.006943 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-fc7659b6-a482-46c2-9747-1baef39e0fbf tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "DELETE /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170" status: 404 len: 111 microversion: 2.20 time: 0.030276 Jun 17 15:48:36.006943 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1948/3479] 10.222.0.48 () {60 vars in 1279 bytes} [Fri Jun 17 15:48:35 2022] DELETE /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 17 15:48:36.012948 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-19292e9e-6f4c-4447-bd24-9670150cd25c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:48:36.013602 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-19292e9e-6f4c-4447-bd24-9670150cd25c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: 031f230c-48e6-46bb-a549-3cb347946170] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:48:36.020390 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-19292e9e-6f4c-4447-bd24-9670150cd25c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:48:36.020823 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-19292e9e-6f4c-4447-bd24-9670150cd25c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:48:36.021646 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-19292e9e-6f4c-4447-bd24-9670150cd25c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:48:36.022053 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-19292e9e-6f4c-4447-bd24-9670150cd25c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:48:36.036934 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.wsgi [None req-19292e9e-6f4c-4447-bd24-9670150cd25c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] HTTP exception thrown: Instance 031f230c-48e6-46bb-a549-3cb347946170 could not be found. Jun 17 15:48:36.038799 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-19292e9e-6f4c-4447-bd24-9670150cd25c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Request method failure captured: Jun 17 15:48:36.038799 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: request: GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170 HTTP/1.1 Jun 17 15:48:36.038799 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Accept: application/json Jun 17 15:48:36.038799 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Accept-Encoding: identity Jun 17 15:48:36.038799 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Connection: close Jun 17 15:48:36.038799 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Content-Length: 0 Jun 17 15:48:36.038799 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Content-Type: application/json Jun 17 15:48:36.038799 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Host: 10.222.0.48 Jun 17 15:48:36.038799 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Openstack-System-Scope: None Jun 17 15:48:36.038799 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: User-Agent: python-urllib3/1.26.9 Jun 17 15:48:36.038799 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Auth-Token: gAAAAABirJmO3gewNbY2JAtBQxglGsurvITXhZlkGTsg43wun2kJZbFQGSoVsmC3VGO1z23mPWmvq_Y_3EEeB-Aw2MbGAcD-Az4iu2ZACX2WxOshE0a1P7-Ocv1lN0wl0jq784UJBFq3ONukPhr9i3g6WpzviRQc0W-LqW9ZkEJq8SfAJsVlcy8 Jun 17 15:48:36.038799 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Domain-Id: None Jun 17 15:48:36.038799 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Domain-Name: None Jun 17 15:48:36.038799 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Identity-Status: Confirmed Jun 17 15:48:36.038799 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Is-Admin-Project: True Jun 17 15:48:36.038799 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Openstack-Nova-Api-Version: 2.20 Jun 17 15:48:36.038799 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Domain-Id: default Jun 17 15:48:36.038799 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Domain-Name: Default Jun 17 15:48:36.038799 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Id: 0c87a857ab3949459349d3528ed05775 Jun 17 15:48:36.038799 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-774557148 Jun 17 15:48:36.038799 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Role: reader,member Jun 17 15:48:36.038799 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Roles: reader,member Jun 17 15:48:36.040624 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0c87a857ab3949459349d3528ed05775", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0c87a857ab3949459349d3528ed05775"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0c87a857ab3949459349d3528ed05775"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0c87a857ab3949459349d3528ed05775"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Jun 17 15:48:36.040624 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant: tempest-AttachVolumeShelveTestJSON-774557148 Jun 17 15:48:36.040624 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant-Id: 0c87a857ab3949459349d3528ed05775 Jun 17 15:48:36.040624 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-774557148 Jun 17 15:48:36.040624 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User: tempest-AttachVolumeShelveTestJSON-774557148-project Jun 17 15:48:36.040624 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Domain-Id: default Jun 17 15:48:36.040624 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Domain-Name: Default Jun 17 15:48:36.040624 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Id: 9aaf800af45049739ed8f27979e90a9e Jun 17 15:48:36.040624 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Name: tempest-AttachVolumeShelveTestJSON-774557148-project Jun 17 15:48:36.040624 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: method: > Jun 17 15:48:36.040624 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: exception: Instance 031f230c-48e6-46bb-a549-3cb347946170 could not be found. Jun 17 15:48:36.040624 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: action_args: {'id': '031f230c-48e6-46bb-a549-3cb347946170'} Jun 17 15:48:36.041790 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 15:48:36.041790 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:48:36.041790 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 15:48:36.041790 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 15:48:36.041790 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 15:48:36.041790 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 15:48:36.041790 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 15:48:36.041790 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 15:48:36.041790 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 15:48:36.041790 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 15:48:36.041790 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 031f230c-48e6-46bb-a549-3cb347946170 could not be found. Jun 17 15:48:36.041790 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:48:36.041790 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:48:36.041790 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:48:36.041790 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:48:36.041790 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:48:36.041790 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:48:36.041790 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 15:48:36.041790 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 15:48:36.041790 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 15:48:36.043182 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 15:48:36.043182 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 15:48:36.043182 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 15:48:36.043182 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 15:48:36.043182 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 15:48:36.043182 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 15:48:36.043182 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 15:48:36.043182 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 031f230c-48e6-46bb-a549-3cb347946170 could not be found. Jun 17 15:48:36.043182 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:48:36.043182 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:48:36.043182 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:48:36.043182 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:48:36.043182 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:48:36.043182 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:48:36.043182 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 15:48:36.043182 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 15:48:36.043182 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 031f230c-48e6-46bb-a549-3cb347946170 could not be found. Jun 17 15:48:36.043182 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:48:36.045508 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-19292e9e-6f4c-4447-bd24-9670150cd25c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Returning 404 to user: Instance 031f230c-48e6-46bb-a549-3cb347946170 could not be found. {{(pid=117649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 15:48:36.045508 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-19292e9e-6f4c-4447-bd24-9670150cd25c tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170" status: 404 len: 111 microversion: 2.20 time: 0.031729 Jun 17 15:48:36.045508 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1532/3480] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:48:36 2022] GET /compute/v2.1/servers/031f230c-48e6-46bb-a549-3cb347946170 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 17 15:48:36.703804 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-f72ad45d-5869-4432-8111-dfed80d1c1fd tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-237562698", "imageRef": "8c105ca4-6fe3-4e70-af71-b03c64fe1efe", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "288b7261-f0bd-4510-ab2e-0de2bc8999e0"}], "security_groups": [{"name": "tempest-securitygroup--621386154"}], "key_name": "tempest-keypair-373040118", "user_data": "}} {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:48:36.818944 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.network.neutron [None req-f72ad45d-5869-4432-8111-dfed80d1c1fd tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] validate_networks() for [('288b7261-f0bd-4510-ab2e-0de2bc8999e0', None, None, None, None, None)] {{(pid=117650) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 15:48:37.182175 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-4d3f584a-870e-453c-a64a-37c48251b9d5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:48:37.182679 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-4d3f584a-870e-453c-a64a-37c48251b9d5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:48:37.189636 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4d3f584a-870e-453c-a64a-37c48251b9d5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:48:37.190055 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4d3f584a-870e-453c-a64a-37c48251b9d5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:48:37.190838 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4d3f584a-870e-453c-a64a-37c48251b9d5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:48:37.191265 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4d3f584a-870e-453c-a64a-37c48251b9d5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:48:37.204435 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.wsgi [None req-4d3f584a-870e-453c-a64a-37c48251b9d5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] HTTP exception thrown: Instance e97df352-5cee-41f7-ae51-f55cd9e85869 could not be found. Jun 17 15:48:37.205983 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-4d3f584a-870e-453c-a64a-37c48251b9d5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Request method failure captured: Jun 17 15:48:37.205983 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: request: DELETE /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 HTTP/1.1 Jun 17 15:48:37.205983 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Accept: application/json Jun 17 15:48:37.205983 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Accept-Encoding: identity Jun 17 15:48:37.205983 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Connection: close Jun 17 15:48:37.205983 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Content-Length: 0 Jun 17 15:48:37.205983 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Content-Type: application/json Jun 17 15:48:37.205983 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Host: 10.222.0.48 Jun 17 15:48:37.205983 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Openstack-System-Scope: None Jun 17 15:48:37.205983 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: User-Agent: python-urllib3/1.26.9 Jun 17 15:48:37.205983 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Auth-Token: gAAAAABirJmO3gewNbY2JAtBQxglGsurvITXhZlkGTsg43wun2kJZbFQGSoVsmC3VGO1z23mPWmvq_Y_3EEeB-Aw2MbGAcD-Az4iu2ZACX2WxOshE0a1P7-Ocv1lN0wl0jq784UJBFq3ONukPhr9i3g6WpzviRQc0W-LqW9ZkEJq8SfAJsVlcy8 Jun 17 15:48:37.205983 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Domain-Id: None Jun 17 15:48:37.205983 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Domain-Name: None Jun 17 15:48:37.205983 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Identity-Status: Confirmed Jun 17 15:48:37.205983 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Is-Admin-Project: True Jun 17 15:48:37.205983 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Openstack-Nova-Api-Version: 2.20 Jun 17 15:48:37.205983 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Domain-Id: default Jun 17 15:48:37.205983 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Domain-Name: Default Jun 17 15:48:37.205983 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Id: 0c87a857ab3949459349d3528ed05775 Jun 17 15:48:37.205983 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-774557148 Jun 17 15:48:37.205983 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Role: reader,member Jun 17 15:48:37.205983 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Roles: reader,member Jun 17 15:48:37.207807 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0c87a857ab3949459349d3528ed05775", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0c87a857ab3949459349d3528ed05775"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0c87a857ab3949459349d3528ed05775"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0c87a857ab3949459349d3528ed05775"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Jun 17 15:48:37.207807 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant: tempest-AttachVolumeShelveTestJSON-774557148 Jun 17 15:48:37.207807 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant-Id: 0c87a857ab3949459349d3528ed05775 Jun 17 15:48:37.207807 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-774557148 Jun 17 15:48:37.207807 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User: tempest-AttachVolumeShelveTestJSON-774557148-project Jun 17 15:48:37.207807 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Domain-Id: default Jun 17 15:48:37.207807 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Domain-Name: Default Jun 17 15:48:37.207807 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Id: 9aaf800af45049739ed8f27979e90a9e Jun 17 15:48:37.207807 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Name: tempest-AttachVolumeShelveTestJSON-774557148-project Jun 17 15:48:37.207807 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: method: > Jun 17 15:48:37.207807 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: exception: Instance e97df352-5cee-41f7-ae51-f55cd9e85869 could not be found. Jun 17 15:48:37.207807 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: action_args: {'id': 'e97df352-5cee-41f7-ae51-f55cd9e85869'} Jun 17 15:48:37.208726 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 15:48:37.208726 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:48:37.208726 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 15:48:37.208726 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 15:48:37.208726 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 15:48:37.208726 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 15:48:37.208726 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 15:48:37.208726 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 15:48:37.208726 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 15:48:37.208726 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 15:48:37.208726 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e97df352-5cee-41f7-ae51-f55cd9e85869 could not be found. Jun 17 15:48:37.208726 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:48:37.208726 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:48:37.208726 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:48:37.208726 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:48:37.208726 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:48:37.208726 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:48:37.208726 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 15:48:37.208726 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 15:48:37.208726 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 15:48:37.210134 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 15:48:37.210134 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 17 15:48:37.210134 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 17 15:48:37.210134 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 17 15:48:37.210134 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 17 15:48:37.210134 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 15:48:37.210134 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 15:48:37.210134 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 15:48:37.210134 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 15:48:37.210134 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e97df352-5cee-41f7-ae51-f55cd9e85869 could not be found. Jun 17 15:48:37.210134 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:48:37.210134 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:48:37.210134 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:48:37.210134 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:48:37.210134 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:48:37.210134 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:48:37.210134 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 15:48:37.210134 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 15:48:37.210134 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e97df352-5cee-41f7-ae51-f55cd9e85869 could not be found. Jun 17 15:48:37.210134 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:48:37.211743 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-4d3f584a-870e-453c-a64a-37c48251b9d5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Returning 404 to user: Instance e97df352-5cee-41f7-ae51-f55cd9e85869 could not be found. {{(pid=117649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 15:48:37.211743 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-4d3f584a-870e-453c-a64a-37c48251b9d5 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "DELETE /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 404 len: 111 microversion: 2.20 time: 0.029121 Jun 17 15:48:37.211743 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1533/3481] 10.222.0.48 () {60 vars in 1279 bytes} [Fri Jun 17 15:48:37 2022] DELETE /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 17 15:48:37.215400 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-b1c1600f-97c4-46f2-a62b-89ce0d7562c7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:48:37.215997 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-b1c1600f-97c4-46f2-a62b-89ce0d7562c7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] [instance: e97df352-5cee-41f7-ae51-f55cd9e85869] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:48:37.221823 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b1c1600f-97c4-46f2-a62b-89ce0d7562c7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:48:37.222273 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b1c1600f-97c4-46f2-a62b-89ce0d7562c7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:48:37.223023 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b1c1600f-97c4-46f2-a62b-89ce0d7562c7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:48:37.223453 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b1c1600f-97c4-46f2-a62b-89ce0d7562c7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:48:37.237325 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.wsgi [None req-b1c1600f-97c4-46f2-a62b-89ce0d7562c7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] HTTP exception thrown: Instance e97df352-5cee-41f7-ae51-f55cd9e85869 could not be found. Jun 17 15:48:37.238846 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-b1c1600f-97c4-46f2-a62b-89ce0d7562c7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Request method failure captured: Jun 17 15:48:37.238846 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: request: GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 HTTP/1.1 Jun 17 15:48:37.238846 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Accept: application/json Jun 17 15:48:37.238846 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Accept-Encoding: identity Jun 17 15:48:37.238846 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Connection: close Jun 17 15:48:37.238846 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Content-Length: 0 Jun 17 15:48:37.238846 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Content-Type: application/json Jun 17 15:48:37.238846 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Host: 10.222.0.48 Jun 17 15:48:37.238846 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Openstack-System-Scope: None Jun 17 15:48:37.238846 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: User-Agent: python-urllib3/1.26.9 Jun 17 15:48:37.238846 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Auth-Token: gAAAAABirJmO3gewNbY2JAtBQxglGsurvITXhZlkGTsg43wun2kJZbFQGSoVsmC3VGO1z23mPWmvq_Y_3EEeB-Aw2MbGAcD-Az4iu2ZACX2WxOshE0a1P7-Ocv1lN0wl0jq784UJBFq3ONukPhr9i3g6WpzviRQc0W-LqW9ZkEJq8SfAJsVlcy8 Jun 17 15:48:37.238846 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Domain-Id: None Jun 17 15:48:37.238846 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Domain-Name: None Jun 17 15:48:37.238846 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Identity-Status: Confirmed Jun 17 15:48:37.238846 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Is-Admin-Project: True Jun 17 15:48:37.238846 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Openstack-Nova-Api-Version: 2.20 Jun 17 15:48:37.238846 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Domain-Id: default Jun 17 15:48:37.238846 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Domain-Name: Default Jun 17 15:48:37.238846 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Id: 0c87a857ab3949459349d3528ed05775 Jun 17 15:48:37.238846 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-774557148 Jun 17 15:48:37.238846 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Role: reader,member Jun 17 15:48:37.238846 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Roles: reader,member Jun 17 15:48:37.240720 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0c87a857ab3949459349d3528ed05775", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0c87a857ab3949459349d3528ed05775"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0c87a857ab3949459349d3528ed05775"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0c87a857ab3949459349d3528ed05775"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Jun 17 15:48:37.240720 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant: tempest-AttachVolumeShelveTestJSON-774557148 Jun 17 15:48:37.240720 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant-Id: 0c87a857ab3949459349d3528ed05775 Jun 17 15:48:37.240720 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-774557148 Jun 17 15:48:37.240720 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User: tempest-AttachVolumeShelveTestJSON-774557148-project Jun 17 15:48:37.240720 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Domain-Id: default Jun 17 15:48:37.240720 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Domain-Name: Default Jun 17 15:48:37.240720 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Id: 9aaf800af45049739ed8f27979e90a9e Jun 17 15:48:37.240720 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Name: tempest-AttachVolumeShelveTestJSON-774557148-project Jun 17 15:48:37.240720 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: method: > Jun 17 15:48:37.240720 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: exception: Instance e97df352-5cee-41f7-ae51-f55cd9e85869 could not be found. Jun 17 15:48:37.240720 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: action_args: {'id': 'e97df352-5cee-41f7-ae51-f55cd9e85869'} Jun 17 15:48:37.241678 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 15:48:37.241678 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:48:37.241678 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 15:48:37.241678 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 15:48:37.241678 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 15:48:37.241678 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 15:48:37.241678 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 15:48:37.241678 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 15:48:37.241678 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 15:48:37.241678 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 15:48:37.241678 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e97df352-5cee-41f7-ae51-f55cd9e85869 could not be found. Jun 17 15:48:37.241678 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:48:37.241678 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:48:37.241678 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:48:37.241678 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:48:37.241678 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:48:37.241678 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:48:37.241678 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 15:48:37.241678 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 15:48:37.241678 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 15:48:37.243320 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 15:48:37.243320 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 15:48:37.243320 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 15:48:37.243320 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 15:48:37.243320 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 15:48:37.243320 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 15:48:37.243320 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 15:48:37.243320 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e97df352-5cee-41f7-ae51-f55cd9e85869 could not be found. Jun 17 15:48:37.243320 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:48:37.243320 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:48:37.243320 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:48:37.243320 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:48:37.243320 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:48:37.243320 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:48:37.243320 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 15:48:37.243320 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 15:48:37.243320 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e97df352-5cee-41f7-ae51-f55cd9e85869 could not be found. Jun 17 15:48:37.243320 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:48:37.244856 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-b1c1600f-97c4-46f2-a62b-89ce0d7562c7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] Returning 404 to user: Instance e97df352-5cee-41f7-ae51-f55cd9e85869 could not be found. {{(pid=117649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 15:48:37.244856 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-b1c1600f-97c4-46f2-a62b-89ce0d7562c7 tempest-AttachVolumeShelveTestJSON-774557148 tempest-AttachVolumeShelveTestJSON-774557148-project] 10.222.0.48 "GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869" status: 404 len: 111 microversion: 2.20 time: 0.028446 Jun 17 15:48:37.244856 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1534/3482] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 17 15:48:37 2022] GET /compute/v2.1/servers/e97df352-5cee-41f7-ae51-f55cd9e85869 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 17 15:48:37.289839 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.virt.hardware [None req-f72ad45d-5869-4432-8111-dfed80d1c1fd tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Flavor limits 0:0:0 {{(pid=117650) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 15:48:37.290370 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.virt.hardware [None req-f72ad45d-5869-4432-8111-dfed80d1c1fd tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Image limits 0:0:0 {{(pid=117650) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 15:48:37.290735 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.virt.hardware [None req-f72ad45d-5869-4432-8111-dfed80d1c1fd tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Flavor pref 0:0:0 {{(pid=117650) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 15:48:37.291145 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.virt.hardware [None req-f72ad45d-5869-4432-8111-dfed80d1c1fd tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Image pref 0:0:0 {{(pid=117650) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 15:48:37.291554 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.virt.hardware [None req-f72ad45d-5869-4432-8111-dfed80d1c1fd tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117650) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 15:48:37.301104 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f72ad45d-5869-4432-8111-dfed80d1c1fd tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:48:37.301547 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f72ad45d-5869-4432-8111-dfed80d1c1fd tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:48:37.302373 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f72ad45d-5869-4432-8111-dfed80d1c1fd tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:48:37.302918 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f72ad45d-5869-4432-8111-dfed80d1c1fd tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:48:37.319730 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.quota [None req-f72ad45d-5869-4432-8111-dfed80d1c1fd tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Getting quotas for project 79efe2b5db31498c81c59b086e5c6f84. Resources: {'cores', 'ram', 'instances'} {{(pid=117650) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 15:48:37.323703 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.quota [None req-f72ad45d-5869-4432-8111-dfed80d1c1fd tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Getting quotas for user 8ab3130962a6456bbbcb1c96aba3506d and project 79efe2b5db31498c81c59b086e5c6f84. Resources: {'cores', 'ram', 'instances'} {{(pid=117650) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 15:48:37.334954 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-f72ad45d-5869-4432-8111-dfed80d1c1fd tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Going to run 1 instances... {{(pid=117650) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 15:48:37.337313 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-f72ad45d-5869-4432-8111-dfed80d1c1fd tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] [instance: 1687c703-69ae-4187-bc39-16c2eca96d87] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c105ca4-6fe3-4e70-af71-b03c64fe1efe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117650) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 15:48:37.388932 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-f72ad45d-5869-4432-8111-dfed80d1c1fd tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.689907 Jun 17 15:48:37.389798 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1949/3483] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Jun 17 15:48:36 2022] POST /compute/v2.1/servers => generated 401 bytes in 691 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 15:48:37.400045 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-cc355468-0ff0-4f18-b9ab-695b8081d2af tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:48:37.400692 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-cc355468-0ff0-4f18-b9ab-695b8081d2af tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] [instance: 1687c703-69ae-4187-bc39-16c2eca96d87] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:48:37.472653 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-cc355468-0ff0-4f18-b9ab-695b8081d2af tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab3130962a6456bbbcb1c96aba3506d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79efe2b5db31498c81c59b086e5c6f84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:48:37.479846 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-cc355468-0ff0-4f18-b9ab-695b8081d2af tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] 10.222.0.48 "GET /compute/v2.1/servers/1687c703-69ae-4187-bc39-16c2eca96d87" status: 200 len: 1240 microversion: 2.1 time: 0.083988 Jun 17 15:48:37.480547 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1535/3484] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:48:37 2022] GET /compute/v2.1/servers/1687c703-69ae-4187-bc39-16c2eca96d87 => generated 1240 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:48:38.499594 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-b33e8c58-9c02-4462-b4a1-5afc4bbe1a61 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:48:38.500216 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-b33e8c58-9c02-4462-b4a1-5afc4bbe1a61 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] [instance: 1687c703-69ae-4187-bc39-16c2eca96d87] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:48:38.507229 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b33e8c58-9c02-4462-b4a1-5afc4bbe1a61 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:48:38.507676 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b33e8c58-9c02-4462-b4a1-5afc4bbe1a61 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:48:38.508465 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b33e8c58-9c02-4462-b4a1-5afc4bbe1a61 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:48:38.508908 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b33e8c58-9c02-4462-b4a1-5afc4bbe1a61 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:48:38.583085 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-b33e8c58-9c02-4462-b4a1-5afc4bbe1a61 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab3130962a6456bbbcb1c96aba3506d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79efe2b5db31498c81c59b086e5c6f84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:48:38.590762 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-b33e8c58-9c02-4462-b4a1-5afc4bbe1a61 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] 10.222.0.48 "GET /compute/v2.1/servers/1687c703-69ae-4187-bc39-16c2eca96d87" status: 200 len: 1298 microversion: 2.1 time: 0.096286 Jun 17 15:48:38.591980 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1950/3485] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:48:38 2022] GET /compute/v2.1/servers/1687c703-69ae-4187-bc39-16c2eca96d87 => generated 1298 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:48:39.610044 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-16245207-cd78-47e7-bbab-8cec67425efd tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:48:39.611413 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-16245207-cd78-47e7-bbab-8cec67425efd tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] [instance: 1687c703-69ae-4187-bc39-16c2eca96d87] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:48:39.624671 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-16245207-cd78-47e7-bbab-8cec67425efd tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:48:39.625610 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-16245207-cd78-47e7-bbab-8cec67425efd tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:48:39.627460 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-16245207-cd78-47e7-bbab-8cec67425efd tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:48:39.628573 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-16245207-cd78-47e7-bbab-8cec67425efd tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:48:39.917471 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-16245207-cd78-47e7-bbab-8cec67425efd tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab3130962a6456bbbcb1c96aba3506d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79efe2b5db31498c81c59b086e5c6f84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:48:39.930168 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-16245207-cd78-47e7-bbab-8cec67425efd tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] 10.222.0.48 "GET /compute/v2.1/servers/1687c703-69ae-4187-bc39-16c2eca96d87" status: 200 len: 1365 microversion: 2.1 time: 0.324394 Jun 17 15:48:39.930905 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1536/3486] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:48:39 2022] GET /compute/v2.1/servers/1687c703-69ae-4187-bc39-16c2eca96d87 => generated 1365 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:48:40.283537 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [req-4d2c66fd-ae9b-4b3f-b018-1a6a08d2578a req-c1b589d8-000b-4748-a15f-bf12324776eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1687c703-69ae-4187-bc39-16c2eca96d87", "tag": "06f6ae3c-94cf-43a6-99c3-ecfe423ec99d"}]} {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:48:40.313885 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [req-4d2c66fd-ae9b-4b3f-b018-1a6a08d2578a req-c1b589d8-000b-4748-a15f-bf12324776eb service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:48:40.314403 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [req-4d2c66fd-ae9b-4b3f-b018-1a6a08d2578a req-c1b589d8-000b-4748-a15f-bf12324776eb service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:48:40.365475 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.compute.server_external_events [req-4d2c66fd-ae9b-4b3f-b018-1a6a08d2578a req-c1b589d8-000b-4748-a15f-bf12324776eb service nova] Creating event network-changed:06f6ae3c-94cf-43a6-99c3-ecfe423ec99d for instance 1687c703-69ae-4187-bc39-16c2eca96d87 on hv-cinder-82549 Jun 17 15:48:40.378145 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [req-4d2c66fd-ae9b-4b3f-b018-1a6a08d2578a req-c1b589d8-000b-4748-a15f-bf12324776eb service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100891 Jun 17 15:48:40.380959 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1951/3487] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 15:48:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:48:40.958249 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-7eedc801-a668-4134-b2fb-14797f5e9800 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:48:40.959581 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-7eedc801-a668-4134-b2fb-14797f5e9800 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] [instance: 1687c703-69ae-4187-bc39-16c2eca96d87] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:48:40.968503 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7eedc801-a668-4134-b2fb-14797f5e9800 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:48:40.968955 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7eedc801-a668-4134-b2fb-14797f5e9800 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:48:40.969733 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7eedc801-a668-4134-b2fb-14797f5e9800 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:48:40.970158 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7eedc801-a668-4134-b2fb-14797f5e9800 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:48:41.237627 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-7eedc801-a668-4134-b2fb-14797f5e9800 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab3130962a6456bbbcb1c96aba3506d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79efe2b5db31498c81c59b086e5c6f84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:48:41.245540 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-7eedc801-a668-4134-b2fb-14797f5e9800 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] 10.222.0.48 "GET /compute/v2.1/servers/1687c703-69ae-4187-bc39-16c2eca96d87" status: 200 len: 1365 microversion: 2.1 time: 0.291971 Jun 17 15:48:41.246196 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1537/3488] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:48:40 2022] GET /compute/v2.1/servers/1687c703-69ae-4187-bc39-16c2eca96d87 => generated 1365 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:48:42.265503 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-7b19b9fe-2109-44a1-83d4-adb594808226 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:48:42.266881 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-7b19b9fe-2109-44a1-83d4-adb594808226 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] [instance: 1687c703-69ae-4187-bc39-16c2eca96d87] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:48:42.273561 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7b19b9fe-2109-44a1-83d4-adb594808226 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:48:42.274030 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7b19b9fe-2109-44a1-83d4-adb594808226 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:48:42.274799 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7b19b9fe-2109-44a1-83d4-adb594808226 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:48:42.275236 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7b19b9fe-2109-44a1-83d4-adb594808226 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:48:42.487466 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-7b19b9fe-2109-44a1-83d4-adb594808226 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab3130962a6456bbbcb1c96aba3506d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79efe2b5db31498c81c59b086e5c6f84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:48:42.495410 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-7b19b9fe-2109-44a1-83d4-adb594808226 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] 10.222.0.48 "GET /compute/v2.1/servers/1687c703-69ae-4187-bc39-16c2eca96d87" status: 200 len: 1365 microversion: 2.1 time: 0.236087 Jun 17 15:48:42.495995 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1952/3489] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:48:42 2022] GET /compute/v2.1/servers/1687c703-69ae-4187-bc39-16c2eca96d87 => generated 1365 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:48:43.514150 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-dd6d8ed4-cb8d-4ae6-909f-442712ff9e60 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:48:43.514819 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-dd6d8ed4-cb8d-4ae6-909f-442712ff9e60 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] [instance: 1687c703-69ae-4187-bc39-16c2eca96d87] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:48:43.529912 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-dd6d8ed4-cb8d-4ae6-909f-442712ff9e60 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:48:43.530933 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-dd6d8ed4-cb8d-4ae6-909f-442712ff9e60 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:48:43.531702 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-dd6d8ed4-cb8d-4ae6-909f-442712ff9e60 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:48:43.532133 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-dd6d8ed4-cb8d-4ae6-909f-442712ff9e60 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:48:44.051507 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-dd6d8ed4-cb8d-4ae6-909f-442712ff9e60 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab3130962a6456bbbcb1c96aba3506d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79efe2b5db31498c81c59b086e5c6f84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:48:44.059808 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-dd6d8ed4-cb8d-4ae6-909f-442712ff9e60 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] 10.222.0.48 "GET /compute/v2.1/servers/1687c703-69ae-4187-bc39-16c2eca96d87" status: 200 len: 1365 microversion: 2.1 time: 0.549496 Jun 17 15:48:44.060760 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1538/3490] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:48:43 2022] GET /compute/v2.1/servers/1687c703-69ae-4187-bc39-16c2eca96d87 => generated 1365 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:48:45.078776 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-474ad444-2b93-46d3-a707-38c63715e91e tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:48:45.079367 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-474ad444-2b93-46d3-a707-38c63715e91e tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] [instance: 1687c703-69ae-4187-bc39-16c2eca96d87] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:48:45.087805 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-474ad444-2b93-46d3-a707-38c63715e91e tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:48:45.088238 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-474ad444-2b93-46d3-a707-38c63715e91e tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:48:45.089271 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-474ad444-2b93-46d3-a707-38c63715e91e tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:48:45.089703 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-474ad444-2b93-46d3-a707-38c63715e91e tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:48:45.242378 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-474ad444-2b93-46d3-a707-38c63715e91e tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab3130962a6456bbbcb1c96aba3506d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79efe2b5db31498c81c59b086e5c6f84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:48:45.263989 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-474ad444-2b93-46d3-a707-38c63715e91e tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] 10.222.0.48 "GET /compute/v2.1/servers/1687c703-69ae-4187-bc39-16c2eca96d87" status: 200 len: 1365 microversion: 2.1 time: 0.189767 Jun 17 15:48:45.264626 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1953/3491] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:48:45 2022] GET /compute/v2.1/servers/1687c703-69ae-4187-bc39-16c2eca96d87 => generated 1365 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:48:45.950538 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [req-af741533-c198-4193-8006-8eeff53df7ed req-12e1d8c9-f0ab-4e00-9879-47653c641592 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1687c703-69ae-4187-bc39-16c2eca96d87", "name": "network-vif-plugged", "status": "completed", "tag": "06f6ae3c-94cf-43a6-99c3-ecfe423ec99d"}]} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:48:45.959206 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-af741533-c198-4193-8006-8eeff53df7ed req-12e1d8c9-f0ab-4e00-9879-47653c641592 service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:48:45.960270 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-af741533-c198-4193-8006-8eeff53df7ed req-12e1d8c9-f0ab-4e00-9879-47653c641592 service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:48:45.972640 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.compute.server_external_events [req-af741533-c198-4193-8006-8eeff53df7ed req-12e1d8c9-f0ab-4e00-9879-47653c641592 service nova] Creating event network-vif-plugged:06f6ae3c-94cf-43a6-99c3-ecfe423ec99d for instance 1687c703-69ae-4187-bc39-16c2eca96d87 on hv-cinder-82549 Jun 17 15:48:45.978526 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [req-af741533-c198-4193-8006-8eeff53df7ed req-12e1d8c9-f0ab-4e00-9879-47653c641592 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031655 Jun 17 15:48:45.979272 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1539/3492] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 15:48:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:48:46.281347 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-b6b47fef-3e28-47c7-8f85-1bba104ef795 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:48:46.283071 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-b6b47fef-3e28-47c7-8f85-1bba104ef795 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] [instance: 1687c703-69ae-4187-bc39-16c2eca96d87] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:48:46.296501 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b6b47fef-3e28-47c7-8f85-1bba104ef795 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:48:46.297251 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b6b47fef-3e28-47c7-8f85-1bba104ef795 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:48:46.298231 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b6b47fef-3e28-47c7-8f85-1bba104ef795 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:48:46.302646 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b6b47fef-3e28-47c7-8f85-1bba104ef795 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:48:46.533735 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-b6b47fef-3e28-47c7-8f85-1bba104ef795 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab3130962a6456bbbcb1c96aba3506d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79efe2b5db31498c81c59b086e5c6f84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:48:46.567356 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-b6b47fef-3e28-47c7-8f85-1bba104ef795 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] 10.222.0.48 "GET /compute/v2.1/servers/1687c703-69ae-4187-bc39-16c2eca96d87" status: 200 len: 1365 microversion: 2.1 time: 0.290305 Jun 17 15:48:46.573039 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1954/3493] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:48:46 2022] GET /compute/v2.1/servers/1687c703-69ae-4187-bc39-16c2eca96d87 => generated 1365 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:48:46.931013 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-728ffac5-ba43-46af-835e-8fe88172e406 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Action: 'create', calling method: .version_select at 0x7faf54c2f0d0>, body: {"keypair": {"name": "tempest-keypair-655403185", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOa1NF6JrLhBn5cIa0ZxAqvohjVv3LPbh1PhCy74zRt2TTKQCukaBQyqMvFd9Mm4RpumPFnSp67E5Tv4CgOPKB/a0n0i70cFQmq4YZp4sSaN59j86wB0BnaaDA4seYth6g=="}} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:48:46.945767 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.quota [None req-728ffac5-ba43-46af-835e-8fe88172e406 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Getting quotas for project f48712151f8a4942a0a08d09a80c902d. Resources: {'key_pairs'} {{(pid=117649) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 15:48:46.950637 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.quota [None req-728ffac5-ba43-46af-835e-8fe88172e406 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Getting quotas for user 4a67b4188f6248cca9ce2f4991d78e62 and project f48712151f8a4942a0a08d09a80c902d. Resources: {'key_pairs'} {{(pid=117649) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 15:48:46.979136 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-728ffac5-ba43-46af-835e-8fe88172e406 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.177167 Jun 17 15:48:46.979853 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1540/3494] 10.222.0.48 () {60 vars in 1158 bytes} [Fri Jun 17 15:48:46 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:48:47.587297 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-a594813c-aaf7-4d81-9d9d-864bb0bd27ea tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:48:47.587960 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-a594813c-aaf7-4d81-9d9d-864bb0bd27ea tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] [instance: 1687c703-69ae-4187-bc39-16c2eca96d87] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:48:47.594592 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell0:SELECT=2 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:48:47.595266 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell0:SELECT=6 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:48:47.597754 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a594813c-aaf7-4d81-9d9d-864bb0bd27ea tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:48:47.598690 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a594813c-aaf7-4d81-9d9d-864bb0bd27ea tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:48:47.599669 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a594813c-aaf7-4d81-9d9d-864bb0bd27ea tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:48:47.600285 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a594813c-aaf7-4d81-9d9d-864bb0bd27ea tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:48:47.813979 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-a594813c-aaf7-4d81-9d9d-864bb0bd27ea tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab3130962a6456bbbcb1c96aba3506d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79efe2b5db31498c81c59b086e5c6f84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:48:47.821428 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-a594813c-aaf7-4d81-9d9d-864bb0bd27ea tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] 10.222.0.48 "GET /compute/v2.1/servers/1687c703-69ae-4187-bc39-16c2eca96d87" status: 200 len: 1554 microversion: 2.1 time: 0.237983 Jun 17 15:48:47.822119 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1955/3495] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:48:47 2022] GET /compute/v2.1/servers/1687c703-69ae-4187-bc39-16c2eca96d87 => generated 1554 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:48:47.839577 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-0478c8b9-329c-4525-908c-22a5a4ea4cde tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:48:47.840274 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-0478c8b9-329c-4525-908c-22a5a4ea4cde tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] [instance: 1687c703-69ae-4187-bc39-16c2eca96d87] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:48:47.846831 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0478c8b9-329c-4525-908c-22a5a4ea4cde tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:48:47.847293 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0478c8b9-329c-4525-908c-22a5a4ea4cde tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:48:47.848050 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0478c8b9-329c-4525-908c-22a5a4ea4cde tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:48:47.848544 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0478c8b9-329c-4525-908c-22a5a4ea4cde tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:48:47.950657 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-0478c8b9-329c-4525-908c-22a5a4ea4cde tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] 10.222.0.48 "GET /compute/v2.1/servers/1687c703-69ae-4187-bc39-16c2eca96d87/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.115559 Jun 17 15:48:47.951251 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1541/3496] 10.222.0.48 () {58 vars in 1274 bytes} [Fri Jun 17 15:48:47 2022] GET /compute/v2.1/servers/1687c703-69ae-4187-bc39-16c2eca96d87/os-interface => generated 284 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:48:48.431748 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-a4a53f79-0c43-4066-95b1-2a36b36a9e80 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-876143597", "imageRef": "8c105ca4-6fe3-4e70-af71-b03c64fe1efe", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2f353cec-10d5-4712-aaaf-331bc64a547b"}], "security_groups": [{"name": "tempest-securitygroup--965580715"}], "key_name": "tempest-keypair-655403185", "user_data": "}} {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:48:48.549655 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.network.neutron [None req-a4a53f79-0c43-4066-95b1-2a36b36a9e80 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] validate_networks() for [('2f353cec-10d5-4712-aaaf-331bc64a547b', None, None, None, None, None)] {{(pid=117650) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 15:48:48.978704 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.virt.hardware [None req-a4a53f79-0c43-4066-95b1-2a36b36a9e80 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Flavor limits 0:0:0 {{(pid=117650) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 15:48:48.979317 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.virt.hardware [None req-a4a53f79-0c43-4066-95b1-2a36b36a9e80 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Image limits 0:0:0 {{(pid=117650) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 15:48:48.979587 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.virt.hardware [None req-a4a53f79-0c43-4066-95b1-2a36b36a9e80 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Flavor pref 0:0:0 {{(pid=117650) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 15:48:48.980135 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.virt.hardware [None req-a4a53f79-0c43-4066-95b1-2a36b36a9e80 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Image pref 0:0:0 {{(pid=117650) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 15:48:48.980595 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.virt.hardware [None req-a4a53f79-0c43-4066-95b1-2a36b36a9e80 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117650) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 15:48:48.991336 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a4a53f79-0c43-4066-95b1-2a36b36a9e80 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:48:48.991778 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a4a53f79-0c43-4066-95b1-2a36b36a9e80 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:48:48.992977 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a4a53f79-0c43-4066-95b1-2a36b36a9e80 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:48:48.993605 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a4a53f79-0c43-4066-95b1-2a36b36a9e80 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:48:49.012070 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.quota [None req-a4a53f79-0c43-4066-95b1-2a36b36a9e80 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Getting quotas for project f48712151f8a4942a0a08d09a80c902d. Resources: {'cores', 'ram', 'instances'} {{(pid=117650) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 15:48:49.018299 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.quota [None req-a4a53f79-0c43-4066-95b1-2a36b36a9e80 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Getting quotas for user 4a67b4188f6248cca9ce2f4991d78e62 and project f48712151f8a4942a0a08d09a80c902d. Resources: {'cores', 'ram', 'instances'} {{(pid=117650) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 15:48:49.036492 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-a4a53f79-0c43-4066-95b1-2a36b36a9e80 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Going to run 1 instances... {{(pid=117650) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 15:48:49.039462 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-a4a53f79-0c43-4066-95b1-2a36b36a9e80 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] [instance: fd8af8c4-d147-4335-90c9-81fe1da1297f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c105ca4-6fe3-4e70-af71-b03c64fe1efe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117650) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 15:48:49.101687 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-a4a53f79-0c43-4066-95b1-2a36b36a9e80 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.674230 Jun 17 15:48:49.103311 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1956/3497] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Jun 17 15:48:48 2022] POST /compute/v2.1/servers => generated 401 bytes in 676 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 15:48:49.113573 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-22dcaab3-59e7-4d72-b514-0df9eff2e940 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:48:49.114952 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-22dcaab3-59e7-4d72-b514-0df9eff2e940 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] [instance: fd8af8c4-d147-4335-90c9-81fe1da1297f] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:48:49.188453 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-22dcaab3-59e7-4d72-b514-0df9eff2e940 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a67b4188f6248cca9ce2f4991d78e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48712151f8a4942a0a08d09a80c902d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:48:49.196142 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-22dcaab3-59e7-4d72-b514-0df9eff2e940 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] 10.222.0.48 "GET /compute/v2.1/servers/fd8af8c4-d147-4335-90c9-81fe1da1297f" status: 200 len: 1236 microversion: 2.1 time: 0.086005 Jun 17 15:48:49.198259 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1542/3498] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:48:49 2022] GET /compute/v2.1/servers/fd8af8c4-d147-4335-90c9-81fe1da1297f => generated 1236 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:48:49.434931 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [req-40c1628a-521f-4675-affa-d30956923705 req-8a03fa56-a0ca-4f79-a49a-39aedea49fd1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1687c703-69ae-4187-bc39-16c2eca96d87", "tag": "06f6ae3c-94cf-43a6-99c3-ecfe423ec99d"}]} {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:48:49.446065 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [req-40c1628a-521f-4675-affa-d30956923705 req-8a03fa56-a0ca-4f79-a49a-39aedea49fd1 service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:48:49.449715 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [req-40c1628a-521f-4675-affa-d30956923705 req-8a03fa56-a0ca-4f79-a49a-39aedea49fd1 service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:48:49.482677 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.compute.server_external_events [req-40c1628a-521f-4675-affa-d30956923705 req-8a03fa56-a0ca-4f79-a49a-39aedea49fd1 service nova] Creating event network-changed:06f6ae3c-94cf-43a6-99c3-ecfe423ec99d for instance 1687c703-69ae-4187-bc39-16c2eca96d87 on hv-cinder-82549 Jun 17 15:48:49.500556 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [req-40c1628a-521f-4675-affa-d30956923705 req-8a03fa56-a0ca-4f79-a49a-39aedea49fd1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070661 Jun 17 15:48:49.501125 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1957/3499] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 15:48:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:48:50.217207 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-c6675d88-9090-4852-b4f5-f90f586fe1f8 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:48:50.218477 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-c6675d88-9090-4852-b4f5-f90f586fe1f8 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] [instance: fd8af8c4-d147-4335-90c9-81fe1da1297f] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:48:50.229065 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c6675d88-9090-4852-b4f5-f90f586fe1f8 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:48:50.229788 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c6675d88-9090-4852-b4f5-f90f586fe1f8 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:48:50.230758 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c6675d88-9090-4852-b4f5-f90f586fe1f8 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:48:50.231428 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c6675d88-9090-4852-b4f5-f90f586fe1f8 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:48:50.335555 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-c6675d88-9090-4852-b4f5-f90f586fe1f8 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a67b4188f6248cca9ce2f4991d78e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48712151f8a4942a0a08d09a80c902d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:48:50.345885 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-c6675d88-9090-4852-b4f5-f90f586fe1f8 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] 10.222.0.48 "GET /compute/v2.1/servers/fd8af8c4-d147-4335-90c9-81fe1da1297f" status: 200 len: 1288 microversion: 2.1 time: 0.136377 Jun 17 15:48:50.347989 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1543/3500] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:48:50 2022] GET /compute/v2.1/servers/fd8af8c4-d147-4335-90c9-81fe1da1297f => generated 1288 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:48:51.365846 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-1efc33c3-d2bd-4096-878a-671e326ead91 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:48:51.366707 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-1efc33c3-d2bd-4096-878a-671e326ead91 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] [instance: fd8af8c4-d147-4335-90c9-81fe1da1297f] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:48:51.374471 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1efc33c3-d2bd-4096-878a-671e326ead91 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:48:51.374924 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1efc33c3-d2bd-4096-878a-671e326ead91 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:48:51.375902 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1efc33c3-d2bd-4096-878a-671e326ead91 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:48:51.376561 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1efc33c3-d2bd-4096-878a-671e326ead91 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:48:51.512223 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-1efc33c3-d2bd-4096-878a-671e326ead91 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a67b4188f6248cca9ce2f4991d78e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48712151f8a4942a0a08d09a80c902d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:48:51.519646 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-1efc33c3-d2bd-4096-878a-671e326ead91 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] 10.222.0.48 "GET /compute/v2.1/servers/fd8af8c4-d147-4335-90c9-81fe1da1297f" status: 200 len: 1361 microversion: 2.1 time: 0.158315 Jun 17 15:48:51.520210 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1958/3501] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:48:51 2022] GET /compute/v2.1/servers/fd8af8c4-d147-4335-90c9-81fe1da1297f => generated 1361 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:48:51.980937 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [req-cd166256-afb9-452a-a79a-bc86b6c3c402 req-cb651d51-6226-4adc-9a6b-4f21bb4fcb0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd8af8c4-d147-4335-90c9-81fe1da1297f", "tag": "cb749a38-539e-467d-84a8-49cb7542c6ae"}]} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:48:51.990115 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-cd166256-afb9-452a-a79a-bc86b6c3c402 req-cb651d51-6226-4adc-9a6b-4f21bb4fcb0c service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:48:51.990567 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-cd166256-afb9-452a-a79a-bc86b6c3c402 req-cb651d51-6226-4adc-9a6b-4f21bb4fcb0c service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:48:52.003371 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.compute.server_external_events [req-cd166256-afb9-452a-a79a-bc86b6c3c402 req-cb651d51-6226-4adc-9a6b-4f21bb4fcb0c service nova] Creating event network-changed:cb749a38-539e-467d-84a8-49cb7542c6ae for instance fd8af8c4-d147-4335-90c9-81fe1da1297f on hv-cinder-82549 Jun 17 15:48:52.011717 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [req-cd166256-afb9-452a-a79a-bc86b6c3c402 req-cb651d51-6226-4adc-9a6b-4f21bb4fcb0c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032979 Jun 17 15:48:52.013364 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1544/3502] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 15:48:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:48:52.537385 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-b40ff155-e87e-4444-a7b4-947ec73ce2e6 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:48:52.537954 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-b40ff155-e87e-4444-a7b4-947ec73ce2e6 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] [instance: fd8af8c4-d147-4335-90c9-81fe1da1297f] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:48:52.544591 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b40ff155-e87e-4444-a7b4-947ec73ce2e6 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:48:52.545046 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b40ff155-e87e-4444-a7b4-947ec73ce2e6 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:48:52.545847 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b40ff155-e87e-4444-a7b4-947ec73ce2e6 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:48:52.546316 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b40ff155-e87e-4444-a7b4-947ec73ce2e6 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:48:52.677389 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-b40ff155-e87e-4444-a7b4-947ec73ce2e6 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a67b4188f6248cca9ce2f4991d78e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48712151f8a4942a0a08d09a80c902d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:48:52.685291 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-b40ff155-e87e-4444-a7b4-947ec73ce2e6 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] 10.222.0.48 "GET /compute/v2.1/servers/fd8af8c4-d147-4335-90c9-81fe1da1297f" status: 200 len: 1361 microversion: 2.1 time: 0.151886 Jun 17 15:48:52.685854 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1959/3503] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:48:52 2022] GET /compute/v2.1/servers/fd8af8c4-d147-4335-90c9-81fe1da1297f => generated 1361 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:48:53.703732 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-a135ff56-31c8-4791-88e4-c42f68568364 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:48:53.704451 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-a135ff56-31c8-4791-88e4-c42f68568364 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] [instance: fd8af8c4-d147-4335-90c9-81fe1da1297f] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:48:53.710559 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a135ff56-31c8-4791-88e4-c42f68568364 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:48:53.711005 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a135ff56-31c8-4791-88e4-c42f68568364 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:48:53.711756 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a135ff56-31c8-4791-88e4-c42f68568364 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:48:53.712184 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a135ff56-31c8-4791-88e4-c42f68568364 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:48:53.840519 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-a135ff56-31c8-4791-88e4-c42f68568364 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a67b4188f6248cca9ce2f4991d78e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48712151f8a4942a0a08d09a80c902d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:48:53.847854 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-a135ff56-31c8-4791-88e4-c42f68568364 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] 10.222.0.48 "GET /compute/v2.1/servers/fd8af8c4-d147-4335-90c9-81fe1da1297f" status: 200 len: 1361 microversion: 2.1 time: 0.149663 Jun 17 15:48:53.848497 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1545/3504] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:48:53 2022] GET /compute/v2.1/servers/fd8af8c4-d147-4335-90c9-81fe1da1297f => generated 1361 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:48:54.864911 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-90301565-13e4-4c86-ad51-f8dbc6c2380f tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:48:54.865519 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-90301565-13e4-4c86-ad51-f8dbc6c2380f tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] [instance: fd8af8c4-d147-4335-90c9-81fe1da1297f] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:48:54.871923 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-90301565-13e4-4c86-ad51-f8dbc6c2380f tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:48:54.872396 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-90301565-13e4-4c86-ad51-f8dbc6c2380f tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:48:54.873152 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-90301565-13e4-4c86-ad51-f8dbc6c2380f tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:48:54.873583 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-90301565-13e4-4c86-ad51-f8dbc6c2380f tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:48:55.003779 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-90301565-13e4-4c86-ad51-f8dbc6c2380f tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a67b4188f6248cca9ce2f4991d78e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48712151f8a4942a0a08d09a80c902d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:48:55.007273 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:48:55.013354 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-90301565-13e4-4c86-ad51-f8dbc6c2380f tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] 10.222.0.48 "GET /compute/v2.1/servers/fd8af8c4-d147-4335-90c9-81fe1da1297f" status: 200 len: 1361 microversion: 2.1 time: 0.152357 Jun 17 15:48:55.013914 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1960/3505] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:48:54 2022] GET /compute/v2.1/servers/fd8af8c4-d147-4335-90c9-81fe1da1297f => generated 1361 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:48:56.030722 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-6d0105bf-bea5-4b65-a23b-ff14ab30a9f5 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:48:56.031350 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-6d0105bf-bea5-4b65-a23b-ff14ab30a9f5 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] [instance: fd8af8c4-d147-4335-90c9-81fe1da1297f] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:48:56.033829 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=2 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:48:56.039433 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6d0105bf-bea5-4b65-a23b-ff14ab30a9f5 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:48:56.039886 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6d0105bf-bea5-4b65-a23b-ff14ab30a9f5 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:48:56.040724 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6d0105bf-bea5-4b65-a23b-ff14ab30a9f5 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:48:56.041162 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-6d0105bf-bea5-4b65-a23b-ff14ab30a9f5 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:48:56.046727 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell1:SELECT=65 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:48:56.177379 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-6d0105bf-bea5-4b65-a23b-ff14ab30a9f5 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a67b4188f6248cca9ce2f4991d78e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48712151f8a4942a0a08d09a80c902d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:48:56.184767 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-6d0105bf-bea5-4b65-a23b-ff14ab30a9f5 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] 10.222.0.48 "GET /compute/v2.1/servers/fd8af8c4-d147-4335-90c9-81fe1da1297f" status: 200 len: 1361 microversion: 2.1 time: 0.158483 Jun 17 15:48:56.185330 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1546/3506] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:48:56 2022] GET /compute/v2.1/servers/fd8af8c4-d147-4335-90c9-81fe1da1297f => generated 1361 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:48:57.202284 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-c3fe384f-ab5b-43b3-a167-d1bc7572602f tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:48:57.202876 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-c3fe384f-ab5b-43b3-a167-d1bc7572602f tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] [instance: fd8af8c4-d147-4335-90c9-81fe1da1297f] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:48:57.210260 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c3fe384f-ab5b-43b3-a167-d1bc7572602f tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:48:57.210704 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c3fe384f-ab5b-43b3-a167-d1bc7572602f tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:48:57.211458 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c3fe384f-ab5b-43b3-a167-d1bc7572602f tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:48:57.211893 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c3fe384f-ab5b-43b3-a167-d1bc7572602f tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:48:57.342664 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-c3fe384f-ab5b-43b3-a167-d1bc7572602f tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a67b4188f6248cca9ce2f4991d78e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48712151f8a4942a0a08d09a80c902d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:48:57.350277 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-c3fe384f-ab5b-43b3-a167-d1bc7572602f tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] 10.222.0.48 "GET /compute/v2.1/servers/fd8af8c4-d147-4335-90c9-81fe1da1297f" status: 200 len: 1361 microversion: 2.1 time: 0.152577 Jun 17 15:48:57.351042 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1961/3507] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:48:57 2022] GET /compute/v2.1/servers/fd8af8c4-d147-4335-90c9-81fe1da1297f => generated 1361 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:48:57.967105 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [req-d440685f-e82a-407e-8660-7a1573a182d7 req-c5fa3991-d585-4507-94d7-afa575eb6f97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd8af8c4-d147-4335-90c9-81fe1da1297f", "name": "network-vif-plugged", "status": "completed", "tag": "cb749a38-539e-467d-84a8-49cb7542c6ae"}]} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:48:57.976005 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-d440685f-e82a-407e-8660-7a1573a182d7 req-c5fa3991-d585-4507-94d7-afa575eb6f97 service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:48:57.976424 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-d440685f-e82a-407e-8660-7a1573a182d7 req-c5fa3991-d585-4507-94d7-afa575eb6f97 service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:48:57.987738 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.compute.server_external_events [req-d440685f-e82a-407e-8660-7a1573a182d7 req-c5fa3991-d585-4507-94d7-afa575eb6f97 service nova] Creating event network-vif-plugged:cb749a38-539e-467d-84a8-49cb7542c6ae for instance fd8af8c4-d147-4335-90c9-81fe1da1297f on hv-cinder-82549 Jun 17 15:48:57.992783 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [req-d440685f-e82a-407e-8660-7a1573a182d7 req-c5fa3991-d585-4507-94d7-afa575eb6f97 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029951 Jun 17 15:48:57.993433 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1547/3508] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 15:48:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:48:58.368477 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-748d8870-97ec-4eb2-846c-077797845e8e tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:48:58.369038 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-748d8870-97ec-4eb2-846c-077797845e8e tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] [instance: fd8af8c4-d147-4335-90c9-81fe1da1297f] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:48:58.371781 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:48:58.377823 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-748d8870-97ec-4eb2-846c-077797845e8e tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:48:58.378264 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-748d8870-97ec-4eb2-846c-077797845e8e tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:48:58.379027 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-748d8870-97ec-4eb2-846c-077797845e8e tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:48:58.379986 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-748d8870-97ec-4eb2-846c-077797845e8e tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:48:58.510724 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-748d8870-97ec-4eb2-846c-077797845e8e tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a67b4188f6248cca9ce2f4991d78e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48712151f8a4942a0a08d09a80c902d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:48:58.518809 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-748d8870-97ec-4eb2-846c-077797845e8e tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] 10.222.0.48 "GET /compute/v2.1/servers/fd8af8c4-d147-4335-90c9-81fe1da1297f" status: 200 len: 1361 microversion: 2.1 time: 0.154281 Jun 17 15:48:58.519372 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1962/3509] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:48:58 2022] GET /compute/v2.1/servers/fd8af8c4-d147-4335-90c9-81fe1da1297f => generated 1361 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:48:59.532785 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell0:SELECT=12 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:48:59.536998 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-2e74fde0-ee7e-4948-8b2d-3d0a0a7e83d2 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:48:59.537695 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-2e74fde0-ee7e-4948-8b2d-3d0a0a7e83d2 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] [instance: fd8af8c4-d147-4335-90c9-81fe1da1297f] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:48:59.544080 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2e74fde0-ee7e-4948-8b2d-3d0a0a7e83d2 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:48:59.544560 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2e74fde0-ee7e-4948-8b2d-3d0a0a7e83d2 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:48:59.545311 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2e74fde0-ee7e-4948-8b2d-3d0a0a7e83d2 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:48:59.545743 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2e74fde0-ee7e-4948-8b2d-3d0a0a7e83d2 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:48:59.673402 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-2e74fde0-ee7e-4948-8b2d-3d0a0a7e83d2 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a67b4188f6248cca9ce2f4991d78e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48712151f8a4942a0a08d09a80c902d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:48:59.681072 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-2e74fde0-ee7e-4948-8b2d-3d0a0a7e83d2 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] 10.222.0.48 "GET /compute/v2.1/servers/fd8af8c4-d147-4335-90c9-81fe1da1297f" status: 200 len: 1548 microversion: 2.1 time: 0.149776 Jun 17 15:48:59.681648 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1548/3510] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:48:59 2022] GET /compute/v2.1/servers/fd8af8c4-d147-4335-90c9-81fe1da1297f => generated 1548 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:48:59.698080 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-9cc09d54-9f2a-4074-91f9-7327ba0befb6 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:48:59.698633 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-9cc09d54-9f2a-4074-91f9-7327ba0befb6 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] [instance: fd8af8c4-d147-4335-90c9-81fe1da1297f] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:48:59.700939 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell0:SELECT=2 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:48:59.701635 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell0:SELECT=6 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:48:59.708121 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9cc09d54-9f2a-4074-91f9-7327ba0befb6 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:48:59.708613 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9cc09d54-9f2a-4074-91f9-7327ba0befb6 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:48:59.709394 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9cc09d54-9f2a-4074-91f9-7327ba0befb6 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:48:59.709823 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9cc09d54-9f2a-4074-91f9-7327ba0befb6 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:48:59.789550 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-9cc09d54-9f2a-4074-91f9-7327ba0befb6 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] 10.222.0.48 "GET /compute/v2.1/servers/fd8af8c4-d147-4335-90c9-81fe1da1297f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095327 Jun 17 15:48:59.790150 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1963/3511] 10.222.0.48 () {58 vars in 1274 bytes} [Fri Jun 17 15:48:59 2022] GET /compute/v2.1/servers/fd8af8c4-d147-4335-90c9-81fe1da1297f/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:49:00.971082 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [req-a411ee8f-63dc-40d2-8e5a-8b0a207e6f7a req-92d212d2-2fbb-400d-bc3c-a5ef543d9a1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd8af8c4-d147-4335-90c9-81fe1da1297f", "tag": "cb749a38-539e-467d-84a8-49cb7542c6ae"}]} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:49:00.984558 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-a411ee8f-63dc-40d2-8e5a-8b0a207e6f7a req-92d212d2-2fbb-400d-bc3c-a5ef543d9a1a service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:49:00.985007 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-a411ee8f-63dc-40d2-8e5a-8b0a207e6f7a req-92d212d2-2fbb-400d-bc3c-a5ef543d9a1a service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:49:00.997123 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.compute.server_external_events [req-a411ee8f-63dc-40d2-8e5a-8b0a207e6f7a req-92d212d2-2fbb-400d-bc3c-a5ef543d9a1a service nova] Creating event network-changed:cb749a38-539e-467d-84a8-49cb7542c6ae for instance fd8af8c4-d147-4335-90c9-81fe1da1297f on hv-cinder-82549 Jun 17 15:49:01.002210 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [req-a411ee8f-63dc-40d2-8e5a-8b0a207e6f7a req-92d212d2-2fbb-400d-bc3c-a5ef543d9a1a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034661 Jun 17 15:49:01.002890 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1549/3512] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 15:49:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:49:24.857997 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_api:SELECT=3 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:49:24.859008 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=16 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:49:24.864030 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-7a9f6071-5ed4-4710-b321-98cddb41b6f1 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:49:24.864569 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-7a9f6071-5ed4-4710-b321-98cddb41b6f1 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] [instance: 1687c703-69ae-4187-bc39-16c2eca96d87] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:49:24.873040 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7a9f6071-5ed4-4710-b321-98cddb41b6f1 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:49:24.873686 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7a9f6071-5ed4-4710-b321-98cddb41b6f1 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:49:24.874600 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7a9f6071-5ed4-4710-b321-98cddb41b6f1 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:49:24.875049 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7a9f6071-5ed4-4710-b321-98cddb41b6f1 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:49:24.901328 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-7a9f6071-5ed4-4710-b321-98cddb41b6f1 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] 10.222.0.48 "GET /compute/v2.1/servers/1687c703-69ae-4187-bc39-16c2eca96d87/ips" status: 200 len: 149 microversion: 2.1 time: 0.044566 Jun 17 15:49:24.901926 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1964/3513] 10.222.0.48 () {58 vars in 1247 bytes} [Fri Jun 17 15:49:24 2022] GET /compute/v2.1/servers/1687c703-69ae-4187-bc39-16c2eca96d87/ips => generated 149 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:49:24.911722 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_api:SELECT=7 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:49:24.912609 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell1:SELECT=15 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:49:24.917333 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-97202f47-3c3c-4ba1-b5fe-17606106819e tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aeef2dd7-c9da-4155-9117-f0eb7109a0b9"}} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:49:24.919029 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-97202f47-3c3c-4ba1-b5fe-17606106819e tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] [instance: 1687c703-69ae-4187-bc39-16c2eca96d87] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:49:24.926599 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-97202f47-3c3c-4ba1-b5fe-17606106819e tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:49:24.927045 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-97202f47-3c3c-4ba1-b5fe-17606106819e tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:49:24.927824 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-97202f47-3c3c-4ba1-b5fe-17606106819e tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:49:24.928252 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-97202f47-3c3c-4ba1-b5fe-17606106819e tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:49:25.017292 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.wsgi [None req-97202f47-3c3c-4ba1-b5fe-17606106819e tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] HTTP exception thrown: Invalid volume: volume aeef2dd7-c9da-4155-9117-f0eb7109a0b9 is already attached to instances: e4173cb9-999f-41f4-ade9-b521fc218a2b Jun 17 15:49:25.019328 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-97202f47-3c3c-4ba1-b5fe-17606106819e tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Request method failure captured: Jun 17 15:49:25.019328 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: request: POST /compute/v2.1/servers/1687c703-69ae-4187-bc39-16c2eca96d87/os-volume_attachments HTTP/1.1 Jun 17 15:49:25.019328 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Accept: application/json Jun 17 15:49:25.019328 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Accept-Encoding: identity Jun 17 15:49:25.019328 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Connection: close Jun 17 15:49:25.019328 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Content-Length: 74 Jun 17 15:49:25.019328 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Content-Type: application/json Jun 17 15:49:25.019328 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Host: 10.222.0.48 Jun 17 15:49:25.019328 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Openstack-System-Scope: None Jun 17 15:49:25.019328 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: User-Agent: python-urllib3/1.26.9 Jun 17 15:49:25.019328 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Auth-Token: gAAAAABirKICwWnhD993Jl4IhDGE-QonLGXk8DgdDZd8k6DQ9ib1E3iCeZvkPKJ1yooc16OipcuLAmHVKfeflaAMN8pddeU0L_b0r5jZEMoMoQRDnLv1aSXXTkcHo205L-oyOwE_Oe-bVu0FH4Pz82Sgm44hDcOVXCq7XBTJwNam2wPPozTvXCI Jun 17 15:49:25.019328 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Domain-Id: None Jun 17 15:49:25.019328 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Domain-Name: None Jun 17 15:49:25.019328 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Identity-Status: Confirmed Jun 17 15:49:25.019328 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Is-Admin-Project: True Jun 17 15:49:25.019328 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Domain-Id: default Jun 17 15:49:25.019328 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Domain-Name: Default Jun 17 15:49:25.019328 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Id: 79efe2b5db31498c81c59b086e5c6f84 Jun 17 15:49:25.019328 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Name: tempest-AttachVolumeNegativeTest-957597123 Jun 17 15:49:25.019328 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Role: reader,member Jun 17 15:49:25.019328 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Roles: reader,member Jun 17 15:49:25.022512 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_79efe2b5db31498c81c59b086e5c6f84", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/79efe2b5db31498c81c59b086e5c6f84"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/79efe2b5db31498c81c59b086e5c6f84"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/79efe2b5db31498c81c59b086e5c6f84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Jun 17 15:49:25.022512 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant: tempest-AttachVolumeNegativeTest-957597123 Jun 17 15:49:25.022512 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant-Id: 79efe2b5db31498c81c59b086e5c6f84 Jun 17 15:49:25.022512 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-957597123 Jun 17 15:49:25.022512 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User: tempest-AttachVolumeNegativeTest-957597123-project Jun 17 15:49:25.022512 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Domain-Id: default Jun 17 15:49:25.022512 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Domain-Name: Default Jun 17 15:49:25.022512 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Id: 8ab3130962a6456bbbcb1c96aba3506d Jun 17 15:49:25.022512 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Name: tempest-AttachVolumeNegativeTest-957597123-project Jun 17 15:49:25.022512 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Jun 17 15:49:25.022512 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: {"volumeAttachment": {"volumeId": "aeef2dd7-c9da-4155-9117-f0eb7109a0b9"}} Jun 17 15:49:25.022512 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: method: > Jun 17 15:49:25.023804 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: exception: Invalid volume: volume aeef2dd7-c9da-4155-9117-f0eb7109a0b9 is already attached to instances: e4173cb9-999f-41f4-ade9-b521fc218a2b Jun 17 15:49:25.023804 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: action_args: {'server_id': '1687c703-69ae-4187-bc39-16c2eca96d87', 'body': {'volumeAttachment': {'volumeId': 'aeef2dd7-c9da-4155-9117-f0eb7109a0b9'}}} Jun 17 15:49:25.023804 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 15:49:25.023804 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:49:25.023804 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 17 15:49:25.023804 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 17 15:49:25.023804 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 17 15:49:25.023804 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 15:49:25.023804 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 17 15:49:25.023804 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 17 15:49:25.023804 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 17 15:49:25.023804 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 17 15:49:25.023804 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 17 15:49:25.023804 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 17 15:49:25.023804 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume aeef2dd7-c9da-4155-9117-f0eb7109a0b9 is already attached to instances: e4173cb9-999f-41f4-ade9-b521fc218a2b Jun 17 15:49:25.023804 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:49:25.023804 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:49:25.023804 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:49:25.023804 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:49:25.025697 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:49:25.025697 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:49:25.025697 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 15:49:25.025697 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 15:49:25.025697 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 15:49:25.025697 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 15:49:25.025697 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 17 15:49:25.025697 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 17 15:49:25.025697 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 17 15:49:25.025697 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 17 15:49:25.025697 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 17 15:49:25.025697 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 17 15:49:25.025697 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 17 15:49:25.025697 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 17 15:49:25.025697 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume aeef2dd7-c9da-4155-9117-f0eb7109a0b9 is already attached to instances: e4173cb9-999f-41f4-ade9-b521fc218a2b Jun 17 15:49:25.025697 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:49:25.025697 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:49:25.025697 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:49:25.025697 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:49:25.025697 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:49:25.028429 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:49:25.028429 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 15:49:25.028429 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 15:49:25.028429 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume aeef2dd7-c9da-4155-9117-f0eb7109a0b9 is already attached to instances: e4173cb9-999f-41f4-ade9-b521fc218a2b Jun 17 15:49:25.028429 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:49:25.028429 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-97202f47-3c3c-4ba1-b5fe-17606106819e tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Returning 400 to user: Invalid volume: volume aeef2dd7-c9da-4155-9117-f0eb7109a0b9 is already attached to instances: e4173cb9-999f-41f4-ade9-b521fc218a2b {{(pid=117649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 15:49:25.028429 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-97202f47-3c3c-4ba1-b5fe-17606106819e tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] 10.222.0.48 "POST /compute/v2.1/servers/1687c703-69ae-4187-bc39-16c2eca96d87/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.111462 Jun 17 15:49:25.028429 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1550/3514] 10.222.0.48 () {60 vars in 1322 bytes} [Fri Jun 17 15:49:24 2022] POST /compute/v2.1/servers/1687c703-69ae-4187-bc39-16c2eca96d87/os-volume_attachments => generated 174 bytes in 114 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 17 15:49:25.034753 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-e580c9db-57e7-4d59-b515-3873f148cae9 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:49:25.035379 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-e580c9db-57e7-4d59-b515-3873f148cae9 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] [instance: 1687c703-69ae-4187-bc39-16c2eca96d87] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:49:25.043743 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e580c9db-57e7-4d59-b515-3873f148cae9 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:49:25.044258 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e580c9db-57e7-4d59-b515-3873f148cae9 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:49:25.045131 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e580c9db-57e7-4d59-b515-3873f148cae9 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:49:25.045622 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-e580c9db-57e7-4d59-b515-3873f148cae9 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:49:25.072808 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-e580c9db-57e7-4d59-b515-3873f148cae9 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] [instance: 1687c703-69ae-4187-bc39-16c2eca96d87] Going to try to terminate instance {{(pid=117650) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 15:49:25.183394 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-e580c9db-57e7-4d59-b515-3873f148cae9 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] 10.222.0.48 "DELETE /compute/v2.1/servers/1687c703-69ae-4187-bc39-16c2eca96d87" status: 204 len: 0 microversion: 2.1 time: 0.153663 Jun 17 15:49:25.184636 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1965/3515] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jun 17 15:49:25 2022] DELETE /compute/v2.1/servers/1687c703-69ae-4187-bc39-16c2eca96d87 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 15:49:25.193526 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-e74a38a4-2059-4864-a16b-b5ecddcfff4b tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:49:25.194190 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-e74a38a4-2059-4864-a16b-b5ecddcfff4b tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] [instance: 1687c703-69ae-4187-bc39-16c2eca96d87] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:49:25.201048 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e74a38a4-2059-4864-a16b-b5ecddcfff4b tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:49:25.201499 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e74a38a4-2059-4864-a16b-b5ecddcfff4b tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:49:25.202289 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e74a38a4-2059-4864-a16b-b5ecddcfff4b tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:49:25.202727 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-e74a38a4-2059-4864-a16b-b5ecddcfff4b tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:49:25.361662 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-e74a38a4-2059-4864-a16b-b5ecddcfff4b tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab3130962a6456bbbcb1c96aba3506d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79efe2b5db31498c81c59b086e5c6f84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:49:25.371264 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-e74a38a4-2059-4864-a16b-b5ecddcfff4b tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] 10.222.0.48 "GET /compute/v2.1/servers/1687c703-69ae-4187-bc39-16c2eca96d87" status: 200 len: 1679 microversion: 2.1 time: 0.182039 Jun 17 15:49:25.371893 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1551/3516] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:49:25 2022] GET /compute/v2.1/servers/1687c703-69ae-4187-bc39-16c2eca96d87 => generated 1679 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:49:26.393583 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-120110f3-77eb-4dda-8e0b-64cfbb5e0bc1 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:49:26.394342 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-120110f3-77eb-4dda-8e0b-64cfbb5e0bc1 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] [instance: 1687c703-69ae-4187-bc39-16c2eca96d87] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:49:26.405348 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-120110f3-77eb-4dda-8e0b-64cfbb5e0bc1 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:49:26.405977 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-120110f3-77eb-4dda-8e0b-64cfbb5e0bc1 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:49:26.407380 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-120110f3-77eb-4dda-8e0b-64cfbb5e0bc1 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:49:26.408172 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-120110f3-77eb-4dda-8e0b-64cfbb5e0bc1 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:49:26.602717 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-120110f3-77eb-4dda-8e0b-64cfbb5e0bc1 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab3130962a6456bbbcb1c96aba3506d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79efe2b5db31498c81c59b086e5c6f84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:49:26.610816 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-120110f3-77eb-4dda-8e0b-64cfbb5e0bc1 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] 10.222.0.48 "GET /compute/v2.1/servers/1687c703-69ae-4187-bc39-16c2eca96d87" status: 200 len: 1679 microversion: 2.1 time: 0.221880 Jun 17 15:49:26.611398 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1966/3517] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:49:26 2022] GET /compute/v2.1/servers/1687c703-69ae-4187-bc39-16c2eca96d87 => generated 1679 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:49:27.628289 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-7b758996-cc80-4380-a15e-bc08753ba37f tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:49:27.628929 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-7b758996-cc80-4380-a15e-bc08753ba37f tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] [instance: 1687c703-69ae-4187-bc39-16c2eca96d87] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:49:27.635837 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7b758996-cc80-4380-a15e-bc08753ba37f tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:49:27.636280 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7b758996-cc80-4380-a15e-bc08753ba37f tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:49:27.637214 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7b758996-cc80-4380-a15e-bc08753ba37f tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:49:27.637651 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7b758996-cc80-4380-a15e-bc08753ba37f tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:49:27.712197 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-7b758996-cc80-4380-a15e-bc08753ba37f tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab3130962a6456bbbcb1c96aba3506d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79efe2b5db31498c81c59b086e5c6f84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:49:27.721660 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-7b758996-cc80-4380-a15e-bc08753ba37f tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] 10.222.0.48 "GET /compute/v2.1/servers/1687c703-69ae-4187-bc39-16c2eca96d87" status: 200 len: 1612 microversion: 2.1 time: 0.097175 Jun 17 15:49:27.722553 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1552/3518] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:49:27 2022] GET /compute/v2.1/servers/1687c703-69ae-4187-bc39-16c2eca96d87 => generated 1612 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:49:27.895633 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [req-e4aba77e-dfbb-4bdc-86e9-b06dd18803e6 req-1d7903db-5d53-4db5-8887-7439a4c82202 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1687c703-69ae-4187-bc39-16c2eca96d87", "name": "network-vif-deleted", "tag": "06f6ae3c-94cf-43a6-99c3-ecfe423ec99d"}]} {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:49:27.906712 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [req-e4aba77e-dfbb-4bdc-86e9-b06dd18803e6 req-1d7903db-5d53-4db5-8887-7439a4c82202 service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:49:27.907161 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [req-e4aba77e-dfbb-4bdc-86e9-b06dd18803e6 req-1d7903db-5d53-4db5-8887-7439a4c82202 service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:49:27.919799 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.compute.server_external_events [req-e4aba77e-dfbb-4bdc-86e9-b06dd18803e6 req-1d7903db-5d53-4db5-8887-7439a4c82202 service nova] Creating event network-vif-deleted:06f6ae3c-94cf-43a6-99c3-ecfe423ec99d for instance 1687c703-69ae-4187-bc39-16c2eca96d87 on hv-cinder-82549 Jun 17 15:49:27.927050 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [req-e4aba77e-dfbb-4bdc-86e9-b06dd18803e6 req-1d7903db-5d53-4db5-8887-7439a4c82202 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037055 Jun 17 15:49:27.927929 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1967/3519] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 15:49:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:49:28.746195 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-8dd58a16-3dd2-442c-aa4f-71bbe06f1821 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:49:28.747509 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-8dd58a16-3dd2-442c-aa4f-71bbe06f1821 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] [instance: 1687c703-69ae-4187-bc39-16c2eca96d87] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:49:28.754682 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8dd58a16-3dd2-442c-aa4f-71bbe06f1821 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:49:28.755208 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8dd58a16-3dd2-442c-aa4f-71bbe06f1821 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:49:28.756085 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8dd58a16-3dd2-442c-aa4f-71bbe06f1821 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:49:28.756628 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8dd58a16-3dd2-442c-aa4f-71bbe06f1821 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:49:28.773468 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.wsgi [None req-8dd58a16-3dd2-442c-aa4f-71bbe06f1821 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] HTTP exception thrown: Instance 1687c703-69ae-4187-bc39-16c2eca96d87 could not be found. Jun 17 15:49:28.775042 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-8dd58a16-3dd2-442c-aa4f-71bbe06f1821 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Request method failure captured: Jun 17 15:49:28.775042 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: request: GET /compute/v2.1/servers/1687c703-69ae-4187-bc39-16c2eca96d87 HTTP/1.1 Jun 17 15:49:28.775042 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Accept: application/json Jun 17 15:49:28.775042 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Accept-Encoding: identity Jun 17 15:49:28.775042 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Connection: close Jun 17 15:49:28.775042 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Content-Length: 0 Jun 17 15:49:28.775042 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Content-Type: application/json Jun 17 15:49:28.775042 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Host: 10.222.0.48 Jun 17 15:49:28.775042 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Openstack-System-Scope: None Jun 17 15:49:28.775042 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: User-Agent: python-urllib3/1.26.9 Jun 17 15:49:28.775042 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Auth-Token: gAAAAABirKICwWnhD993Jl4IhDGE-QonLGXk8DgdDZd8k6DQ9ib1E3iCeZvkPKJ1yooc16OipcuLAmHVKfeflaAMN8pddeU0L_b0r5jZEMoMoQRDnLv1aSXXTkcHo205L-oyOwE_Oe-bVu0FH4Pz82Sgm44hDcOVXCq7XBTJwNam2wPPozTvXCI Jun 17 15:49:28.775042 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Domain-Id: None Jun 17 15:49:28.775042 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Domain-Name: None Jun 17 15:49:28.775042 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Identity-Status: Confirmed Jun 17 15:49:28.775042 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Is-Admin-Project: True Jun 17 15:49:28.775042 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Domain-Id: default Jun 17 15:49:28.775042 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Domain-Name: Default Jun 17 15:49:28.775042 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Id: 79efe2b5db31498c81c59b086e5c6f84 Jun 17 15:49:28.775042 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Name: tempest-AttachVolumeNegativeTest-957597123 Jun 17 15:49:28.775042 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Role: reader,member Jun 17 15:49:28.775042 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Roles: reader,member Jun 17 15:49:28.781323 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_79efe2b5db31498c81c59b086e5c6f84", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/79efe2b5db31498c81c59b086e5c6f84"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/79efe2b5db31498c81c59b086e5c6f84"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/79efe2b5db31498c81c59b086e5c6f84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Jun 17 15:49:28.781323 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant: tempest-AttachVolumeNegativeTest-957597123 Jun 17 15:49:28.781323 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant-Id: 79efe2b5db31498c81c59b086e5c6f84 Jun 17 15:49:28.781323 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-957597123 Jun 17 15:49:28.781323 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User: tempest-AttachVolumeNegativeTest-957597123-project Jun 17 15:49:28.781323 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Domain-Id: default Jun 17 15:49:28.781323 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Domain-Name: Default Jun 17 15:49:28.781323 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Id: 8ab3130962a6456bbbcb1c96aba3506d Jun 17 15:49:28.781323 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Name: tempest-AttachVolumeNegativeTest-957597123-project Jun 17 15:49:28.781323 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: method: > Jun 17 15:49:28.781323 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: exception: Instance 1687c703-69ae-4187-bc39-16c2eca96d87 could not be found. Jun 17 15:49:28.781323 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: action_args: {'id': '1687c703-69ae-4187-bc39-16c2eca96d87'} Jun 17 15:49:28.782405 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 15:49:28.782405 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:49:28.782405 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 15:49:28.782405 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 15:49:28.782405 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 15:49:28.782405 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 15:49:28.782405 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 15:49:28.782405 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 15:49:28.782405 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 15:49:28.782405 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 15:49:28.782405 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1687c703-69ae-4187-bc39-16c2eca96d87 could not be found. Jun 17 15:49:28.782405 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:49:28.782405 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:49:28.782405 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:49:28.782405 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:49:28.782405 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:49:28.782405 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:49:28.782405 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 15:49:28.782405 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 15:49:28.782405 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 15:49:28.785791 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 15:49:28.785791 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 15:49:28.785791 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 15:49:28.785791 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 15:49:28.785791 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 15:49:28.785791 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 15:49:28.785791 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 15:49:28.785791 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1687c703-69ae-4187-bc39-16c2eca96d87 could not be found. Jun 17 15:49:28.785791 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:49:28.785791 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:49:28.785791 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:49:28.785791 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:49:28.785791 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:49:28.785791 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:49:28.785791 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 15:49:28.785791 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 15:49:28.785791 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1687c703-69ae-4187-bc39-16c2eca96d87 could not be found. Jun 17 15:49:28.785791 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:49:28.788161 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-8dd58a16-3dd2-442c-aa4f-71bbe06f1821 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Returning 404 to user: Instance 1687c703-69ae-4187-bc39-16c2eca96d87 could not be found. {{(pid=117649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 15:49:28.788161 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-8dd58a16-3dd2-442c-aa4f-71bbe06f1821 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] 10.222.0.48 "GET /compute/v2.1/servers/1687c703-69ae-4187-bc39-16c2eca96d87" status: 404 len: 111 microversion: 2.1 time: 0.036869 Jun 17 15:49:28.788161 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1553/3520] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:49:28 2022] GET /compute/v2.1/servers/1687c703-69ae-4187-bc39-16c2eca96d87 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 15:49:28.790808 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-228d4685-e2da-4284-bffb-1d7e4292d5e8 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Calling method '.version_select at 0x7faf50327790>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:49:28.821804 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-228d4685-e2da-4284-bffb-1d7e4292d5e8 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-373040118" status: 202 len: 0 microversion: 2.1 time: 0.039539 Jun 17 15:49:28.823298 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1968/3521] 10.222.0.48 () {58 vars in 1217 bytes} [Fri Jun 17 15:49:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-373040118 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 15:49:29.645291 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-ec3f8b07-cc8a-4c39-b338-265af5d3415a tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:49:29.645790 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-ec3f8b07-cc8a-4c39-b338-265af5d3415a tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] [instance: e4173cb9-999f-41f4-ade9-b521fc218a2b] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:49:29.652960 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ec3f8b07-cc8a-4c39-b338-265af5d3415a tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:49:29.653421 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ec3f8b07-cc8a-4c39-b338-265af5d3415a tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:49:29.654190 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ec3f8b07-cc8a-4c39-b338-265af5d3415a tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:49:29.654622 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ec3f8b07-cc8a-4c39-b338-265af5d3415a tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:49:29.744217 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.objects.instance [None req-ec3f8b07-cc8a-4c39-b338-265af5d3415a tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lazy-loading 'services' on Instance uuid e4173cb9-999f-41f4-ade9-b521fc218a2b {{(pid=117649) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 15:49:29.822811 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-ec3f8b07-cc8a-4c39-b338-265af5d3415a tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] 10.222.0.48 "DELETE /compute/v2.1/servers/e4173cb9-999f-41f4-ade9-b521fc218a2b/os-volume_attachments/aeef2dd7-c9da-4155-9117-f0eb7109a0b9" status: 202 len: 0 microversion: 2.1 time: 0.181351 Jun 17 15:49:29.823771 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1554/3522] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Jun 17 15:49:29 2022] DELETE /compute/v2.1/servers/e4173cb9-999f-41f4-ade9-b521fc218a2b/os-volume_attachments/aeef2dd7-c9da-4155-9117-f0eb7109a0b9 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 15:49:29.834903 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-059d914a-a66d-4eb6-81ef-c562daf23907 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:49:29.835983 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-059d914a-a66d-4eb6-81ef-c562daf23907 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] [instance: e4173cb9-999f-41f4-ade9-b521fc218a2b] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:49:29.843995 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-059d914a-a66d-4eb6-81ef-c562daf23907 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:49:29.845295 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-059d914a-a66d-4eb6-81ef-c562daf23907 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:49:29.846097 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-059d914a-a66d-4eb6-81ef-c562daf23907 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:49:29.846574 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-059d914a-a66d-4eb6-81ef-c562daf23907 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:49:29.881049 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-059d914a-a66d-4eb6-81ef-c562daf23907 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] 10.222.0.48 "GET /compute/v2.1/servers/e4173cb9-999f-41f4-ade9-b521fc218a2b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051601 Jun 17 15:49:29.881628 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1969/3523] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:49:29 2022] GET /compute/v2.1/servers/e4173cb9-999f-41f4-ade9-b521fc218a2b/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:49:30.894691 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-1c59a4ed-f3c7-45d5-8343-645a47ea5778 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:49:30.895773 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-1c59a4ed-f3c7-45d5-8343-645a47ea5778 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] [instance: e4173cb9-999f-41f4-ade9-b521fc218a2b] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:49:30.902129 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1c59a4ed-f3c7-45d5-8343-645a47ea5778 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:49:30.902576 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1c59a4ed-f3c7-45d5-8343-645a47ea5778 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:49:30.903340 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1c59a4ed-f3c7-45d5-8343-645a47ea5778 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:49:30.903770 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1c59a4ed-f3c7-45d5-8343-645a47ea5778 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:49:30.933483 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-1c59a4ed-f3c7-45d5-8343-645a47ea5778 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] 10.222.0.48 "GET /compute/v2.1/servers/e4173cb9-999f-41f4-ade9-b521fc218a2b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043575 Jun 17 15:49:30.934675 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1555/3524] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:49:30 2022] GET /compute/v2.1/servers/e4173cb9-999f-41f4-ade9-b521fc218a2b/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 17 15:49:30.992945 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-a06a1ad3-5e42-42e2-9cb5-b69df47cf617 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:49:30.993551 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-a06a1ad3-5e42-42e2-9cb5-b69df47cf617 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] [instance: e4173cb9-999f-41f4-ade9-b521fc218a2b] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:49:31.000670 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a06a1ad3-5e42-42e2-9cb5-b69df47cf617 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:49:31.001118 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a06a1ad3-5e42-42e2-9cb5-b69df47cf617 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:49:31.001886 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a06a1ad3-5e42-42e2-9cb5-b69df47cf617 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:49:31.002321 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a06a1ad3-5e42-42e2-9cb5-b69df47cf617 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:49:31.028288 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-a06a1ad3-5e42-42e2-9cb5-b69df47cf617 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] [instance: e4173cb9-999f-41f4-ade9-b521fc218a2b] Going to try to terminate instance {{(pid=117650) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 15:49:31.107683 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-a06a1ad3-5e42-42e2-9cb5-b69df47cf617 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] 10.222.0.48 "DELETE /compute/v2.1/servers/e4173cb9-999f-41f4-ade9-b521fc218a2b" status: 204 len: 0 microversion: 2.1 time: 0.118327 Jun 17 15:49:31.108294 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1970/3525] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jun 17 15:49:30 2022] DELETE /compute/v2.1/servers/e4173cb9-999f-41f4-ade9-b521fc218a2b => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 15:49:31.116908 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-7b9334f2-db58-45cb-8c05-7a94301557a2 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:49:31.117606 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-7b9334f2-db58-45cb-8c05-7a94301557a2 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] [instance: e4173cb9-999f-41f4-ade9-b521fc218a2b] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:49:31.124428 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7b9334f2-db58-45cb-8c05-7a94301557a2 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:49:31.124885 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7b9334f2-db58-45cb-8c05-7a94301557a2 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:49:31.125689 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7b9334f2-db58-45cb-8c05-7a94301557a2 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:49:31.126163 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-7b9334f2-db58-45cb-8c05-7a94301557a2 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:49:31.283541 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-7b9334f2-db58-45cb-8c05-7a94301557a2 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab3130962a6456bbbcb1c96aba3506d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79efe2b5db31498c81c59b086e5c6f84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:49:31.291751 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-7b9334f2-db58-45cb-8c05-7a94301557a2 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] 10.222.0.48 "GET /compute/v2.1/servers/e4173cb9-999f-41f4-ade9-b521fc218a2b" status: 200 len: 1682 microversion: 2.1 time: 0.179003 Jun 17 15:49:31.292384 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1556/3526] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:49:31 2022] GET /compute/v2.1/servers/e4173cb9-999f-41f4-ade9-b521fc218a2b => generated 1682 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:49:32.310837 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-b5218363-bc28-4a87-9c8c-739950a50ac8 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:49:32.311428 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-b5218363-bc28-4a87-9c8c-739950a50ac8 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] [instance: e4173cb9-999f-41f4-ade9-b521fc218a2b] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:49:32.318332 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b5218363-bc28-4a87-9c8c-739950a50ac8 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:49:32.318776 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b5218363-bc28-4a87-9c8c-739950a50ac8 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:49:32.319532 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b5218363-bc28-4a87-9c8c-739950a50ac8 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:49:32.319960 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b5218363-bc28-4a87-9c8c-739950a50ac8 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:49:32.454690 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-b5218363-bc28-4a87-9c8c-739950a50ac8 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab3130962a6456bbbcb1c96aba3506d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79efe2b5db31498c81c59b086e5c6f84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:49:32.462285 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-b5218363-bc28-4a87-9c8c-739950a50ac8 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] 10.222.0.48 "GET /compute/v2.1/servers/e4173cb9-999f-41f4-ade9-b521fc218a2b" status: 200 len: 1682 microversion: 2.1 time: 0.156554 Jun 17 15:49:32.462851 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1971/3527] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:49:32 2022] GET /compute/v2.1/servers/e4173cb9-999f-41f4-ade9-b521fc218a2b => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:49:33.480386 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-98d82801-f7c3-43db-983b-1a7e2b8411a1 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:49:33.481237 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-98d82801-f7c3-43db-983b-1a7e2b8411a1 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] [instance: e4173cb9-999f-41f4-ade9-b521fc218a2b] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:49:33.487711 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-98d82801-f7c3-43db-983b-1a7e2b8411a1 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:49:33.488155 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-98d82801-f7c3-43db-983b-1a7e2b8411a1 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:49:33.488944 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-98d82801-f7c3-43db-983b-1a7e2b8411a1 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:49:33.489374 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-98d82801-f7c3-43db-983b-1a7e2b8411a1 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:49:33.686244 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-98d82801-f7c3-43db-983b-1a7e2b8411a1 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab3130962a6456bbbcb1c96aba3506d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79efe2b5db31498c81c59b086e5c6f84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:49:33.702843 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-98d82801-f7c3-43db-983b-1a7e2b8411a1 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] 10.222.0.48 "GET /compute/v2.1/servers/e4173cb9-999f-41f4-ade9-b521fc218a2b" status: 200 len: 1682 microversion: 2.1 time: 0.227047 Jun 17 15:49:33.704351 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1557/3528] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:49:33 2022] GET /compute/v2.1/servers/e4173cb9-999f-41f4-ade9-b521fc218a2b => generated 1682 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:49:33.991127 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [req-392012fd-fea2-4f80-8744-92c302c69e40 req-4056f489-2618-46b7-8b9b-fda22afac13f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4173cb9-999f-41f4-ade9-b521fc218a2b", "name": "network-vif-deleted", "tag": "43096010-9b78-424f-89a3-0da3cacf6d65"}]} {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:49:34.002550 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [req-392012fd-fea2-4f80-8744-92c302c69e40 req-4056f489-2618-46b7-8b9b-fda22afac13f service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:49:34.002998 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [req-392012fd-fea2-4f80-8744-92c302c69e40 req-4056f489-2618-46b7-8b9b-fda22afac13f service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:49:34.018060 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.compute.server_external_events [req-392012fd-fea2-4f80-8744-92c302c69e40 req-4056f489-2618-46b7-8b9b-fda22afac13f service nova] Creating event network-vif-deleted:43096010-9b78-424f-89a3-0da3cacf6d65 for instance e4173cb9-999f-41f4-ade9-b521fc218a2b on hv-cinder-82549 Jun 17 15:49:34.024258 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [req-392012fd-fea2-4f80-8744-92c302c69e40 req-4056f489-2618-46b7-8b9b-fda22afac13f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037958 Jun 17 15:49:34.024919 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1972/3529] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 15:49:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:49:34.723249 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-0884dd65-c7c0-41ab-a3ac-f1d2c2ed9b3f tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:49:34.723947 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-0884dd65-c7c0-41ab-a3ac-f1d2c2ed9b3f tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] [instance: e4173cb9-999f-41f4-ade9-b521fc218a2b] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:49:34.731409 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0884dd65-c7c0-41ab-a3ac-f1d2c2ed9b3f tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:49:34.731842 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0884dd65-c7c0-41ab-a3ac-f1d2c2ed9b3f tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:49:34.732994 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0884dd65-c7c0-41ab-a3ac-f1d2c2ed9b3f tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:49:34.733127 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0884dd65-c7c0-41ab-a3ac-f1d2c2ed9b3f tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:49:34.746904 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.wsgi [None req-0884dd65-c7c0-41ab-a3ac-f1d2c2ed9b3f tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] HTTP exception thrown: Instance e4173cb9-999f-41f4-ade9-b521fc218a2b could not be found. Jun 17 15:49:34.748611 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-0884dd65-c7c0-41ab-a3ac-f1d2c2ed9b3f tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Request method failure captured: Jun 17 15:49:34.748611 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: request: GET /compute/v2.1/servers/e4173cb9-999f-41f4-ade9-b521fc218a2b HTTP/1.1 Jun 17 15:49:34.748611 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Accept: application/json Jun 17 15:49:34.748611 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Accept-Encoding: identity Jun 17 15:49:34.748611 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Connection: close Jun 17 15:49:34.748611 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Content-Length: 0 Jun 17 15:49:34.748611 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Content-Type: application/json Jun 17 15:49:34.748611 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Host: 10.222.0.48 Jun 17 15:49:34.748611 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Openstack-System-Scope: None Jun 17 15:49:34.748611 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: User-Agent: python-urllib3/1.26.9 Jun 17 15:49:34.748611 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Auth-Token: gAAAAABirKICwWnhD993Jl4IhDGE-QonLGXk8DgdDZd8k6DQ9ib1E3iCeZvkPKJ1yooc16OipcuLAmHVKfeflaAMN8pddeU0L_b0r5jZEMoMoQRDnLv1aSXXTkcHo205L-oyOwE_Oe-bVu0FH4Pz82Sgm44hDcOVXCq7XBTJwNam2wPPozTvXCI Jun 17 15:49:34.748611 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Domain-Id: None Jun 17 15:49:34.748611 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Domain-Name: None Jun 17 15:49:34.748611 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Identity-Status: Confirmed Jun 17 15:49:34.748611 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Is-Admin-Project: True Jun 17 15:49:34.748611 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Domain-Id: default Jun 17 15:49:34.748611 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Domain-Name: Default Jun 17 15:49:34.748611 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Id: 79efe2b5db31498c81c59b086e5c6f84 Jun 17 15:49:34.748611 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Name: tempest-AttachVolumeNegativeTest-957597123 Jun 17 15:49:34.748611 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Role: reader,member Jun 17 15:49:34.748611 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Roles: reader,member Jun 17 15:49:34.750533 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_79efe2b5db31498c81c59b086e5c6f84", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/79efe2b5db31498c81c59b086e5c6f84"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/79efe2b5db31498c81c59b086e5c6f84"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/79efe2b5db31498c81c59b086e5c6f84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Jun 17 15:49:34.750533 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant: tempest-AttachVolumeNegativeTest-957597123 Jun 17 15:49:34.750533 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant-Id: 79efe2b5db31498c81c59b086e5c6f84 Jun 17 15:49:34.750533 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-957597123 Jun 17 15:49:34.750533 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User: tempest-AttachVolumeNegativeTest-957597123-project Jun 17 15:49:34.750533 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Domain-Id: default Jun 17 15:49:34.750533 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Domain-Name: Default Jun 17 15:49:34.750533 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Id: 8ab3130962a6456bbbcb1c96aba3506d Jun 17 15:49:34.750533 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Name: tempest-AttachVolumeNegativeTest-957597123-project Jun 17 15:49:34.750533 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: method: > Jun 17 15:49:34.750533 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: exception: Instance e4173cb9-999f-41f4-ade9-b521fc218a2b could not be found. Jun 17 15:49:34.750533 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: action_args: {'id': 'e4173cb9-999f-41f4-ade9-b521fc218a2b'} Jun 17 15:49:34.751546 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 15:49:34.751546 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:49:34.751546 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 15:49:34.751546 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 15:49:34.751546 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 15:49:34.751546 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 15:49:34.751546 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 15:49:34.751546 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 15:49:34.751546 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 15:49:34.751546 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 15:49:34.751546 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4173cb9-999f-41f4-ade9-b521fc218a2b could not be found. Jun 17 15:49:34.751546 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:49:34.751546 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:49:34.751546 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:49:34.751546 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:49:34.751546 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:49:34.751546 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:49:34.751546 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 15:49:34.751546 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 15:49:34.751546 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 15:49:34.753294 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 15:49:34.753294 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 15:49:34.753294 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 15:49:34.753294 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 15:49:34.753294 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 15:49:34.753294 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 15:49:34.753294 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 15:49:34.753294 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4173cb9-999f-41f4-ade9-b521fc218a2b could not be found. Jun 17 15:49:34.753294 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:49:34.753294 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:49:34.753294 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:49:34.753294 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:49:34.753294 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:49:34.753294 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:49:34.753294 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 15:49:34.753294 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 15:49:34.753294 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4173cb9-999f-41f4-ade9-b521fc218a2b could not be found. Jun 17 15:49:34.753294 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:49:34.755014 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-0884dd65-c7c0-41ab-a3ac-f1d2c2ed9b3f tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Returning 404 to user: Instance e4173cb9-999f-41f4-ade9-b521fc218a2b could not be found. {{(pid=117649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 15:49:34.755014 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-0884dd65-c7c0-41ab-a3ac-f1d2c2ed9b3f tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] 10.222.0.48 "GET /compute/v2.1/servers/e4173cb9-999f-41f4-ade9-b521fc218a2b" status: 404 len: 111 microversion: 2.1 time: 0.030771 Jun 17 15:49:34.755014 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1558/3530] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:49:34 2022] GET /compute/v2.1/servers/e4173cb9-999f-41f4-ade9-b521fc218a2b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 17 15:49:34.760854 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-f766201f-fe4c-46df-806c-013a08a7233c tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Calling method '.version_select at 0x7faf5019daf0>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:49:34.785209 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-f766201f-fe4c-46df-806c-013a08a7233c tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-980914522" status: 202 len: 0 microversion: 2.1 time: 0.028476 Jun 17 15:49:34.785795 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1973/3531] 10.222.0.48 () {58 vars in 1217 bytes} [Fri Jun 17 15:49:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-980914522 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 15:49:35.471711 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-394a7df5-115b-4dea-b566-57c2bdc72049 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Action: 'create', calling method: .version_select at 0x7faf54c65e50>, body: {"keypair": {"name": "tempest-keypair-834307557", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBCexF6H+sM2EyDjVJTmco4wnSQiwc5+AGN0cg7ZtceWZZ+8NEx0sGqnfMRS2M/Q1HETeqanikvX4nO1Apnkz4I1oMxYZp5UAWZFnmJ9UqrgjCYp6nRggGk5zODVfpVPeQ=="}} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:49:35.486735 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.quota [None req-394a7df5-115b-4dea-b566-57c2bdc72049 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Getting quotas for project 79efe2b5db31498c81c59b086e5c6f84. Resources: {'key_pairs'} {{(pid=117649) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 15:49:35.490535 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.quota [None req-394a7df5-115b-4dea-b566-57c2bdc72049 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Getting quotas for user 8ab3130962a6456bbbcb1c96aba3506d and project 79efe2b5db31498c81c59b086e5c6f84. Resources: {'key_pairs'} {{(pid=117649) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 15:49:35.512393 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-394a7df5-115b-4dea-b566-57c2bdc72049 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.044427 Jun 17 15:49:35.512980 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1559/3532] 10.222.0.48 () {60 vars in 1158 bytes} [Fri Jun 17 15:49:35 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:49:36.765849 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-5b679af6-4084-4064-9b21-a82be25cea5f tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-524323233", "imageRef": "8c105ca4-6fe3-4e70-af71-b03c64fe1efe", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "288b7261-f0bd-4510-ab2e-0de2bc8999e0"}], "security_groups": [{"name": "tempest-securitygroup--1413705015"}], "key_name": "tempest-keypair-834307557", "user_data": "}} {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:49:36.872743 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.network.neutron [None req-5b679af6-4084-4064-9b21-a82be25cea5f tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] validate_networks() for [('288b7261-f0bd-4510-ab2e-0de2bc8999e0', None, None, None, None, None)] {{(pid=117650) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 15:49:37.002047 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-5f7d495e-6b58-487b-810c-ba7ec383c3cd tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:49:37.002644 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-5f7d495e-6b58-487b-810c-ba7ec383c3cd tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] [instance: fd8af8c4-d147-4335-90c9-81fe1da1297f] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:49:37.008616 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5f7d495e-6b58-487b-810c-ba7ec383c3cd tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:49:37.009061 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5f7d495e-6b58-487b-810c-ba7ec383c3cd tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:49:37.009816 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5f7d495e-6b58-487b-810c-ba7ec383c3cd tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:49:37.010245 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5f7d495e-6b58-487b-810c-ba7ec383c3cd tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:49:37.034595 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-5f7d495e-6b58-487b-810c-ba7ec383c3cd tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] 10.222.0.48 "GET /compute/v2.1/servers/fd8af8c4-d147-4335-90c9-81fe1da1297f/ips" status: 200 len: 147 microversion: 2.1 time: 0.036802 Jun 17 15:49:37.035145 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1560/3533] 10.222.0.48 () {58 vars in 1247 bytes} [Fri Jun 17 15:49:36 2022] GET /compute/v2.1/servers/fd8af8c4-d147-4335-90c9-81fe1da1297f/ips => generated 147 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:49:37.255327 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.virt.hardware [None req-5b679af6-4084-4064-9b21-a82be25cea5f tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Flavor limits 0:0:0 {{(pid=117650) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 15:49:37.255757 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.virt.hardware [None req-5b679af6-4084-4064-9b21-a82be25cea5f tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Image limits 0:0:0 {{(pid=117650) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 15:49:37.256226 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.virt.hardware [None req-5b679af6-4084-4064-9b21-a82be25cea5f tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Flavor pref 0:0:0 {{(pid=117650) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 15:49:37.256678 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.virt.hardware [None req-5b679af6-4084-4064-9b21-a82be25cea5f tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Image pref 0:0:0 {{(pid=117650) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 15:49:37.257086 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.virt.hardware [None req-5b679af6-4084-4064-9b21-a82be25cea5f tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117650) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 15:49:37.266431 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5b679af6-4084-4064-9b21-a82be25cea5f tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:49:37.266867 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5b679af6-4084-4064-9b21-a82be25cea5f tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:49:37.267646 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5b679af6-4084-4064-9b21-a82be25cea5f tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:49:37.268073 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5b679af6-4084-4064-9b21-a82be25cea5f tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:49:37.285141 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.quota [None req-5b679af6-4084-4064-9b21-a82be25cea5f tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Getting quotas for project 79efe2b5db31498c81c59b086e5c6f84. Resources: {'cores', 'ram', 'instances'} {{(pid=117650) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 15:49:37.289058 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.quota [None req-5b679af6-4084-4064-9b21-a82be25cea5f tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Getting quotas for user 8ab3130962a6456bbbcb1c96aba3506d and project 79efe2b5db31498c81c59b086e5c6f84. Resources: {'cores', 'ram', 'instances'} {{(pid=117650) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 15:49:37.300406 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-5b679af6-4084-4064-9b21-a82be25cea5f tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Going to run 1 instances... {{(pid=117650) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 15:49:37.302672 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-5b679af6-4084-4064-9b21-a82be25cea5f tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] [instance: 390b2d03-4e54-44c3-91db-08c6eed28adb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c105ca4-6fe3-4e70-af71-b03c64fe1efe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117650) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 15:49:37.346979 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-5b679af6-4084-4064-9b21-a82be25cea5f tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.586785 Jun 17 15:49:37.347846 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1974/3534] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Jun 17 15:49:36 2022] POST /compute/v2.1/servers => generated 402 bytes in 588 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 15:49:37.359522 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-a675510b-1bf9-45b8-a59f-f5a4e3e394ee tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:49:37.360171 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-a675510b-1bf9-45b8-a59f-f5a4e3e394ee tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] [instance: 390b2d03-4e54-44c3-91db-08c6eed28adb] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:49:37.414766 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-a675510b-1bf9-45b8-a59f-f5a4e3e394ee tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab3130962a6456bbbcb1c96aba3506d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79efe2b5db31498c81c59b086e5c6f84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:49:37.422416 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-a675510b-1bf9-45b8-a59f-f5a4e3e394ee tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] 10.222.0.48 "GET /compute/v2.1/servers/390b2d03-4e54-44c3-91db-08c6eed28adb" status: 200 len: 1240 microversion: 2.1 time: 0.068394 Jun 17 15:49:37.423085 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1561/3535] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:49:37 2022] GET /compute/v2.1/servers/390b2d03-4e54-44c3-91db-08c6eed28adb => generated 1240 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:49:38.443094 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-93cc9de4-90d1-4c20-bc3c-810b24892947 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:49:38.443815 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-93cc9de4-90d1-4c20-bc3c-810b24892947 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] [instance: 390b2d03-4e54-44c3-91db-08c6eed28adb] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:49:38.451856 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-93cc9de4-90d1-4c20-bc3c-810b24892947 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:49:38.452618 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-93cc9de4-90d1-4c20-bc3c-810b24892947 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:49:38.453392 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-93cc9de4-90d1-4c20-bc3c-810b24892947 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:49:38.453823 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-93cc9de4-90d1-4c20-bc3c-810b24892947 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:49:38.521508 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-93cc9de4-90d1-4c20-bc3c-810b24892947 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab3130962a6456bbbcb1c96aba3506d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79efe2b5db31498c81c59b086e5c6f84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:49:38.530246 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-93cc9de4-90d1-4c20-bc3c-810b24892947 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] 10.222.0.48 "GET /compute/v2.1/servers/390b2d03-4e54-44c3-91db-08c6eed28adb" status: 200 len: 1310 microversion: 2.1 time: 0.094404 Jun 17 15:49:38.540153 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1975/3536] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:49:38 2022] GET /compute/v2.1/servers/390b2d03-4e54-44c3-91db-08c6eed28adb => generated 1310 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:49:39.452019 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-84818787-e775-4d79-a478-cd9dc61d0dee tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "be3e15ad-59cc-4a90-ac9d-a707c1952aaa"}} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:49:39.453169 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-84818787-e775-4d79-a478-cd9dc61d0dee tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] [instance: fd8af8c4-d147-4335-90c9-81fe1da1297f] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:49:39.460377 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-84818787-e775-4d79-a478-cd9dc61d0dee tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:49:39.461101 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-84818787-e775-4d79-a478-cd9dc61d0dee tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:49:39.462099 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-84818787-e775-4d79-a478-cd9dc61d0dee tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:49:39.462532 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-84818787-e775-4d79-a478-cd9dc61d0dee tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:49:39.548006 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-62d75346-00e3-406c-b0e3-f2a6bf276789 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:49:39.548901 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-62d75346-00e3-406c-b0e3-f2a6bf276789 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] [instance: 390b2d03-4e54-44c3-91db-08c6eed28adb] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:49:39.556802 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-62d75346-00e3-406c-b0e3-f2a6bf276789 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:49:39.559952 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-62d75346-00e3-406c-b0e3-f2a6bf276789 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:49:39.560917 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-62d75346-00e3-406c-b0e3-f2a6bf276789 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:49:39.561444 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-62d75346-00e3-406c-b0e3-f2a6bf276789 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:49:39.722780 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-62d75346-00e3-406c-b0e3-f2a6bf276789 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab3130962a6456bbbcb1c96aba3506d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79efe2b5db31498c81c59b086e5c6f84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:49:39.731437 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-62d75346-00e3-406c-b0e3-f2a6bf276789 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] 10.222.0.48 "GET /compute/v2.1/servers/390b2d03-4e54-44c3-91db-08c6eed28adb" status: 200 len: 1366 microversion: 2.1 time: 0.187434 Jun 17 15:49:39.732001 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1976/3537] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:49:39 2022] GET /compute/v2.1/servers/390b2d03-4e54-44c3-91db-08c6eed28adb => generated 1366 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:49:39.748712 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-84818787-e775-4d79-a478-cd9dc61d0dee tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] 10.222.0.48 "POST /compute/v2.1/servers/fd8af8c4-d147-4335-90c9-81fe1da1297f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.300564 Jun 17 15:49:39.749337 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1562/3538] 10.222.0.48 () {60 vars in 1322 bytes} [Fri Jun 17 15:49:39 2022] POST /compute/v2.1/servers/fd8af8c4-d147-4335-90c9-81fe1da1297f/os-volume_attachments => generated 194 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:49:40.097070 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [req-4902c4d6-42c2-4708-ab7e-5f9803557631 req-ce6c7904-5ad2-4fd2-a686-8b2b173dedf1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "390b2d03-4e54-44c3-91db-08c6eed28adb", "tag": "4b7d847d-258d-49e0-854f-733e710260d5"}]} {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:49:40.125040 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [req-4902c4d6-42c2-4708-ab7e-5f9803557631 req-ce6c7904-5ad2-4fd2-a686-8b2b173dedf1 service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:49:40.126319 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [req-4902c4d6-42c2-4708-ab7e-5f9803557631 req-ce6c7904-5ad2-4fd2-a686-8b2b173dedf1 service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:49:40.154543 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.compute.server_external_events [req-4902c4d6-42c2-4708-ab7e-5f9803557631 req-ce6c7904-5ad2-4fd2-a686-8b2b173dedf1 service nova] Creating event network-changed:4b7d847d-258d-49e0-854f-733e710260d5 for instance 390b2d03-4e54-44c3-91db-08c6eed28adb on hv-cinder-82549 Jun 17 15:49:40.160289 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [req-4902c4d6-42c2-4708-ab7e-5f9803557631 req-ce6c7904-5ad2-4fd2-a686-8b2b173dedf1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076154 Jun 17 15:49:40.161474 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1977/3539] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 15:49:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:49:40.749559 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-ee170957-949b-4938-a2ea-4d2dee5b2aa7 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:49:40.750259 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-ee170957-949b-4938-a2ea-4d2dee5b2aa7 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] [instance: 390b2d03-4e54-44c3-91db-08c6eed28adb] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:49:40.756884 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ee170957-949b-4938-a2ea-4d2dee5b2aa7 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:49:40.757332 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ee170957-949b-4938-a2ea-4d2dee5b2aa7 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:49:40.758106 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ee170957-949b-4938-a2ea-4d2dee5b2aa7 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:49:40.758544 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ee170957-949b-4938-a2ea-4d2dee5b2aa7 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:49:40.906458 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-ee170957-949b-4938-a2ea-4d2dee5b2aa7 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab3130962a6456bbbcb1c96aba3506d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79efe2b5db31498c81c59b086e5c6f84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:49:40.913953 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-ee170957-949b-4938-a2ea-4d2dee5b2aa7 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] 10.222.0.48 "GET /compute/v2.1/servers/390b2d03-4e54-44c3-91db-08c6eed28adb" status: 200 len: 1366 microversion: 2.1 time: 0.169694 Jun 17 15:49:40.914518 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1563/3540] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:49:40 2022] GET /compute/v2.1/servers/390b2d03-4e54-44c3-91db-08c6eed28adb => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:49:41.936985 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-59c0b69e-a90d-4b40-a893-da875247a949 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:49:41.937849 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-59c0b69e-a90d-4b40-a893-da875247a949 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] [instance: 390b2d03-4e54-44c3-91db-08c6eed28adb] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:49:41.944973 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-59c0b69e-a90d-4b40-a893-da875247a949 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:49:41.945413 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-59c0b69e-a90d-4b40-a893-da875247a949 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:49:41.946183 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-59c0b69e-a90d-4b40-a893-da875247a949 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:49:41.946613 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-59c0b69e-a90d-4b40-a893-da875247a949 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:49:42.093511 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-59c0b69e-a90d-4b40-a893-da875247a949 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab3130962a6456bbbcb1c96aba3506d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79efe2b5db31498c81c59b086e5c6f84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:49:42.101396 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-59c0b69e-a90d-4b40-a893-da875247a949 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] 10.222.0.48 "GET /compute/v2.1/servers/390b2d03-4e54-44c3-91db-08c6eed28adb" status: 200 len: 1366 microversion: 2.1 time: 0.171546 Jun 17 15:49:42.102190 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1978/3541] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:49:41 2022] GET /compute/v2.1/servers/390b2d03-4e54-44c3-91db-08c6eed28adb => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:49:43.119289 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-d6a4badf-3ce4-4f56-8399-4b7c6d2c920d tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:49:43.119880 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-d6a4badf-3ce4-4f56-8399-4b7c6d2c920d tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] [instance: 390b2d03-4e54-44c3-91db-08c6eed28adb] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:49:43.126474 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d6a4badf-3ce4-4f56-8399-4b7c6d2c920d tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:49:43.126925 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d6a4badf-3ce4-4f56-8399-4b7c6d2c920d tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:49:43.127673 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d6a4badf-3ce4-4f56-8399-4b7c6d2c920d tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:49:43.128107 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d6a4badf-3ce4-4f56-8399-4b7c6d2c920d tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:49:43.258763 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-d6a4badf-3ce4-4f56-8399-4b7c6d2c920d tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab3130962a6456bbbcb1c96aba3506d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79efe2b5db31498c81c59b086e5c6f84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:49:43.266786 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-d6a4badf-3ce4-4f56-8399-4b7c6d2c920d tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] 10.222.0.48 "GET /compute/v2.1/servers/390b2d03-4e54-44c3-91db-08c6eed28adb" status: 200 len: 1366 microversion: 2.1 time: 0.151452 Jun 17 15:49:43.267341 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1564/3542] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:49:43 2022] GET /compute/v2.1/servers/390b2d03-4e54-44c3-91db-08c6eed28adb => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:49:44.283142 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-4cdc4c0a-2b3f-4250-bc46-0ed06c626dba tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:49:44.283753 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-4cdc4c0a-2b3f-4250-bc46-0ed06c626dba tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] [instance: 390b2d03-4e54-44c3-91db-08c6eed28adb] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:49:44.290556 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4cdc4c0a-2b3f-4250-bc46-0ed06c626dba tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:49:44.291001 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4cdc4c0a-2b3f-4250-bc46-0ed06c626dba tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:49:44.291762 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4cdc4c0a-2b3f-4250-bc46-0ed06c626dba tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:49:44.292193 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4cdc4c0a-2b3f-4250-bc46-0ed06c626dba tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:49:44.426188 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-4cdc4c0a-2b3f-4250-bc46-0ed06c626dba tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab3130962a6456bbbcb1c96aba3506d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79efe2b5db31498c81c59b086e5c6f84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:49:44.434170 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-4cdc4c0a-2b3f-4250-bc46-0ed06c626dba tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] 10.222.0.48 "GET /compute/v2.1/servers/390b2d03-4e54-44c3-91db-08c6eed28adb" status: 200 len: 1366 microversion: 2.1 time: 0.154460 Jun 17 15:49:44.434732 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1979/3543] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:49:44 2022] GET /compute/v2.1/servers/390b2d03-4e54-44c3-91db-08c6eed28adb => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:49:45.451053 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-8962a2ba-93bc-419c-adec-49a8897f5b9c tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:49:45.451662 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-8962a2ba-93bc-419c-adec-49a8897f5b9c tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] [instance: 390b2d03-4e54-44c3-91db-08c6eed28adb] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:49:45.458086 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8962a2ba-93bc-419c-adec-49a8897f5b9c tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:49:45.458537 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8962a2ba-93bc-419c-adec-49a8897f5b9c tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:49:45.459279 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8962a2ba-93bc-419c-adec-49a8897f5b9c tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:49:45.459709 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-8962a2ba-93bc-419c-adec-49a8897f5b9c tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:49:45.595076 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-8962a2ba-93bc-419c-adec-49a8897f5b9c tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab3130962a6456bbbcb1c96aba3506d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79efe2b5db31498c81c59b086e5c6f84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:49:45.602676 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-8962a2ba-93bc-419c-adec-49a8897f5b9c tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] 10.222.0.48 "GET /compute/v2.1/servers/390b2d03-4e54-44c3-91db-08c6eed28adb" status: 200 len: 1366 microversion: 2.1 time: 0.155278 Jun 17 15:49:45.603247 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1565/3544] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:49:45 2022] GET /compute/v2.1/servers/390b2d03-4e54-44c3-91db-08c6eed28adb => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:49:46.149095 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [req-6713fb4a-f112-4fff-ac6e-d873b551973d req-4c2388f0-0313-42a5-a5f8-aa87173e5434 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "390b2d03-4e54-44c3-91db-08c6eed28adb", "name": "network-vif-plugged", "status": "completed", "tag": "4b7d847d-258d-49e0-854f-733e710260d5"}]} {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:49:46.158390 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [req-6713fb4a-f112-4fff-ac6e-d873b551973d req-4c2388f0-0313-42a5-a5f8-aa87173e5434 service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:49:46.158845 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [req-6713fb4a-f112-4fff-ac6e-d873b551973d req-4c2388f0-0313-42a5-a5f8-aa87173e5434 service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:49:46.170375 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.compute.server_external_events [req-6713fb4a-f112-4fff-ac6e-d873b551973d req-4c2388f0-0313-42a5-a5f8-aa87173e5434 service nova] Creating event network-vif-plugged:4b7d847d-258d-49e0-854f-733e710260d5 for instance 390b2d03-4e54-44c3-91db-08c6eed28adb on hv-cinder-82549 Jun 17 15:49:46.175129 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [req-6713fb4a-f112-4fff-ac6e-d873b551973d req-4c2388f0-0313-42a5-a5f8-aa87173e5434 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030635 Jun 17 15:49:46.175881 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1980/3545] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 15:49:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:49:46.620186 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-09a036e3-9ca0-412e-b344-2f96a06f4d6e tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:49:46.620836 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-09a036e3-9ca0-412e-b344-2f96a06f4d6e tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] [instance: 390b2d03-4e54-44c3-91db-08c6eed28adb] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:49:46.628487 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-09a036e3-9ca0-412e-b344-2f96a06f4d6e tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:49:46.628916 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-09a036e3-9ca0-412e-b344-2f96a06f4d6e tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:49:46.629884 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-09a036e3-9ca0-412e-b344-2f96a06f4d6e tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:49:46.630334 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-09a036e3-9ca0-412e-b344-2f96a06f4d6e tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:49:46.758484 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-09a036e3-9ca0-412e-b344-2f96a06f4d6e tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab3130962a6456bbbcb1c96aba3506d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79efe2b5db31498c81c59b086e5c6f84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:49:46.766315 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-09a036e3-9ca0-412e-b344-2f96a06f4d6e tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] 10.222.0.48 "GET /compute/v2.1/servers/390b2d03-4e54-44c3-91db-08c6eed28adb" status: 200 len: 1366 microversion: 2.1 time: 0.149933 Jun 17 15:49:46.766868 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1566/3546] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:49:46 2022] GET /compute/v2.1/servers/390b2d03-4e54-44c3-91db-08c6eed28adb => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:49:47.256592 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-06c18611-3633-4afe-a3ff-bb43962b7691 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:49:47.262837 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-06c18611-3633-4afe-a3ff-bb43962b7691 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:49:47.263276 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-06c18611-3633-4afe-a3ff-bb43962b7691 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:49:47.291046 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell0:SELECT=2 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:49:47.316350 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell0:SELECT=6 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:49:47.329877 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-06c18611-3633-4afe-a3ff-bb43962b7691 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] [instance: fd8af8c4-d147-4335-90c9-81fe1da1297f] Going to try to stop instance {{(pid=117650) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 17 15:49:47.366462 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:49:47.377238 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-06c18611-3633-4afe-a3ff-bb43962b7691 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] 10.222.0.48 "POST /compute/v2.1/servers/fd8af8c4-d147-4335-90c9-81fe1da1297f/action" status: 202 len: 0 microversion: 2.1 time: 0.125186 Jun 17 15:49:47.377943 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1981/3547] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jun 17 15:49:47 2022] POST /compute/v2.1/servers/fd8af8c4-d147-4335-90c9-81fe1da1297f/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 15:49:47.386847 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-b10a4fde-43d1-4bdb-9eb8-40d8f88f5398 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:49:47.389444 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-b10a4fde-43d1-4bdb-9eb8-40d8f88f5398 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] [instance: fd8af8c4-d147-4335-90c9-81fe1da1297f] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:49:47.398312 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b10a4fde-43d1-4bdb-9eb8-40d8f88f5398 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:49:47.398839 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b10a4fde-43d1-4bdb-9eb8-40d8f88f5398 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:49:47.399934 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b10a4fde-43d1-4bdb-9eb8-40d8f88f5398 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:49:47.400393 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b10a4fde-43d1-4bdb-9eb8-40d8f88f5398 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:49:47.420518 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell0:SELECT=6 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:49:47.550198 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-b10a4fde-43d1-4bdb-9eb8-40d8f88f5398 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a67b4188f6248cca9ce2f4991d78e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48712151f8a4942a0a08d09a80c902d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:49:47.558429 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-b10a4fde-43d1-4bdb-9eb8-40d8f88f5398 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] 10.222.0.48 "GET /compute/v2.1/servers/fd8af8c4-d147-4335-90c9-81fe1da1297f" status: 200 len: 1723 microversion: 2.1 time: 0.175759 Jun 17 15:49:47.558997 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1567/3548] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:49:47 2022] GET /compute/v2.1/servers/fd8af8c4-d147-4335-90c9-81fe1da1297f => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:49:47.783706 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-0999fb11-9c10-4480-b121-e7eb922db6d8 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:49:47.784492 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-0999fb11-9c10-4480-b121-e7eb922db6d8 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] [instance: 390b2d03-4e54-44c3-91db-08c6eed28adb] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:49:47.792088 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0999fb11-9c10-4480-b121-e7eb922db6d8 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:49:47.792556 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0999fb11-9c10-4480-b121-e7eb922db6d8 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:49:47.793320 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0999fb11-9c10-4480-b121-e7eb922db6d8 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:49:47.793747 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-0999fb11-9c10-4480-b121-e7eb922db6d8 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:49:47.939807 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-0999fb11-9c10-4480-b121-e7eb922db6d8 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab3130962a6456bbbcb1c96aba3506d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79efe2b5db31498c81c59b086e5c6f84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:49:47.947655 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-0999fb11-9c10-4480-b121-e7eb922db6d8 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] 10.222.0.48 "GET /compute/v2.1/servers/390b2d03-4e54-44c3-91db-08c6eed28adb" status: 200 len: 1555 microversion: 2.1 time: 0.168080 Jun 17 15:49:47.948268 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1982/3549] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:49:47 2022] GET /compute/v2.1/servers/390b2d03-4e54-44c3-91db-08c6eed28adb => generated 1555 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:49:47.964910 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-300b1b69-b104-4e40-8aff-e4b30cd27c7c tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:49:47.965526 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-300b1b69-b104-4e40-8aff-e4b30cd27c7c tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] [instance: 390b2d03-4e54-44c3-91db-08c6eed28adb] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:49:47.972373 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-300b1b69-b104-4e40-8aff-e4b30cd27c7c tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:49:47.972811 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-300b1b69-b104-4e40-8aff-e4b30cd27c7c tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:49:47.973586 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-300b1b69-b104-4e40-8aff-e4b30cd27c7c tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:49:47.974020 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-300b1b69-b104-4e40-8aff-e4b30cd27c7c tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:49:47.978400 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:49:48.056246 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-300b1b69-b104-4e40-8aff-e4b30cd27c7c tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] 10.222.0.48 "GET /compute/v2.1/servers/390b2d03-4e54-44c3-91db-08c6eed28adb/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095220 Jun 17 15:49:48.057520 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1568/3550] 10.222.0.48 () {58 vars in 1274 bytes} [Fri Jun 17 15:49:47 2022] GET /compute/v2.1/servers/390b2d03-4e54-44c3-91db-08c6eed28adb/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:49:48.575785 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-ec62a2cf-d688-40f2-be20-8674f036a295 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:49:48.576453 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-ec62a2cf-d688-40f2-be20-8674f036a295 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] [instance: fd8af8c4-d147-4335-90c9-81fe1da1297f] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:49:48.584016 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ec62a2cf-d688-40f2-be20-8674f036a295 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:49:48.584531 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ec62a2cf-d688-40f2-be20-8674f036a295 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:49:48.585669 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ec62a2cf-d688-40f2-be20-8674f036a295 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:49:48.586541 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ec62a2cf-d688-40f2-be20-8674f036a295 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:49:48.725088 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-ec62a2cf-d688-40f2-be20-8674f036a295 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a67b4188f6248cca9ce2f4991d78e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48712151f8a4942a0a08d09a80c902d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:49:48.735020 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-ec62a2cf-d688-40f2-be20-8674f036a295 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] 10.222.0.48 "GET /compute/v2.1/servers/fd8af8c4-d147-4335-90c9-81fe1da1297f" status: 200 len: 1723 microversion: 2.1 time: 0.163137 Jun 17 15:49:48.736417 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1983/3551] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:49:48 2022] GET /compute/v2.1/servers/fd8af8c4-d147-4335-90c9-81fe1da1297f => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:49:49.051879 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [req-5dc0b30e-b2b0-4bd7-9129-b0055d033942 req-03bf6649-7c1b-4394-a320-79e0217b6128 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "390b2d03-4e54-44c3-91db-08c6eed28adb", "tag": "4b7d847d-258d-49e0-854f-733e710260d5"}]} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:49:49.060229 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-5dc0b30e-b2b0-4bd7-9129-b0055d033942 req-03bf6649-7c1b-4394-a320-79e0217b6128 service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:49:49.060704 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-5dc0b30e-b2b0-4bd7-9129-b0055d033942 req-03bf6649-7c1b-4394-a320-79e0217b6128 service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:49:49.071735 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.compute.server_external_events [req-5dc0b30e-b2b0-4bd7-9129-b0055d033942 req-03bf6649-7c1b-4394-a320-79e0217b6128 service nova] Creating event network-changed:4b7d847d-258d-49e0-854f-733e710260d5 for instance 390b2d03-4e54-44c3-91db-08c6eed28adb on hv-cinder-82549 Jun 17 15:49:49.077500 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [req-5dc0b30e-b2b0-4bd7-9129-b0055d033942 req-03bf6649-7c1b-4394-a320-79e0217b6128 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029674 Jun 17 15:49:49.078136 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1569/3552] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 15:49:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:49:49.752842 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-bf690ede-0c25-4f4b-a50f-47b4ccf123ad tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:49:49.753437 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-bf690ede-0c25-4f4b-a50f-47b4ccf123ad tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] [instance: fd8af8c4-d147-4335-90c9-81fe1da1297f] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:49:49.760253 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bf690ede-0c25-4f4b-a50f-47b4ccf123ad tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:49:49.761087 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bf690ede-0c25-4f4b-a50f-47b4ccf123ad tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:49:49.762244 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bf690ede-0c25-4f4b-a50f-47b4ccf123ad tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:49:49.762692 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bf690ede-0c25-4f4b-a50f-47b4ccf123ad tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:49:49.907127 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-bf690ede-0c25-4f4b-a50f-47b4ccf123ad tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a67b4188f6248cca9ce2f4991d78e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48712151f8a4942a0a08d09a80c902d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:49:49.916277 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-bf690ede-0c25-4f4b-a50f-47b4ccf123ad tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] 10.222.0.48 "GET /compute/v2.1/servers/fd8af8c4-d147-4335-90c9-81fe1da1297f" status: 200 len: 1723 microversion: 2.1 time: 0.167497 Jun 17 15:49:49.925857 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1984/3553] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:49:49 2022] GET /compute/v2.1/servers/fd8af8c4-d147-4335-90c9-81fe1da1297f => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:49:50.935637 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-1617c8c0-391b-4f31-bb32-23c1ad788ec3 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:49:50.936356 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-1617c8c0-391b-4f31-bb32-23c1ad788ec3 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] [instance: fd8af8c4-d147-4335-90c9-81fe1da1297f] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:49:50.942610 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1617c8c0-391b-4f31-bb32-23c1ad788ec3 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:49:50.943056 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1617c8c0-391b-4f31-bb32-23c1ad788ec3 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:49:50.943810 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1617c8c0-391b-4f31-bb32-23c1ad788ec3 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:49:50.944244 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1617c8c0-391b-4f31-bb32-23c1ad788ec3 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:49:51.071642 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-1617c8c0-391b-4f31-bb32-23c1ad788ec3 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a67b4188f6248cca9ce2f4991d78e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48712151f8a4942a0a08d09a80c902d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:49:51.079572 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-1617c8c0-391b-4f31-bb32-23c1ad788ec3 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] 10.222.0.48 "GET /compute/v2.1/servers/fd8af8c4-d147-4335-90c9-81fe1da1297f" status: 200 len: 1723 microversion: 2.1 time: 0.149180 Jun 17 15:49:51.080137 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1570/3554] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:49:50 2022] GET /compute/v2.1/servers/fd8af8c4-d147-4335-90c9-81fe1da1297f => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:49:52.096769 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-2160607d-8d77-47d1-9b1b-baded297c1a7 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:49:52.097384 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-2160607d-8d77-47d1-9b1b-baded297c1a7 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] [instance: fd8af8c4-d147-4335-90c9-81fe1da1297f] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:49:52.104314 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2160607d-8d77-47d1-9b1b-baded297c1a7 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:49:52.104793 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2160607d-8d77-47d1-9b1b-baded297c1a7 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:49:52.105563 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2160607d-8d77-47d1-9b1b-baded297c1a7 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:49:52.105997 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-2160607d-8d77-47d1-9b1b-baded297c1a7 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:49:52.234067 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-2160607d-8d77-47d1-9b1b-baded297c1a7 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a67b4188f6248cca9ce2f4991d78e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48712151f8a4942a0a08d09a80c902d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:49:52.242009 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-2160607d-8d77-47d1-9b1b-baded297c1a7 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] 10.222.0.48 "GET /compute/v2.1/servers/fd8af8c4-d147-4335-90c9-81fe1da1297f" status: 200 len: 1723 microversion: 2.1 time: 0.149168 Jun 17 15:49:52.242566 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1985/3555] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:49:52 2022] GET /compute/v2.1/servers/fd8af8c4-d147-4335-90c9-81fe1da1297f => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:49:53.258996 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-ea4351bf-df6c-4e56-8540-30528d9b06ab tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:49:53.259558 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-ea4351bf-df6c-4e56-8540-30528d9b06ab tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] [instance: fd8af8c4-d147-4335-90c9-81fe1da1297f] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:49:53.266576 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ea4351bf-df6c-4e56-8540-30528d9b06ab tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:49:53.267023 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ea4351bf-df6c-4e56-8540-30528d9b06ab tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:49:53.267821 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ea4351bf-df6c-4e56-8540-30528d9b06ab tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:49:53.268219 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ea4351bf-df6c-4e56-8540-30528d9b06ab tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:49:53.404581 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-ea4351bf-df6c-4e56-8540-30528d9b06ab tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a67b4188f6248cca9ce2f4991d78e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48712151f8a4942a0a08d09a80c902d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:49:53.412476 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-ea4351bf-df6c-4e56-8540-30528d9b06ab tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] 10.222.0.48 "GET /compute/v2.1/servers/fd8af8c4-d147-4335-90c9-81fe1da1297f" status: 200 len: 1723 microversion: 2.1 time: 0.157387 Jun 17 15:49:53.413046 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1571/3556] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:49:53 2022] GET /compute/v2.1/servers/fd8af8c4-d147-4335-90c9-81fe1da1297f => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:49:54.430136 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-628ea643-371b-4959-863f-671603d91e32 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:49:54.430703 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-628ea643-371b-4959-863f-671603d91e32 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] [instance: fd8af8c4-d147-4335-90c9-81fe1da1297f] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:49:54.437925 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-628ea643-371b-4959-863f-671603d91e32 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:49:54.438405 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-628ea643-371b-4959-863f-671603d91e32 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:49:54.439177 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-628ea643-371b-4959-863f-671603d91e32 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:49:54.439619 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-628ea643-371b-4959-863f-671603d91e32 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:49:54.569934 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-628ea643-371b-4959-863f-671603d91e32 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a67b4188f6248cca9ce2f4991d78e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48712151f8a4942a0a08d09a80c902d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:49:54.577875 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-628ea643-371b-4959-863f-671603d91e32 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] 10.222.0.48 "GET /compute/v2.1/servers/fd8af8c4-d147-4335-90c9-81fe1da1297f" status: 200 len: 1723 microversion: 2.1 time: 0.151710 Jun 17 15:49:54.578430 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1986/3557] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:49:54 2022] GET /compute/v2.1/servers/fd8af8c4-d147-4335-90c9-81fe1da1297f => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:49:55.594871 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-967763d2-c842-48b3-9bf6-5308d697d305 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:49:55.595481 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-967763d2-c842-48b3-9bf6-5308d697d305 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] [instance: fd8af8c4-d147-4335-90c9-81fe1da1297f] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:49:55.597911 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=1 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:49:55.603575 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-967763d2-c842-48b3-9bf6-5308d697d305 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:49:55.604018 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-967763d2-c842-48b3-9bf6-5308d697d305 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:49:55.604791 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-967763d2-c842-48b3-9bf6-5308d697d305 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:49:55.605221 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-967763d2-c842-48b3-9bf6-5308d697d305 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:49:55.731981 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-967763d2-c842-48b3-9bf6-5308d697d305 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a67b4188f6248cca9ce2f4991d78e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48712151f8a4942a0a08d09a80c902d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:49:55.739791 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-967763d2-c842-48b3-9bf6-5308d697d305 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] 10.222.0.48 "GET /compute/v2.1/servers/fd8af8c4-d147-4335-90c9-81fe1da1297f" status: 200 len: 1723 microversion: 2.1 time: 0.148753 Jun 17 15:49:55.740373 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1572/3558] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:49:55 2022] GET /compute/v2.1/servers/fd8af8c4-d147-4335-90c9-81fe1da1297f => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:49:56.757625 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-78cbbb58-3cff-4b1a-87ee-4e727f3fae56 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:49:56.758251 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-78cbbb58-3cff-4b1a-87ee-4e727f3fae56 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] [instance: fd8af8c4-d147-4335-90c9-81fe1da1297f] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:49:56.760180 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:49:56.766297 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-78cbbb58-3cff-4b1a-87ee-4e727f3fae56 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:49:56.766736 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-78cbbb58-3cff-4b1a-87ee-4e727f3fae56 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:49:56.767486 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-78cbbb58-3cff-4b1a-87ee-4e727f3fae56 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:49:56.767913 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-78cbbb58-3cff-4b1a-87ee-4e727f3fae56 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:49:56.899318 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-78cbbb58-3cff-4b1a-87ee-4e727f3fae56 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a67b4188f6248cca9ce2f4991d78e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48712151f8a4942a0a08d09a80c902d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:49:56.907189 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-78cbbb58-3cff-4b1a-87ee-4e727f3fae56 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] 10.222.0.48 "GET /compute/v2.1/servers/fd8af8c4-d147-4335-90c9-81fe1da1297f" status: 200 len: 1723 microversion: 2.1 time: 0.153620 Jun 17 15:49:56.907752 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1987/3559] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:49:56 2022] GET /compute/v2.1/servers/fd8af8c4-d147-4335-90c9-81fe1da1297f => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:49:57.924007 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-aa830875-c210-4ed5-b899-b828782cfdd3 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:49:57.924646 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-aa830875-c210-4ed5-b899-b828782cfdd3 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] [instance: fd8af8c4-d147-4335-90c9-81fe1da1297f] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:49:57.931249 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-aa830875-c210-4ed5-b899-b828782cfdd3 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:49:57.931702 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-aa830875-c210-4ed5-b899-b828782cfdd3 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:49:57.932490 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-aa830875-c210-4ed5-b899-b828782cfdd3 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:49:57.932931 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-aa830875-c210-4ed5-b899-b828782cfdd3 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:49:58.062215 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-aa830875-c210-4ed5-b899-b828782cfdd3 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a67b4188f6248cca9ce2f4991d78e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48712151f8a4942a0a08d09a80c902d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:49:58.070164 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-aa830875-c210-4ed5-b899-b828782cfdd3 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] 10.222.0.48 "GET /compute/v2.1/servers/fd8af8c4-d147-4335-90c9-81fe1da1297f" status: 200 len: 1700 microversion: 2.1 time: 0.150019 Jun 17 15:49:58.070731 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1573/3560] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:49:57 2022] GET /compute/v2.1/servers/fd8af8c4-d147-4335-90c9-81fe1da1297f => generated 1700 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:49:58.086719 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-40768180-28be-4204-99ab-c1d28a5a67c6 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:49:58.094106 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-40768180-28be-4204-99ab-c1d28a5a67c6 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:49:58.094560 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-40768180-28be-4204-99ab-c1d28a5a67c6 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:49:58.118943 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-40768180-28be-4204-99ab-c1d28a5a67c6 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] [instance: fd8af8c4-d147-4335-90c9-81fe1da1297f] Going to try to start instance {{(pid=117650) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 17 15:49:58.163411 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-40768180-28be-4204-99ab-c1d28a5a67c6 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] 10.222.0.48 "POST /compute/v2.1/servers/fd8af8c4-d147-4335-90c9-81fe1da1297f/action" status: 202 len: 0 microversion: 2.1 time: 0.080294 Jun 17 15:49:58.164013 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1988/3561] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jun 17 15:49:58 2022] POST /compute/v2.1/servers/fd8af8c4-d147-4335-90c9-81fe1da1297f/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 15:49:58.172137 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-a80ba570-c1fb-4ab3-b94d-5cc876746df4 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:49:58.172785 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-a80ba570-c1fb-4ab3-b94d-5cc876746df4 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] [instance: fd8af8c4-d147-4335-90c9-81fe1da1297f] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:49:58.179163 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a80ba570-c1fb-4ab3-b94d-5cc876746df4 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:49:58.179679 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a80ba570-c1fb-4ab3-b94d-5cc876746df4 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:49:58.180576 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a80ba570-c1fb-4ab3-b94d-5cc876746df4 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:49:58.181032 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a80ba570-c1fb-4ab3-b94d-5cc876746df4 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:49:58.345158 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-a80ba570-c1fb-4ab3-b94d-5cc876746df4 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a67b4188f6248cca9ce2f4991d78e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48712151f8a4942a0a08d09a80c902d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:49:58.358078 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-a80ba570-c1fb-4ab3-b94d-5cc876746df4 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] 10.222.0.48 "GET /compute/v2.1/servers/fd8af8c4-d147-4335-90c9-81fe1da1297f" status: 200 len: 1709 microversion: 2.1 time: 0.189733 Jun 17 15:49:58.358621 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1574/3562] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:49:58 2022] GET /compute/v2.1/servers/fd8af8c4-d147-4335-90c9-81fe1da1297f => generated 1709 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:49:59.376039 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-f4a1dc35-bbc4-4150-b497-878f08f1a6ee tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:49:59.376807 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-f4a1dc35-bbc4-4150-b497-878f08f1a6ee tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] [instance: fd8af8c4-d147-4335-90c9-81fe1da1297f] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:49:59.383030 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f4a1dc35-bbc4-4150-b497-878f08f1a6ee tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:49:59.383474 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f4a1dc35-bbc4-4150-b497-878f08f1a6ee tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:49:59.384236 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f4a1dc35-bbc4-4150-b497-878f08f1a6ee tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:49:59.384697 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f4a1dc35-bbc4-4150-b497-878f08f1a6ee tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:49:59.511621 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-f4a1dc35-bbc4-4150-b497-878f08f1a6ee tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a67b4188f6248cca9ce2f4991d78e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48712151f8a4942a0a08d09a80c902d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:49:59.520108 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-f4a1dc35-bbc4-4150-b497-878f08f1a6ee tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] 10.222.0.48 "GET /compute/v2.1/servers/fd8af8c4-d147-4335-90c9-81fe1da1297f" status: 200 len: 1709 microversion: 2.1 time: 0.148836 Jun 17 15:49:59.520710 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1989/3563] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:49:59 2022] GET /compute/v2.1/servers/fd8af8c4-d147-4335-90c9-81fe1da1297f => generated 1709 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:50:00.537994 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-c7686947-cbf6-41b6-b318-442c6243aea6 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:50:00.538553 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-c7686947-cbf6-41b6-b318-442c6243aea6 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] [instance: fd8af8c4-d147-4335-90c9-81fe1da1297f] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:50:00.545564 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c7686947-cbf6-41b6-b318-442c6243aea6 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:50:00.546011 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c7686947-cbf6-41b6-b318-442c6243aea6 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:50:00.546764 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c7686947-cbf6-41b6-b318-442c6243aea6 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:50:00.547201 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c7686947-cbf6-41b6-b318-442c6243aea6 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:50:00.673757 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-c7686947-cbf6-41b6-b318-442c6243aea6 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a67b4188f6248cca9ce2f4991d78e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48712151f8a4942a0a08d09a80c902d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:50:00.681668 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-c7686947-cbf6-41b6-b318-442c6243aea6 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] 10.222.0.48 "GET /compute/v2.1/servers/fd8af8c4-d147-4335-90c9-81fe1da1297f" status: 200 len: 1713 microversion: 2.1 time: 0.147657 Jun 17 15:50:00.682234 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1575/3564] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:50:00 2022] GET /compute/v2.1/servers/fd8af8c4-d147-4335-90c9-81fe1da1297f => generated 1713 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:50:21.436720 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-a77ea807-4298-47c2-ad07-e3f34e54a61b tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:50:21.437320 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-a77ea807-4298-47c2-ad07-e3f34e54a61b tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] [instance: 390b2d03-4e54-44c3-91db-08c6eed28adb] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:50:21.439771 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_api:SELECT=5 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:50:21.440563 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:50:21.446744 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a77ea807-4298-47c2-ad07-e3f34e54a61b tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:50:21.447178 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a77ea807-4298-47c2-ad07-e3f34e54a61b tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:50:21.447938 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a77ea807-4298-47c2-ad07-e3f34e54a61b tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:50:21.448396 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a77ea807-4298-47c2-ad07-e3f34e54a61b tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:50:21.472562 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-a77ea807-4298-47c2-ad07-e3f34e54a61b tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] 10.222.0.48 "GET /compute/v2.1/servers/390b2d03-4e54-44c3-91db-08c6eed28adb/ips" status: 200 len: 149 microversion: 2.1 time: 0.040118 Jun 17 15:50:21.473065 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1990/3565] 10.222.0.48 () {58 vars in 1247 bytes} [Fri Jun 17 15:50:21 2022] GET /compute/v2.1/servers/390b2d03-4e54-44c3-91db-08c6eed28adb/ips => generated 149 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:50:22.798785 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-ac865776-9906-4c1d-818f-0e127f9219d5 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8cda3b73-ee23-4b73-8cb3-4271fc008048"}} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:50:22.799901 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-ac865776-9906-4c1d-818f-0e127f9219d5 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] [instance: 390b2d03-4e54-44c3-91db-08c6eed28adb] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:50:22.802092 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_api:SELECT=7 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:50:22.802737 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell1:SELECT=40 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:50:22.808317 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ac865776-9906-4c1d-818f-0e127f9219d5 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:50:22.808785 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ac865776-9906-4c1d-818f-0e127f9219d5 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:50:22.809551 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ac865776-9906-4c1d-818f-0e127f9219d5 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:50:22.809982 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ac865776-9906-4c1d-818f-0e127f9219d5 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:50:23.073557 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-ac865776-9906-4c1d-818f-0e127f9219d5 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] 10.222.0.48 "POST /compute/v2.1/servers/390b2d03-4e54-44c3-91db-08c6eed28adb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.278551 Jun 17 15:50:23.074164 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1576/3566] 10.222.0.48 () {60 vars in 1322 bytes} [Fri Jun 17 15:50:22 2022] POST /compute/v2.1/servers/390b2d03-4e54-44c3-91db-08c6eed28adb/os-volume_attachments => generated 194 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:50:30.561690 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-f27b7b66-a7b6-465f-8066-008dc7bb3659 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8cda3b73-ee23-4b73-8cb3-4271fc008048"}} {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:50:30.562746 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-f27b7b66-a7b6-465f-8066-008dc7bb3659 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] [instance: 390b2d03-4e54-44c3-91db-08c6eed28adb] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:50:30.568829 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f27b7b66-a7b6-465f-8066-008dc7bb3659 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:50:30.569271 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f27b7b66-a7b6-465f-8066-008dc7bb3659 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:50:30.570018 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f27b7b66-a7b6-465f-8066-008dc7bb3659 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:50:30.570445 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f27b7b66-a7b6-465f-8066-008dc7bb3659 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:50:30.648018 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.wsgi [None req-f27b7b66-a7b6-465f-8066-008dc7bb3659 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] HTTP exception thrown: Invalid volume: volume 8cda3b73-ee23-4b73-8cb3-4271fc008048 is already attached to instances: 390b2d03-4e54-44c3-91db-08c6eed28adb Jun 17 15:50:30.649824 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-f27b7b66-a7b6-465f-8066-008dc7bb3659 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Request method failure captured: Jun 17 15:50:30.649824 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: request: POST /compute/v2.1/servers/390b2d03-4e54-44c3-91db-08c6eed28adb/os-volume_attachments HTTP/1.1 Jun 17 15:50:30.649824 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Accept: application/json Jun 17 15:50:30.649824 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Accept-Encoding: identity Jun 17 15:50:30.649824 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Connection: close Jun 17 15:50:30.649824 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Content-Length: 74 Jun 17 15:50:30.649824 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Content-Type: application/json Jun 17 15:50:30.649824 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Host: 10.222.0.48 Jun 17 15:50:30.649824 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Openstack-System-Scope: None Jun 17 15:50:30.649824 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: User-Agent: python-urllib3/1.26.9 Jun 17 15:50:30.649824 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Auth-Token: gAAAAABirKICwWnhD993Jl4IhDGE-QonLGXk8DgdDZd8k6DQ9ib1E3iCeZvkPKJ1yooc16OipcuLAmHVKfeflaAMN8pddeU0L_b0r5jZEMoMoQRDnLv1aSXXTkcHo205L-oyOwE_Oe-bVu0FH4Pz82Sgm44hDcOVXCq7XBTJwNam2wPPozTvXCI Jun 17 15:50:30.649824 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Domain-Id: None Jun 17 15:50:30.649824 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Domain-Name: None Jun 17 15:50:30.649824 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Identity-Status: Confirmed Jun 17 15:50:30.649824 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Is-Admin-Project: True Jun 17 15:50:30.649824 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Domain-Id: default Jun 17 15:50:30.649824 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Domain-Name: Default Jun 17 15:50:30.649824 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Id: 79efe2b5db31498c81c59b086e5c6f84 Jun 17 15:50:30.649824 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Name: tempest-AttachVolumeNegativeTest-957597123 Jun 17 15:50:30.649824 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Role: reader,member Jun 17 15:50:30.649824 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Roles: reader,member Jun 17 15:50:30.651681 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_79efe2b5db31498c81c59b086e5c6f84", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/79efe2b5db31498c81c59b086e5c6f84"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/79efe2b5db31498c81c59b086e5c6f84"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/79efe2b5db31498c81c59b086e5c6f84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Jun 17 15:50:30.651681 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant: tempest-AttachVolumeNegativeTest-957597123 Jun 17 15:50:30.651681 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant-Id: 79efe2b5db31498c81c59b086e5c6f84 Jun 17 15:50:30.651681 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-957597123 Jun 17 15:50:30.651681 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User: tempest-AttachVolumeNegativeTest-957597123-project Jun 17 15:50:30.651681 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Domain-Id: default Jun 17 15:50:30.651681 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Domain-Name: Default Jun 17 15:50:30.651681 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Id: 8ab3130962a6456bbbcb1c96aba3506d Jun 17 15:50:30.651681 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Name: tempest-AttachVolumeNegativeTest-957597123-project Jun 17 15:50:30.651681 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Jun 17 15:50:30.651681 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: {"volumeAttachment": {"volumeId": "8cda3b73-ee23-4b73-8cb3-4271fc008048"}} Jun 17 15:50:30.651681 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: method: > Jun 17 15:50:30.653489 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: exception: Invalid volume: volume 8cda3b73-ee23-4b73-8cb3-4271fc008048 is already attached to instances: 390b2d03-4e54-44c3-91db-08c6eed28adb Jun 17 15:50:30.653489 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: action_args: {'server_id': '390b2d03-4e54-44c3-91db-08c6eed28adb', 'body': {'volumeAttachment': {'volumeId': '8cda3b73-ee23-4b73-8cb3-4271fc008048'}}} Jun 17 15:50:30.653489 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 15:50:30.653489 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:50:30.653489 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 17 15:50:30.653489 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 17 15:50:30.653489 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 17 15:50:30.653489 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 17 15:50:30.653489 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 17 15:50:30.653489 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 17 15:50:30.653489 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 17 15:50:30.653489 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 17 15:50:30.653489 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 17 15:50:30.653489 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 17 15:50:30.653489 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 8cda3b73-ee23-4b73-8cb3-4271fc008048 is already attached to instances: 390b2d03-4e54-44c3-91db-08c6eed28adb Jun 17 15:50:30.653489 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:50:30.653489 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:50:30.653489 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:50:30.653489 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:50:30.655159 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:50:30.655159 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:50:30.655159 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 15:50:30.655159 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 15:50:30.655159 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 15:50:30.655159 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 15:50:30.655159 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 17 15:50:30.655159 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 17 15:50:30.655159 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 17 15:50:30.655159 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 17 15:50:30.655159 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 17 15:50:30.655159 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 17 15:50:30.655159 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 17 15:50:30.655159 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 17 15:50:30.655159 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 8cda3b73-ee23-4b73-8cb3-4271fc008048 is already attached to instances: 390b2d03-4e54-44c3-91db-08c6eed28adb Jun 17 15:50:30.655159 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:50:30.655159 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:50:30.655159 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:50:30.655159 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:50:30.655159 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:50:30.657195 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:50:30.657195 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 15:50:30.657195 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 15:50:30.657195 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 8cda3b73-ee23-4b73-8cb3-4271fc008048 is already attached to instances: 390b2d03-4e54-44c3-91db-08c6eed28adb Jun 17 15:50:30.657195 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:50:30.657195 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-f27b7b66-a7b6-465f-8066-008dc7bb3659 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Returning 400 to user: Invalid volume: volume 8cda3b73-ee23-4b73-8cb3-4271fc008048 is already attached to instances: 390b2d03-4e54-44c3-91db-08c6eed28adb {{(pid=117650) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 15:50:30.657195 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-f27b7b66-a7b6-465f-8066-008dc7bb3659 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] 10.222.0.48 "POST /compute/v2.1/servers/390b2d03-4e54-44c3-91db-08c6eed28adb/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.093681 Jun 17 15:50:30.657195 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1991/3567] 10.222.0.48 () {60 vars in 1322 bytes} [Fri Jun 17 15:50:30 2022] POST /compute/v2.1/servers/390b2d03-4e54-44c3-91db-08c6eed28adb/os-volume_attachments => generated 174 bytes in 95 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 17 15:50:30.712582 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-d8d1c78c-0bd3-4ba6-910b-84761cb322ee tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:50:30.713099 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-d8d1c78c-0bd3-4ba6-910b-84761cb322ee tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] [instance: 390b2d03-4e54-44c3-91db-08c6eed28adb] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:50:30.719728 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d8d1c78c-0bd3-4ba6-910b-84761cb322ee tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:50:30.720176 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d8d1c78c-0bd3-4ba6-910b-84761cb322ee tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:50:30.720959 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d8d1c78c-0bd3-4ba6-910b-84761cb322ee tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:50:30.721396 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d8d1c78c-0bd3-4ba6-910b-84761cb322ee tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:50:30.802293 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.objects.instance [None req-d8d1c78c-0bd3-4ba6-910b-84761cb322ee tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lazy-loading 'services' on Instance uuid 390b2d03-4e54-44c3-91db-08c6eed28adb {{(pid=117649) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 15:50:30.876552 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-d8d1c78c-0bd3-4ba6-910b-84761cb322ee tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] 10.222.0.48 "DELETE /compute/v2.1/servers/390b2d03-4e54-44c3-91db-08c6eed28adb/os-volume_attachments/8cda3b73-ee23-4b73-8cb3-4271fc008048" status: 202 len: 0 microversion: 2.1 time: 0.168488 Jun 17 15:50:30.877180 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1577/3568] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Jun 17 15:50:30 2022] DELETE /compute/v2.1/servers/390b2d03-4e54-44c3-91db-08c6eed28adb/os-volume_attachments/8cda3b73-ee23-4b73-8cb3-4271fc008048 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 15:50:30.886104 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-d93a4735-308f-4e17-b8c9-970b10507ae9 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:50:30.887667 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-d93a4735-308f-4e17-b8c9-970b10507ae9 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] [instance: 390b2d03-4e54-44c3-91db-08c6eed28adb] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:50:30.893987 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d93a4735-308f-4e17-b8c9-970b10507ae9 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:50:30.894363 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d93a4735-308f-4e17-b8c9-970b10507ae9 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:50:30.895118 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d93a4735-308f-4e17-b8c9-970b10507ae9 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:50:30.895542 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-d93a4735-308f-4e17-b8c9-970b10507ae9 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:50:30.925929 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-d93a4735-308f-4e17-b8c9-970b10507ae9 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] 10.222.0.48 "GET /compute/v2.1/servers/390b2d03-4e54-44c3-91db-08c6eed28adb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043702 Jun 17 15:50:30.926492 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1992/3569] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:50:30 2022] GET /compute/v2.1/servers/390b2d03-4e54-44c3-91db-08c6eed28adb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:50:31.938077 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-1da6e25f-f015-4261-b632-0aea2d67f899 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:50:31.939052 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-1da6e25f-f015-4261-b632-0aea2d67f899 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] [instance: 390b2d03-4e54-44c3-91db-08c6eed28adb] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:50:31.945879 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1da6e25f-f015-4261-b632-0aea2d67f899 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:50:31.946321 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1da6e25f-f015-4261-b632-0aea2d67f899 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:50:31.947082 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1da6e25f-f015-4261-b632-0aea2d67f899 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:50:31.947508 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1da6e25f-f015-4261-b632-0aea2d67f899 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:50:31.976434 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-1da6e25f-f015-4261-b632-0aea2d67f899 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] 10.222.0.48 "GET /compute/v2.1/servers/390b2d03-4e54-44c3-91db-08c6eed28adb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043387 Jun 17 15:50:31.976999 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1578/3570] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:50:31 2022] GET /compute/v2.1/servers/390b2d03-4e54-44c3-91db-08c6eed28adb/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 17 15:50:32.036907 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-ca8f55c6-bcba-4ae6-bd31-9bf9ef6bfff9 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:50:32.037459 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-ca8f55c6-bcba-4ae6-bd31-9bf9ef6bfff9 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] [instance: 390b2d03-4e54-44c3-91db-08c6eed28adb] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:50:32.044822 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ca8f55c6-bcba-4ae6-bd31-9bf9ef6bfff9 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:50:32.045262 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ca8f55c6-bcba-4ae6-bd31-9bf9ef6bfff9 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:50:32.046044 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ca8f55c6-bcba-4ae6-bd31-9bf9ef6bfff9 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:50:32.046673 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ca8f55c6-bcba-4ae6-bd31-9bf9ef6bfff9 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:50:32.071150 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-ca8f55c6-bcba-4ae6-bd31-9bf9ef6bfff9 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] [instance: 390b2d03-4e54-44c3-91db-08c6eed28adb] Going to try to terminate instance {{(pid=117650) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 15:50:32.147460 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-ca8f55c6-bcba-4ae6-bd31-9bf9ef6bfff9 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] 10.222.0.48 "DELETE /compute/v2.1/servers/390b2d03-4e54-44c3-91db-08c6eed28adb" status: 204 len: 0 microversion: 2.1 time: 0.113907 Jun 17 15:50:32.148277 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1993/3571] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jun 17 15:50:32 2022] DELETE /compute/v2.1/servers/390b2d03-4e54-44c3-91db-08c6eed28adb => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 15:50:32.157250 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-090b689e-e266-47ea-ba5a-cfc6063db0d5 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:50:32.157995 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-090b689e-e266-47ea-ba5a-cfc6063db0d5 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] [instance: 390b2d03-4e54-44c3-91db-08c6eed28adb] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:50:32.164099 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-090b689e-e266-47ea-ba5a-cfc6063db0d5 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:50:32.164603 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-090b689e-e266-47ea-ba5a-cfc6063db0d5 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:50:32.165356 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-090b689e-e266-47ea-ba5a-cfc6063db0d5 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:50:32.165790 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-090b689e-e266-47ea-ba5a-cfc6063db0d5 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:50:32.302108 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-090b689e-e266-47ea-ba5a-cfc6063db0d5 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab3130962a6456bbbcb1c96aba3506d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79efe2b5db31498c81c59b086e5c6f84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:50:32.309888 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-090b689e-e266-47ea-ba5a-cfc6063db0d5 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] 10.222.0.48 "GET /compute/v2.1/servers/390b2d03-4e54-44c3-91db-08c6eed28adb" status: 200 len: 1680 microversion: 2.1 time: 0.157178 Jun 17 15:50:32.310465 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1579/3572] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:50:32 2022] GET /compute/v2.1/servers/390b2d03-4e54-44c3-91db-08c6eed28adb => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:50:33.327749 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-68cb2c1b-ab31-4c55-bcc8-4d805a797070 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:50:33.328487 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-68cb2c1b-ab31-4c55-bcc8-4d805a797070 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] [instance: 390b2d03-4e54-44c3-91db-08c6eed28adb] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:50:33.335073 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-68cb2c1b-ab31-4c55-bcc8-4d805a797070 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:50:33.335520 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-68cb2c1b-ab31-4c55-bcc8-4d805a797070 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:50:33.336288 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-68cb2c1b-ab31-4c55-bcc8-4d805a797070 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:50:33.336749 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-68cb2c1b-ab31-4c55-bcc8-4d805a797070 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:50:33.478331 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-68cb2c1b-ab31-4c55-bcc8-4d805a797070 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab3130962a6456bbbcb1c96aba3506d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79efe2b5db31498c81c59b086e5c6f84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:50:33.486014 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-68cb2c1b-ab31-4c55-bcc8-4d805a797070 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] 10.222.0.48 "GET /compute/v2.1/servers/390b2d03-4e54-44c3-91db-08c6eed28adb" status: 200 len: 1680 microversion: 2.1 time: 0.162578 Jun 17 15:50:33.486585 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1994/3573] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:50:33 2022] GET /compute/v2.1/servers/390b2d03-4e54-44c3-91db-08c6eed28adb => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:50:33.672149 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-abf2a392-a0a2-494a-aff3-f9f4108dc7dc tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:50:33.672789 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-abf2a392-a0a2-494a-aff3-f9f4108dc7dc tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] [instance: fd8af8c4-d147-4335-90c9-81fe1da1297f] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:50:33.679148 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-abf2a392-a0a2-494a-aff3-f9f4108dc7dc tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:50:33.679599 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-abf2a392-a0a2-494a-aff3-f9f4108dc7dc tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:50:33.680363 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-abf2a392-a0a2-494a-aff3-f9f4108dc7dc tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:50:33.680797 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-abf2a392-a0a2-494a-aff3-f9f4108dc7dc tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:50:33.759361 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.objects.instance [None req-abf2a392-a0a2-494a-aff3-f9f4108dc7dc tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lazy-loading 'services' on Instance uuid fd8af8c4-d147-4335-90c9-81fe1da1297f {{(pid=117649) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 15:50:33.830209 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-abf2a392-a0a2-494a-aff3-f9f4108dc7dc tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] 10.222.0.48 "DELETE /compute/v2.1/servers/fd8af8c4-d147-4335-90c9-81fe1da1297f/os-volume_attachments/be3e15ad-59cc-4a90-ac9d-a707c1952aaa" status: 202 len: 0 microversion: 2.1 time: 0.162412 Jun 17 15:50:33.830782 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1580/3574] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Jun 17 15:50:33 2022] DELETE /compute/v2.1/servers/fd8af8c4-d147-4335-90c9-81fe1da1297f/os-volume_attachments/be3e15ad-59cc-4a90-ac9d-a707c1952aaa => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 15:50:34.503129 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-859b8dfb-7f29-4e63-b822-63aadfe73afc tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:50:34.503755 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-859b8dfb-7f29-4e63-b822-63aadfe73afc tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] [instance: 390b2d03-4e54-44c3-91db-08c6eed28adb] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:50:34.511265 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-859b8dfb-7f29-4e63-b822-63aadfe73afc tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:50:34.511724 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-859b8dfb-7f29-4e63-b822-63aadfe73afc tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:50:34.512719 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-859b8dfb-7f29-4e63-b822-63aadfe73afc tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:50:34.513304 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-859b8dfb-7f29-4e63-b822-63aadfe73afc tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:50:34.583126 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-859b8dfb-7f29-4e63-b822-63aadfe73afc tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab3130962a6456bbbcb1c96aba3506d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79efe2b5db31498c81c59b086e5c6f84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:50:34.592454 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-859b8dfb-7f29-4e63-b822-63aadfe73afc tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] 10.222.0.48 "GET /compute/v2.1/servers/390b2d03-4e54-44c3-91db-08c6eed28adb" status: 200 len: 1612 microversion: 2.1 time: 0.093105 Jun 17 15:50:34.593135 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1995/3575] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:50:34 2022] GET /compute/v2.1/servers/390b2d03-4e54-44c3-91db-08c6eed28adb => generated 1612 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:50:34.837402 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [req-7fd4a5d6-6fbb-41aa-b3f9-991686169a3f req-eab5a2f4-1212-42f2-a4e2-6062c70535a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "390b2d03-4e54-44c3-91db-08c6eed28adb", "name": "network-vif-deleted", "tag": "4b7d847d-258d-49e0-854f-733e710260d5"}]} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:50:34.856708 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-7fd4a5d6-6fbb-41aa-b3f9-991686169a3f req-eab5a2f4-1212-42f2-a4e2-6062c70535a6 service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:50:34.857474 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-7fd4a5d6-6fbb-41aa-b3f9-991686169a3f req-eab5a2f4-1212-42f2-a4e2-6062c70535a6 service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:50:34.871285 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.compute.server_external_events [req-7fd4a5d6-6fbb-41aa-b3f9-991686169a3f req-eab5a2f4-1212-42f2-a4e2-6062c70535a6 service nova] Creating event network-vif-deleted:4b7d847d-258d-49e0-854f-733e710260d5 for instance 390b2d03-4e54-44c3-91db-08c6eed28adb on hv-cinder-82549 Jun 17 15:50:34.876511 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [req-7fd4a5d6-6fbb-41aa-b3f9-991686169a3f req-eab5a2f4-1212-42f2-a4e2-6062c70535a6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125468 Jun 17 15:50:34.877278 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1581/3576] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 15:50:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:50:34.957806 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-1680e33f-4564-46eb-8414-0ce5c6a30ed3 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:50:34.965766 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1680e33f-4564-46eb-8414-0ce5c6a30ed3 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:50:34.966495 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1680e33f-4564-46eb-8414-0ce5c6a30ed3 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:50:34.992602 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-1680e33f-4564-46eb-8414-0ce5c6a30ed3 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] [instance: fd8af8c4-d147-4335-90c9-81fe1da1297f] Going to try to stop instance {{(pid=117650) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 17 15:50:35.045804 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-1680e33f-4564-46eb-8414-0ce5c6a30ed3 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] 10.222.0.48 "POST /compute/v2.1/servers/fd8af8c4-d147-4335-90c9-81fe1da1297f/action" status: 202 len: 0 microversion: 2.1 time: 0.091873 Jun 17 15:50:35.046662 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1996/3577] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jun 17 15:50:34 2022] POST /compute/v2.1/servers/fd8af8c4-d147-4335-90c9-81fe1da1297f/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 17 15:50:35.056864 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-59c4d7bc-6aa4-4fca-aa86-79d4c8aa01ef tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:50:35.056864 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-59c4d7bc-6aa4-4fca-aa86-79d4c8aa01ef tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] [instance: fd8af8c4-d147-4335-90c9-81fe1da1297f] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:50:35.063562 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-59c4d7bc-6aa4-4fca-aa86-79d4c8aa01ef tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:50:35.064086 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-59c4d7bc-6aa4-4fca-aa86-79d4c8aa01ef tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:50:35.064954 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-59c4d7bc-6aa4-4fca-aa86-79d4c8aa01ef tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:50:35.065510 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-59c4d7bc-6aa4-4fca-aa86-79d4c8aa01ef tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:50:35.218480 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-59c4d7bc-6aa4-4fca-aa86-79d4c8aa01ef tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a67b4188f6248cca9ce2f4991d78e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48712151f8a4942a0a08d09a80c902d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:50:35.226056 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-59c4d7bc-6aa4-4fca-aa86-79d4c8aa01ef tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] 10.222.0.48 "GET /compute/v2.1/servers/fd8af8c4-d147-4335-90c9-81fe1da1297f" status: 200 len: 1677 microversion: 2.1 time: 0.175310 Jun 17 15:50:35.226619 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1582/3578] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:50:35 2022] GET /compute/v2.1/servers/fd8af8c4-d147-4335-90c9-81fe1da1297f => generated 1677 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:50:35.613263 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-9c07afd5-435b-4503-b702-42c2caeffa82 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:50:35.613974 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-9c07afd5-435b-4503-b702-42c2caeffa82 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] [instance: 390b2d03-4e54-44c3-91db-08c6eed28adb] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:50:35.620882 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9c07afd5-435b-4503-b702-42c2caeffa82 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:50:35.622183 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9c07afd5-435b-4503-b702-42c2caeffa82 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:50:35.622992 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9c07afd5-435b-4503-b702-42c2caeffa82 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:50:35.623429 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9c07afd5-435b-4503-b702-42c2caeffa82 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:50:35.661845 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9c07afd5-435b-4503-b702-42c2caeffa82 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:50:35.662499 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-9c07afd5-435b-4503-b702-42c2caeffa82 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:50:35.663419 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.objects.instance [None req-9c07afd5-435b-4503-b702-42c2caeffa82 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lazy-loading 'fault' on Instance uuid 390b2d03-4e54-44c3-91db-08c6eed28adb {{(pid=117650) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 15:50:35.716774 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-9c07afd5-435b-4503-b702-42c2caeffa82 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab3130962a6456bbbcb1c96aba3506d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79efe2b5db31498c81c59b086e5c6f84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:50:35.724612 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-9c07afd5-435b-4503-b702-42c2caeffa82 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] 10.222.0.48 "GET /compute/v2.1/servers/390b2d03-4e54-44c3-91db-08c6eed28adb" status: 200 len: 1330 microversion: 2.1 time: 0.116652 Jun 17 15:50:35.734543 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1997/3579] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:50:35 2022] GET /compute/v2.1/servers/390b2d03-4e54-44c3-91db-08c6eed28adb => generated 1330 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:50:36.243420 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-486ac236-56e1-479f-b2c6-e5fe295c955f tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:50:36.244024 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-486ac236-56e1-479f-b2c6-e5fe295c955f tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] [instance: fd8af8c4-d147-4335-90c9-81fe1da1297f] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:50:36.251291 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-486ac236-56e1-479f-b2c6-e5fe295c955f tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:50:36.251743 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-486ac236-56e1-479f-b2c6-e5fe295c955f tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:50:36.252777 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-486ac236-56e1-479f-b2c6-e5fe295c955f tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:50:36.252982 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-486ac236-56e1-479f-b2c6-e5fe295c955f tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:50:36.383456 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-486ac236-56e1-479f-b2c6-e5fe295c955f tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a67b4188f6248cca9ce2f4991d78e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48712151f8a4942a0a08d09a80c902d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:50:36.391241 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-486ac236-56e1-479f-b2c6-e5fe295c955f tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] 10.222.0.48 "GET /compute/v2.1/servers/fd8af8c4-d147-4335-90c9-81fe1da1297f" status: 200 len: 1677 microversion: 2.1 time: 0.151760 Jun 17 15:50:36.391804 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1583/3580] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:50:36 2022] GET /compute/v2.1/servers/fd8af8c4-d147-4335-90c9-81fe1da1297f => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:50:36.742560 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-ba8d7e28-0312-46be-9a55-c18e9ddc0b8c tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:50:36.743304 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-ba8d7e28-0312-46be-9a55-c18e9ddc0b8c tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] [instance: 390b2d03-4e54-44c3-91db-08c6eed28adb] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:50:36.749950 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ba8d7e28-0312-46be-9a55-c18e9ddc0b8c tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:50:36.750400 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ba8d7e28-0312-46be-9a55-c18e9ddc0b8c tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:50:36.751158 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ba8d7e28-0312-46be-9a55-c18e9ddc0b8c tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:50:36.751590 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-ba8d7e28-0312-46be-9a55-c18e9ddc0b8c tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:50:36.765369 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.wsgi [None req-ba8d7e28-0312-46be-9a55-c18e9ddc0b8c tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] HTTP exception thrown: Instance 390b2d03-4e54-44c3-91db-08c6eed28adb could not be found. Jun 17 15:50:36.767093 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-ba8d7e28-0312-46be-9a55-c18e9ddc0b8c tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Request method failure captured: Jun 17 15:50:36.767093 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: request: GET /compute/v2.1/servers/390b2d03-4e54-44c3-91db-08c6eed28adb HTTP/1.1 Jun 17 15:50:36.767093 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Accept: application/json Jun 17 15:50:36.767093 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Accept-Encoding: identity Jun 17 15:50:36.767093 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Connection: close Jun 17 15:50:36.767093 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Content-Length: 0 Jun 17 15:50:36.767093 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Content-Type: application/json Jun 17 15:50:36.767093 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Host: 10.222.0.48 Jun 17 15:50:36.767093 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Openstack-System-Scope: None Jun 17 15:50:36.767093 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: User-Agent: python-urllib3/1.26.9 Jun 17 15:50:36.767093 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Auth-Token: gAAAAABirKICwWnhD993Jl4IhDGE-QonLGXk8DgdDZd8k6DQ9ib1E3iCeZvkPKJ1yooc16OipcuLAmHVKfeflaAMN8pddeU0L_b0r5jZEMoMoQRDnLv1aSXXTkcHo205L-oyOwE_Oe-bVu0FH4Pz82Sgm44hDcOVXCq7XBTJwNam2wPPozTvXCI Jun 17 15:50:36.767093 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Domain-Id: None Jun 17 15:50:36.767093 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Domain-Name: None Jun 17 15:50:36.767093 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Identity-Status: Confirmed Jun 17 15:50:36.767093 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Is-Admin-Project: True Jun 17 15:50:36.767093 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Domain-Id: default Jun 17 15:50:36.767093 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Domain-Name: Default Jun 17 15:50:36.767093 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Id: 79efe2b5db31498c81c59b086e5c6f84 Jun 17 15:50:36.767093 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Name: tempest-AttachVolumeNegativeTest-957597123 Jun 17 15:50:36.767093 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Role: reader,member Jun 17 15:50:36.767093 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Roles: reader,member Jun 17 15:50:36.768990 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_79efe2b5db31498c81c59b086e5c6f84", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/79efe2b5db31498c81c59b086e5c6f84"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/79efe2b5db31498c81c59b086e5c6f84"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/79efe2b5db31498c81c59b086e5c6f84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Jun 17 15:50:36.768990 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant: tempest-AttachVolumeNegativeTest-957597123 Jun 17 15:50:36.768990 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant-Id: 79efe2b5db31498c81c59b086e5c6f84 Jun 17 15:50:36.768990 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-957597123 Jun 17 15:50:36.768990 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User: tempest-AttachVolumeNegativeTest-957597123-project Jun 17 15:50:36.768990 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Domain-Id: default Jun 17 15:50:36.768990 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Domain-Name: Default Jun 17 15:50:36.768990 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Id: 8ab3130962a6456bbbcb1c96aba3506d Jun 17 15:50:36.768990 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Name: tempest-AttachVolumeNegativeTest-957597123-project Jun 17 15:50:36.768990 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: method: > Jun 17 15:50:36.768990 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: exception: Instance 390b2d03-4e54-44c3-91db-08c6eed28adb could not be found. Jun 17 15:50:36.768990 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: action_args: {'id': '390b2d03-4e54-44c3-91db-08c6eed28adb'} Jun 17 15:50:36.769887 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 15:50:36.769887 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:50:36.769887 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 15:50:36.769887 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 15:50:36.769887 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 15:50:36.769887 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 15:50:36.769887 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 15:50:36.769887 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 15:50:36.769887 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 15:50:36.769887 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 15:50:36.769887 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 390b2d03-4e54-44c3-91db-08c6eed28adb could not be found. Jun 17 15:50:36.769887 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:50:36.769887 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:50:36.769887 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:50:36.769887 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:50:36.769887 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:50:36.769887 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:50:36.769887 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 15:50:36.769887 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 15:50:36.769887 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 15:50:36.771584 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 15:50:36.771584 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 15:50:36.771584 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 15:50:36.771584 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 15:50:36.771584 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 15:50:36.771584 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 15:50:36.771584 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 15:50:36.771584 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 390b2d03-4e54-44c3-91db-08c6eed28adb could not be found. Jun 17 15:50:36.771584 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:50:36.771584 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:50:36.771584 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:50:36.771584 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:50:36.771584 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:50:36.771584 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:50:36.771584 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 15:50:36.771584 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 15:50:36.771584 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 390b2d03-4e54-44c3-91db-08c6eed28adb could not be found. Jun 17 15:50:36.771584 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:50:36.773272 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-ba8d7e28-0312-46be-9a55-c18e9ddc0b8c tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Returning 404 to user: Instance 390b2d03-4e54-44c3-91db-08c6eed28adb could not be found. {{(pid=117650) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 15:50:36.773272 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-ba8d7e28-0312-46be-9a55-c18e9ddc0b8c tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] 10.222.0.48 "GET /compute/v2.1/servers/390b2d03-4e54-44c3-91db-08c6eed28adb" status: 404 len: 111 microversion: 2.1 time: 0.029971 Jun 17 15:50:36.773272 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1998/3581] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:50:36 2022] GET /compute/v2.1/servers/390b2d03-4e54-44c3-91db-08c6eed28adb => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 15:50:36.778192 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-038e1baa-5357-440b-ae5d-5ec6b81ca5d1 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Calling method '.version_select at 0x7faf54bf4310>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:50:36.799064 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-038e1baa-5357-440b-ae5d-5ec6b81ca5d1 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-834307557" status: 202 len: 0 microversion: 2.1 time: 0.025249 Jun 17 15:50:36.799650 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1584/3582] 10.222.0.48 () {58 vars in 1217 bytes} [Fri Jun 17 15:50:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-834307557 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 15:50:37.408787 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-36de62d4-70e6-449b-beab-715a271f5e33 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:50:37.409402 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-36de62d4-70e6-449b-beab-715a271f5e33 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] [instance: fd8af8c4-d147-4335-90c9-81fe1da1297f] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:50:37.415622 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-36de62d4-70e6-449b-beab-715a271f5e33 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:50:37.416073 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-36de62d4-70e6-449b-beab-715a271f5e33 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:50:37.416875 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-36de62d4-70e6-449b-beab-715a271f5e33 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:50:37.417313 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-36de62d4-70e6-449b-beab-715a271f5e33 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:50:37.640276 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-36de62d4-70e6-449b-beab-715a271f5e33 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a67b4188f6248cca9ce2f4991d78e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48712151f8a4942a0a08d09a80c902d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:50:37.649239 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-36de62d4-70e6-449b-beab-715a271f5e33 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] 10.222.0.48 "GET /compute/v2.1/servers/fd8af8c4-d147-4335-90c9-81fe1da1297f" status: 200 len: 1677 microversion: 2.1 time: 0.243516 Jun 17 15:50:37.649435 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 1999/3583] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:50:37 2022] GET /compute/v2.1/servers/fd8af8c4-d147-4335-90c9-81fe1da1297f => generated 1677 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:50:37.720529 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-ed9bd003-359b-4618-8944-48b425011612 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Action: 'create', calling method: .version_select at 0x7faf54c05280>, body: {"keypair": {"name": "tempest-keypair-330527002", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIOIQkT+jwjCNilUW2D4R2Mt4NrQxlGCdPPa+Y0uT0KyTXUAdE/NNr0dS0lkbBHGYw3I5/cGVjFhrNxMDpcJAgVTz3DXSM2vhHeSb8GXfOmijVMuzh8EDVThw10LwiCNLg=="}} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:50:37.736045 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.quota [None req-ed9bd003-359b-4618-8944-48b425011612 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Getting quotas for project 79efe2b5db31498c81c59b086e5c6f84. Resources: {'key_pairs'} {{(pid=117649) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 15:50:37.740074 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.quota [None req-ed9bd003-359b-4618-8944-48b425011612 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Getting quotas for user 8ab3130962a6456bbbcb1c96aba3506d and project 79efe2b5db31498c81c59b086e5c6f84. Resources: {'key_pairs'} {{(pid=117649) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 15:50:37.762246 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-ed9bd003-359b-4618-8944-48b425011612 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.045391 Jun 17 15:50:37.762826 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1585/3584] 10.222.0.48 () {60 vars in 1158 bytes} [Fri Jun 17 15:50:37 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:50:38.666429 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-4748f665-89b3-47c7-8803-5c43dd00eb84 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:50:38.667045 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-4748f665-89b3-47c7-8803-5c43dd00eb84 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] [instance: fd8af8c4-d147-4335-90c9-81fe1da1297f] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:50:38.673529 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4748f665-89b3-47c7-8803-5c43dd00eb84 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:50:38.673984 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4748f665-89b3-47c7-8803-5c43dd00eb84 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:50:38.674745 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4748f665-89b3-47c7-8803-5c43dd00eb84 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:50:38.675184 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4748f665-89b3-47c7-8803-5c43dd00eb84 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:50:38.887630 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-4748f665-89b3-47c7-8803-5c43dd00eb84 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a67b4188f6248cca9ce2f4991d78e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48712151f8a4942a0a08d09a80c902d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:50:38.895284 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-4748f665-89b3-47c7-8803-5c43dd00eb84 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] 10.222.0.48 "GET /compute/v2.1/servers/fd8af8c4-d147-4335-90c9-81fe1da1297f" status: 200 len: 1677 microversion: 2.1 time: 0.232824 Jun 17 15:50:38.895850 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 2000/3585] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:50:38 2022] GET /compute/v2.1/servers/fd8af8c4-d147-4335-90c9-81fe1da1297f => generated 1677 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:50:39.078416 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-cfe21961-85ce-4101-a2ec-75a45383c69e tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1487482406", "imageRef": "8c105ca4-6fe3-4e70-af71-b03c64fe1efe", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "288b7261-f0bd-4510-ab2e-0de2bc8999e0"}], "security_groups": [{"name": "tempest-securitygroup--1161074803"}], "key_name": "tempest-keypair-330527002", "user_data": "}} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:50:39.186212 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.network.neutron [None req-cfe21961-85ce-4101-a2ec-75a45383c69e tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] validate_networks() for [('288b7261-f0bd-4510-ab2e-0de2bc8999e0', None, None, None, None, None)] {{(pid=117649) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 15:50:39.632288 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-cfe21961-85ce-4101-a2ec-75a45383c69e tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Flavor limits 0:0:0 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 15:50:39.632757 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-cfe21961-85ce-4101-a2ec-75a45383c69e tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Image limits 0:0:0 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 15:50:39.633230 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-cfe21961-85ce-4101-a2ec-75a45383c69e tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Flavor pref 0:0:0 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 15:50:39.633644 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-cfe21961-85ce-4101-a2ec-75a45383c69e tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Image pref 0:0:0 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 15:50:39.634055 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.virt.hardware [None req-cfe21961-85ce-4101-a2ec-75a45383c69e tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117649) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 15:50:39.644621 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cfe21961-85ce-4101-a2ec-75a45383c69e tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:50:39.645070 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cfe21961-85ce-4101-a2ec-75a45383c69e tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:50:39.645863 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cfe21961-85ce-4101-a2ec-75a45383c69e tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:50:39.646298 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-cfe21961-85ce-4101-a2ec-75a45383c69e tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:50:39.663378 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.quota [None req-cfe21961-85ce-4101-a2ec-75a45383c69e tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Getting quotas for project 79efe2b5db31498c81c59b086e5c6f84. Resources: {'cores', 'ram', 'instances'} {{(pid=117649) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 15:50:39.667485 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.quota [None req-cfe21961-85ce-4101-a2ec-75a45383c69e tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Getting quotas for user 8ab3130962a6456bbbcb1c96aba3506d and project 79efe2b5db31498c81c59b086e5c6f84. Resources: {'cores', 'ram', 'instances'} {{(pid=117649) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 15:50:39.678573 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-cfe21961-85ce-4101-a2ec-75a45383c69e tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Going to run 1 instances... {{(pid=117649) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 15:50:39.680886 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-cfe21961-85ce-4101-a2ec-75a45383c69e tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] [instance: 537247a8-cd91-485c-b763-5f8d6e27d81e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c105ca4-6fe3-4e70-af71-b03c64fe1efe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117649) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 15:50:39.728925 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-cfe21961-85ce-4101-a2ec-75a45383c69e tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.655095 Jun 17 15:50:39.729668 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1586/3586] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Jun 17 15:50:39 2022] POST /compute/v2.1/servers => generated 402 bytes in 657 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 15:50:39.740834 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-81da623d-b9c1-4843-827d-d3f3e3e9afaf tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:50:39.741555 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-81da623d-b9c1-4843-827d-d3f3e3e9afaf tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] [instance: 537247a8-cd91-485c-b763-5f8d6e27d81e] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:50:39.801893 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-81da623d-b9c1-4843-827d-d3f3e3e9afaf tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab3130962a6456bbbcb1c96aba3506d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79efe2b5db31498c81c59b086e5c6f84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:50:39.810221 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-81da623d-b9c1-4843-827d-d3f3e3e9afaf tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] 10.222.0.48 "GET /compute/v2.1/servers/537247a8-cd91-485c-b763-5f8d6e27d81e" status: 200 len: 1241 microversion: 2.1 time: 0.072604 Jun 17 15:50:39.810894 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 2001/3587] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:50:39 2022] GET /compute/v2.1/servers/537247a8-cd91-485c-b763-5f8d6e27d81e => generated 1241 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:50:39.914405 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-d55f7eff-2f14-40f5-b63b-c5abea8dbfc9 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:50:39.914954 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-d55f7eff-2f14-40f5-b63b-c5abea8dbfc9 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] [instance: fd8af8c4-d147-4335-90c9-81fe1da1297f] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:50:39.922165 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d55f7eff-2f14-40f5-b63b-c5abea8dbfc9 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:50:39.922623 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d55f7eff-2f14-40f5-b63b-c5abea8dbfc9 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:50:39.923623 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d55f7eff-2f14-40f5-b63b-c5abea8dbfc9 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:50:39.923823 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-d55f7eff-2f14-40f5-b63b-c5abea8dbfc9 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:50:40.064116 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-d55f7eff-2f14-40f5-b63b-c5abea8dbfc9 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a67b4188f6248cca9ce2f4991d78e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48712151f8a4942a0a08d09a80c902d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:50:40.072494 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-d55f7eff-2f14-40f5-b63b-c5abea8dbfc9 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] 10.222.0.48 "GET /compute/v2.1/servers/fd8af8c4-d147-4335-90c9-81fe1da1297f" status: 200 len: 1677 microversion: 2.1 time: 0.161993 Jun 17 15:50:40.073077 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1587/3588] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:50:39 2022] GET /compute/v2.1/servers/fd8af8c4-d147-4335-90c9-81fe1da1297f => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:50:40.828116 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-5539021e-e30e-4980-9c00-0ed918663b92 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:50:40.829320 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-5539021e-e30e-4980-9c00-0ed918663b92 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] [instance: 537247a8-cd91-485c-b763-5f8d6e27d81e] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:50:40.841728 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5539021e-e30e-4980-9c00-0ed918663b92 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:50:40.842497 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5539021e-e30e-4980-9c00-0ed918663b92 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:50:40.843894 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5539021e-e30e-4980-9c00-0ed918663b92 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:50:40.844735 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5539021e-e30e-4980-9c00-0ed918663b92 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:50:40.923232 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-5539021e-e30e-4980-9c00-0ed918663b92 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab3130962a6456bbbcb1c96aba3506d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79efe2b5db31498c81c59b086e5c6f84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:50:40.932381 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-5539021e-e30e-4980-9c00-0ed918663b92 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] 10.222.0.48 "GET /compute/v2.1/servers/537247a8-cd91-485c-b763-5f8d6e27d81e" status: 200 len: 1301 microversion: 2.1 time: 0.109070 Jun 17 15:50:40.942553 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 2002/3589] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:50:40 2022] GET /compute/v2.1/servers/537247a8-cd91-485c-b763-5f8d6e27d81e => generated 1301 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:50:41.090154 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-00591fdf-73bd-46ca-ab55-67e83d1c647d tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:50:41.090841 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-00591fdf-73bd-46ca-ab55-67e83d1c647d tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] [instance: fd8af8c4-d147-4335-90c9-81fe1da1297f] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:50:41.097577 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-00591fdf-73bd-46ca-ab55-67e83d1c647d tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:50:41.098032 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-00591fdf-73bd-46ca-ab55-67e83d1c647d tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:50:41.098782 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-00591fdf-73bd-46ca-ab55-67e83d1c647d tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:50:41.099212 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-00591fdf-73bd-46ca-ab55-67e83d1c647d tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:50:41.325344 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-00591fdf-73bd-46ca-ab55-67e83d1c647d tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a67b4188f6248cca9ce2f4991d78e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48712151f8a4942a0a08d09a80c902d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:50:41.337880 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-00591fdf-73bd-46ca-ab55-67e83d1c647d tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] 10.222.0.48 "GET /compute/v2.1/servers/fd8af8c4-d147-4335-90c9-81fe1da1297f" status: 200 len: 1677 microversion: 2.1 time: 0.251762 Jun 17 15:50:41.338267 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1588/3590] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:50:41 2022] GET /compute/v2.1/servers/fd8af8c4-d147-4335-90c9-81fe1da1297f => generated 1677 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:50:41.950170 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-53b3a1a4-c5c7-4018-8d7d-a3d72af4e182 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:50:41.950859 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-53b3a1a4-c5c7-4018-8d7d-a3d72af4e182 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] [instance: 537247a8-cd91-485c-b763-5f8d6e27d81e] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:50:41.957637 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-53b3a1a4-c5c7-4018-8d7d-a3d72af4e182 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:50:41.958204 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-53b3a1a4-c5c7-4018-8d7d-a3d72af4e182 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:50:41.959046 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-53b3a1a4-c5c7-4018-8d7d-a3d72af4e182 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:50:41.959683 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-53b3a1a4-c5c7-4018-8d7d-a3d72af4e182 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:50:42.093947 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-53b3a1a4-c5c7-4018-8d7d-a3d72af4e182 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab3130962a6456bbbcb1c96aba3506d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79efe2b5db31498c81c59b086e5c6f84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:50:42.102249 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-53b3a1a4-c5c7-4018-8d7d-a3d72af4e182 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] 10.222.0.48 "GET /compute/v2.1/servers/537247a8-cd91-485c-b763-5f8d6e27d81e" status: 200 len: 1367 microversion: 2.1 time: 0.156498 Jun 17 15:50:42.103084 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 2003/3591] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:50:41 2022] GET /compute/v2.1/servers/537247a8-cd91-485c-b763-5f8d6e27d81e => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:50:42.355880 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-ba47f0f4-a30b-405f-a452-436cf1fcb27b tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:50:42.356676 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-ba47f0f4-a30b-405f-a452-436cf1fcb27b tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] [instance: fd8af8c4-d147-4335-90c9-81fe1da1297f] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:50:42.363770 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ba47f0f4-a30b-405f-a452-436cf1fcb27b tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:50:42.364275 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ba47f0f4-a30b-405f-a452-436cf1fcb27b tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:50:42.365371 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ba47f0f4-a30b-405f-a452-436cf1fcb27b tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:50:42.365814 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ba47f0f4-a30b-405f-a452-436cf1fcb27b tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:50:42.489532 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [req-97496f3d-3327-4240-af4b-74f527bbceeb req-a864c7d6-ce5b-4a6b-9700-772313d970e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "537247a8-cd91-485c-b763-5f8d6e27d81e", "tag": "35d0a0c8-023f-4095-8014-a1d27ba2ac79"}]} {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:50:42.506752 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [req-97496f3d-3327-4240-af4b-74f527bbceeb req-a864c7d6-ce5b-4a6b-9700-772313d970e8 service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:50:42.512999 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [req-97496f3d-3327-4240-af4b-74f527bbceeb req-a864c7d6-ce5b-4a6b-9700-772313d970e8 service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:50:42.543960 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.compute.server_external_events [req-97496f3d-3327-4240-af4b-74f527bbceeb req-a864c7d6-ce5b-4a6b-9700-772313d970e8 service nova] Creating event network-changed:35d0a0c8-023f-4095-8014-a1d27ba2ac79 for instance 537247a8-cd91-485c-b763-5f8d6e27d81e on hv-cinder-82549 Jun 17 15:50:42.549688 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [req-97496f3d-3327-4240-af4b-74f527bbceeb req-a864c7d6-ce5b-4a6b-9700-772313d970e8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064091 Jun 17 15:50:42.551139 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 2004/3592] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 15:50:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:50:42.616190 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-ba47f0f4-a30b-405f-a452-436cf1fcb27b tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a67b4188f6248cca9ce2f4991d78e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48712151f8a4942a0a08d09a80c902d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:50:42.624683 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-ba47f0f4-a30b-405f-a452-436cf1fcb27b tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] 10.222.0.48 "GET /compute/v2.1/servers/fd8af8c4-d147-4335-90c9-81fe1da1297f" status: 200 len: 1677 microversion: 2.1 time: 0.273325 Jun 17 15:50:42.625419 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1589/3593] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:50:42 2022] GET /compute/v2.1/servers/fd8af8c4-d147-4335-90c9-81fe1da1297f => generated 1677 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:50:43.121329 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-cd2dc09b-9182-4767-aaca-a9eec317279b tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:50:43.122021 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-cd2dc09b-9182-4767-aaca-a9eec317279b tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] [instance: 537247a8-cd91-485c-b763-5f8d6e27d81e] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:50:43.128207 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cd2dc09b-9182-4767-aaca-a9eec317279b tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:50:43.128678 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cd2dc09b-9182-4767-aaca-a9eec317279b tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:50:43.129421 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cd2dc09b-9182-4767-aaca-a9eec317279b tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:50:43.129846 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cd2dc09b-9182-4767-aaca-a9eec317279b tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:50:43.262055 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-cd2dc09b-9182-4767-aaca-a9eec317279b tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab3130962a6456bbbcb1c96aba3506d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79efe2b5db31498c81c59b086e5c6f84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:50:43.269394 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-cd2dc09b-9182-4767-aaca-a9eec317279b tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] 10.222.0.48 "GET /compute/v2.1/servers/537247a8-cd91-485c-b763-5f8d6e27d81e" status: 200 len: 1367 microversion: 2.1 time: 0.152724 Jun 17 15:50:43.269944 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 2005/3594] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:50:43 2022] GET /compute/v2.1/servers/537247a8-cd91-485c-b763-5f8d6e27d81e => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:50:43.642853 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-62413357-bb3d-43f7-a220-189d13d3f569 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:50:43.643476 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-62413357-bb3d-43f7-a220-189d13d3f569 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] [instance: fd8af8c4-d147-4335-90c9-81fe1da1297f] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:50:43.650103 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-62413357-bb3d-43f7-a220-189d13d3f569 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:50:43.650549 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-62413357-bb3d-43f7-a220-189d13d3f569 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:50:43.651319 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-62413357-bb3d-43f7-a220-189d13d3f569 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:50:43.651794 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-62413357-bb3d-43f7-a220-189d13d3f569 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:50:44.122074 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-62413357-bb3d-43f7-a220-189d13d3f569 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a67b4188f6248cca9ce2f4991d78e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48712151f8a4942a0a08d09a80c902d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:50:44.129799 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-62413357-bb3d-43f7-a220-189d13d3f569 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] 10.222.0.48 "GET /compute/v2.1/servers/fd8af8c4-d147-4335-90c9-81fe1da1297f" status: 200 len: 1677 microversion: 2.1 time: 0.490908 Jun 17 15:50:44.130483 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1590/3595] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:50:43 2022] GET /compute/v2.1/servers/fd8af8c4-d147-4335-90c9-81fe1da1297f => generated 1677 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:50:44.289487 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-4caecee7-5761-4e07-b7c5-1196217ffb4a tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:50:44.290579 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-4caecee7-5761-4e07-b7c5-1196217ffb4a tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] [instance: 537247a8-cd91-485c-b763-5f8d6e27d81e] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:50:44.299431 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4caecee7-5761-4e07-b7c5-1196217ffb4a tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:50:44.299896 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4caecee7-5761-4e07-b7c5-1196217ffb4a tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:50:44.300696 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4caecee7-5761-4e07-b7c5-1196217ffb4a tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:50:44.301243 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4caecee7-5761-4e07-b7c5-1196217ffb4a tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:50:44.306766 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:50:44.463396 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-4caecee7-5761-4e07-b7c5-1196217ffb4a tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab3130962a6456bbbcb1c96aba3506d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79efe2b5db31498c81c59b086e5c6f84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:50:44.471089 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-4caecee7-5761-4e07-b7c5-1196217ffb4a tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] 10.222.0.48 "GET /compute/v2.1/servers/537247a8-cd91-485c-b763-5f8d6e27d81e" status: 200 len: 1367 microversion: 2.1 time: 0.188299 Jun 17 15:50:44.471663 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 2006/3596] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:50:44 2022] GET /compute/v2.1/servers/537247a8-cd91-485c-b763-5f8d6e27d81e => generated 1367 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:50:45.148847 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-0c04cf66-0807-4179-8e83-98d39ff0ed80 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:50:45.149474 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-0c04cf66-0807-4179-8e83-98d39ff0ed80 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] [instance: fd8af8c4-d147-4335-90c9-81fe1da1297f] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:50:45.157303 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0c04cf66-0807-4179-8e83-98d39ff0ed80 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:50:45.157753 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0c04cf66-0807-4179-8e83-98d39ff0ed80 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:50:45.158564 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0c04cf66-0807-4179-8e83-98d39ff0ed80 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:50:45.163239 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-0c04cf66-0807-4179-8e83-98d39ff0ed80 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:50:45.339887 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-0c04cf66-0807-4179-8e83-98d39ff0ed80 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a67b4188f6248cca9ce2f4991d78e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48712151f8a4942a0a08d09a80c902d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:50:45.348016 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-0c04cf66-0807-4179-8e83-98d39ff0ed80 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] 10.222.0.48 "GET /compute/v2.1/servers/fd8af8c4-d147-4335-90c9-81fe1da1297f" status: 200 len: 1677 microversion: 2.1 time: 0.203097 Jun 17 15:50:45.348624 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1591/3597] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:50:45 2022] GET /compute/v2.1/servers/fd8af8c4-d147-4335-90c9-81fe1da1297f => generated 1677 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:50:45.488300 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-6f0d0ae9-2611-4728-8626-d251ec7217c0 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:50:45.488938 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-6f0d0ae9-2611-4728-8626-d251ec7217c0 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] [instance: 537247a8-cd91-485c-b763-5f8d6e27d81e] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:50:45.495650 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6f0d0ae9-2611-4728-8626-d251ec7217c0 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:50:45.496642 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6f0d0ae9-2611-4728-8626-d251ec7217c0 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:50:45.497408 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6f0d0ae9-2611-4728-8626-d251ec7217c0 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:50:45.497838 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6f0d0ae9-2611-4728-8626-d251ec7217c0 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:50:45.631811 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-6f0d0ae9-2611-4728-8626-d251ec7217c0 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab3130962a6456bbbcb1c96aba3506d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79efe2b5db31498c81c59b086e5c6f84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:50:45.640232 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-6f0d0ae9-2611-4728-8626-d251ec7217c0 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] 10.222.0.48 "GET /compute/v2.1/servers/537247a8-cd91-485c-b763-5f8d6e27d81e" status: 200 len: 1367 microversion: 2.1 time: 0.155843 Jun 17 15:50:45.641055 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 2007/3598] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:50:45 2022] GET /compute/v2.1/servers/537247a8-cd91-485c-b763-5f8d6e27d81e => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:50:46.366088 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-298e34c6-9a86-48fa-a160-52c7b2346327 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:50:46.366688 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-298e34c6-9a86-48fa-a160-52c7b2346327 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] [instance: fd8af8c4-d147-4335-90c9-81fe1da1297f] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:50:46.373709 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-298e34c6-9a86-48fa-a160-52c7b2346327 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:50:46.374163 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-298e34c6-9a86-48fa-a160-52c7b2346327 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:50:46.374919 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-298e34c6-9a86-48fa-a160-52c7b2346327 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:50:46.375353 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-298e34c6-9a86-48fa-a160-52c7b2346327 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:50:46.515185 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-298e34c6-9a86-48fa-a160-52c7b2346327 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a67b4188f6248cca9ce2f4991d78e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48712151f8a4942a0a08d09a80c902d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:50:46.523967 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-298e34c6-9a86-48fa-a160-52c7b2346327 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] 10.222.0.48 "GET /compute/v2.1/servers/fd8af8c4-d147-4335-90c9-81fe1da1297f" status: 200 len: 1654 microversion: 2.1 time: 0.162207 Jun 17 15:50:46.524596 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1592/3599] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:50:46 2022] GET /compute/v2.1/servers/fd8af8c4-d147-4335-90c9-81fe1da1297f => generated 1654 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:50:46.545356 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-7087b680-553e-4de6-a34d-def8d5d8ccff tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:50:46.553112 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7087b680-553e-4de6-a34d-def8d5d8ccff tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:50:46.553559 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-7087b680-553e-4de6-a34d-def8d5d8ccff tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:50:46.578915 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-7087b680-553e-4de6-a34d-def8d5d8ccff tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] [instance: fd8af8c4-d147-4335-90c9-81fe1da1297f] Going to try to start instance {{(pid=117650) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 17 15:50:46.633555 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-7087b680-553e-4de6-a34d-def8d5d8ccff tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] 10.222.0.48 "POST /compute/v2.1/servers/fd8af8c4-d147-4335-90c9-81fe1da1297f/action" status: 202 len: 0 microversion: 2.1 time: 0.095653 Jun 17 15:50:46.634153 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 2008/3600] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jun 17 15:50:46 2022] POST /compute/v2.1/servers/fd8af8c4-d147-4335-90c9-81fe1da1297f/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 15:50:46.642651 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-78711080-b4c7-4a07-b4cd-45452ee54743 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:50:46.643264 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-78711080-b4c7-4a07-b4cd-45452ee54743 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] [instance: fd8af8c4-d147-4335-90c9-81fe1da1297f] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:50:46.650599 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-78711080-b4c7-4a07-b4cd-45452ee54743 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:50:46.650599 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-78711080-b4c7-4a07-b4cd-45452ee54743 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:50:46.651324 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-78711080-b4c7-4a07-b4cd-45452ee54743 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:50:46.651695 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-78711080-b4c7-4a07-b4cd-45452ee54743 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:50:46.656980 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:50:46.659490 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-f0d144d7-e281-4b1e-9de3-a3a015531438 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:50:46.660202 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-f0d144d7-e281-4b1e-9de3-a3a015531438 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] [instance: 537247a8-cd91-485c-b763-5f8d6e27d81e] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:50:46.666693 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f0d144d7-e281-4b1e-9de3-a3a015531438 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:50:46.667103 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f0d144d7-e281-4b1e-9de3-a3a015531438 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:50:46.667873 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f0d144d7-e281-4b1e-9de3-a3a015531438 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:50:46.668294 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f0d144d7-e281-4b1e-9de3-a3a015531438 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:50:46.811663 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-f0d144d7-e281-4b1e-9de3-a3a015531438 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab3130962a6456bbbcb1c96aba3506d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79efe2b5db31498c81c59b086e5c6f84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:50:46.819382 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-f0d144d7-e281-4b1e-9de3-a3a015531438 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] 10.222.0.48 "GET /compute/v2.1/servers/537247a8-cd91-485c-b763-5f8d6e27d81e" status: 200 len: 1367 microversion: 2.1 time: 0.165113 Jun 17 15:50:46.819963 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 2009/3601] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:50:46 2022] GET /compute/v2.1/servers/537247a8-cd91-485c-b763-5f8d6e27d81e => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:50:46.841398 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-78711080-b4c7-4a07-b4cd-45452ee54743 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a67b4188f6248cca9ce2f4991d78e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48712151f8a4942a0a08d09a80c902d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:50:46.849688 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-78711080-b4c7-4a07-b4cd-45452ee54743 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] 10.222.0.48 "GET /compute/v2.1/servers/fd8af8c4-d147-4335-90c9-81fe1da1297f" status: 200 len: 1663 microversion: 2.1 time: 0.210768 Jun 17 15:50:46.850806 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1593/3602] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:50:46 2022] GET /compute/v2.1/servers/fd8af8c4-d147-4335-90c9-81fe1da1297f => generated 1663 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:50:47.837978 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-b9ea6c7e-d32d-4bb4-a9b8-a7c5975d1305 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:50:47.838639 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-b9ea6c7e-d32d-4bb4-a9b8-a7c5975d1305 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] [instance: 537247a8-cd91-485c-b763-5f8d6e27d81e] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:50:47.845344 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b9ea6c7e-d32d-4bb4-a9b8-a7c5975d1305 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:50:47.845799 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b9ea6c7e-d32d-4bb4-a9b8-a7c5975d1305 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:50:47.846576 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b9ea6c7e-d32d-4bb4-a9b8-a7c5975d1305 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:50:47.847021 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b9ea6c7e-d32d-4bb4-a9b8-a7c5975d1305 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:50:47.867394 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-9a7a5973-8b07-4c32-b78d-792f37ab15df tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:50:47.868005 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-9a7a5973-8b07-4c32-b78d-792f37ab15df tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] [instance: fd8af8c4-d147-4335-90c9-81fe1da1297f] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:50:47.875108 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9a7a5973-8b07-4c32-b78d-792f37ab15df tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:50:47.875677 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9a7a5973-8b07-4c32-b78d-792f37ab15df tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:50:47.876464 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9a7a5973-8b07-4c32-b78d-792f37ab15df tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:50:47.876896 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9a7a5973-8b07-4c32-b78d-792f37ab15df tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:50:47.992851 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-b9ea6c7e-d32d-4bb4-a9b8-a7c5975d1305 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab3130962a6456bbbcb1c96aba3506d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79efe2b5db31498c81c59b086e5c6f84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:50:48.001430 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-b9ea6c7e-d32d-4bb4-a9b8-a7c5975d1305 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] 10.222.0.48 "GET /compute/v2.1/servers/537247a8-cd91-485c-b763-5f8d6e27d81e" status: 200 len: 1367 microversion: 2.1 time: 0.168982 Jun 17 15:50:48.002016 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 2010/3603] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:50:47 2022] GET /compute/v2.1/servers/537247a8-cd91-485c-b763-5f8d6e27d81e => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:50:48.028724 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-9a7a5973-8b07-4c32-b78d-792f37ab15df tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a67b4188f6248cca9ce2f4991d78e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48712151f8a4942a0a08d09a80c902d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:50:48.037210 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-9a7a5973-8b07-4c32-b78d-792f37ab15df tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] 10.222.0.48 "GET /compute/v2.1/servers/fd8af8c4-d147-4335-90c9-81fe1da1297f" status: 200 len: 1667 microversion: 2.1 time: 0.173664 Jun 17 15:50:48.037794 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1594/3604] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:50:47 2022] GET /compute/v2.1/servers/fd8af8c4-d147-4335-90c9-81fe1da1297f => generated 1667 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:50:48.551862 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [req-44e967df-febe-4950-b8c8-ed035dac3061 req-dc473b21-3c54-4796-b94f-2748b96ed480 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "537247a8-cd91-485c-b763-5f8d6e27d81e", "name": "network-vif-plugged", "status": "completed", "tag": "35d0a0c8-023f-4095-8014-a1d27ba2ac79"}]} {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:50:48.564081 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [req-44e967df-febe-4950-b8c8-ed035dac3061 req-dc473b21-3c54-4796-b94f-2748b96ed480 service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:50:48.564607 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [req-44e967df-febe-4950-b8c8-ed035dac3061 req-dc473b21-3c54-4796-b94f-2748b96ed480 service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:50:48.575772 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.compute.server_external_events [req-44e967df-febe-4950-b8c8-ed035dac3061 req-dc473b21-3c54-4796-b94f-2748b96ed480 service nova] Creating event network-vif-plugged:35d0a0c8-023f-4095-8014-a1d27ba2ac79 for instance 537247a8-cd91-485c-b763-5f8d6e27d81e on hv-cinder-82549 Jun 17 15:50:48.580907 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [req-44e967df-febe-4950-b8c8-ed035dac3061 req-dc473b21-3c54-4796-b94f-2748b96ed480 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095771 Jun 17 15:50:48.581561 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 2011/3605] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 15:50:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:50:49.018329 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-98cce85c-193c-4531-8322-194f32c73caf tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:50:49.018946 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-98cce85c-193c-4531-8322-194f32c73caf tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] [instance: 537247a8-cd91-485c-b763-5f8d6e27d81e] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:50:49.025383 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-98cce85c-193c-4531-8322-194f32c73caf tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:50:49.025822 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-98cce85c-193c-4531-8322-194f32c73caf tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:50:49.026578 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-98cce85c-193c-4531-8322-194f32c73caf tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:50:49.027650 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-98cce85c-193c-4531-8322-194f32c73caf tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:50:49.162407 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-98cce85c-193c-4531-8322-194f32c73caf tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab3130962a6456bbbcb1c96aba3506d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79efe2b5db31498c81c59b086e5c6f84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:50:49.170066 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-98cce85c-193c-4531-8322-194f32c73caf tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] 10.222.0.48 "GET /compute/v2.1/servers/537247a8-cd91-485c-b763-5f8d6e27d81e" status: 200 len: 1367 microversion: 2.1 time: 0.155570 Jun 17 15:50:49.170648 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1595/3606] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:50:49 2022] GET /compute/v2.1/servers/537247a8-cd91-485c-b763-5f8d6e27d81e => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:50:50.184644 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell0:SELECT=2 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:50:50.189004 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-4f696f9a-b297-4551-9f16-d0040ba3e35e tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:50:50.189700 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-4f696f9a-b297-4551-9f16-d0040ba3e35e tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] [instance: 537247a8-cd91-485c-b763-5f8d6e27d81e] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:50:50.196133 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4f696f9a-b297-4551-9f16-d0040ba3e35e tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:50:50.196674 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4f696f9a-b297-4551-9f16-d0040ba3e35e tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:50:50.197422 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4f696f9a-b297-4551-9f16-d0040ba3e35e tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:50:50.197849 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4f696f9a-b297-4551-9f16-d0040ba3e35e tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:50:50.330817 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-4f696f9a-b297-4551-9f16-d0040ba3e35e tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab3130962a6456bbbcb1c96aba3506d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79efe2b5db31498c81c59b086e5c6f84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:50:50.339068 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-4f696f9a-b297-4551-9f16-d0040ba3e35e tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] 10.222.0.48 "GET /compute/v2.1/servers/537247a8-cd91-485c-b763-5f8d6e27d81e" status: 200 len: 1556 microversion: 2.1 time: 0.155786 Jun 17 15:50:50.340229 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 2012/3607] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:50:50 2022] GET /compute/v2.1/servers/537247a8-cd91-485c-b763-5f8d6e27d81e => generated 1556 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:50:50.356939 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-ce44025c-f632-4a87-bc16-026f39273f9b tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:50:50.357517 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-ce44025c-f632-4a87-bc16-026f39273f9b tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] [instance: 537247a8-cd91-485c-b763-5f8d6e27d81e] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:50:50.359187 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell0:SELECT=2 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:50:50.359988 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell0:SELECT=10 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:50:50.366158 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ce44025c-f632-4a87-bc16-026f39273f9b tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:50:50.366596 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ce44025c-f632-4a87-bc16-026f39273f9b tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:50:50.367355 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ce44025c-f632-4a87-bc16-026f39273f9b tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:50:50.367786 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-ce44025c-f632-4a87-bc16-026f39273f9b tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:50:50.448599 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-ce44025c-f632-4a87-bc16-026f39273f9b tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] 10.222.0.48 "GET /compute/v2.1/servers/537247a8-cd91-485c-b763-5f8d6e27d81e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095894 Jun 17 15:50:50.449755 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1596/3608] 10.222.0.48 () {58 vars in 1274 bytes} [Fri Jun 17 15:50:50 2022] GET /compute/v2.1/servers/537247a8-cd91-485c-b763-5f8d6e27d81e/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:50:51.434244 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [req-83526749-3124-434e-b432-4e9560c7a8d2 req-7cf9b368-1019-4bcb-95c7-0771c4bbc378 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "537247a8-cd91-485c-b763-5f8d6e27d81e", "tag": "35d0a0c8-023f-4095-8014-a1d27ba2ac79"}]} {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:50:51.443197 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [req-83526749-3124-434e-b432-4e9560c7a8d2 req-7cf9b368-1019-4bcb-95c7-0771c4bbc378 service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:50:51.443637 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [req-83526749-3124-434e-b432-4e9560c7a8d2 req-7cf9b368-1019-4bcb-95c7-0771c4bbc378 service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:50:51.456281 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.compute.server_external_events [req-83526749-3124-434e-b432-4e9560c7a8d2 req-7cf9b368-1019-4bcb-95c7-0771c4bbc378 service nova] Creating event network-changed:35d0a0c8-023f-4095-8014-a1d27ba2ac79 for instance 537247a8-cd91-485c-b763-5f8d6e27d81e on hv-cinder-82549 Jun 17 15:50:51.461170 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [req-83526749-3124-434e-b432-4e9560c7a8d2 req-7cf9b368-1019-4bcb-95c7-0771c4bbc378 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031255 Jun 17 15:50:51.461756 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 2013/3609] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 15:50:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:51:20.700909 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_api:SELECT=65,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:51:20.701750 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell1:SELECT=20 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:51:20.706202 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-bf71e244-0a5d-4ce2-927e-f5d2b2361db0 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:51:20.707171 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-bf71e244-0a5d-4ce2-927e-f5d2b2361db0 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] [instance: fd8af8c4-d147-4335-90c9-81fe1da1297f] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:51:20.714810 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bf71e244-0a5d-4ce2-927e-f5d2b2361db0 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:51:20.715252 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bf71e244-0a5d-4ce2-927e-f5d2b2361db0 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:51:20.716005 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bf71e244-0a5d-4ce2-927e-f5d2b2361db0 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:51:20.716468 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-bf71e244-0a5d-4ce2-927e-f5d2b2361db0 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:51:20.746509 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-bf71e244-0a5d-4ce2-927e-f5d2b2361db0 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] 10.222.0.48 "GET /compute/v2.1/servers/fd8af8c4-d147-4335-90c9-81fe1da1297f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046922 Jun 17 15:51:20.747048 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1597/3610] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:51:20 2022] GET /compute/v2.1/servers/fd8af8c4-d147-4335-90c9-81fe1da1297f/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 17 15:51:20.807020 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:51:20.807826 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:51:20.811791 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-09b423c8-a1b8-449e-b84f-f35d2f12e195 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:51:20.812397 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-09b423c8-a1b8-449e-b84f-f35d2f12e195 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] [instance: fd8af8c4-d147-4335-90c9-81fe1da1297f] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:51:20.820616 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-09b423c8-a1b8-449e-b84f-f35d2f12e195 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:51:20.821061 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-09b423c8-a1b8-449e-b84f-f35d2f12e195 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:51:20.821816 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-09b423c8-a1b8-449e-b84f-f35d2f12e195 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:51:20.822242 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-09b423c8-a1b8-449e-b84f-f35d2f12e195 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:51:20.847963 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-09b423c8-a1b8-449e-b84f-f35d2f12e195 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] [instance: fd8af8c4-d147-4335-90c9-81fe1da1297f] Going to try to terminate instance {{(pid=117650) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 15:51:20.922866 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-09b423c8-a1b8-449e-b84f-f35d2f12e195 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] 10.222.0.48 "DELETE /compute/v2.1/servers/fd8af8c4-d147-4335-90c9-81fe1da1297f" status: 204 len: 0 microversion: 2.1 time: 0.117037 Jun 17 15:51:20.923419 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 2014/3611] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jun 17 15:51:20 2022] DELETE /compute/v2.1/servers/fd8af8c4-d147-4335-90c9-81fe1da1297f => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 15:51:20.932354 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-37a2de97-016e-40b0-a1ab-d796d1958a2e tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:51:20.933002 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-37a2de97-016e-40b0-a1ab-d796d1958a2e tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] [instance: fd8af8c4-d147-4335-90c9-81fe1da1297f] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:51:20.939710 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-37a2de97-016e-40b0-a1ab-d796d1958a2e tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:51:20.940163 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-37a2de97-016e-40b0-a1ab-d796d1958a2e tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:51:20.940935 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-37a2de97-016e-40b0-a1ab-d796d1958a2e tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:51:20.941360 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-37a2de97-016e-40b0-a1ab-d796d1958a2e tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:51:21.119429 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-37a2de97-016e-40b0-a1ab-d796d1958a2e tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a67b4188f6248cca9ce2f4991d78e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48712151f8a4942a0a08d09a80c902d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:51:21.127099 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-37a2de97-016e-40b0-a1ab-d796d1958a2e tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] 10.222.0.48 "GET /compute/v2.1/servers/fd8af8c4-d147-4335-90c9-81fe1da1297f" status: 200 len: 1673 microversion: 2.1 time: 0.198921 Jun 17 15:51:21.127661 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1598/3612] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:51:20 2022] GET /compute/v2.1/servers/fd8af8c4-d147-4335-90c9-81fe1da1297f => generated 1673 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:51:22.145890 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-6645544e-ac8c-4499-973e-bc6b4b758945 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:51:22.146581 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-6645544e-ac8c-4499-973e-bc6b4b758945 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] [instance: fd8af8c4-d147-4335-90c9-81fe1da1297f] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:51:22.153677 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6645544e-ac8c-4499-973e-bc6b4b758945 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:51:22.154118 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6645544e-ac8c-4499-973e-bc6b4b758945 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:51:22.154870 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6645544e-ac8c-4499-973e-bc6b4b758945 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:51:22.155297 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6645544e-ac8c-4499-973e-bc6b4b758945 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:51:22.294094 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-6645544e-ac8c-4499-973e-bc6b4b758945 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a67b4188f6248cca9ce2f4991d78e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48712151f8a4942a0a08d09a80c902d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:51:22.301526 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-6645544e-ac8c-4499-973e-bc6b4b758945 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] 10.222.0.48 "GET /compute/v2.1/servers/fd8af8c4-d147-4335-90c9-81fe1da1297f" status: 200 len: 1673 microversion: 2.1 time: 0.159851 Jun 17 15:51:22.302086 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 2015/3613] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:51:22 2022] GET /compute/v2.1/servers/fd8af8c4-d147-4335-90c9-81fe1da1297f => generated 1673 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:51:23.319035 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-43546767-c3c3-4e75-b2c8-84747641cc0b tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:51:23.319652 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-43546767-c3c3-4e75-b2c8-84747641cc0b tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] [instance: fd8af8c4-d147-4335-90c9-81fe1da1297f] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:51:23.327099 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-43546767-c3c3-4e75-b2c8-84747641cc0b tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:51:23.327542 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-43546767-c3c3-4e75-b2c8-84747641cc0b tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:51:23.328307 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-43546767-c3c3-4e75-b2c8-84747641cc0b tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:51:23.328993 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-43546767-c3c3-4e75-b2c8-84747641cc0b tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:51:23.774444 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-43546767-c3c3-4e75-b2c8-84747641cc0b tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a67b4188f6248cca9ce2f4991d78e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48712151f8a4942a0a08d09a80c902d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:51:23.781899 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-43546767-c3c3-4e75-b2c8-84747641cc0b tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] 10.222.0.48 "GET /compute/v2.1/servers/fd8af8c4-d147-4335-90c9-81fe1da1297f" status: 200 len: 1673 microversion: 2.1 time: 0.466768 Jun 17 15:51:23.782465 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1599/3614] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:51:23 2022] GET /compute/v2.1/servers/fd8af8c4-d147-4335-90c9-81fe1da1297f => generated 1673 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:51:24.306069 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [req-7f3c486c-fa2c-435a-a77e-c072806e729e req-8ccf64b8-b1f7-46f7-a790-033b283d7227 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd8af8c4-d147-4335-90c9-81fe1da1297f", "name": "network-vif-deleted", "tag": "cb749a38-539e-467d-84a8-49cb7542c6ae"}]} {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:51:24.315956 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [req-7f3c486c-fa2c-435a-a77e-c072806e729e req-8ccf64b8-b1f7-46f7-a790-033b283d7227 service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:51:24.316399 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [req-7f3c486c-fa2c-435a-a77e-c072806e729e req-8ccf64b8-b1f7-46f7-a790-033b283d7227 service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:51:24.328146 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.compute.server_external_events [req-7f3c486c-fa2c-435a-a77e-c072806e729e req-8ccf64b8-b1f7-46f7-a790-033b283d7227 service nova] Creating event network-vif-deleted:cb749a38-539e-467d-84a8-49cb7542c6ae for instance fd8af8c4-d147-4335-90c9-81fe1da1297f on hv-cinder-82549 Jun 17 15:51:24.333583 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [req-7f3c486c-fa2c-435a-a77e-c072806e729e req-8ccf64b8-b1f7-46f7-a790-033b283d7227 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031337 Jun 17 15:51:24.334304 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 2016/3615] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 15:51:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:51:24.800249 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-651704cc-e63e-40a4-8380-cc6feb5f50e8 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:51:24.800912 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-651704cc-e63e-40a4-8380-cc6feb5f50e8 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] [instance: fd8af8c4-d147-4335-90c9-81fe1da1297f] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:51:24.809076 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-651704cc-e63e-40a4-8380-cc6feb5f50e8 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:51:24.809577 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-651704cc-e63e-40a4-8380-cc6feb5f50e8 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:51:24.810336 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-651704cc-e63e-40a4-8380-cc6feb5f50e8 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:51:24.810769 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-651704cc-e63e-40a4-8380-cc6feb5f50e8 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:51:24.853054 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-651704cc-e63e-40a4-8380-cc6feb5f50e8 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:51:24.853305 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-651704cc-e63e-40a4-8380-cc6feb5f50e8 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:51:24.853648 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.objects.instance [None req-651704cc-e63e-40a4-8380-cc6feb5f50e8 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lazy-loading 'fault' on Instance uuid fd8af8c4-d147-4335-90c9-81fe1da1297f {{(pid=117649) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 15:51:24.902018 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-651704cc-e63e-40a4-8380-cc6feb5f50e8 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a67b4188f6248cca9ce2f4991d78e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48712151f8a4942a0a08d09a80c902d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:51:24.909433 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-651704cc-e63e-40a4-8380-cc6feb5f50e8 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] 10.222.0.48 "GET /compute/v2.1/servers/fd8af8c4-d147-4335-90c9-81fe1da1297f" status: 200 len: 1326 microversion: 2.1 time: 0.114203 Jun 17 15:51:24.909996 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1600/3616] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:51:24 2022] GET /compute/v2.1/servers/fd8af8c4-d147-4335-90c9-81fe1da1297f => generated 1326 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:51:25.927749 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-cedc3c59-f33a-49fc-aef4-e6a481922d99 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:51:25.928602 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-cedc3c59-f33a-49fc-aef4-e6a481922d99 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] [instance: fd8af8c4-d147-4335-90c9-81fe1da1297f] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:51:25.935241 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cedc3c59-f33a-49fc-aef4-e6a481922d99 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:51:25.935679 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cedc3c59-f33a-49fc-aef4-e6a481922d99 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:51:25.936452 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cedc3c59-f33a-49fc-aef4-e6a481922d99 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:51:25.936912 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-cedc3c59-f33a-49fc-aef4-e6a481922d99 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:51:25.950770 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.wsgi [None req-cedc3c59-f33a-49fc-aef4-e6a481922d99 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] HTTP exception thrown: Instance fd8af8c4-d147-4335-90c9-81fe1da1297f could not be found. Jun 17 15:51:25.952458 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-cedc3c59-f33a-49fc-aef4-e6a481922d99 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Request method failure captured: Jun 17 15:51:25.952458 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: request: GET /compute/v2.1/servers/fd8af8c4-d147-4335-90c9-81fe1da1297f HTTP/1.1 Jun 17 15:51:25.952458 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Accept: application/json Jun 17 15:51:25.952458 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Accept-Encoding: identity Jun 17 15:51:25.952458 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Connection: close Jun 17 15:51:25.952458 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Content-Length: 0 Jun 17 15:51:25.952458 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Content-Type: application/json Jun 17 15:51:25.952458 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Host: 10.222.0.48 Jun 17 15:51:25.952458 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Openstack-System-Scope: None Jun 17 15:51:25.952458 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: User-Agent: python-urllib3/1.26.9 Jun 17 15:51:25.952458 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Auth-Token: gAAAAABirKJeTyCXrTCQy-bGxTKgDl4EFAGbdfKhrfX98_akte22A6o57chrnwb8MiN8zerRCfHFXFJF3ju0KF_az-Y6ZtMcglz-hccJUzk89U2Rm4CIfvI76ok_o-e35dct0O4-VqTgwqKasC-Hxdg5jdWF-WcQKQDALG94UYD94ozGvgP_l_c Jun 17 15:51:25.952458 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Domain-Id: None Jun 17 15:51:25.952458 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Domain-Name: None Jun 17 15:51:25.952458 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Identity-Status: Confirmed Jun 17 15:51:25.952458 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Is-Admin-Project: True Jun 17 15:51:25.952458 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Domain-Id: default Jun 17 15:51:25.952458 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Domain-Name: Default Jun 17 15:51:25.952458 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Id: f48712151f8a4942a0a08d09a80c902d Jun 17 15:51:25.952458 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Name: tempest-AttachVolumeTestJSON-1503700068 Jun 17 15:51:25.952458 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Role: reader,member Jun 17 15:51:25.952458 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Roles: reader,member Jun 17 15:51:25.954331 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f48712151f8a4942a0a08d09a80c902d", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f48712151f8a4942a0a08d09a80c902d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f48712151f8a4942a0a08d09a80c902d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f48712151f8a4942a0a08d09a80c902d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Jun 17 15:51:25.954331 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant: tempest-AttachVolumeTestJSON-1503700068 Jun 17 15:51:25.954331 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant-Id: f48712151f8a4942a0a08d09a80c902d Jun 17 15:51:25.954331 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1503700068 Jun 17 15:51:25.954331 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User: tempest-AttachVolumeTestJSON-1503700068-project Jun 17 15:51:25.954331 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Domain-Id: default Jun 17 15:51:25.954331 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Domain-Name: Default Jun 17 15:51:25.954331 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Id: 4a67b4188f6248cca9ce2f4991d78e62 Jun 17 15:51:25.954331 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Name: tempest-AttachVolumeTestJSON-1503700068-project Jun 17 15:51:25.954331 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: method: > Jun 17 15:51:25.954331 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: exception: Instance fd8af8c4-d147-4335-90c9-81fe1da1297f could not be found. Jun 17 15:51:25.954331 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: action_args: {'id': 'fd8af8c4-d147-4335-90c9-81fe1da1297f'} Jun 17 15:51:25.955542 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 15:51:25.955542 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:51:25.955542 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 15:51:25.955542 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 15:51:25.955542 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 15:51:25.955542 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 15:51:25.955542 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 15:51:25.955542 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 15:51:25.955542 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 15:51:25.955542 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 15:51:25.955542 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd8af8c4-d147-4335-90c9-81fe1da1297f could not be found. Jun 17 15:51:25.955542 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:51:25.955542 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:51:25.955542 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:51:25.955542 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:51:25.955542 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:51:25.955542 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:51:25.955542 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 15:51:25.955542 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 15:51:25.955542 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 15:51:25.957350 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 15:51:25.957350 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 15:51:25.957350 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 15:51:25.957350 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 15:51:25.957350 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 15:51:25.957350 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 15:51:25.957350 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 15:51:25.957350 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd8af8c4-d147-4335-90c9-81fe1da1297f could not be found. Jun 17 15:51:25.957350 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:51:25.957350 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:51:25.957350 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:51:25.957350 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:51:25.957350 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:51:25.957350 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:51:25.957350 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 15:51:25.957350 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 15:51:25.957350 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd8af8c4-d147-4335-90c9-81fe1da1297f could not be found. Jun 17 15:51:25.957350 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:51:25.959059 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-cedc3c59-f33a-49fc-aef4-e6a481922d99 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Returning 404 to user: Instance fd8af8c4-d147-4335-90c9-81fe1da1297f could not be found. {{(pid=117650) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 15:51:25.959059 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-cedc3c59-f33a-49fc-aef4-e6a481922d99 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] 10.222.0.48 "GET /compute/v2.1/servers/fd8af8c4-d147-4335-90c9-81fe1da1297f" status: 404 len: 111 microversion: 2.1 time: 0.031017 Jun 17 15:51:25.959059 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 2017/3617] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:51:25 2022] GET /compute/v2.1/servers/fd8af8c4-d147-4335-90c9-81fe1da1297f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 15:51:25.962689 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-31e06bcb-9032-4f80-a7f3-c147736f1c81 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Calling method '.version_select at 0x7faf54c059d0>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:51:25.980384 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-31e06bcb-9032-4f80-a7f3-c147736f1c81 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-655403185" status: 202 len: 0 microversion: 2.1 time: 0.021331 Jun 17 15:51:25.980961 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1601/3618] 10.222.0.48 () {58 vars in 1217 bytes} [Fri Jun 17 15:51:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-655403185 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 17 15:51:26.592488 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-1d89d07d-42e8-44fe-9818-a74c1e30f826 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Action: 'create', calling method: .version_select at 0x7faf50c9e1f0>, body: {"keypair": {"name": "tempest-keypair-991362206", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJAWC6n6F2I2Fwp5kw6KgurxXRyvAbVmY/PaTgXrf1Fe38Cf5xif5MyRbKbHb1RXssbQtT8EJaPbhiY78si/9hCCweMKF9dnKjETYU6kC4C6UK7OepFOPCNnW7gR80ERfA=="}} {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:51:26.607222 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.quota [None req-1d89d07d-42e8-44fe-9818-a74c1e30f826 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Getting quotas for project f48712151f8a4942a0a08d09a80c902d. Resources: {'key_pairs'} {{(pid=117650) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 15:51:26.611021 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.quota [None req-1d89d07d-42e8-44fe-9818-a74c1e30f826 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Getting quotas for user 4a67b4188f6248cca9ce2f4991d78e62 and project f48712151f8a4942a0a08d09a80c902d. Resources: {'key_pairs'} {{(pid=117650) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 15:51:26.633596 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-1d89d07d-42e8-44fe-9818-a74c1e30f826 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.045205 Jun 17 15:51:26.634191 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 2018/3619] 10.222.0.48 () {60 vars in 1158 bytes} [Fri Jun 17 15:51:26 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:51:27.348936 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-726e4094-140b-4375-bee9-0e3723a58f09 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:51:27.350276 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-726e4094-140b-4375-bee9-0e3723a58f09 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] [instance: 537247a8-cd91-485c-b763-5f8d6e27d81e] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:51:27.359210 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-726e4094-140b-4375-bee9-0e3723a58f09 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:51:27.359758 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-726e4094-140b-4375-bee9-0e3723a58f09 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:51:27.360569 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-726e4094-140b-4375-bee9-0e3723a58f09 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:51:27.361197 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-726e4094-140b-4375-bee9-0e3723a58f09 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:51:27.388933 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-726e4094-140b-4375-bee9-0e3723a58f09 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] 10.222.0.48 "GET /compute/v2.1/servers/537247a8-cd91-485c-b763-5f8d6e27d81e/ips" status: 200 len: 149 microversion: 2.1 time: 0.044410 Jun 17 15:51:27.389504 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1602/3620] 10.222.0.48 () {58 vars in 1247 bytes} [Fri Jun 17 15:51:27 2022] GET /compute/v2.1/servers/537247a8-cd91-485c-b763-5f8d6e27d81e/ips => generated 149 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:51:27.867201 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-6c6ac98d-e881-44fe-ba9e-8ddcfa0cfbe4 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-233837528", "imageRef": "8c105ca4-6fe3-4e70-af71-b03c64fe1efe", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2f353cec-10d5-4712-aaaf-331bc64a547b"}], "security_groups": [{"name": "tempest-securitygroup--1151583089"}], "key_name": "tempest-keypair-991362206", "user_data": "}} {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:51:27.967431 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.network.neutron [None req-6c6ac98d-e881-44fe-ba9e-8ddcfa0cfbe4 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] validate_networks() for [('2f353cec-10d5-4712-aaaf-331bc64a547b', None, None, None, None, None)] {{(pid=117650) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 15:51:28.333680 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.virt.hardware [None req-6c6ac98d-e881-44fe-ba9e-8ddcfa0cfbe4 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Flavor limits 0:0:0 {{(pid=117650) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 15:51:28.334102 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.virt.hardware [None req-6c6ac98d-e881-44fe-ba9e-8ddcfa0cfbe4 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Image limits 0:0:0 {{(pid=117650) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 15:51:28.334575 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.virt.hardware [None req-6c6ac98d-e881-44fe-ba9e-8ddcfa0cfbe4 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Flavor pref 0:0:0 {{(pid=117650) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 15:51:28.334984 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.virt.hardware [None req-6c6ac98d-e881-44fe-ba9e-8ddcfa0cfbe4 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Image pref 0:0:0 {{(pid=117650) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 15:51:28.335394 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.virt.hardware [None req-6c6ac98d-e881-44fe-ba9e-8ddcfa0cfbe4 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117650) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 15:51:28.345112 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6c6ac98d-e881-44fe-ba9e-8ddcfa0cfbe4 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:51:28.345587 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6c6ac98d-e881-44fe-ba9e-8ddcfa0cfbe4 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:51:28.346373 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6c6ac98d-e881-44fe-ba9e-8ddcfa0cfbe4 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:51:28.346812 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-6c6ac98d-e881-44fe-ba9e-8ddcfa0cfbe4 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:51:28.363943 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.quota [None req-6c6ac98d-e881-44fe-ba9e-8ddcfa0cfbe4 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Getting quotas for project f48712151f8a4942a0a08d09a80c902d. Resources: {'cores', 'ram', 'instances'} {{(pid=117650) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 15:51:28.368033 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.quota [None req-6c6ac98d-e881-44fe-ba9e-8ddcfa0cfbe4 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Getting quotas for user 4a67b4188f6248cca9ce2f4991d78e62 and project f48712151f8a4942a0a08d09a80c902d. Resources: {'cores', 'ram', 'instances'} {{(pid=117650) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 15:51:28.379426 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-6c6ac98d-e881-44fe-ba9e-8ddcfa0cfbe4 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Going to run 1 instances... {{(pid=117650) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 15:51:28.381719 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-6c6ac98d-e881-44fe-ba9e-8ddcfa0cfbe4 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] [instance: 0868ffdc-e030-4180-a3dd-f8b5231471b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c105ca4-6fe3-4e70-af71-b03c64fe1efe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117650) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 15:51:28.426663 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-6c6ac98d-e881-44fe-ba9e-8ddcfa0cfbe4 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.564203 Jun 17 15:51:28.427436 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 2019/3621] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Jun 17 15:51:27 2022] POST /compute/v2.1/servers => generated 402 bytes in 565 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 15:51:28.437242 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-41e6f7d0-f439-4633-81c9-765e0f307d15 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:51:28.437844 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-41e6f7d0-f439-4633-81c9-765e0f307d15 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] [instance: 0868ffdc-e030-4180-a3dd-f8b5231471b6] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:51:28.495764 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-41e6f7d0-f439-4633-81c9-765e0f307d15 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a67b4188f6248cca9ce2f4991d78e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48712151f8a4942a0a08d09a80c902d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:51:28.502480 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-41e6f7d0-f439-4633-81c9-765e0f307d15 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] 10.222.0.48 "GET /compute/v2.1/servers/0868ffdc-e030-4180-a3dd-f8b5231471b6" status: 200 len: 1236 microversion: 2.1 time: 0.069096 Jun 17 15:51:28.503050 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1603/3622] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:51:28 2022] GET /compute/v2.1/servers/0868ffdc-e030-4180-a3dd-f8b5231471b6 => generated 1236 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:51:28.733637 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-225111a7-27b3-484f-9a43-9d1dd382a52a tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "93b274e9-7707-4900-b1af-2fd1cd7e9d40"}} {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:51:28.734757 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-225111a7-27b3-484f-9a43-9d1dd382a52a tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] [instance: 537247a8-cd91-485c-b763-5f8d6e27d81e] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:51:28.741708 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-225111a7-27b3-484f-9a43-9d1dd382a52a tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:51:28.742155 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-225111a7-27b3-484f-9a43-9d1dd382a52a tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:51:28.742912 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-225111a7-27b3-484f-9a43-9d1dd382a52a tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:51:28.743345 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-225111a7-27b3-484f-9a43-9d1dd382a52a tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:51:29.008566 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-225111a7-27b3-484f-9a43-9d1dd382a52a tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] 10.222.0.48 "POST /compute/v2.1/servers/537247a8-cd91-485c-b763-5f8d6e27d81e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.278771 Jun 17 15:51:29.009256 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 2020/3623] 10.222.0.48 () {60 vars in 1322 bytes} [Fri Jun 17 15:51:28 2022] POST /compute/v2.1/servers/537247a8-cd91-485c-b763-5f8d6e27d81e/os-volume_attachments => generated 194 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:51:29.519203 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-a3000af9-ae71-423f-b48e-23adb4364a77 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:51:29.520205 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-a3000af9-ae71-423f-b48e-23adb4364a77 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] [instance: 0868ffdc-e030-4180-a3dd-f8b5231471b6] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:51:29.528828 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a3000af9-ae71-423f-b48e-23adb4364a77 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:51:29.529531 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a3000af9-ae71-423f-b48e-23adb4364a77 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:51:29.530245 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a3000af9-ae71-423f-b48e-23adb4364a77 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:51:29.530749 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a3000af9-ae71-423f-b48e-23adb4364a77 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:51:29.608848 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-a3000af9-ae71-423f-b48e-23adb4364a77 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a67b4188f6248cca9ce2f4991d78e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48712151f8a4942a0a08d09a80c902d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:51:29.616368 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-a3000af9-ae71-423f-b48e-23adb4364a77 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] 10.222.0.48 "GET /compute/v2.1/servers/0868ffdc-e030-4180-a3dd-f8b5231471b6" status: 200 len: 1306 microversion: 2.1 time: 0.101070 Jun 17 15:51:29.616914 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1604/3624] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:51:29 2022] GET /compute/v2.1/servers/0868ffdc-e030-4180-a3dd-f8b5231471b6 => generated 1306 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:51:30.634477 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-57da6be9-fb85-4ec2-b2fd-8145ce5d541a tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:51:30.635865 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-57da6be9-fb85-4ec2-b2fd-8145ce5d541a tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] [instance: 0868ffdc-e030-4180-a3dd-f8b5231471b6] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:51:30.646476 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-57da6be9-fb85-4ec2-b2fd-8145ce5d541a tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:51:30.646882 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-57da6be9-fb85-4ec2-b2fd-8145ce5d541a tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:51:30.647759 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-57da6be9-fb85-4ec2-b2fd-8145ce5d541a tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:51:30.648204 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-57da6be9-fb85-4ec2-b2fd-8145ce5d541a tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:51:30.795337 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-57da6be9-fb85-4ec2-b2fd-8145ce5d541a tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a67b4188f6248cca9ce2f4991d78e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48712151f8a4942a0a08d09a80c902d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:51:30.805732 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-57da6be9-fb85-4ec2-b2fd-8145ce5d541a tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] 10.222.0.48 "GET /compute/v2.1/servers/0868ffdc-e030-4180-a3dd-f8b5231471b6" status: 200 len: 1362 microversion: 2.1 time: 0.175928 Jun 17 15:51:30.808566 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 2021/3625] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:51:30 2022] GET /compute/v2.1/servers/0868ffdc-e030-4180-a3dd-f8b5231471b6 => generated 1362 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:51:30.943737 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [req-db7e978f-69f0-4e3f-8ddb-19658c200bbb req-8b423c25-a6da-4ead-9b5f-3a3e3bb110c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0868ffdc-e030-4180-a3dd-f8b5231471b6", "tag": "9d045b39-d9e4-4c97-85f1-396b4e20f020"}]} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:51:30.954130 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-db7e978f-69f0-4e3f-8ddb-19658c200bbb req-8b423c25-a6da-4ead-9b5f-3a3e3bb110c8 service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:51:30.954631 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-db7e978f-69f0-4e3f-8ddb-19658c200bbb req-8b423c25-a6da-4ead-9b5f-3a3e3bb110c8 service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:51:30.969914 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.compute.server_external_events [req-db7e978f-69f0-4e3f-8ddb-19658c200bbb req-8b423c25-a6da-4ead-9b5f-3a3e3bb110c8 service nova] Creating event network-changed:9d045b39-d9e4-4c97-85f1-396b4e20f020 for instance 0868ffdc-e030-4180-a3dd-f8b5231471b6 on hv-cinder-82549 Jun 17 15:51:30.977010 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [req-db7e978f-69f0-4e3f-8ddb-19658c200bbb req-8b423c25-a6da-4ead-9b5f-3a3e3bb110c8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038877 Jun 17 15:51:30.977627 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1605/3626] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 15:51:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:51:31.825513 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-1ada8fee-b8e7-494b-baee-68d76cebef12 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:51:31.826124 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-1ada8fee-b8e7-494b-baee-68d76cebef12 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] [instance: 0868ffdc-e030-4180-a3dd-f8b5231471b6] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:51:31.832787 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1ada8fee-b8e7-494b-baee-68d76cebef12 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:51:31.833262 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1ada8fee-b8e7-494b-baee-68d76cebef12 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:51:31.834045 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1ada8fee-b8e7-494b-baee-68d76cebef12 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:51:31.834520 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1ada8fee-b8e7-494b-baee-68d76cebef12 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:51:31.969589 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-1ada8fee-b8e7-494b-baee-68d76cebef12 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a67b4188f6248cca9ce2f4991d78e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48712151f8a4942a0a08d09a80c902d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:51:31.977372 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-1ada8fee-b8e7-494b-baee-68d76cebef12 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] 10.222.0.48 "GET /compute/v2.1/servers/0868ffdc-e030-4180-a3dd-f8b5231471b6" status: 200 len: 1362 microversion: 2.1 time: 0.156222 Jun 17 15:51:31.978205 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 2022/3627] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:51:31 2022] GET /compute/v2.1/servers/0868ffdc-e030-4180-a3dd-f8b5231471b6 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:51:32.994890 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-5b8210d8-0538-4069-9d7a-a955a0cb282c tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:51:32.995497 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-5b8210d8-0538-4069-9d7a-a955a0cb282c tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] [instance: 0868ffdc-e030-4180-a3dd-f8b5231471b6] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:51:33.002181 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5b8210d8-0538-4069-9d7a-a955a0cb282c tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:51:33.002627 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5b8210d8-0538-4069-9d7a-a955a0cb282c tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:51:33.003380 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5b8210d8-0538-4069-9d7a-a955a0cb282c tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:51:33.003809 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5b8210d8-0538-4069-9d7a-a955a0cb282c tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:51:33.134594 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-5b8210d8-0538-4069-9d7a-a955a0cb282c tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a67b4188f6248cca9ce2f4991d78e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48712151f8a4942a0a08d09a80c902d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:51:33.142930 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-5b8210d8-0538-4069-9d7a-a955a0cb282c tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] 10.222.0.48 "GET /compute/v2.1/servers/0868ffdc-e030-4180-a3dd-f8b5231471b6" status: 200 len: 1362 microversion: 2.1 time: 0.152254 Jun 17 15:51:33.143507 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1606/3628] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:51:32 2022] GET /compute/v2.1/servers/0868ffdc-e030-4180-a3dd-f8b5231471b6 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:51:34.160448 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-4bb60141-66c3-4a3a-a5e4-51a1a27903c1 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:51:34.161058 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-4bb60141-66c3-4a3a-a5e4-51a1a27903c1 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] [instance: 0868ffdc-e030-4180-a3dd-f8b5231471b6] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:51:34.168085 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4bb60141-66c3-4a3a-a5e4-51a1a27903c1 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:51:34.168567 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4bb60141-66c3-4a3a-a5e4-51a1a27903c1 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:51:34.169328 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4bb60141-66c3-4a3a-a5e4-51a1a27903c1 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:51:34.169788 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4bb60141-66c3-4a3a-a5e4-51a1a27903c1 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:51:34.319060 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-4bb60141-66c3-4a3a-a5e4-51a1a27903c1 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a67b4188f6248cca9ce2f4991d78e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48712151f8a4942a0a08d09a80c902d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:51:34.327615 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-4bb60141-66c3-4a3a-a5e4-51a1a27903c1 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] 10.222.0.48 "GET /compute/v2.1/servers/0868ffdc-e030-4180-a3dd-f8b5231471b6" status: 200 len: 1362 microversion: 2.1 time: 0.171045 Jun 17 15:51:34.328216 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 2023/3629] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:51:34 2022] GET /compute/v2.1/servers/0868ffdc-e030-4180-a3dd-f8b5231471b6 => generated 1362 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:51:35.346925 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-02e8ac46-4dd6-41bf-bf30-a828377f9324 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:51:35.348577 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-02e8ac46-4dd6-41bf-bf30-a828377f9324 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] [instance: 0868ffdc-e030-4180-a3dd-f8b5231471b6] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:51:35.355964 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-02e8ac46-4dd6-41bf-bf30-a828377f9324 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:51:35.356703 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-02e8ac46-4dd6-41bf-bf30-a828377f9324 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:51:35.357189 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-02e8ac46-4dd6-41bf-bf30-a828377f9324 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:51:35.357675 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-02e8ac46-4dd6-41bf-bf30-a828377f9324 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:51:35.507617 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-02e8ac46-4dd6-41bf-bf30-a828377f9324 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a67b4188f6248cca9ce2f4991d78e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48712151f8a4942a0a08d09a80c902d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:51:35.515907 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-02e8ac46-4dd6-41bf-bf30-a828377f9324 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] 10.222.0.48 "GET /compute/v2.1/servers/0868ffdc-e030-4180-a3dd-f8b5231471b6" status: 200 len: 1362 microversion: 2.1 time: 0.174354 Jun 17 15:51:35.516516 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1607/3630] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:51:35 2022] GET /compute/v2.1/servers/0868ffdc-e030-4180-a3dd-f8b5231471b6 => generated 1362 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:51:36.532180 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-baa6c2e8-5919-42e9-aa72-63818bd61406 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:51:36.532895 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-baa6c2e8-5919-42e9-aa72-63818bd61406 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] [instance: 0868ffdc-e030-4180-a3dd-f8b5231471b6] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:51:36.542328 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-baa6c2e8-5919-42e9-aa72-63818bd61406 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:51:36.542774 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-baa6c2e8-5919-42e9-aa72-63818bd61406 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:51:36.543539 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-baa6c2e8-5919-42e9-aa72-63818bd61406 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:51:36.543968 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-baa6c2e8-5919-42e9-aa72-63818bd61406 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:51:36.641264 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-dd95b7f9-6541-44f6-96e6-d5622e152043 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:51:36.642306 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-dd95b7f9-6541-44f6-96e6-d5622e152043 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] [instance: 537247a8-cd91-485c-b763-5f8d6e27d81e] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:51:36.649263 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-dd95b7f9-6541-44f6-96e6-d5622e152043 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:51:36.649754 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-dd95b7f9-6541-44f6-96e6-d5622e152043 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:51:36.651862 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-dd95b7f9-6541-44f6-96e6-d5622e152043 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:51:36.653120 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-dd95b7f9-6541-44f6-96e6-d5622e152043 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:51:36.709365 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-baa6c2e8-5919-42e9-aa72-63818bd61406 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a67b4188f6248cca9ce2f4991d78e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48712151f8a4942a0a08d09a80c902d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:51:36.719512 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-baa6c2e8-5919-42e9-aa72-63818bd61406 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] 10.222.0.48 "GET /compute/v2.1/servers/0868ffdc-e030-4180-a3dd-f8b5231471b6" status: 200 len: 1362 microversion: 2.1 time: 0.191017 Jun 17 15:51:36.720382 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 2024/3631] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:51:36 2022] GET /compute/v2.1/servers/0868ffdc-e030-4180-a3dd-f8b5231471b6 => generated 1362 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:51:36.758327 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.objects.instance [None req-dd95b7f9-6541-44f6-96e6-d5622e152043 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lazy-loading 'services' on Instance uuid 537247a8-cd91-485c-b763-5f8d6e27d81e {{(pid=117649) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 15:51:36.833408 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-dd95b7f9-6541-44f6-96e6-d5622e152043 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] 10.222.0.48 "DELETE /compute/v2.1/servers/537247a8-cd91-485c-b763-5f8d6e27d81e/os-volume_attachments/93b274e9-7707-4900-b1af-2fd1cd7e9d40" status: 202 len: 0 microversion: 2.1 time: 0.196288 Jun 17 15:51:36.834005 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1608/3632] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Jun 17 15:51:36 2022] DELETE /compute/v2.1/servers/537247a8-cd91-485c-b763-5f8d6e27d81e/os-volume_attachments/93b274e9-7707-4900-b1af-2fd1cd7e9d40 => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 15:51:36.843064 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-4aef4e1b-e50d-4e59-b164-62808ac7e189 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:51:36.844157 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-4aef4e1b-e50d-4e59-b164-62808ac7e189 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] [instance: 537247a8-cd91-485c-b763-5f8d6e27d81e] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:51:36.850329 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4aef4e1b-e50d-4e59-b164-62808ac7e189 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:51:36.851016 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4aef4e1b-e50d-4e59-b164-62808ac7e189 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:51:36.851783 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4aef4e1b-e50d-4e59-b164-62808ac7e189 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:51:36.852224 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4aef4e1b-e50d-4e59-b164-62808ac7e189 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:51:36.866874 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [req-b7f3bbc8-5316-4789-8a25-2e75aff02ae7 req-88717a3d-7a5e-4f1a-8e08-583415371306 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0868ffdc-e030-4180-a3dd-f8b5231471b6", "name": "network-vif-plugged", "status": "completed", "tag": "9d045b39-d9e4-4c97-85f1-396b4e20f020"}]} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:51:36.880672 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-b7f3bbc8-5316-4789-8a25-2e75aff02ae7 req-88717a3d-7a5e-4f1a-8e08-583415371306 service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:51:36.881128 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-b7f3bbc8-5316-4789-8a25-2e75aff02ae7 req-88717a3d-7a5e-4f1a-8e08-583415371306 service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:51:36.885774 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-4aef4e1b-e50d-4e59-b164-62808ac7e189 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] 10.222.0.48 "GET /compute/v2.1/servers/537247a8-cd91-485c-b763-5f8d6e27d81e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047409 Jun 17 15:51:36.886423 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 2025/3633] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:51:36 2022] GET /compute/v2.1/servers/537247a8-cd91-485c-b763-5f8d6e27d81e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:51:36.898489 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.compute.server_external_events [req-b7f3bbc8-5316-4789-8a25-2e75aff02ae7 req-88717a3d-7a5e-4f1a-8e08-583415371306 service nova] Creating event network-vif-plugged:9d045b39-d9e4-4c97-85f1-396b4e20f020 for instance 0868ffdc-e030-4180-a3dd-f8b5231471b6 on hv-cinder-82549 Jun 17 15:51:36.903498 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [req-b7f3bbc8-5316-4789-8a25-2e75aff02ae7 req-88717a3d-7a5e-4f1a-8e08-583415371306 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042213 Jun 17 15:51:36.904400 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1609/3634] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 15:51:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:51:37.737087 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-c2dfddd1-7622-4a8d-a905-28a235009832 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:51:37.737659 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-c2dfddd1-7622-4a8d-a905-28a235009832 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] [instance: 0868ffdc-e030-4180-a3dd-f8b5231471b6] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:51:37.744238 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c2dfddd1-7622-4a8d-a905-28a235009832 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:51:37.744713 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c2dfddd1-7622-4a8d-a905-28a235009832 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:51:37.745465 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c2dfddd1-7622-4a8d-a905-28a235009832 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:51:37.745894 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-c2dfddd1-7622-4a8d-a905-28a235009832 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:51:37.884634 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-c2dfddd1-7622-4a8d-a905-28a235009832 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a67b4188f6248cca9ce2f4991d78e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48712151f8a4942a0a08d09a80c902d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:51:37.892973 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-c2dfddd1-7622-4a8d-a905-28a235009832 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] 10.222.0.48 "GET /compute/v2.1/servers/0868ffdc-e030-4180-a3dd-f8b5231471b6" status: 200 len: 1362 microversion: 2.1 time: 0.159767 Jun 17 15:51:37.893551 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 2026/3635] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:51:37 2022] GET /compute/v2.1/servers/0868ffdc-e030-4180-a3dd-f8b5231471b6 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:51:37.897949 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-eb36da6b-0883-4a27-8e8e-03b83a628f80 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:51:37.898944 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-eb36da6b-0883-4a27-8e8e-03b83a628f80 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] [instance: 537247a8-cd91-485c-b763-5f8d6e27d81e] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:51:37.905687 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-eb36da6b-0883-4a27-8e8e-03b83a628f80 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:51:37.906126 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-eb36da6b-0883-4a27-8e8e-03b83a628f80 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:51:37.906869 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-eb36da6b-0883-4a27-8e8e-03b83a628f80 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:51:37.907301 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-eb36da6b-0883-4a27-8e8e-03b83a628f80 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:51:37.935227 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-eb36da6b-0883-4a27-8e8e-03b83a628f80 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] 10.222.0.48 "GET /compute/v2.1/servers/537247a8-cd91-485c-b763-5f8d6e27d81e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042008 Jun 17 15:51:37.935767 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1610/3636] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:51:37 2022] GET /compute/v2.1/servers/537247a8-cd91-485c-b763-5f8d6e27d81e/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 17 15:51:38.001223 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-3d611fbc-d04f-4f4a-9e20-54ff62333258 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:51:38.001679 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-3d611fbc-d04f-4f4a-9e20-54ff62333258 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] [instance: 537247a8-cd91-485c-b763-5f8d6e27d81e] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:51:38.007823 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3d611fbc-d04f-4f4a-9e20-54ff62333258 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:51:38.008263 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3d611fbc-d04f-4f4a-9e20-54ff62333258 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:51:38.009062 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3d611fbc-d04f-4f4a-9e20-54ff62333258 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:51:38.009487 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3d611fbc-d04f-4f4a-9e20-54ff62333258 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:51:38.034493 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-3d611fbc-d04f-4f4a-9e20-54ff62333258 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] [instance: 537247a8-cd91-485c-b763-5f8d6e27d81e] Going to try to terminate instance {{(pid=117650) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 15:51:38.109486 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-3d611fbc-d04f-4f4a-9e20-54ff62333258 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] 10.222.0.48 "DELETE /compute/v2.1/servers/537247a8-cd91-485c-b763-5f8d6e27d81e" status: 204 len: 0 microversion: 2.1 time: 0.111994 Jun 17 15:51:38.110079 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 2027/3637] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jun 17 15:51:37 2022] DELETE /compute/v2.1/servers/537247a8-cd91-485c-b763-5f8d6e27d81e => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 15:51:38.118849 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-9ef54ab5-6394-463a-9617-d6929df823bd tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:51:38.119966 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-9ef54ab5-6394-463a-9617-d6929df823bd tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] [instance: 537247a8-cd91-485c-b763-5f8d6e27d81e] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:51:38.125907 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9ef54ab5-6394-463a-9617-d6929df823bd tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:51:38.126358 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9ef54ab5-6394-463a-9617-d6929df823bd tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:51:38.127113 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9ef54ab5-6394-463a-9617-d6929df823bd tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:51:38.127576 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9ef54ab5-6394-463a-9617-d6929df823bd tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:51:38.257139 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-9ef54ab5-6394-463a-9617-d6929df823bd tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab3130962a6456bbbcb1c96aba3506d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79efe2b5db31498c81c59b086e5c6f84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:51:38.265382 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-9ef54ab5-6394-463a-9617-d6929df823bd tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] 10.222.0.48 "GET /compute/v2.1/servers/537247a8-cd91-485c-b763-5f8d6e27d81e" status: 200 len: 1681 microversion: 2.1 time: 0.150458 Jun 17 15:51:38.265941 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1611/3638] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:51:38 2022] GET /compute/v2.1/servers/537247a8-cd91-485c-b763-5f8d6e27d81e => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:51:38.910987 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-97e81eda-597f-4916-8279-0e65b0a3fecd tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:51:38.911685 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-97e81eda-597f-4916-8279-0e65b0a3fecd tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] [instance: 0868ffdc-e030-4180-a3dd-f8b5231471b6] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:51:38.913659 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell0:SELECT=2 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:51:38.914325 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell0:SELECT=10 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:51:38.921167 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-97e81eda-597f-4916-8279-0e65b0a3fecd tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:51:38.921611 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-97e81eda-597f-4916-8279-0e65b0a3fecd tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:51:38.922400 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-97e81eda-597f-4916-8279-0e65b0a3fecd tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:51:38.922829 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-97e81eda-597f-4916-8279-0e65b0a3fecd tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:51:39.061176 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-97e81eda-597f-4916-8279-0e65b0a3fecd tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a67b4188f6248cca9ce2f4991d78e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48712151f8a4942a0a08d09a80c902d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:51:39.064677 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:51:39.069430 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-97e81eda-597f-4916-8279-0e65b0a3fecd tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] 10.222.0.48 "GET /compute/v2.1/servers/0868ffdc-e030-4180-a3dd-f8b5231471b6" status: 200 len: 1362 microversion: 2.1 time: 0.162736 Jun 17 15:51:39.070002 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 2028/3639] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:51:38 2022] GET /compute/v2.1/servers/0868ffdc-e030-4180-a3dd-f8b5231471b6 => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:51:39.282808 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-b59ffeb9-eb92-4612-8326-31732fde7ef1 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:51:39.283372 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-b59ffeb9-eb92-4612-8326-31732fde7ef1 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] [instance: 537247a8-cd91-485c-b763-5f8d6e27d81e] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:51:39.285388 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell0:SELECT=2 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:51:39.291412 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b59ffeb9-eb92-4612-8326-31732fde7ef1 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:51:39.291869 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b59ffeb9-eb92-4612-8326-31732fde7ef1 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:51:39.292653 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b59ffeb9-eb92-4612-8326-31732fde7ef1 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:51:39.293095 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-b59ffeb9-eb92-4612-8326-31732fde7ef1 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:51:39.432899 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-b59ffeb9-eb92-4612-8326-31732fde7ef1 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab3130962a6456bbbcb1c96aba3506d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79efe2b5db31498c81c59b086e5c6f84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:51:39.440596 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-b59ffeb9-eb92-4612-8326-31732fde7ef1 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] 10.222.0.48 "GET /compute/v2.1/servers/537247a8-cd91-485c-b763-5f8d6e27d81e" status: 200 len: 1681 microversion: 2.1 time: 0.161827 Jun 17 15:51:39.441819 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1612/3640] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:51:39 2022] GET /compute/v2.1/servers/537247a8-cd91-485c-b763-5f8d6e27d81e => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:51:40.086996 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-06ef01fe-bd75-42f2-9830-62586138a06a tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:51:40.087614 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-06ef01fe-bd75-42f2-9830-62586138a06a tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] [instance: 0868ffdc-e030-4180-a3dd-f8b5231471b6] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:51:40.096000 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-06ef01fe-bd75-42f2-9830-62586138a06a tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:51:40.096484 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-06ef01fe-bd75-42f2-9830-62586138a06a tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:51:40.097256 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-06ef01fe-bd75-42f2-9830-62586138a06a tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:51:40.097711 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-06ef01fe-bd75-42f2-9830-62586138a06a tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:51:40.235169 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-06ef01fe-bd75-42f2-9830-62586138a06a tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a67b4188f6248cca9ce2f4991d78e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48712151f8a4942a0a08d09a80c902d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:51:40.243157 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-06ef01fe-bd75-42f2-9830-62586138a06a tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] 10.222.0.48 "GET /compute/v2.1/servers/0868ffdc-e030-4180-a3dd-f8b5231471b6" status: 200 len: 1548 microversion: 2.1 time: 0.159990 Jun 17 15:51:40.243988 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 2029/3641] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:51:40 2022] GET /compute/v2.1/servers/0868ffdc-e030-4180-a3dd-f8b5231471b6 => generated 1548 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:51:40.259808 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-3ff39ed5-f817-40cc-a300-7b07fe113a48 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:51:40.260315 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-3ff39ed5-f817-40cc-a300-7b07fe113a48 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] [instance: 0868ffdc-e030-4180-a3dd-f8b5231471b6] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:51:40.266822 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3ff39ed5-f817-40cc-a300-7b07fe113a48 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:51:40.267276 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3ff39ed5-f817-40cc-a300-7b07fe113a48 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:51:40.268133 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3ff39ed5-f817-40cc-a300-7b07fe113a48 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:51:40.268610 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-3ff39ed5-f817-40cc-a300-7b07fe113a48 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:51:40.393097 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-3ff39ed5-f817-40cc-a300-7b07fe113a48 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] 10.222.0.48 "GET /compute/v2.1/servers/0868ffdc-e030-4180-a3dd-f8b5231471b6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.137087 Jun 17 15:51:40.393685 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1613/3642] 10.222.0.48 () {58 vars in 1274 bytes} [Fri Jun 17 15:51:40 2022] GET /compute/v2.1/servers/0868ffdc-e030-4180-a3dd-f8b5231471b6/os-interface => generated 284 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:51:40.458407 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-dd5896ec-a93c-458a-a43b-7b7909b68497 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:51:40.459114 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-dd5896ec-a93c-458a-a43b-7b7909b68497 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] [instance: 537247a8-cd91-485c-b763-5f8d6e27d81e] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:51:40.465219 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-dd5896ec-a93c-458a-a43b-7b7909b68497 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:51:40.465749 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-dd5896ec-a93c-458a-a43b-7b7909b68497 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:51:40.466576 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-dd5896ec-a93c-458a-a43b-7b7909b68497 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:51:40.467078 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-dd5896ec-a93c-458a-a43b-7b7909b68497 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:51:40.713032 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-dd5896ec-a93c-458a-a43b-7b7909b68497 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ab3130962a6456bbbcb1c96aba3506d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79efe2b5db31498c81c59b086e5c6f84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:51:40.721370 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-dd5896ec-a93c-458a-a43b-7b7909b68497 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] 10.222.0.48 "GET /compute/v2.1/servers/537247a8-cd91-485c-b763-5f8d6e27d81e" status: 200 len: 1681 microversion: 2.1 time: 0.266632 Jun 17 15:51:40.721993 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 2030/3643] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:51:40 2022] GET /compute/v2.1/servers/537247a8-cd91-485c-b763-5f8d6e27d81e => generated 1681 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:51:41.073401 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [req-cdfefaa5-a340-48e5-9393-48afe05cf0e5 req-db7105f4-cca9-40d6-8186-de54a8f3dfda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "537247a8-cd91-485c-b763-5f8d6e27d81e", "name": "network-vif-deleted", "tag": "35d0a0c8-023f-4095-8014-a1d27ba2ac79"}]} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:51:41.081618 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-cdfefaa5-a340-48e5-9393-48afe05cf0e5 req-db7105f4-cca9-40d6-8186-de54a8f3dfda service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:51:41.082056 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-cdfefaa5-a340-48e5-9393-48afe05cf0e5 req-db7105f4-cca9-40d6-8186-de54a8f3dfda service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:51:41.094175 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.compute.server_external_events [req-cdfefaa5-a340-48e5-9393-48afe05cf0e5 req-db7105f4-cca9-40d6-8186-de54a8f3dfda service nova] Creating event network-vif-deleted:35d0a0c8-023f-4095-8014-a1d27ba2ac79 for instance 537247a8-cd91-485c-b763-5f8d6e27d81e on hv-cinder-82549 Jun 17 15:51:41.099764 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [req-cdfefaa5-a340-48e5-9393-48afe05cf0e5 req-db7105f4-cca9-40d6-8186-de54a8f3dfda service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030668 Jun 17 15:51:41.100588 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1614/3644] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 15:51:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:51:41.740211 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-46acb689-e572-49c6-99b2-b0c9691a7621 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:51:41.740944 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-46acb689-e572-49c6-99b2-b0c9691a7621 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] [instance: 537247a8-cd91-485c-b763-5f8d6e27d81e] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:51:41.749043 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-46acb689-e572-49c6-99b2-b0c9691a7621 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:51:41.749736 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-46acb689-e572-49c6-99b2-b0c9691a7621 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:51:41.750695 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-46acb689-e572-49c6-99b2-b0c9691a7621 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:51:41.751311 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-46acb689-e572-49c6-99b2-b0c9691a7621 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:51:41.772827 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [req-2166a31a-c3f3-4e7e-a317-f1514a07f850 req-5eeae308-846b-4919-a5b7-e560dcb9853a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0868ffdc-e030-4180-a3dd-f8b5231471b6", "tag": "9d045b39-d9e4-4c97-85f1-396b4e20f020"}]} {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:51:41.779073 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.wsgi [None req-46acb689-e572-49c6-99b2-b0c9691a7621 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] HTTP exception thrown: Instance 537247a8-cd91-485c-b763-5f8d6e27d81e could not be found. Jun 17 15:51:41.781273 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-46acb689-e572-49c6-99b2-b0c9691a7621 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Request method failure captured: Jun 17 15:51:41.781273 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: request: GET /compute/v2.1/servers/537247a8-cd91-485c-b763-5f8d6e27d81e HTTP/1.1 Jun 17 15:51:41.781273 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Accept: application/json Jun 17 15:51:41.781273 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Accept-Encoding: identity Jun 17 15:51:41.781273 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Connection: close Jun 17 15:51:41.781273 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Content-Length: 0 Jun 17 15:51:41.781273 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Content-Type: application/json Jun 17 15:51:41.781273 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Host: 10.222.0.48 Jun 17 15:51:41.781273 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Openstack-System-Scope: None Jun 17 15:51:41.781273 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: User-Agent: python-urllib3/1.26.9 Jun 17 15:51:41.781273 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Auth-Token: gAAAAABirKICwWnhD993Jl4IhDGE-QonLGXk8DgdDZd8k6DQ9ib1E3iCeZvkPKJ1yooc16OipcuLAmHVKfeflaAMN8pddeU0L_b0r5jZEMoMoQRDnLv1aSXXTkcHo205L-oyOwE_Oe-bVu0FH4Pz82Sgm44hDcOVXCq7XBTJwNam2wPPozTvXCI Jun 17 15:51:41.781273 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Domain-Id: None Jun 17 15:51:41.781273 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Domain-Name: None Jun 17 15:51:41.781273 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Identity-Status: Confirmed Jun 17 15:51:41.781273 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Is-Admin-Project: True Jun 17 15:51:41.781273 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Domain-Id: default Jun 17 15:51:41.781273 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Domain-Name: Default Jun 17 15:51:41.781273 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Id: 79efe2b5db31498c81c59b086e5c6f84 Jun 17 15:51:41.781273 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Name: tempest-AttachVolumeNegativeTest-957597123 Jun 17 15:51:41.781273 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Role: reader,member Jun 17 15:51:41.781273 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Roles: reader,member Jun 17 15:51:41.783336 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_79efe2b5db31498c81c59b086e5c6f84", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/79efe2b5db31498c81c59b086e5c6f84"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/79efe2b5db31498c81c59b086e5c6f84"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/79efe2b5db31498c81c59b086e5c6f84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Jun 17 15:51:41.783336 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant: tempest-AttachVolumeNegativeTest-957597123 Jun 17 15:51:41.783336 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant-Id: 79efe2b5db31498c81c59b086e5c6f84 Jun 17 15:51:41.783336 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-957597123 Jun 17 15:51:41.783336 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User: tempest-AttachVolumeNegativeTest-957597123-project Jun 17 15:51:41.783336 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Domain-Id: default Jun 17 15:51:41.783336 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Domain-Name: Default Jun 17 15:51:41.783336 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Id: 8ab3130962a6456bbbcb1c96aba3506d Jun 17 15:51:41.783336 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Name: tempest-AttachVolumeNegativeTest-957597123-project Jun 17 15:51:41.783336 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: method: > Jun 17 15:51:41.783336 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: exception: Instance 537247a8-cd91-485c-b763-5f8d6e27d81e could not be found. Jun 17 15:51:41.783336 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: action_args: {'id': '537247a8-cd91-485c-b763-5f8d6e27d81e'} Jun 17 15:51:41.784443 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 15:51:41.784443 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:51:41.784443 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 15:51:41.784443 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 15:51:41.784443 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 15:51:41.784443 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 15:51:41.784443 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 15:51:41.784443 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 15:51:41.784443 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 15:51:41.784443 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 15:51:41.784443 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 537247a8-cd91-485c-b763-5f8d6e27d81e could not be found. Jun 17 15:51:41.784443 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:51:41.784443 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:51:41.784443 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:51:41.784443 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:51:41.784443 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:51:41.784443 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:51:41.784443 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 15:51:41.784443 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 15:51:41.784443 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 15:51:41.786137 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 15:51:41.786137 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 15:51:41.786137 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 15:51:41.786137 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 15:51:41.786137 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 15:51:41.786137 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 15:51:41.786137 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 15:51:41.786137 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 537247a8-cd91-485c-b763-5f8d6e27d81e could not be found. Jun 17 15:51:41.786137 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:51:41.786137 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:51:41.786137 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:51:41.786137 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:51:41.786137 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:51:41.786137 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:51:41.786137 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 15:51:41.786137 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 15:51:41.786137 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 537247a8-cd91-485c-b763-5f8d6e27d81e could not be found. Jun 17 15:51:41.786137 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:51:41.789268 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-46acb689-e572-49c6-99b2-b0c9691a7621 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Returning 404 to user: Instance 537247a8-cd91-485c-b763-5f8d6e27d81e could not be found. {{(pid=117649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 15:51:41.790331 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-46acb689-e572-49c6-99b2-b0c9691a7621 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] 10.222.0.48 "GET /compute/v2.1/servers/537247a8-cd91-485c-b763-5f8d6e27d81e" status: 404 len: 111 microversion: 2.1 time: 0.055156 Jun 17 15:51:41.795042 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1615/3645] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:51:41 2022] GET /compute/v2.1/servers/537247a8-cd91-485c-b763-5f8d6e27d81e => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 17 15:51:41.796502 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [req-2166a31a-c3f3-4e7e-a317-f1514a07f850 req-5eeae308-846b-4919-a5b7-e560dcb9853a service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:51:41.796948 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [req-2166a31a-c3f3-4e7e-a317-f1514a07f850 req-5eeae308-846b-4919-a5b7-e560dcb9853a service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:51:41.800293 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-24477e09-cb33-45a3-b6a3-664d8bfde4b9 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Calling method '.version_select at 0x7faf54af9430>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:51:41.808863 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.compute.server_external_events [req-2166a31a-c3f3-4e7e-a317-f1514a07f850 req-5eeae308-846b-4919-a5b7-e560dcb9853a service nova] Creating event network-changed:9d045b39-d9e4-4c97-85f1-396b4e20f020 for instance 0868ffdc-e030-4180-a3dd-f8b5231471b6 on hv-cinder-82549 Jun 17 15:51:41.814045 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [req-2166a31a-c3f3-4e7e-a317-f1514a07f850 req-5eeae308-846b-4919-a5b7-e560dcb9853a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119026 Jun 17 15:51:41.815083 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 2031/3646] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 15:51:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:51:41.820501 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-24477e09-cb33-45a3-b6a3-664d8bfde4b9 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-330527002" status: 202 len: 0 microversion: 2.1 time: 0.024117 Jun 17 15:51:41.821062 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1616/3647] 10.222.0.48 () {58 vars in 1217 bytes} [Fri Jun 17 15:51:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-330527002 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 15:51:44.248837 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-89859a2d-5058-4867-adab-8d9317da676e tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:51:44.249425 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-89859a2d-5058-4867-adab-8d9317da676e tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] [instance: 537247a8-cd91-485c-b763-5f8d6e27d81e] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:51:44.255598 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-89859a2d-5058-4867-adab-8d9317da676e tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:51:44.256045 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-89859a2d-5058-4867-adab-8d9317da676e tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:51:44.256836 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-89859a2d-5058-4867-adab-8d9317da676e tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:51:44.257271 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-89859a2d-5058-4867-adab-8d9317da676e tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:51:44.270379 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.wsgi [None req-89859a2d-5058-4867-adab-8d9317da676e tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] HTTP exception thrown: Instance 537247a8-cd91-485c-b763-5f8d6e27d81e could not be found. Jun 17 15:51:44.272046 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-89859a2d-5058-4867-adab-8d9317da676e tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Request method failure captured: Jun 17 15:51:44.272046 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: request: DELETE /compute/v2.1/servers/537247a8-cd91-485c-b763-5f8d6e27d81e HTTP/1.1 Jun 17 15:51:44.272046 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Accept: application/json Jun 17 15:51:44.272046 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Accept-Encoding: identity Jun 17 15:51:44.272046 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Connection: close Jun 17 15:51:44.272046 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Content-Length: 0 Jun 17 15:51:44.272046 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Content-Type: application/json Jun 17 15:51:44.272046 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Host: 10.222.0.48 Jun 17 15:51:44.272046 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Openstack-System-Scope: None Jun 17 15:51:44.272046 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: User-Agent: python-urllib3/1.26.9 Jun 17 15:51:44.272046 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Auth-Token: gAAAAABirKICwWnhD993Jl4IhDGE-QonLGXk8DgdDZd8k6DQ9ib1E3iCeZvkPKJ1yooc16OipcuLAmHVKfeflaAMN8pddeU0L_b0r5jZEMoMoQRDnLv1aSXXTkcHo205L-oyOwE_Oe-bVu0FH4Pz82Sgm44hDcOVXCq7XBTJwNam2wPPozTvXCI Jun 17 15:51:44.272046 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Domain-Id: None Jun 17 15:51:44.272046 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Domain-Name: None Jun 17 15:51:44.272046 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Identity-Status: Confirmed Jun 17 15:51:44.272046 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Is-Admin-Project: True Jun 17 15:51:44.272046 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Domain-Id: default Jun 17 15:51:44.272046 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Domain-Name: Default Jun 17 15:51:44.272046 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Id: 79efe2b5db31498c81c59b086e5c6f84 Jun 17 15:51:44.272046 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Name: tempest-AttachVolumeNegativeTest-957597123 Jun 17 15:51:44.272046 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Role: reader,member Jun 17 15:51:44.272046 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Roles: reader,member Jun 17 15:51:44.273871 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_79efe2b5db31498c81c59b086e5c6f84", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/79efe2b5db31498c81c59b086e5c6f84"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/79efe2b5db31498c81c59b086e5c6f84"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/79efe2b5db31498c81c59b086e5c6f84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Jun 17 15:51:44.273871 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant: tempest-AttachVolumeNegativeTest-957597123 Jun 17 15:51:44.273871 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant-Id: 79efe2b5db31498c81c59b086e5c6f84 Jun 17 15:51:44.273871 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-957597123 Jun 17 15:51:44.273871 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User: tempest-AttachVolumeNegativeTest-957597123-project Jun 17 15:51:44.273871 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Domain-Id: default Jun 17 15:51:44.273871 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Domain-Name: Default Jun 17 15:51:44.273871 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Id: 8ab3130962a6456bbbcb1c96aba3506d Jun 17 15:51:44.273871 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Name: tempest-AttachVolumeNegativeTest-957597123-project Jun 17 15:51:44.273871 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: method: > Jun 17 15:51:44.273871 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: exception: Instance 537247a8-cd91-485c-b763-5f8d6e27d81e could not be found. Jun 17 15:51:44.273871 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: action_args: {'id': '537247a8-cd91-485c-b763-5f8d6e27d81e'} Jun 17 15:51:44.274892 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 15:51:44.274892 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:51:44.274892 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 15:51:44.274892 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 15:51:44.274892 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 15:51:44.274892 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 15:51:44.274892 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 15:51:44.274892 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 15:51:44.274892 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 15:51:44.274892 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 15:51:44.274892 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 537247a8-cd91-485c-b763-5f8d6e27d81e could not be found. Jun 17 15:51:44.274892 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:51:44.274892 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:51:44.274892 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:51:44.274892 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:51:44.274892 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:51:44.274892 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:51:44.274892 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 15:51:44.274892 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 15:51:44.274892 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 15:51:44.277639 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 15:51:44.277639 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 17 15:51:44.277639 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 17 15:51:44.277639 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 17 15:51:44.277639 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 17 15:51:44.277639 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 15:51:44.277639 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 15:51:44.277639 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 15:51:44.277639 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 15:51:44.277639 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 537247a8-cd91-485c-b763-5f8d6e27d81e could not be found. Jun 17 15:51:44.277639 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:51:44.277639 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:51:44.277639 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:51:44.277639 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:51:44.277639 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:51:44.277639 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:51:44.277639 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 15:51:44.277639 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 15:51:44.277639 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 537247a8-cd91-485c-b763-5f8d6e27d81e could not be found. Jun 17 15:51:44.277639 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:51:44.279311 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-89859a2d-5058-4867-adab-8d9317da676e tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Returning 404 to user: Instance 537247a8-cd91-485c-b763-5f8d6e27d81e could not be found. {{(pid=117650) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 15:51:44.279311 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-89859a2d-5058-4867-adab-8d9317da676e tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] 10.222.0.48 "DELETE /compute/v2.1/servers/537247a8-cd91-485c-b763-5f8d6e27d81e" status: 404 len: 111 microversion: 2.1 time: 0.029339 Jun 17 15:51:44.279311 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 2032/3648] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jun 17 15:51:44 2022] DELETE /compute/v2.1/servers/537247a8-cd91-485c-b763-5f8d6e27d81e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 15:51:44.283418 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-4ecf5cee-3de1-4092-9eac-ec74c5e7c716 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:51:44.284030 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-4ecf5cee-3de1-4092-9eac-ec74c5e7c716 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] [instance: 537247a8-cd91-485c-b763-5f8d6e27d81e] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:51:44.291005 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4ecf5cee-3de1-4092-9eac-ec74c5e7c716 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:51:44.291997 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4ecf5cee-3de1-4092-9eac-ec74c5e7c716 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:51:44.292808 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4ecf5cee-3de1-4092-9eac-ec74c5e7c716 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:51:44.293242 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-4ecf5cee-3de1-4092-9eac-ec74c5e7c716 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:51:44.311213 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.wsgi [None req-4ecf5cee-3de1-4092-9eac-ec74c5e7c716 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] HTTP exception thrown: Instance 537247a8-cd91-485c-b763-5f8d6e27d81e could not be found. Jun 17 15:51:44.312824 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-4ecf5cee-3de1-4092-9eac-ec74c5e7c716 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Request method failure captured: Jun 17 15:51:44.312824 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: request: GET /compute/v2.1/servers/537247a8-cd91-485c-b763-5f8d6e27d81e HTTP/1.1 Jun 17 15:51:44.312824 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Accept: application/json Jun 17 15:51:44.312824 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Accept-Encoding: identity Jun 17 15:51:44.312824 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Connection: close Jun 17 15:51:44.312824 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Content-Length: 0 Jun 17 15:51:44.312824 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Content-Type: application/json Jun 17 15:51:44.312824 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Host: 10.222.0.48 Jun 17 15:51:44.312824 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Openstack-System-Scope: None Jun 17 15:51:44.312824 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: User-Agent: python-urllib3/1.26.9 Jun 17 15:51:44.312824 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Auth-Token: gAAAAABirKICwWnhD993Jl4IhDGE-QonLGXk8DgdDZd8k6DQ9ib1E3iCeZvkPKJ1yooc16OipcuLAmHVKfeflaAMN8pddeU0L_b0r5jZEMoMoQRDnLv1aSXXTkcHo205L-oyOwE_Oe-bVu0FH4Pz82Sgm44hDcOVXCq7XBTJwNam2wPPozTvXCI Jun 17 15:51:44.312824 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Domain-Id: None Jun 17 15:51:44.312824 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Domain-Name: None Jun 17 15:51:44.312824 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Identity-Status: Confirmed Jun 17 15:51:44.312824 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Is-Admin-Project: True Jun 17 15:51:44.312824 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Domain-Id: default Jun 17 15:51:44.312824 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Domain-Name: Default Jun 17 15:51:44.312824 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Id: 79efe2b5db31498c81c59b086e5c6f84 Jun 17 15:51:44.312824 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Name: tempest-AttachVolumeNegativeTest-957597123 Jun 17 15:51:44.312824 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Role: reader,member Jun 17 15:51:44.312824 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Roles: reader,member Jun 17 15:51:44.314731 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_79efe2b5db31498c81c59b086e5c6f84", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/79efe2b5db31498c81c59b086e5c6f84"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/79efe2b5db31498c81c59b086e5c6f84"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/79efe2b5db31498c81c59b086e5c6f84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Jun 17 15:51:44.314731 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant: tempest-AttachVolumeNegativeTest-957597123 Jun 17 15:51:44.314731 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant-Id: 79efe2b5db31498c81c59b086e5c6f84 Jun 17 15:51:44.314731 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-957597123 Jun 17 15:51:44.314731 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User: tempest-AttachVolumeNegativeTest-957597123-project Jun 17 15:51:44.314731 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Domain-Id: default Jun 17 15:51:44.314731 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Domain-Name: Default Jun 17 15:51:44.314731 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Id: 8ab3130962a6456bbbcb1c96aba3506d Jun 17 15:51:44.314731 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Name: tempest-AttachVolumeNegativeTest-957597123-project Jun 17 15:51:44.314731 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: method: > Jun 17 15:51:44.314731 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: exception: Instance 537247a8-cd91-485c-b763-5f8d6e27d81e could not be found. Jun 17 15:51:44.314731 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: action_args: {'id': '537247a8-cd91-485c-b763-5f8d6e27d81e'} Jun 17 15:51:44.315643 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 15:51:44.315643 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:51:44.315643 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 15:51:44.315643 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 15:51:44.315643 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 15:51:44.315643 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 15:51:44.315643 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 15:51:44.315643 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 15:51:44.315643 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 15:51:44.315643 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 15:51:44.315643 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 537247a8-cd91-485c-b763-5f8d6e27d81e could not be found. Jun 17 15:51:44.315643 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:51:44.315643 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:51:44.315643 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:51:44.315643 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:51:44.315643 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:51:44.315643 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:51:44.315643 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 15:51:44.315643 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 15:51:44.315643 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 15:51:44.317203 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 15:51:44.317203 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 15:51:44.317203 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 15:51:44.317203 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 15:51:44.317203 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 15:51:44.317203 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 15:51:44.317203 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 15:51:44.317203 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 537247a8-cd91-485c-b763-5f8d6e27d81e could not be found. Jun 17 15:51:44.317203 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:51:44.317203 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:51:44.317203 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:51:44.317203 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:51:44.317203 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:51:44.317203 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:51:44.317203 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 15:51:44.317203 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 15:51:44.317203 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 537247a8-cd91-485c-b763-5f8d6e27d81e could not be found. Jun 17 15:51:44.317203 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:51:44.318694 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-4ecf5cee-3de1-4092-9eac-ec74c5e7c716 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Returning 404 to user: Instance 537247a8-cd91-485c-b763-5f8d6e27d81e could not be found. {{(pid=117649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 15:51:44.318694 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-4ecf5cee-3de1-4092-9eac-ec74c5e7c716 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] 10.222.0.48 "GET /compute/v2.1/servers/537247a8-cd91-485c-b763-5f8d6e27d81e" status: 404 len: 111 microversion: 2.1 time: 0.035696 Jun 17 15:51:44.318694 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1617/3649] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:51:44 2022] GET /compute/v2.1/servers/537247a8-cd91-485c-b763-5f8d6e27d81e => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 17 15:51:45.454433 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-1d7be148-9dcf-4b91-845f-ef8e6a03410c tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:51:45.454956 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-1d7be148-9dcf-4b91-845f-ef8e6a03410c tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] [instance: 390b2d03-4e54-44c3-91db-08c6eed28adb] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:51:45.461242 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1d7be148-9dcf-4b91-845f-ef8e6a03410c tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:51:45.461773 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1d7be148-9dcf-4b91-845f-ef8e6a03410c tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:51:45.490703 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1d7be148-9dcf-4b91-845f-ef8e6a03410c tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:51:45.490703 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1d7be148-9dcf-4b91-845f-ef8e6a03410c tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:51:45.490703 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.wsgi [None req-1d7be148-9dcf-4b91-845f-ef8e6a03410c tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] HTTP exception thrown: Instance 390b2d03-4e54-44c3-91db-08c6eed28adb could not be found. Jun 17 15:51:45.490703 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-1d7be148-9dcf-4b91-845f-ef8e6a03410c tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Request method failure captured: Jun 17 15:51:45.490703 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: request: DELETE /compute/v2.1/servers/390b2d03-4e54-44c3-91db-08c6eed28adb HTTP/1.1 Jun 17 15:51:45.490703 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Accept: application/json Jun 17 15:51:45.490703 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Accept-Encoding: identity Jun 17 15:51:45.490703 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Connection: close Jun 17 15:51:45.490703 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Content-Length: 0 Jun 17 15:51:45.490703 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Content-Type: application/json Jun 17 15:51:45.490703 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Host: 10.222.0.48 Jun 17 15:51:45.490703 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Openstack-System-Scope: None Jun 17 15:51:45.490703 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: User-Agent: python-urllib3/1.26.9 Jun 17 15:51:45.492592 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Auth-Token: gAAAAABirKICwWnhD993Jl4IhDGE-QonLGXk8DgdDZd8k6DQ9ib1E3iCeZvkPKJ1yooc16OipcuLAmHVKfeflaAMN8pddeU0L_b0r5jZEMoMoQRDnLv1aSXXTkcHo205L-oyOwE_Oe-bVu0FH4Pz82Sgm44hDcOVXCq7XBTJwNam2wPPozTvXCI Jun 17 15:51:45.492592 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Domain-Id: None Jun 17 15:51:45.492592 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Domain-Name: None Jun 17 15:51:45.492592 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Identity-Status: Confirmed Jun 17 15:51:45.492592 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Is-Admin-Project: True Jun 17 15:51:45.492592 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Domain-Id: default Jun 17 15:51:45.492592 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Domain-Name: Default Jun 17 15:51:45.492592 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Id: 79efe2b5db31498c81c59b086e5c6f84 Jun 17 15:51:45.492592 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Name: tempest-AttachVolumeNegativeTest-957597123 Jun 17 15:51:45.492592 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Role: reader,member Jun 17 15:51:45.492592 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Roles: reader,member Jun 17 15:51:45.492592 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_79efe2b5db31498c81c59b086e5c6f84", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/79efe2b5db31498c81c59b086e5c6f84"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/79efe2b5db31498c81c59b086e5c6f84"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/79efe2b5db31498c81c59b086e5c6f84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Jun 17 15:51:45.492592 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant: tempest-AttachVolumeNegativeTest-957597123 Jun 17 15:51:45.492592 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant-Id: 79efe2b5db31498c81c59b086e5c6f84 Jun 17 15:51:45.492592 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-957597123 Jun 17 15:51:45.493677 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User: tempest-AttachVolumeNegativeTest-957597123-project Jun 17 15:51:45.493677 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Domain-Id: default Jun 17 15:51:45.493677 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Domain-Name: Default Jun 17 15:51:45.493677 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Id: 8ab3130962a6456bbbcb1c96aba3506d Jun 17 15:51:45.493677 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Name: tempest-AttachVolumeNegativeTest-957597123-project Jun 17 15:51:45.493677 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: method: > Jun 17 15:51:45.493677 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: exception: Instance 390b2d03-4e54-44c3-91db-08c6eed28adb could not be found. Jun 17 15:51:45.493677 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: action_args: {'id': '390b2d03-4e54-44c3-91db-08c6eed28adb'} Jun 17 15:51:45.493677 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 15:51:45.493677 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:51:45.493677 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 15:51:45.493677 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 15:51:45.493677 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 15:51:45.493677 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 15:51:45.493677 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 15:51:45.493677 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 15:51:45.493677 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 15:51:45.493677 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 15:51:45.493677 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 390b2d03-4e54-44c3-91db-08c6eed28adb could not be found. Jun 17 15:51:45.493677 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:51:45.493677 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:51:45.493677 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:51:45.493677 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:51:45.496061 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:51:45.496061 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:51:45.496061 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 15:51:45.496061 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 15:51:45.496061 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 15:51:45.496061 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 15:51:45.496061 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 17 15:51:45.496061 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 17 15:51:45.496061 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 17 15:51:45.496061 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 17 15:51:45.496061 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 15:51:45.496061 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 15:51:45.496061 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 15:51:45.496061 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 15:51:45.496061 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 390b2d03-4e54-44c3-91db-08c6eed28adb could not be found. Jun 17 15:51:45.496061 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:51:45.496061 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:51:45.496061 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:51:45.496061 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:51:45.498493 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:51:45.498493 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:51:45.498493 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 15:51:45.498493 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 15:51:45.498493 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 390b2d03-4e54-44c3-91db-08c6eed28adb could not be found. Jun 17 15:51:45.498493 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:51:45.498493 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-1d7be148-9dcf-4b91-845f-ef8e6a03410c tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Returning 404 to user: Instance 390b2d03-4e54-44c3-91db-08c6eed28adb could not be found. {{(pid=117650) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 15:51:45.498493 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-1d7be148-9dcf-4b91-845f-ef8e6a03410c tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] 10.222.0.48 "DELETE /compute/v2.1/servers/390b2d03-4e54-44c3-91db-08c6eed28adb" status: 404 len: 111 microversion: 2.1 time: 0.031078 Jun 17 15:51:45.498493 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 2033/3650] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jun 17 15:51:45 2022] DELETE /compute/v2.1/servers/390b2d03-4e54-44c3-91db-08c6eed28adb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 15:51:45.501867 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-1c717693-754a-4964-9de0-0c4065ea63e5 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:51:45.502580 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-1c717693-754a-4964-9de0-0c4065ea63e5 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] [instance: 390b2d03-4e54-44c3-91db-08c6eed28adb] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:51:45.510012 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1c717693-754a-4964-9de0-0c4065ea63e5 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:51:45.510941 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1c717693-754a-4964-9de0-0c4065ea63e5 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:51:45.511699 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1c717693-754a-4964-9de0-0c4065ea63e5 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:51:45.512137 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1c717693-754a-4964-9de0-0c4065ea63e5 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:51:45.525401 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.wsgi [None req-1c717693-754a-4964-9de0-0c4065ea63e5 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] HTTP exception thrown: Instance 390b2d03-4e54-44c3-91db-08c6eed28adb could not be found. Jun 17 15:51:45.526926 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-1c717693-754a-4964-9de0-0c4065ea63e5 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Request method failure captured: Jun 17 15:51:45.526926 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: request: GET /compute/v2.1/servers/390b2d03-4e54-44c3-91db-08c6eed28adb HTTP/1.1 Jun 17 15:51:45.526926 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Accept: application/json Jun 17 15:51:45.526926 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Accept-Encoding: identity Jun 17 15:51:45.526926 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Connection: close Jun 17 15:51:45.526926 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Content-Length: 0 Jun 17 15:51:45.526926 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Content-Type: application/json Jun 17 15:51:45.526926 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Host: 10.222.0.48 Jun 17 15:51:45.526926 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Openstack-System-Scope: None Jun 17 15:51:45.526926 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: User-Agent: python-urllib3/1.26.9 Jun 17 15:51:45.526926 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Auth-Token: gAAAAABirKICwWnhD993Jl4IhDGE-QonLGXk8DgdDZd8k6DQ9ib1E3iCeZvkPKJ1yooc16OipcuLAmHVKfeflaAMN8pddeU0L_b0r5jZEMoMoQRDnLv1aSXXTkcHo205L-oyOwE_Oe-bVu0FH4Pz82Sgm44hDcOVXCq7XBTJwNam2wPPozTvXCI Jun 17 15:51:45.526926 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Domain-Id: None Jun 17 15:51:45.526926 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Domain-Name: None Jun 17 15:51:45.526926 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Identity-Status: Confirmed Jun 17 15:51:45.526926 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Is-Admin-Project: True Jun 17 15:51:45.526926 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Domain-Id: default Jun 17 15:51:45.526926 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Domain-Name: Default Jun 17 15:51:45.526926 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Id: 79efe2b5db31498c81c59b086e5c6f84 Jun 17 15:51:45.526926 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Name: tempest-AttachVolumeNegativeTest-957597123 Jun 17 15:51:45.526926 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Role: reader,member Jun 17 15:51:45.526926 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Roles: reader,member Jun 17 15:51:45.528068 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_79efe2b5db31498c81c59b086e5c6f84", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/79efe2b5db31498c81c59b086e5c6f84"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/79efe2b5db31498c81c59b086e5c6f84"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/79efe2b5db31498c81c59b086e5c6f84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Jun 17 15:51:45.528068 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant: tempest-AttachVolumeNegativeTest-957597123 Jun 17 15:51:45.528068 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant-Id: 79efe2b5db31498c81c59b086e5c6f84 Jun 17 15:51:45.528068 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-957597123 Jun 17 15:51:45.528068 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User: tempest-AttachVolumeNegativeTest-957597123-project Jun 17 15:51:45.528068 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Domain-Id: default Jun 17 15:51:45.528068 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Domain-Name: Default Jun 17 15:51:45.528068 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Id: 8ab3130962a6456bbbcb1c96aba3506d Jun 17 15:51:45.528068 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Name: tempest-AttachVolumeNegativeTest-957597123-project Jun 17 15:51:45.528068 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: method: > Jun 17 15:51:45.528068 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: exception: Instance 390b2d03-4e54-44c3-91db-08c6eed28adb could not be found. Jun 17 15:51:45.528068 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: action_args: {'id': '390b2d03-4e54-44c3-91db-08c6eed28adb'} Jun 17 15:51:45.528806 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 15:51:45.528806 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:51:45.528806 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 15:51:45.528806 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 15:51:45.528806 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 15:51:45.528806 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 15:51:45.528806 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 15:51:45.528806 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 15:51:45.528806 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 15:51:45.528806 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 15:51:45.528806 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 390b2d03-4e54-44c3-91db-08c6eed28adb could not be found. Jun 17 15:51:45.528806 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:51:45.528806 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:51:45.528806 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:51:45.528806 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:51:45.528806 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:51:45.528806 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:51:45.528806 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 15:51:45.528806 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 15:51:45.528806 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 15:51:45.529712 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 15:51:45.529712 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 15:51:45.529712 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 15:51:45.529712 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 15:51:45.529712 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 15:51:45.529712 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 15:51:45.529712 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 15:51:45.529712 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 390b2d03-4e54-44c3-91db-08c6eed28adb could not be found. Jun 17 15:51:45.529712 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:51:45.529712 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:51:45.529712 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:51:45.529712 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:51:45.529712 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:51:45.529712 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:51:45.529712 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 15:51:45.529712 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 15:51:45.529712 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 390b2d03-4e54-44c3-91db-08c6eed28adb could not be found. Jun 17 15:51:45.529712 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:51:45.530472 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-1c717693-754a-4964-9de0-0c4065ea63e5 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Returning 404 to user: Instance 390b2d03-4e54-44c3-91db-08c6eed28adb could not be found. {{(pid=117649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 15:51:45.530472 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-1c717693-754a-4964-9de0-0c4065ea63e5 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] 10.222.0.48 "GET /compute/v2.1/servers/390b2d03-4e54-44c3-91db-08c6eed28adb" status: 404 len: 111 microversion: 2.1 time: 0.040466 Jun 17 15:51:45.530472 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1618/3651] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:51:45 2022] GET /compute/v2.1/servers/390b2d03-4e54-44c3-91db-08c6eed28adb => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 15:51:45.536940 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-5a88fb73-e2fd-4104-8367-f042992ba360 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:51:45.537469 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-5a88fb73-e2fd-4104-8367-f042992ba360 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] [instance: 1687c703-69ae-4187-bc39-16c2eca96d87] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:51:45.543521 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5a88fb73-e2fd-4104-8367-f042992ba360 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:51:45.543958 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5a88fb73-e2fd-4104-8367-f042992ba360 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:51:45.544734 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5a88fb73-e2fd-4104-8367-f042992ba360 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:51:45.545163 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5a88fb73-e2fd-4104-8367-f042992ba360 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:51:45.559387 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.wsgi [None req-5a88fb73-e2fd-4104-8367-f042992ba360 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] HTTP exception thrown: Instance 1687c703-69ae-4187-bc39-16c2eca96d87 could not be found. Jun 17 15:51:45.560965 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-5a88fb73-e2fd-4104-8367-f042992ba360 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Request method failure captured: Jun 17 15:51:45.560965 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: request: DELETE /compute/v2.1/servers/1687c703-69ae-4187-bc39-16c2eca96d87 HTTP/1.1 Jun 17 15:51:45.560965 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Accept: application/json Jun 17 15:51:45.560965 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Accept-Encoding: identity Jun 17 15:51:45.560965 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Connection: close Jun 17 15:51:45.560965 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Content-Length: 0 Jun 17 15:51:45.560965 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Content-Type: application/json Jun 17 15:51:45.560965 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Host: 10.222.0.48 Jun 17 15:51:45.560965 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Openstack-System-Scope: None Jun 17 15:51:45.560965 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: User-Agent: python-urllib3/1.26.9 Jun 17 15:51:45.560965 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Auth-Token: gAAAAABirKICwWnhD993Jl4IhDGE-QonLGXk8DgdDZd8k6DQ9ib1E3iCeZvkPKJ1yooc16OipcuLAmHVKfeflaAMN8pddeU0L_b0r5jZEMoMoQRDnLv1aSXXTkcHo205L-oyOwE_Oe-bVu0FH4Pz82Sgm44hDcOVXCq7XBTJwNam2wPPozTvXCI Jun 17 15:51:45.560965 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Domain-Id: None Jun 17 15:51:45.560965 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Domain-Name: None Jun 17 15:51:45.560965 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Identity-Status: Confirmed Jun 17 15:51:45.560965 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Is-Admin-Project: True Jun 17 15:51:45.560965 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Domain-Id: default Jun 17 15:51:45.560965 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Domain-Name: Default Jun 17 15:51:45.560965 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Id: 79efe2b5db31498c81c59b086e5c6f84 Jun 17 15:51:45.560965 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Name: tempest-AttachVolumeNegativeTest-957597123 Jun 17 15:51:45.560965 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Role: reader,member Jun 17 15:51:45.560965 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Roles: reader,member Jun 17 15:51:45.562138 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_79efe2b5db31498c81c59b086e5c6f84", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/79efe2b5db31498c81c59b086e5c6f84"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/79efe2b5db31498c81c59b086e5c6f84"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/79efe2b5db31498c81c59b086e5c6f84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Jun 17 15:51:45.562138 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant: tempest-AttachVolumeNegativeTest-957597123 Jun 17 15:51:45.562138 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant-Id: 79efe2b5db31498c81c59b086e5c6f84 Jun 17 15:51:45.562138 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-957597123 Jun 17 15:51:45.562138 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User: tempest-AttachVolumeNegativeTest-957597123-project Jun 17 15:51:45.562138 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Domain-Id: default Jun 17 15:51:45.562138 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Domain-Name: Default Jun 17 15:51:45.562138 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Id: 8ab3130962a6456bbbcb1c96aba3506d Jun 17 15:51:45.562138 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Name: tempest-AttachVolumeNegativeTest-957597123-project Jun 17 15:51:45.562138 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: method: > Jun 17 15:51:45.562138 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: exception: Instance 1687c703-69ae-4187-bc39-16c2eca96d87 could not be found. Jun 17 15:51:45.562138 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: action_args: {'id': '1687c703-69ae-4187-bc39-16c2eca96d87'} Jun 17 15:51:45.562815 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 15:51:45.562815 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:51:45.562815 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 15:51:45.562815 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 15:51:45.562815 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 15:51:45.562815 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 15:51:45.562815 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 15:51:45.562815 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 15:51:45.562815 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 15:51:45.562815 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 15:51:45.562815 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1687c703-69ae-4187-bc39-16c2eca96d87 could not be found. Jun 17 15:51:45.562815 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:51:45.562815 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:51:45.562815 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:51:45.562815 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:51:45.562815 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:51:45.562815 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:51:45.562815 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 15:51:45.562815 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 15:51:45.562815 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 15:51:45.563865 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 15:51:45.563865 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 17 15:51:45.563865 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 17 15:51:45.563865 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 17 15:51:45.563865 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 17 15:51:45.563865 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 15:51:45.563865 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 15:51:45.563865 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 15:51:45.563865 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 15:51:45.563865 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1687c703-69ae-4187-bc39-16c2eca96d87 could not be found. Jun 17 15:51:45.563865 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:51:45.563865 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:51:45.563865 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:51:45.563865 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:51:45.563865 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:51:45.563865 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:51:45.563865 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 15:51:45.563865 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 15:51:45.563865 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1687c703-69ae-4187-bc39-16c2eca96d87 could not be found. Jun 17 15:51:45.563865 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:51:45.565000 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-5a88fb73-e2fd-4104-8367-f042992ba360 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Returning 404 to user: Instance 1687c703-69ae-4187-bc39-16c2eca96d87 could not be found. {{(pid=117650) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 15:51:45.565000 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-5a88fb73-e2fd-4104-8367-f042992ba360 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] 10.222.0.48 "DELETE /compute/v2.1/servers/1687c703-69ae-4187-bc39-16c2eca96d87" status: 404 len: 111 microversion: 2.1 time: 0.029215 Jun 17 15:51:45.565000 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 2034/3652] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jun 17 15:51:45 2022] DELETE /compute/v2.1/servers/1687c703-69ae-4187-bc39-16c2eca96d87 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 15:51:45.571193 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-c0555e86-8a03-410c-adce-c90d3e871e86 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:51:45.571808 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-c0555e86-8a03-410c-adce-c90d3e871e86 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] [instance: 1687c703-69ae-4187-bc39-16c2eca96d87] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:51:45.579483 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c0555e86-8a03-410c-adce-c90d3e871e86 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:51:45.579956 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c0555e86-8a03-410c-adce-c90d3e871e86 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:51:45.580945 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c0555e86-8a03-410c-adce-c90d3e871e86 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:51:45.581379 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c0555e86-8a03-410c-adce-c90d3e871e86 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:51:45.595820 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.wsgi [None req-c0555e86-8a03-410c-adce-c90d3e871e86 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] HTTP exception thrown: Instance 1687c703-69ae-4187-bc39-16c2eca96d87 could not be found. Jun 17 15:51:45.597427 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-c0555e86-8a03-410c-adce-c90d3e871e86 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Request method failure captured: Jun 17 15:51:45.597427 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: request: GET /compute/v2.1/servers/1687c703-69ae-4187-bc39-16c2eca96d87 HTTP/1.1 Jun 17 15:51:45.597427 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Accept: application/json Jun 17 15:51:45.597427 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Accept-Encoding: identity Jun 17 15:51:45.597427 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Connection: close Jun 17 15:51:45.597427 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Content-Length: 0 Jun 17 15:51:45.597427 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Content-Type: application/json Jun 17 15:51:45.597427 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Host: 10.222.0.48 Jun 17 15:51:45.597427 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Openstack-System-Scope: None Jun 17 15:51:45.597427 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: User-Agent: python-urllib3/1.26.9 Jun 17 15:51:45.597427 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Auth-Token: gAAAAABirKICwWnhD993Jl4IhDGE-QonLGXk8DgdDZd8k6DQ9ib1E3iCeZvkPKJ1yooc16OipcuLAmHVKfeflaAMN8pddeU0L_b0r5jZEMoMoQRDnLv1aSXXTkcHo205L-oyOwE_Oe-bVu0FH4Pz82Sgm44hDcOVXCq7XBTJwNam2wPPozTvXCI Jun 17 15:51:45.597427 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Domain-Id: None Jun 17 15:51:45.597427 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Domain-Name: None Jun 17 15:51:45.597427 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Identity-Status: Confirmed Jun 17 15:51:45.597427 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Is-Admin-Project: True Jun 17 15:51:45.597427 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Domain-Id: default Jun 17 15:51:45.597427 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Domain-Name: Default Jun 17 15:51:45.597427 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Id: 79efe2b5db31498c81c59b086e5c6f84 Jun 17 15:51:45.597427 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Name: tempest-AttachVolumeNegativeTest-957597123 Jun 17 15:51:45.597427 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Role: reader,member Jun 17 15:51:45.597427 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Roles: reader,member Jun 17 15:51:45.598632 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_79efe2b5db31498c81c59b086e5c6f84", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/79efe2b5db31498c81c59b086e5c6f84"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/79efe2b5db31498c81c59b086e5c6f84"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/79efe2b5db31498c81c59b086e5c6f84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Jun 17 15:51:45.598632 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant: tempest-AttachVolumeNegativeTest-957597123 Jun 17 15:51:45.598632 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant-Id: 79efe2b5db31498c81c59b086e5c6f84 Jun 17 15:51:45.598632 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-957597123 Jun 17 15:51:45.598632 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User: tempest-AttachVolumeNegativeTest-957597123-project Jun 17 15:51:45.598632 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Domain-Id: default Jun 17 15:51:45.598632 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Domain-Name: Default Jun 17 15:51:45.598632 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Id: 8ab3130962a6456bbbcb1c96aba3506d Jun 17 15:51:45.598632 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Name: tempest-AttachVolumeNegativeTest-957597123-project Jun 17 15:51:45.598632 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: method: > Jun 17 15:51:45.598632 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: exception: Instance 1687c703-69ae-4187-bc39-16c2eca96d87 could not be found. Jun 17 15:51:45.598632 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: action_args: {'id': '1687c703-69ae-4187-bc39-16c2eca96d87'} Jun 17 15:51:45.599297 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 15:51:45.599297 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:51:45.599297 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 15:51:45.599297 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 15:51:45.599297 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 15:51:45.599297 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 15:51:45.599297 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 15:51:45.599297 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 15:51:45.599297 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 15:51:45.599297 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 15:51:45.599297 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1687c703-69ae-4187-bc39-16c2eca96d87 could not be found. Jun 17 15:51:45.599297 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:51:45.599297 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:51:45.599297 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:51:45.599297 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:51:45.599297 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:51:45.599297 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:51:45.599297 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 15:51:45.599297 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 15:51:45.599297 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 15:51:45.603746 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 15:51:45.603746 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 15:51:45.603746 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 15:51:45.603746 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 15:51:45.603746 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 15:51:45.603746 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 15:51:45.603746 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 15:51:45.603746 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1687c703-69ae-4187-bc39-16c2eca96d87 could not be found. Jun 17 15:51:45.603746 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:51:45.603746 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:51:45.603746 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:51:45.603746 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:51:45.603746 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:51:45.603746 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:51:45.603746 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 15:51:45.603746 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 15:51:45.603746 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1687c703-69ae-4187-bc39-16c2eca96d87 could not be found. Jun 17 15:51:45.603746 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:51:45.604772 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-c0555e86-8a03-410c-adce-c90d3e871e86 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Returning 404 to user: Instance 1687c703-69ae-4187-bc39-16c2eca96d87 could not be found. {{(pid=117649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 15:51:45.604772 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-c0555e86-8a03-410c-adce-c90d3e871e86 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] 10.222.0.48 "GET /compute/v2.1/servers/1687c703-69ae-4187-bc39-16c2eca96d87" status: 404 len: 111 microversion: 2.1 time: 0.031443 Jun 17 15:51:45.604772 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1619/3653] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:51:45 2022] GET /compute/v2.1/servers/1687c703-69ae-4187-bc39-16c2eca96d87 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 15:51:46.737093 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-1ebf4b60-a48d-4e49-ade2-0b79056c349d tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:51:46.737605 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-1ebf4b60-a48d-4e49-ade2-0b79056c349d tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] [instance: e4173cb9-999f-41f4-ade9-b521fc218a2b] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:51:46.744813 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1ebf4b60-a48d-4e49-ade2-0b79056c349d tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:51:46.745275 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1ebf4b60-a48d-4e49-ade2-0b79056c349d tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:51:46.746046 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1ebf4b60-a48d-4e49-ade2-0b79056c349d tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:51:46.746475 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-1ebf4b60-a48d-4e49-ade2-0b79056c349d tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:51:46.759958 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.wsgi [None req-1ebf4b60-a48d-4e49-ade2-0b79056c349d tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] HTTP exception thrown: Instance e4173cb9-999f-41f4-ade9-b521fc218a2b could not be found. Jun 17 15:51:46.761535 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-1ebf4b60-a48d-4e49-ade2-0b79056c349d tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Request method failure captured: Jun 17 15:51:46.761535 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: request: DELETE /compute/v2.1/servers/e4173cb9-999f-41f4-ade9-b521fc218a2b HTTP/1.1 Jun 17 15:51:46.761535 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Accept: application/json Jun 17 15:51:46.761535 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Accept-Encoding: identity Jun 17 15:51:46.761535 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Connection: close Jun 17 15:51:46.761535 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Content-Length: 0 Jun 17 15:51:46.761535 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Content-Type: application/json Jun 17 15:51:46.761535 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Host: 10.222.0.48 Jun 17 15:51:46.761535 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Openstack-System-Scope: None Jun 17 15:51:46.761535 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: User-Agent: python-urllib3/1.26.9 Jun 17 15:51:46.761535 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Auth-Token: gAAAAABirKICwWnhD993Jl4IhDGE-QonLGXk8DgdDZd8k6DQ9ib1E3iCeZvkPKJ1yooc16OipcuLAmHVKfeflaAMN8pddeU0L_b0r5jZEMoMoQRDnLv1aSXXTkcHo205L-oyOwE_Oe-bVu0FH4Pz82Sgm44hDcOVXCq7XBTJwNam2wPPozTvXCI Jun 17 15:51:46.761535 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Domain-Id: None Jun 17 15:51:46.761535 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Domain-Name: None Jun 17 15:51:46.761535 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Identity-Status: Confirmed Jun 17 15:51:46.761535 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Is-Admin-Project: True Jun 17 15:51:46.761535 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Domain-Id: default Jun 17 15:51:46.761535 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Domain-Name: Default Jun 17 15:51:46.761535 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Id: 79efe2b5db31498c81c59b086e5c6f84 Jun 17 15:51:46.761535 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Name: tempest-AttachVolumeNegativeTest-957597123 Jun 17 15:51:46.761535 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Role: reader,member Jun 17 15:51:46.761535 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Roles: reader,member Jun 17 15:51:46.762719 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_79efe2b5db31498c81c59b086e5c6f84", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/79efe2b5db31498c81c59b086e5c6f84"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/79efe2b5db31498c81c59b086e5c6f84"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/79efe2b5db31498c81c59b086e5c6f84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Jun 17 15:51:46.762719 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant: tempest-AttachVolumeNegativeTest-957597123 Jun 17 15:51:46.762719 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant-Id: 79efe2b5db31498c81c59b086e5c6f84 Jun 17 15:51:46.762719 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-957597123 Jun 17 15:51:46.762719 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User: tempest-AttachVolumeNegativeTest-957597123-project Jun 17 15:51:46.762719 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Domain-Id: default Jun 17 15:51:46.762719 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Domain-Name: Default Jun 17 15:51:46.762719 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Id: 8ab3130962a6456bbbcb1c96aba3506d Jun 17 15:51:46.762719 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Name: tempest-AttachVolumeNegativeTest-957597123-project Jun 17 15:51:46.762719 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: method: > Jun 17 15:51:46.762719 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: exception: Instance e4173cb9-999f-41f4-ade9-b521fc218a2b could not be found. Jun 17 15:51:46.762719 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: action_args: {'id': 'e4173cb9-999f-41f4-ade9-b521fc218a2b'} Jun 17 15:51:46.763354 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 15:51:46.763354 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:51:46.763354 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 15:51:46.763354 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 15:51:46.763354 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 15:51:46.763354 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 15:51:46.763354 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 15:51:46.763354 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 15:51:46.763354 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 15:51:46.763354 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 15:51:46.763354 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4173cb9-999f-41f4-ade9-b521fc218a2b could not be found. Jun 17 15:51:46.763354 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:51:46.763354 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:51:46.763354 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:51:46.763354 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:51:46.763354 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:51:46.763354 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:51:46.763354 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 15:51:46.763354 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 15:51:46.763354 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 15:51:46.764393 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 15:51:46.764393 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 17 15:51:46.764393 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 17 15:51:46.764393 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 17 15:51:46.764393 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 17 15:51:46.764393 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 15:51:46.764393 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 15:51:46.764393 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 15:51:46.764393 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 15:51:46.764393 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4173cb9-999f-41f4-ade9-b521fc218a2b could not be found. Jun 17 15:51:46.764393 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:51:46.764393 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:51:46.764393 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:51:46.764393 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:51:46.764393 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:51:46.764393 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:51:46.764393 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 15:51:46.764393 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 15:51:46.764393 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4173cb9-999f-41f4-ade9-b521fc218a2b could not be found. Jun 17 15:51:46.764393 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:51:46.765513 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-1ebf4b60-a48d-4e49-ade2-0b79056c349d tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Returning 404 to user: Instance e4173cb9-999f-41f4-ade9-b521fc218a2b could not be found. {{(pid=117650) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 15:51:46.765513 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-1ebf4b60-a48d-4e49-ade2-0b79056c349d tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] 10.222.0.48 "DELETE /compute/v2.1/servers/e4173cb9-999f-41f4-ade9-b521fc218a2b" status: 404 len: 111 microversion: 2.1 time: 0.029739 Jun 17 15:51:46.765513 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 2035/3654] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jun 17 15:51:46 2022] DELETE /compute/v2.1/servers/e4173cb9-999f-41f4-ade9-b521fc218a2b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 15:51:46.771223 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-9c5d2550-c97b-4c8e-b13d-ac497419bd09 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:51:46.771831 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-9c5d2550-c97b-4c8e-b13d-ac497419bd09 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] [instance: e4173cb9-999f-41f4-ade9-b521fc218a2b] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:51:46.778344 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9c5d2550-c97b-4c8e-b13d-ac497419bd09 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:51:46.778789 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9c5d2550-c97b-4c8e-b13d-ac497419bd09 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:51:46.779528 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9c5d2550-c97b-4c8e-b13d-ac497419bd09 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:51:46.779955 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9c5d2550-c97b-4c8e-b13d-ac497419bd09 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:51:46.796144 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.wsgi [None req-9c5d2550-c97b-4c8e-b13d-ac497419bd09 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] HTTP exception thrown: Instance e4173cb9-999f-41f4-ade9-b521fc218a2b could not be found. Jun 17 15:51:46.797688 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-9c5d2550-c97b-4c8e-b13d-ac497419bd09 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Request method failure captured: Jun 17 15:51:46.797688 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: request: GET /compute/v2.1/servers/e4173cb9-999f-41f4-ade9-b521fc218a2b HTTP/1.1 Jun 17 15:51:46.797688 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Accept: application/json Jun 17 15:51:46.797688 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Accept-Encoding: identity Jun 17 15:51:46.797688 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Connection: close Jun 17 15:51:46.797688 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Content-Length: 0 Jun 17 15:51:46.797688 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Content-Type: application/json Jun 17 15:51:46.797688 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Host: 10.222.0.48 Jun 17 15:51:46.797688 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Openstack-System-Scope: None Jun 17 15:51:46.797688 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: User-Agent: python-urllib3/1.26.9 Jun 17 15:51:46.797688 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Auth-Token: gAAAAABirKICwWnhD993Jl4IhDGE-QonLGXk8DgdDZd8k6DQ9ib1E3iCeZvkPKJ1yooc16OipcuLAmHVKfeflaAMN8pddeU0L_b0r5jZEMoMoQRDnLv1aSXXTkcHo205L-oyOwE_Oe-bVu0FH4Pz82Sgm44hDcOVXCq7XBTJwNam2wPPozTvXCI Jun 17 15:51:46.797688 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Domain-Id: None Jun 17 15:51:46.797688 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Domain-Name: None Jun 17 15:51:46.797688 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Identity-Status: Confirmed Jun 17 15:51:46.797688 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Is-Admin-Project: True Jun 17 15:51:46.797688 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Domain-Id: default Jun 17 15:51:46.797688 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Domain-Name: Default Jun 17 15:51:46.797688 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Id: 79efe2b5db31498c81c59b086e5c6f84 Jun 17 15:51:46.797688 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Name: tempest-AttachVolumeNegativeTest-957597123 Jun 17 15:51:46.797688 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Role: reader,member Jun 17 15:51:46.797688 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Roles: reader,member Jun 17 15:51:46.798851 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_79efe2b5db31498c81c59b086e5c6f84", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/79efe2b5db31498c81c59b086e5c6f84"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/79efe2b5db31498c81c59b086e5c6f84"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/79efe2b5db31498c81c59b086e5c6f84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Jun 17 15:51:46.798851 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant: tempest-AttachVolumeNegativeTest-957597123 Jun 17 15:51:46.798851 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant-Id: 79efe2b5db31498c81c59b086e5c6f84 Jun 17 15:51:46.798851 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-957597123 Jun 17 15:51:46.798851 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User: tempest-AttachVolumeNegativeTest-957597123-project Jun 17 15:51:46.798851 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Domain-Id: default Jun 17 15:51:46.798851 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Domain-Name: Default Jun 17 15:51:46.798851 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Id: 8ab3130962a6456bbbcb1c96aba3506d Jun 17 15:51:46.798851 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Name: tempest-AttachVolumeNegativeTest-957597123-project Jun 17 15:51:46.798851 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: method: > Jun 17 15:51:46.798851 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: exception: Instance e4173cb9-999f-41f4-ade9-b521fc218a2b could not be found. Jun 17 15:51:46.798851 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: action_args: {'id': 'e4173cb9-999f-41f4-ade9-b521fc218a2b'} Jun 17 15:51:46.799513 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 15:51:46.799513 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:51:46.799513 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 15:51:46.799513 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 15:51:46.799513 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 15:51:46.799513 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 15:51:46.799513 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 15:51:46.799513 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 15:51:46.799513 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 15:51:46.799513 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 15:51:46.799513 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4173cb9-999f-41f4-ade9-b521fc218a2b could not be found. Jun 17 15:51:46.799513 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:51:46.799513 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:51:46.799513 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:51:46.799513 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:51:46.799513 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:51:46.799513 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:51:46.799513 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 15:51:46.799513 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 15:51:46.799513 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 15:51:46.800795 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 15:51:46.800795 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 15:51:46.800795 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 15:51:46.800795 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 15:51:46.800795 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 15:51:46.800795 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 15:51:46.800795 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 15:51:46.800795 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4173cb9-999f-41f4-ade9-b521fc218a2b could not be found. Jun 17 15:51:46.800795 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:51:46.800795 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:51:46.800795 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:51:46.800795 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:51:46.800795 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:51:46.800795 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:51:46.800795 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 15:51:46.800795 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 15:51:46.800795 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4173cb9-999f-41f4-ade9-b521fc218a2b could not be found. Jun 17 15:51:46.800795 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:51:46.801785 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-9c5d2550-c97b-4c8e-b13d-ac497419bd09 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] Returning 404 to user: Instance e4173cb9-999f-41f4-ade9-b521fc218a2b could not be found. {{(pid=117649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 15:51:46.801785 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-9c5d2550-c97b-4c8e-b13d-ac497419bd09 tempest-AttachVolumeNegativeTest-957597123 tempest-AttachVolumeNegativeTest-957597123-project] 10.222.0.48 "GET /compute/v2.1/servers/e4173cb9-999f-41f4-ade9-b521fc218a2b" status: 404 len: 111 microversion: 2.1 time: 0.031604 Jun 17 15:51:46.801785 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1620/3655] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:51:46 2022] GET /compute/v2.1/servers/e4173cb9-999f-41f4-ade9-b521fc218a2b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 15:52:16.678061 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-5d82a7fb-e9e7-4081-81be-be49b6936889 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:52:16.678582 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-5d82a7fb-e9e7-4081-81be-be49b6936889 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] [instance: 0868ffdc-e030-4180-a3dd-f8b5231471b6] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:52:16.681393 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:52:16.682793 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=22 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:52:16.689680 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5d82a7fb-e9e7-4081-81be-be49b6936889 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:52:16.690124 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5d82a7fb-e9e7-4081-81be-be49b6936889 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:52:16.690891 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5d82a7fb-e9e7-4081-81be-be49b6936889 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:52:16.691323 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-5d82a7fb-e9e7-4081-81be-be49b6936889 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:52:16.715188 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-5d82a7fb-e9e7-4081-81be-be49b6936889 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] 10.222.0.48 "GET /compute/v2.1/servers/0868ffdc-e030-4180-a3dd-f8b5231471b6/ips" status: 200 len: 146 microversion: 2.1 time: 0.040863 Jun 17 15:52:16.715756 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 2036/3656] 10.222.0.48 () {58 vars in 1247 bytes} [Fri Jun 17 15:52:16 2022] GET /compute/v2.1/servers/0868ffdc-e030-4180-a3dd-f8b5231471b6/ips => generated 146 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:52:20.139798 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-c4a7c88a-20c9-4a75-8134-1987423d6f43 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "69c563b1-30ef-4e8f-94a0-2c106332ed92"}} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:52:20.140982 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-c4a7c88a-20c9-4a75-8134-1987423d6f43 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] [instance: 0868ffdc-e030-4180-a3dd-f8b5231471b6] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:52:20.143418 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_api:SELECT=54,nova_api:DELETE=2 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:52:20.144356 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=1 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:52:20.151266 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c4a7c88a-20c9-4a75-8134-1987423d6f43 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:52:20.151735 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c4a7c88a-20c9-4a75-8134-1987423d6f43 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:52:20.152596 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c4a7c88a-20c9-4a75-8134-1987423d6f43 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:52:20.153099 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-c4a7c88a-20c9-4a75-8134-1987423d6f43 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:52:20.418378 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-c4a7c88a-20c9-4a75-8134-1987423d6f43 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] 10.222.0.48 "POST /compute/v2.1/servers/0868ffdc-e030-4180-a3dd-f8b5231471b6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.282616 Jun 17 15:52:20.419058 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1621/3657] 10.222.0.48 () {60 vars in 1322 bytes} [Fri Jun 17 15:52:20 2022] POST /compute/v2.1/servers/0868ffdc-e030-4180-a3dd-f8b5231471b6/os-volume_attachments => generated 194 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:52:30.015922 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-15417e86-a57d-403f-9849-ded970af5a6d tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:52:30.016874 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-15417e86-a57d-403f-9849-ded970af5a6d tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] [instance: 0868ffdc-e030-4180-a3dd-f8b5231471b6] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:52:30.018939 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_api:SELECT=2 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:52:30.019575 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=4 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:52:30.025585 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-15417e86-a57d-403f-9849-ded970af5a6d tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:52:30.026036 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-15417e86-a57d-403f-9849-ded970af5a6d tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:52:30.027465 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-15417e86-a57d-403f-9849-ded970af5a6d tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:52:30.027898 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-15417e86-a57d-403f-9849-ded970af5a6d tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:52:30.057538 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-15417e86-a57d-403f-9849-ded970af5a6d tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] 10.222.0.48 "GET /compute/v2.1/servers/0868ffdc-e030-4180-a3dd-f8b5231471b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044955 Jun 17 15:52:30.057749 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 2037/3658] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:52:30 2022] GET /compute/v2.1/servers/0868ffdc-e030-4180-a3dd-f8b5231471b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:52:30.068161 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-17784420-64f9-4907-a7e0-54c85e0b7431 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:52:30.068837 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-17784420-64f9-4907-a7e0-54c85e0b7431 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] [instance: 0868ffdc-e030-4180-a3dd-f8b5231471b6] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:52:30.075520 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-17784420-64f9-4907-a7e0-54c85e0b7431 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:52:30.075961 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-17784420-64f9-4907-a7e0-54c85e0b7431 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:52:30.076738 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-17784420-64f9-4907-a7e0-54c85e0b7431 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:52:30.077170 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-17784420-64f9-4907-a7e0-54c85e0b7431 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:52:30.105780 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-17784420-64f9-4907-a7e0-54c85e0b7431 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] 10.222.0.48 "GET /compute/v2.1/servers/0868ffdc-e030-4180-a3dd-f8b5231471b6/os-volume_attachments/69c563b1-30ef-4e8f-94a0-2c106332ed92" status: 200 len: 194 microversion: 2.1 time: 0.041954 Jun 17 15:52:30.106363 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1622/3659] 10.222.0.48 () {58 vars in 1412 bytes} [Fri Jun 17 15:52:30 2022] GET /compute/v2.1/servers/0868ffdc-e030-4180-a3dd-f8b5231471b6/os-volume_attachments/69c563b1-30ef-4e8f-94a0-2c106332ed92 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:52:31.419554 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-3f692f85-d686-4b9a-89c7-5e113002644a tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eedbca28-c8f3-4325-b149-439bff0d440d"}} {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:52:31.420637 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-3f692f85-d686-4b9a-89c7-5e113002644a tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] [instance: 0868ffdc-e030-4180-a3dd-f8b5231471b6] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:52:31.427106 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3f692f85-d686-4b9a-89c7-5e113002644a tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:52:31.427551 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3f692f85-d686-4b9a-89c7-5e113002644a tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:52:31.428310 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3f692f85-d686-4b9a-89c7-5e113002644a tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:52:31.428766 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3f692f85-d686-4b9a-89c7-5e113002644a tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:52:31.681167 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-3f692f85-d686-4b9a-89c7-5e113002644a tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] 10.222.0.48 "POST /compute/v2.1/servers/0868ffdc-e030-4180-a3dd-f8b5231471b6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.265964 Jun 17 15:52:31.681968 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 2038/3660] 10.222.0.48 () {60 vars in 1322 bytes} [Fri Jun 17 15:52:31 2022] POST /compute/v2.1/servers/0868ffdc-e030-4180-a3dd-f8b5231471b6/os-volume_attachments => generated 194 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:52:39.186893 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-74902ec0-7db4-4aac-8332-537fa37aecc8 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:52:39.187876 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-74902ec0-7db4-4aac-8332-537fa37aecc8 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] [instance: 0868ffdc-e030-4180-a3dd-f8b5231471b6] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:52:39.194599 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-74902ec0-7db4-4aac-8332-537fa37aecc8 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:52:39.195050 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-74902ec0-7db4-4aac-8332-537fa37aecc8 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:52:39.195815 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-74902ec0-7db4-4aac-8332-537fa37aecc8 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:52:39.196378 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-74902ec0-7db4-4aac-8332-537fa37aecc8 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:52:39.227190 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-74902ec0-7db4-4aac-8332-537fa37aecc8 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] 10.222.0.48 "GET /compute/v2.1/servers/0868ffdc-e030-4180-a3dd-f8b5231471b6/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044705 Jun 17 15:52:39.227736 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1623/3661] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:52:39 2022] GET /compute/v2.1/servers/0868ffdc-e030-4180-a3dd-f8b5231471b6/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:52:39.369183 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-b128d7a1-45c8-46df-ab7c-3ecbc4396728 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:52:39.369782 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-b128d7a1-45c8-46df-ab7c-3ecbc4396728 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] [instance: 0868ffdc-e030-4180-a3dd-f8b5231471b6] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:52:39.376450 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b128d7a1-45c8-46df-ab7c-3ecbc4396728 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:52:39.376892 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b128d7a1-45c8-46df-ab7c-3ecbc4396728 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:52:39.377777 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b128d7a1-45c8-46df-ab7c-3ecbc4396728 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:52:39.378218 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-b128d7a1-45c8-46df-ab7c-3ecbc4396728 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:52:39.408889 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-b128d7a1-45c8-46df-ab7c-3ecbc4396728 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] 10.222.0.48 "GET /compute/v2.1/servers/0868ffdc-e030-4180-a3dd-f8b5231471b6/os-volume_attachments/69c563b1-30ef-4e8f-94a0-2c106332ed92" status: 200 len: 194 microversion: 2.1 time: 0.044479 Jun 17 15:52:39.409470 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 2039/3662] 10.222.0.48 () {58 vars in 1412 bytes} [Fri Jun 17 15:52:39 2022] GET /compute/v2.1/servers/0868ffdc-e030-4180-a3dd-f8b5231471b6/os-volume_attachments/69c563b1-30ef-4e8f-94a0-2c106332ed92 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:52:39.418931 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-f17dce9b-9f2c-4a0b-84c2-2165f0520b73 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:52:39.419419 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-f17dce9b-9f2c-4a0b-84c2-2165f0520b73 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] [instance: 0868ffdc-e030-4180-a3dd-f8b5231471b6] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:52:39.425358 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f17dce9b-9f2c-4a0b-84c2-2165f0520b73 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:52:39.425799 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f17dce9b-9f2c-4a0b-84c2-2165f0520b73 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:52:39.426541 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f17dce9b-9f2c-4a0b-84c2-2165f0520b73 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:52:39.426973 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f17dce9b-9f2c-4a0b-84c2-2165f0520b73 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:52:39.505190 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.objects.instance [None req-f17dce9b-9f2c-4a0b-84c2-2165f0520b73 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lazy-loading 'services' on Instance uuid 0868ffdc-e030-4180-a3dd-f8b5231471b6 {{(pid=117649) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 15:52:39.578259 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-f17dce9b-9f2c-4a0b-84c2-2165f0520b73 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] 10.222.0.48 "DELETE /compute/v2.1/servers/0868ffdc-e030-4180-a3dd-f8b5231471b6/os-volume_attachments/69c563b1-30ef-4e8f-94a0-2c106332ed92" status: 202 len: 0 microversion: 2.1 time: 0.163001 Jun 17 15:52:39.578913 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1624/3663] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Jun 17 15:52:39 2022] DELETE /compute/v2.1/servers/0868ffdc-e030-4180-a3dd-f8b5231471b6/os-volume_attachments/69c563b1-30ef-4e8f-94a0-2c106332ed92 => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 15:52:42.798859 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-3606efe8-9f38-4307-80c7-6be8fbdd3bb0 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:52:42.799419 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-3606efe8-9f38-4307-80c7-6be8fbdd3bb0 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] [instance: 0868ffdc-e030-4180-a3dd-f8b5231471b6] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:52:42.805954 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3606efe8-9f38-4307-80c7-6be8fbdd3bb0 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:52:42.806403 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3606efe8-9f38-4307-80c7-6be8fbdd3bb0 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:52:42.807185 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3606efe8-9f38-4307-80c7-6be8fbdd3bb0 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:52:42.807587 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-3606efe8-9f38-4307-80c7-6be8fbdd3bb0 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:52:42.835612 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-3606efe8-9f38-4307-80c7-6be8fbdd3bb0 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] 10.222.0.48 "GET /compute/v2.1/servers/0868ffdc-e030-4180-a3dd-f8b5231471b6/os-volume_attachments/eedbca28-c8f3-4325-b149-439bff0d440d" status: 200 len: 194 microversion: 2.1 time: 0.040717 Jun 17 15:52:42.836184 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 2040/3664] 10.222.0.48 () {58 vars in 1412 bytes} [Fri Jun 17 15:52:42 2022] GET /compute/v2.1/servers/0868ffdc-e030-4180-a3dd-f8b5231471b6/os-volume_attachments/eedbca28-c8f3-4325-b149-439bff0d440d => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:52:42.847236 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-fac9d1ce-bc1f-4bc1-ac8a-f21146b8e4f6 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:52:42.847818 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-fac9d1ce-bc1f-4bc1-ac8a-f21146b8e4f6 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] [instance: 0868ffdc-e030-4180-a3dd-f8b5231471b6] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:52:42.854193 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fac9d1ce-bc1f-4bc1-ac8a-f21146b8e4f6 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:52:42.854628 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fac9d1ce-bc1f-4bc1-ac8a-f21146b8e4f6 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:52:42.855978 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fac9d1ce-bc1f-4bc1-ac8a-f21146b8e4f6 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:52:42.856439 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-fac9d1ce-bc1f-4bc1-ac8a-f21146b8e4f6 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:52:42.934390 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.objects.instance [None req-fac9d1ce-bc1f-4bc1-ac8a-f21146b8e4f6 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lazy-loading 'services' on Instance uuid 0868ffdc-e030-4180-a3dd-f8b5231471b6 {{(pid=117649) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 15:52:43.004444 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-fac9d1ce-bc1f-4bc1-ac8a-f21146b8e4f6 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] 10.222.0.48 "DELETE /compute/v2.1/servers/0868ffdc-e030-4180-a3dd-f8b5231471b6/os-volume_attachments/eedbca28-c8f3-4325-b149-439bff0d440d" status: 202 len: 0 microversion: 2.1 time: 0.161657 Jun 17 15:52:43.005001 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1625/3665] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Jun 17 15:52:42 2022] DELETE /compute/v2.1/servers/0868ffdc-e030-4180-a3dd-f8b5231471b6/os-volume_attachments/eedbca28-c8f3-4325-b149-439bff0d440d => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 15:52:44.164349 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-907eb857-b85f-48b7-bd4d-7b8869dec72b tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:52:44.165646 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-907eb857-b85f-48b7-bd4d-7b8869dec72b tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] [instance: 0868ffdc-e030-4180-a3dd-f8b5231471b6] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:52:44.172862 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-907eb857-b85f-48b7-bd4d-7b8869dec72b tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:52:44.173309 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-907eb857-b85f-48b7-bd4d-7b8869dec72b tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:52:44.174071 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-907eb857-b85f-48b7-bd4d-7b8869dec72b tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:52:44.174506 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-907eb857-b85f-48b7-bd4d-7b8869dec72b tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:52:44.203916 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-907eb857-b85f-48b7-bd4d-7b8869dec72b tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] 10.222.0.48 "GET /compute/v2.1/servers/0868ffdc-e030-4180-a3dd-f8b5231471b6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043491 Jun 17 15:52:44.204503 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 2041/3666] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:52:44 2022] GET /compute/v2.1/servers/0868ffdc-e030-4180-a3dd-f8b5231471b6/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 17 15:52:44.308699 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-00a1fb44-4c32-4e9a-85f0-7de505e8a77f tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:52:44.309614 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-00a1fb44-4c32-4e9a-85f0-7de505e8a77f tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] [instance: 0868ffdc-e030-4180-a3dd-f8b5231471b6] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:52:44.315923 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-00a1fb44-4c32-4e9a-85f0-7de505e8a77f tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:52:44.316390 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-00a1fb44-4c32-4e9a-85f0-7de505e8a77f tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:52:44.317148 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-00a1fb44-4c32-4e9a-85f0-7de505e8a77f tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:52:44.318150 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-00a1fb44-4c32-4e9a-85f0-7de505e8a77f tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:52:44.346728 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-00a1fb44-4c32-4e9a-85f0-7de505e8a77f tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] 10.222.0.48 "GET /compute/v2.1/servers/0868ffdc-e030-4180-a3dd-f8b5231471b6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042859 Jun 17 15:52:44.347489 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1626/3667] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 17 15:52:44 2022] GET /compute/v2.1/servers/0868ffdc-e030-4180-a3dd-f8b5231471b6/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 17 15:52:44.406941 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-51c76a4f-31e6-4287-bd07-ac22bdd205bd tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:52:44.407437 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-51c76a4f-31e6-4287-bd07-ac22bdd205bd tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] [instance: 0868ffdc-e030-4180-a3dd-f8b5231471b6] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:52:44.413606 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-51c76a4f-31e6-4287-bd07-ac22bdd205bd tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:52:44.414080 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-51c76a4f-31e6-4287-bd07-ac22bdd205bd tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:52:44.414817 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-51c76a4f-31e6-4287-bd07-ac22bdd205bd tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:52:44.415250 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-51c76a4f-31e6-4287-bd07-ac22bdd205bd tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:52:44.440167 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-51c76a4f-31e6-4287-bd07-ac22bdd205bd tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] [instance: 0868ffdc-e030-4180-a3dd-f8b5231471b6] Going to try to terminate instance {{(pid=117650) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 15:52:44.523671 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-51c76a4f-31e6-4287-bd07-ac22bdd205bd tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] 10.222.0.48 "DELETE /compute/v2.1/servers/0868ffdc-e030-4180-a3dd-f8b5231471b6" status: 204 len: 0 microversion: 2.1 time: 0.120477 Jun 17 15:52:44.524202 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 2042/3668] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jun 17 15:52:44 2022] DELETE /compute/v2.1/servers/0868ffdc-e030-4180-a3dd-f8b5231471b6 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 15:52:44.532703 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-f0e54410-ada2-4a6d-b97b-7daf7ec3c7d9 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:52:44.533308 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-f0e54410-ada2-4a6d-b97b-7daf7ec3c7d9 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] [instance: 0868ffdc-e030-4180-a3dd-f8b5231471b6] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:52:44.539484 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f0e54410-ada2-4a6d-b97b-7daf7ec3c7d9 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:52:44.539929 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f0e54410-ada2-4a6d-b97b-7daf7ec3c7d9 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:52:44.540704 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f0e54410-ada2-4a6d-b97b-7daf7ec3c7d9 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:52:44.541134 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-f0e54410-ada2-4a6d-b97b-7daf7ec3c7d9 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:52:44.678165 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-f0e54410-ada2-4a6d-b97b-7daf7ec3c7d9 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a67b4188f6248cca9ce2f4991d78e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48712151f8a4942a0a08d09a80c902d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:52:44.686052 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-f0e54410-ada2-4a6d-b97b-7daf7ec3c7d9 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] 10.222.0.48 "GET /compute/v2.1/servers/0868ffdc-e030-4180-a3dd-f8b5231471b6" status: 200 len: 1673 microversion: 2.1 time: 0.157149 Jun 17 15:52:44.686633 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1627/3669] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:52:44 2022] GET /compute/v2.1/servers/0868ffdc-e030-4180-a3dd-f8b5231471b6 => generated 1673 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:52:45.703714 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-a6361f03-db7e-48ff-926a-600dc2ec6736 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:52:45.704719 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-a6361f03-db7e-48ff-926a-600dc2ec6736 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] [instance: 0868ffdc-e030-4180-a3dd-f8b5231471b6] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:52:45.711270 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a6361f03-db7e-48ff-926a-600dc2ec6736 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:52:45.711817 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a6361f03-db7e-48ff-926a-600dc2ec6736 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:52:45.712626 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a6361f03-db7e-48ff-926a-600dc2ec6736 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:52:45.713066 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-a6361f03-db7e-48ff-926a-600dc2ec6736 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:52:45.862751 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-a6361f03-db7e-48ff-926a-600dc2ec6736 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a67b4188f6248cca9ce2f4991d78e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48712151f8a4942a0a08d09a80c902d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:52:45.870074 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-a6361f03-db7e-48ff-926a-600dc2ec6736 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] 10.222.0.48 "GET /compute/v2.1/servers/0868ffdc-e030-4180-a3dd-f8b5231471b6" status: 200 len: 1673 microversion: 2.1 time: 0.171154 Jun 17 15:52:45.871164 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 2043/3670] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:52:45 2022] GET /compute/v2.1/servers/0868ffdc-e030-4180-a3dd-f8b5231471b6 => generated 1673 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:52:46.887488 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-1920dfef-9e0c-4962-90f9-47955784dfb5 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:52:46.888227 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-1920dfef-9e0c-4962-90f9-47955784dfb5 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] [instance: 0868ffdc-e030-4180-a3dd-f8b5231471b6] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:52:46.895103 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1920dfef-9e0c-4962-90f9-47955784dfb5 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:52:46.895629 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1920dfef-9e0c-4962-90f9-47955784dfb5 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:52:46.896490 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1920dfef-9e0c-4962-90f9-47955784dfb5 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:52:46.896926 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1920dfef-9e0c-4962-90f9-47955784dfb5 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:52:47.035279 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-1920dfef-9e0c-4962-90f9-47955784dfb5 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a67b4188f6248cca9ce2f4991d78e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48712151f8a4942a0a08d09a80c902d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:52:47.043235 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-1920dfef-9e0c-4962-90f9-47955784dfb5 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] 10.222.0.48 "GET /compute/v2.1/servers/0868ffdc-e030-4180-a3dd-f8b5231471b6" status: 200 len: 1673 microversion: 2.1 time: 0.160215 Jun 17 15:52:47.043839 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1628/3671] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:52:46 2022] GET /compute/v2.1/servers/0868ffdc-e030-4180-a3dd-f8b5231471b6 => generated 1673 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:52:47.965499 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [req-19aec59d-5797-43e6-a17b-1d1d44e14aed req-330992dc-6125-4b8e-876f-1660586dee3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0868ffdc-e030-4180-a3dd-f8b5231471b6", "name": "network-vif-deleted", "tag": "9d045b39-d9e4-4c97-85f1-396b4e20f020"}]} {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:52:47.976926 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [req-19aec59d-5797-43e6-a17b-1d1d44e14aed req-330992dc-6125-4b8e-876f-1660586dee3a service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:52:47.977641 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [req-19aec59d-5797-43e6-a17b-1d1d44e14aed req-330992dc-6125-4b8e-876f-1660586dee3a service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:52:47.989652 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.compute.server_external_events [req-19aec59d-5797-43e6-a17b-1d1d44e14aed req-330992dc-6125-4b8e-876f-1660586dee3a service nova] Creating event network-vif-deleted:9d045b39-d9e4-4c97-85f1-396b4e20f020 for instance 0868ffdc-e030-4180-a3dd-f8b5231471b6 on hv-cinder-82549 Jun 17 15:52:47.994806 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [req-19aec59d-5797-43e6-a17b-1d1d44e14aed req-330992dc-6125-4b8e-876f-1660586dee3a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034345 Jun 17 15:52:47.996659 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 2044/3672] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 15:52:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:52:48.063780 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-94a67609-0841-4568-be20-afe41a635a68 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:52:48.066261 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-94a67609-0841-4568-be20-afe41a635a68 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] [instance: 0868ffdc-e030-4180-a3dd-f8b5231471b6] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:52:48.074571 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-94a67609-0841-4568-be20-afe41a635a68 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:52:48.075975 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-94a67609-0841-4568-be20-afe41a635a68 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:52:48.077021 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-94a67609-0841-4568-be20-afe41a635a68 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:52:48.078065 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-94a67609-0841-4568-be20-afe41a635a68 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:52:48.145360 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-94a67609-0841-4568-be20-afe41a635a68 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:52:48.146735 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-94a67609-0841-4568-be20-afe41a635a68 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:52:48.147365 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.objects.instance [None req-94a67609-0841-4568-be20-afe41a635a68 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lazy-loading 'fault' on Instance uuid 0868ffdc-e030-4180-a3dd-f8b5231471b6 {{(pid=117649) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 15:52:48.209336 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-94a67609-0841-4568-be20-afe41a635a68 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a67b4188f6248cca9ce2f4991d78e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48712151f8a4942a0a08d09a80c902d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:52:48.218202 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-94a67609-0841-4568-be20-afe41a635a68 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] 10.222.0.48 "GET /compute/v2.1/servers/0868ffdc-e030-4180-a3dd-f8b5231471b6" status: 200 len: 1326 microversion: 2.1 time: 0.162218 Jun 17 15:52:48.219333 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1629/3673] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:52:48 2022] GET /compute/v2.1/servers/0868ffdc-e030-4180-a3dd-f8b5231471b6 => generated 1326 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:52:49.236764 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-55ecacfe-ca9f-41ec-8b21-8bcfccd936ee tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:52:49.237581 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-55ecacfe-ca9f-41ec-8b21-8bcfccd936ee tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] [instance: 0868ffdc-e030-4180-a3dd-f8b5231471b6] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:52:49.244517 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-55ecacfe-ca9f-41ec-8b21-8bcfccd936ee tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:52:49.244824 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-55ecacfe-ca9f-41ec-8b21-8bcfccd936ee tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:52:49.246210 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-55ecacfe-ca9f-41ec-8b21-8bcfccd936ee tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:52:49.246747 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-55ecacfe-ca9f-41ec-8b21-8bcfccd936ee tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:52:49.260387 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.wsgi [None req-55ecacfe-ca9f-41ec-8b21-8bcfccd936ee tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] HTTP exception thrown: Instance 0868ffdc-e030-4180-a3dd-f8b5231471b6 could not be found. Jun 17 15:52:49.262086 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-55ecacfe-ca9f-41ec-8b21-8bcfccd936ee tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Request method failure captured: Jun 17 15:52:49.262086 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: request: GET /compute/v2.1/servers/0868ffdc-e030-4180-a3dd-f8b5231471b6 HTTP/1.1 Jun 17 15:52:49.262086 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Accept: application/json Jun 17 15:52:49.262086 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Accept-Encoding: identity Jun 17 15:52:49.262086 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Connection: close Jun 17 15:52:49.262086 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Content-Length: 0 Jun 17 15:52:49.262086 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Content-Type: application/json Jun 17 15:52:49.262086 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Host: 10.222.0.48 Jun 17 15:52:49.262086 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Openstack-System-Scope: None Jun 17 15:52:49.262086 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: User-Agent: python-urllib3/1.26.9 Jun 17 15:52:49.262086 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Auth-Token: gAAAAABirKJeTyCXrTCQy-bGxTKgDl4EFAGbdfKhrfX98_akte22A6o57chrnwb8MiN8zerRCfHFXFJF3ju0KF_az-Y6ZtMcglz-hccJUzk89U2Rm4CIfvI76ok_o-e35dct0O4-VqTgwqKasC-Hxdg5jdWF-WcQKQDALG94UYD94ozGvgP_l_c Jun 17 15:52:49.262086 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Domain-Id: None Jun 17 15:52:49.262086 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Domain-Name: None Jun 17 15:52:49.262086 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Identity-Status: Confirmed Jun 17 15:52:49.262086 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Is-Admin-Project: True Jun 17 15:52:49.262086 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Domain-Id: default Jun 17 15:52:49.262086 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Domain-Name: Default Jun 17 15:52:49.262086 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Id: f48712151f8a4942a0a08d09a80c902d Jun 17 15:52:49.262086 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Name: tempest-AttachVolumeTestJSON-1503700068 Jun 17 15:52:49.262086 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Role: reader,member Jun 17 15:52:49.262086 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Roles: reader,member Jun 17 15:52:49.263394 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f48712151f8a4942a0a08d09a80c902d", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f48712151f8a4942a0a08d09a80c902d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f48712151f8a4942a0a08d09a80c902d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f48712151f8a4942a0a08d09a80c902d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Jun 17 15:52:49.263394 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant: tempest-AttachVolumeTestJSON-1503700068 Jun 17 15:52:49.263394 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant-Id: f48712151f8a4942a0a08d09a80c902d Jun 17 15:52:49.263394 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1503700068 Jun 17 15:52:49.263394 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User: tempest-AttachVolumeTestJSON-1503700068-project Jun 17 15:52:49.263394 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Domain-Id: default Jun 17 15:52:49.263394 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Domain-Name: Default Jun 17 15:52:49.263394 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Id: 4a67b4188f6248cca9ce2f4991d78e62 Jun 17 15:52:49.263394 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Name: tempest-AttachVolumeTestJSON-1503700068-project Jun 17 15:52:49.263394 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: method: > Jun 17 15:52:49.263394 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: exception: Instance 0868ffdc-e030-4180-a3dd-f8b5231471b6 could not be found. Jun 17 15:52:49.263394 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: action_args: {'id': '0868ffdc-e030-4180-a3dd-f8b5231471b6'} Jun 17 15:52:49.264580 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 15:52:49.264580 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:52:49.264580 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 15:52:49.264580 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 15:52:49.264580 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 15:52:49.264580 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 15:52:49.264580 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 15:52:49.264580 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 15:52:49.264580 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 15:52:49.264580 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 15:52:49.264580 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0868ffdc-e030-4180-a3dd-f8b5231471b6 could not be found. Jun 17 15:52:49.264580 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:52:49.264580 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:52:49.264580 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:52:49.264580 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:52:49.264580 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:52:49.264580 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:52:49.264580 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 15:52:49.264580 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 15:52:49.264580 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 15:52:49.265923 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 15:52:49.265923 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 15:52:49.265923 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 15:52:49.265923 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 15:52:49.265923 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 15:52:49.265923 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 15:52:49.265923 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 15:52:49.265923 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0868ffdc-e030-4180-a3dd-f8b5231471b6 could not be found. Jun 17 15:52:49.265923 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:52:49.265923 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:52:49.265923 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:52:49.265923 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:52:49.265923 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:52:49.265923 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:52:49.265923 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 15:52:49.265923 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 15:52:49.265923 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0868ffdc-e030-4180-a3dd-f8b5231471b6 could not be found. Jun 17 15:52:49.265923 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:52:49.267748 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-55ecacfe-ca9f-41ec-8b21-8bcfccd936ee tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Returning 404 to user: Instance 0868ffdc-e030-4180-a3dd-f8b5231471b6 could not be found. {{(pid=117650) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 15:52:49.267748 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-55ecacfe-ca9f-41ec-8b21-8bcfccd936ee tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] 10.222.0.48 "GET /compute/v2.1/servers/0868ffdc-e030-4180-a3dd-f8b5231471b6" status: 404 len: 111 microversion: 2.1 time: 0.031751 Jun 17 15:52:49.267748 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 2045/3674] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:52:49 2022] GET /compute/v2.1/servers/0868ffdc-e030-4180-a3dd-f8b5231471b6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 15:52:49.272442 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-179f419e-6ec7-4d21-bde9-f787ef604534 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Calling method '.version_select at 0x7faf54af9430>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:52:49.293146 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-179f419e-6ec7-4d21-bde9-f787ef604534 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-991362206" status: 202 len: 0 microversion: 2.1 time: 0.023943 Jun 17 15:52:49.293852 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1630/3675] 10.222.0.48 () {58 vars in 1217 bytes} [Fri Jun 17 15:52:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-991362206 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 17 15:52:52.235169 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-f559d443-ca64-45a9-8024-bc80608002f9 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:52:52.235650 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-f559d443-ca64-45a9-8024-bc80608002f9 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] [instance: 0868ffdc-e030-4180-a3dd-f8b5231471b6] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:52:52.242094 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f559d443-ca64-45a9-8024-bc80608002f9 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:52:52.242538 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f559d443-ca64-45a9-8024-bc80608002f9 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:52:52.243291 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f559d443-ca64-45a9-8024-bc80608002f9 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:52:52.243727 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f559d443-ca64-45a9-8024-bc80608002f9 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:52:52.256799 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.wsgi [None req-f559d443-ca64-45a9-8024-bc80608002f9 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] HTTP exception thrown: Instance 0868ffdc-e030-4180-a3dd-f8b5231471b6 could not be found. Jun 17 15:52:52.258309 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-f559d443-ca64-45a9-8024-bc80608002f9 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Request method failure captured: Jun 17 15:52:52.258309 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: request: DELETE /compute/v2.1/servers/0868ffdc-e030-4180-a3dd-f8b5231471b6 HTTP/1.1 Jun 17 15:52:52.258309 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Accept: application/json Jun 17 15:52:52.258309 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Accept-Encoding: identity Jun 17 15:52:52.258309 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Connection: close Jun 17 15:52:52.258309 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Content-Length: 0 Jun 17 15:52:52.258309 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Content-Type: application/json Jun 17 15:52:52.258309 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Host: 10.222.0.48 Jun 17 15:52:52.258309 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Openstack-System-Scope: None Jun 17 15:52:52.258309 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: User-Agent: python-urllib3/1.26.9 Jun 17 15:52:52.258309 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Auth-Token: gAAAAABirKJeTyCXrTCQy-bGxTKgDl4EFAGbdfKhrfX98_akte22A6o57chrnwb8MiN8zerRCfHFXFJF3ju0KF_az-Y6ZtMcglz-hccJUzk89U2Rm4CIfvI76ok_o-e35dct0O4-VqTgwqKasC-Hxdg5jdWF-WcQKQDALG94UYD94ozGvgP_l_c Jun 17 15:52:52.258309 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Domain-Id: None Jun 17 15:52:52.258309 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Domain-Name: None Jun 17 15:52:52.258309 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Identity-Status: Confirmed Jun 17 15:52:52.258309 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Is-Admin-Project: True Jun 17 15:52:52.258309 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Domain-Id: default Jun 17 15:52:52.258309 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Domain-Name: Default Jun 17 15:52:52.258309 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Id: f48712151f8a4942a0a08d09a80c902d Jun 17 15:52:52.258309 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Name: tempest-AttachVolumeTestJSON-1503700068 Jun 17 15:52:52.258309 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Role: reader,member Jun 17 15:52:52.258309 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Roles: reader,member Jun 17 15:52:52.259607 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f48712151f8a4942a0a08d09a80c902d", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f48712151f8a4942a0a08d09a80c902d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f48712151f8a4942a0a08d09a80c902d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f48712151f8a4942a0a08d09a80c902d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Jun 17 15:52:52.259607 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant: tempest-AttachVolumeTestJSON-1503700068 Jun 17 15:52:52.259607 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant-Id: f48712151f8a4942a0a08d09a80c902d Jun 17 15:52:52.259607 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1503700068 Jun 17 15:52:52.259607 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User: tempest-AttachVolumeTestJSON-1503700068-project Jun 17 15:52:52.259607 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Domain-Id: default Jun 17 15:52:52.259607 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Domain-Name: Default Jun 17 15:52:52.259607 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Id: 4a67b4188f6248cca9ce2f4991d78e62 Jun 17 15:52:52.259607 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Name: tempest-AttachVolumeTestJSON-1503700068-project Jun 17 15:52:52.259607 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: method: > Jun 17 15:52:52.259607 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: exception: Instance 0868ffdc-e030-4180-a3dd-f8b5231471b6 could not be found. Jun 17 15:52:52.259607 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: action_args: {'id': '0868ffdc-e030-4180-a3dd-f8b5231471b6'} Jun 17 15:52:52.260443 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 15:52:52.260443 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:52:52.260443 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 15:52:52.260443 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 15:52:52.260443 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 15:52:52.260443 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 15:52:52.260443 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 15:52:52.260443 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 15:52:52.260443 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 15:52:52.260443 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 15:52:52.260443 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0868ffdc-e030-4180-a3dd-f8b5231471b6 could not be found. Jun 17 15:52:52.260443 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:52:52.260443 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:52:52.260443 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:52:52.260443 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:52:52.260443 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:52:52.260443 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:52:52.260443 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 15:52:52.260443 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 15:52:52.260443 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 15:52:52.262282 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 15:52:52.262282 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 17 15:52:52.262282 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 17 15:52:52.262282 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 17 15:52:52.262282 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 17 15:52:52.262282 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 15:52:52.262282 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 15:52:52.262282 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 15:52:52.262282 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 15:52:52.262282 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0868ffdc-e030-4180-a3dd-f8b5231471b6 could not be found. Jun 17 15:52:52.262282 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:52:52.262282 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:52:52.262282 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:52:52.262282 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:52:52.262282 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:52:52.262282 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:52:52.262282 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 15:52:52.262282 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 15:52:52.262282 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0868ffdc-e030-4180-a3dd-f8b5231471b6 could not be found. Jun 17 15:52:52.262282 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:52:52.263686 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-f559d443-ca64-45a9-8024-bc80608002f9 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Returning 404 to user: Instance 0868ffdc-e030-4180-a3dd-f8b5231471b6 could not be found. {{(pid=117650) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 15:52:52.263686 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-f559d443-ca64-45a9-8024-bc80608002f9 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] 10.222.0.48 "DELETE /compute/v2.1/servers/0868ffdc-e030-4180-a3dd-f8b5231471b6" status: 404 len: 111 microversion: 2.1 time: 0.029077 Jun 17 15:52:52.263686 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 2046/3676] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jun 17 15:52:52 2022] DELETE /compute/v2.1/servers/0868ffdc-e030-4180-a3dd-f8b5231471b6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 15:52:52.268803 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-1918b1e8-660d-4380-83c2-47c3a630b276 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:52:52.269413 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-1918b1e8-660d-4380-83c2-47c3a630b276 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] [instance: 0868ffdc-e030-4180-a3dd-f8b5231471b6] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:52:52.271810 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_api:SELECT=24,nova_api:DELETE=1 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:52:52.278999 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1918b1e8-660d-4380-83c2-47c3a630b276 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:52:52.279715 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1918b1e8-660d-4380-83c2-47c3a630b276 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:52:52.281480 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1918b1e8-660d-4380-83c2-47c3a630b276 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:52:52.282495 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1918b1e8-660d-4380-83c2-47c3a630b276 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:52:52.292548 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:52:52.302340 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.wsgi [None req-1918b1e8-660d-4380-83c2-47c3a630b276 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] HTTP exception thrown: Instance 0868ffdc-e030-4180-a3dd-f8b5231471b6 could not be found. Jun 17 15:52:52.303985 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-1918b1e8-660d-4380-83c2-47c3a630b276 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Request method failure captured: Jun 17 15:52:52.303985 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: request: GET /compute/v2.1/servers/0868ffdc-e030-4180-a3dd-f8b5231471b6 HTTP/1.1 Jun 17 15:52:52.303985 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Accept: application/json Jun 17 15:52:52.303985 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Accept-Encoding: identity Jun 17 15:52:52.303985 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Connection: close Jun 17 15:52:52.303985 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Content-Length: 0 Jun 17 15:52:52.303985 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Content-Type: application/json Jun 17 15:52:52.303985 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Host: 10.222.0.48 Jun 17 15:52:52.303985 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Openstack-System-Scope: None Jun 17 15:52:52.303985 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: User-Agent: python-urllib3/1.26.9 Jun 17 15:52:52.303985 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Auth-Token: gAAAAABirKJeTyCXrTCQy-bGxTKgDl4EFAGbdfKhrfX98_akte22A6o57chrnwb8MiN8zerRCfHFXFJF3ju0KF_az-Y6ZtMcglz-hccJUzk89U2Rm4CIfvI76ok_o-e35dct0O4-VqTgwqKasC-Hxdg5jdWF-WcQKQDALG94UYD94ozGvgP_l_c Jun 17 15:52:52.303985 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Domain-Id: None Jun 17 15:52:52.303985 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Domain-Name: None Jun 17 15:52:52.303985 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Identity-Status: Confirmed Jun 17 15:52:52.303985 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Is-Admin-Project: True Jun 17 15:52:52.303985 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Domain-Id: default Jun 17 15:52:52.303985 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Domain-Name: Default Jun 17 15:52:52.303985 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Id: f48712151f8a4942a0a08d09a80c902d Jun 17 15:52:52.303985 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Name: tempest-AttachVolumeTestJSON-1503700068 Jun 17 15:52:52.303985 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Role: reader,member Jun 17 15:52:52.303985 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Roles: reader,member Jun 17 15:52:52.305294 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f48712151f8a4942a0a08d09a80c902d", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f48712151f8a4942a0a08d09a80c902d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f48712151f8a4942a0a08d09a80c902d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f48712151f8a4942a0a08d09a80c902d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Jun 17 15:52:52.305294 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant: tempest-AttachVolumeTestJSON-1503700068 Jun 17 15:52:52.305294 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant-Id: f48712151f8a4942a0a08d09a80c902d Jun 17 15:52:52.305294 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1503700068 Jun 17 15:52:52.305294 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User: tempest-AttachVolumeTestJSON-1503700068-project Jun 17 15:52:52.305294 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Domain-Id: default Jun 17 15:52:52.305294 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Domain-Name: Default Jun 17 15:52:52.305294 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Id: 4a67b4188f6248cca9ce2f4991d78e62 Jun 17 15:52:52.305294 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Name: tempest-AttachVolumeTestJSON-1503700068-project Jun 17 15:52:52.305294 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: method: > Jun 17 15:52:52.305294 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: exception: Instance 0868ffdc-e030-4180-a3dd-f8b5231471b6 could not be found. Jun 17 15:52:52.305294 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: action_args: {'id': '0868ffdc-e030-4180-a3dd-f8b5231471b6'} Jun 17 15:52:52.305889 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 15:52:52.305889 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:52:52.305889 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 15:52:52.305889 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 15:52:52.305889 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 15:52:52.305889 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 15:52:52.305889 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 15:52:52.305889 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 15:52:52.305889 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 15:52:52.305889 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 15:52:52.305889 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0868ffdc-e030-4180-a3dd-f8b5231471b6 could not be found. Jun 17 15:52:52.305889 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:52:52.305889 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:52:52.305889 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:52:52.305889 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:52:52.305889 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:52:52.305889 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:52:52.305889 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 15:52:52.305889 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 15:52:52.305889 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 15:52:52.306835 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 15:52:52.306835 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 15:52:52.306835 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 15:52:52.306835 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 15:52:52.306835 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 15:52:52.306835 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 15:52:52.306835 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 15:52:52.306835 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0868ffdc-e030-4180-a3dd-f8b5231471b6 could not be found. Jun 17 15:52:52.306835 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:52:52.306835 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:52:52.306835 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:52:52.306835 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:52:52.306835 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:52:52.306835 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:52:52.306835 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 15:52:52.306835 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 15:52:52.306835 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0868ffdc-e030-4180-a3dd-f8b5231471b6 could not be found. Jun 17 15:52:52.306835 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:52:52.307681 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-1918b1e8-660d-4380-83c2-47c3a630b276 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Returning 404 to user: Instance 0868ffdc-e030-4180-a3dd-f8b5231471b6 could not be found. {{(pid=117649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 15:52:52.307681 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-1918b1e8-660d-4380-83c2-47c3a630b276 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] 10.222.0.48 "GET /compute/v2.1/servers/0868ffdc-e030-4180-a3dd-f8b5231471b6" status: 404 len: 111 microversion: 2.1 time: 0.040481 Jun 17 15:52:52.307681 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1631/3677] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:52:52 2022] GET /compute/v2.1/servers/0868ffdc-e030-4180-a3dd-f8b5231471b6 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 15:52:53.443659 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-66fc4141-355e-4cca-95c1-8f7fa14197b9 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:52:53.444159 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-66fc4141-355e-4cca-95c1-8f7fa14197b9 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] [instance: fd8af8c4-d147-4335-90c9-81fe1da1297f] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:52:53.450755 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-66fc4141-355e-4cca-95c1-8f7fa14197b9 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:52:53.451200 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-66fc4141-355e-4cca-95c1-8f7fa14197b9 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:52:53.451961 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-66fc4141-355e-4cca-95c1-8f7fa14197b9 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:52:53.452414 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-66fc4141-355e-4cca-95c1-8f7fa14197b9 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:52:53.466152 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.wsgi [None req-66fc4141-355e-4cca-95c1-8f7fa14197b9 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] HTTP exception thrown: Instance fd8af8c4-d147-4335-90c9-81fe1da1297f could not be found. Jun 17 15:52:53.467673 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-66fc4141-355e-4cca-95c1-8f7fa14197b9 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Request method failure captured: Jun 17 15:52:53.467673 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: request: DELETE /compute/v2.1/servers/fd8af8c4-d147-4335-90c9-81fe1da1297f HTTP/1.1 Jun 17 15:52:53.467673 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Accept: application/json Jun 17 15:52:53.467673 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Accept-Encoding: identity Jun 17 15:52:53.467673 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Connection: close Jun 17 15:52:53.467673 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Content-Length: 0 Jun 17 15:52:53.467673 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Content-Type: application/json Jun 17 15:52:53.467673 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Host: 10.222.0.48 Jun 17 15:52:53.467673 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Openstack-System-Scope: None Jun 17 15:52:53.467673 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: User-Agent: python-urllib3/1.26.9 Jun 17 15:52:53.467673 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Auth-Token: gAAAAABirKJeTyCXrTCQy-bGxTKgDl4EFAGbdfKhrfX98_akte22A6o57chrnwb8MiN8zerRCfHFXFJF3ju0KF_az-Y6ZtMcglz-hccJUzk89U2Rm4CIfvI76ok_o-e35dct0O4-VqTgwqKasC-Hxdg5jdWF-WcQKQDALG94UYD94ozGvgP_l_c Jun 17 15:52:53.467673 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Domain-Id: None Jun 17 15:52:53.467673 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Domain-Name: None Jun 17 15:52:53.467673 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Identity-Status: Confirmed Jun 17 15:52:53.467673 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Is-Admin-Project: True Jun 17 15:52:53.467673 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Domain-Id: default Jun 17 15:52:53.467673 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Domain-Name: Default Jun 17 15:52:53.467673 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Id: f48712151f8a4942a0a08d09a80c902d Jun 17 15:52:53.467673 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Name: tempest-AttachVolumeTestJSON-1503700068 Jun 17 15:52:53.467673 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Role: reader,member Jun 17 15:52:53.467673 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Roles: reader,member Jun 17 15:52:53.468954 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f48712151f8a4942a0a08d09a80c902d", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f48712151f8a4942a0a08d09a80c902d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f48712151f8a4942a0a08d09a80c902d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f48712151f8a4942a0a08d09a80c902d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Jun 17 15:52:53.468954 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant: tempest-AttachVolumeTestJSON-1503700068 Jun 17 15:52:53.468954 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant-Id: f48712151f8a4942a0a08d09a80c902d Jun 17 15:52:53.468954 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1503700068 Jun 17 15:52:53.468954 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User: tempest-AttachVolumeTestJSON-1503700068-project Jun 17 15:52:53.468954 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Domain-Id: default Jun 17 15:52:53.468954 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Domain-Name: Default Jun 17 15:52:53.468954 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Id: 4a67b4188f6248cca9ce2f4991d78e62 Jun 17 15:52:53.468954 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Name: tempest-AttachVolumeTestJSON-1503700068-project Jun 17 15:52:53.468954 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: method: > Jun 17 15:52:53.468954 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: exception: Instance fd8af8c4-d147-4335-90c9-81fe1da1297f could not be found. Jun 17 15:52:53.468954 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: action_args: {'id': 'fd8af8c4-d147-4335-90c9-81fe1da1297f'} Jun 17 15:52:53.469682 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 15:52:53.469682 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:52:53.469682 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 15:52:53.469682 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 15:52:53.469682 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 15:52:53.469682 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 15:52:53.469682 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 15:52:53.469682 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 15:52:53.469682 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 15:52:53.469682 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 15:52:53.469682 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd8af8c4-d147-4335-90c9-81fe1da1297f could not be found. Jun 17 15:52:53.469682 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:52:53.469682 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:52:53.469682 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:52:53.469682 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:52:53.469682 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:52:53.469682 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:52:53.469682 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 15:52:53.469682 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 15:52:53.469682 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 15:52:53.470685 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 15:52:53.470685 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 17 15:52:53.470685 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 17 15:52:53.470685 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 17 15:52:53.470685 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 17 15:52:53.470685 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 15:52:53.470685 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 15:52:53.470685 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 15:52:53.470685 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 15:52:53.470685 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd8af8c4-d147-4335-90c9-81fe1da1297f could not be found. Jun 17 15:52:53.470685 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:52:53.470685 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:52:53.470685 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:52:53.470685 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:52:53.470685 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:52:53.470685 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:52:53.470685 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 15:52:53.470685 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 15:52:53.470685 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd8af8c4-d147-4335-90c9-81fe1da1297f could not be found. Jun 17 15:52:53.470685 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:52:53.471978 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-66fc4141-355e-4cca-95c1-8f7fa14197b9 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Returning 404 to user: Instance fd8af8c4-d147-4335-90c9-81fe1da1297f could not be found. {{(pid=117650) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 15:52:53.471978 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-66fc4141-355e-4cca-95c1-8f7fa14197b9 tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] 10.222.0.48 "DELETE /compute/v2.1/servers/fd8af8c4-d147-4335-90c9-81fe1da1297f" status: 404 len: 111 microversion: 2.1 time: 0.029237 Jun 17 15:52:53.471978 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 2047/3678] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jun 17 15:52:53 2022] DELETE /compute/v2.1/servers/fd8af8c4-d147-4335-90c9-81fe1da1297f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 15:52:53.478974 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-1a29f227-3732-4a74-b303-69f346afb49d tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:52:53.479587 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-1a29f227-3732-4a74-b303-69f346afb49d tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] [instance: fd8af8c4-d147-4335-90c9-81fe1da1297f] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:52:53.487943 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1a29f227-3732-4a74-b303-69f346afb49d tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:52:53.488428 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1a29f227-3732-4a74-b303-69f346afb49d tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:52:53.489202 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1a29f227-3732-4a74-b303-69f346afb49d tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:52:53.489638 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-1a29f227-3732-4a74-b303-69f346afb49d tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:52:53.503329 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.wsgi [None req-1a29f227-3732-4a74-b303-69f346afb49d tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] HTTP exception thrown: Instance fd8af8c4-d147-4335-90c9-81fe1da1297f could not be found. Jun 17 15:52:53.504892 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-1a29f227-3732-4a74-b303-69f346afb49d tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Request method failure captured: Jun 17 15:52:53.504892 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: request: GET /compute/v2.1/servers/fd8af8c4-d147-4335-90c9-81fe1da1297f HTTP/1.1 Jun 17 15:52:53.504892 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Accept: application/json Jun 17 15:52:53.504892 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Accept-Encoding: identity Jun 17 15:52:53.504892 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Connection: close Jun 17 15:52:53.504892 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Content-Length: 0 Jun 17 15:52:53.504892 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Content-Type: application/json Jun 17 15:52:53.504892 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Host: 10.222.0.48 Jun 17 15:52:53.504892 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Openstack-System-Scope: None Jun 17 15:52:53.504892 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: User-Agent: python-urllib3/1.26.9 Jun 17 15:52:53.504892 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Auth-Token: gAAAAABirKJeTyCXrTCQy-bGxTKgDl4EFAGbdfKhrfX98_akte22A6o57chrnwb8MiN8zerRCfHFXFJF3ju0KF_az-Y6ZtMcglz-hccJUzk89U2Rm4CIfvI76ok_o-e35dct0O4-VqTgwqKasC-Hxdg5jdWF-WcQKQDALG94UYD94ozGvgP_l_c Jun 17 15:52:53.504892 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Domain-Id: None Jun 17 15:52:53.504892 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Domain-Name: None Jun 17 15:52:53.504892 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Identity-Status: Confirmed Jun 17 15:52:53.504892 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Is-Admin-Project: True Jun 17 15:52:53.504892 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Domain-Id: default Jun 17 15:52:53.504892 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Domain-Name: Default Jun 17 15:52:53.504892 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Id: f48712151f8a4942a0a08d09a80c902d Jun 17 15:52:53.504892 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Name: tempest-AttachVolumeTestJSON-1503700068 Jun 17 15:52:53.504892 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Role: reader,member Jun 17 15:52:53.504892 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Roles: reader,member Jun 17 15:52:53.505957 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f48712151f8a4942a0a08d09a80c902d", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f48712151f8a4942a0a08d09a80c902d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f48712151f8a4942a0a08d09a80c902d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f48712151f8a4942a0a08d09a80c902d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Jun 17 15:52:53.505957 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant: tempest-AttachVolumeTestJSON-1503700068 Jun 17 15:52:53.505957 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant-Id: f48712151f8a4942a0a08d09a80c902d Jun 17 15:52:53.505957 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1503700068 Jun 17 15:52:53.505957 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User: tempest-AttachVolumeTestJSON-1503700068-project Jun 17 15:52:53.505957 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Domain-Id: default Jun 17 15:52:53.505957 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Domain-Name: Default Jun 17 15:52:53.505957 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Id: 4a67b4188f6248cca9ce2f4991d78e62 Jun 17 15:52:53.505957 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Name: tempest-AttachVolumeTestJSON-1503700068-project Jun 17 15:52:53.505957 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: method: > Jun 17 15:52:53.505957 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: exception: Instance fd8af8c4-d147-4335-90c9-81fe1da1297f could not be found. Jun 17 15:52:53.505957 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: action_args: {'id': 'fd8af8c4-d147-4335-90c9-81fe1da1297f'} Jun 17 15:52:53.506671 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 15:52:53.506671 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:52:53.506671 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 15:52:53.506671 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 15:52:53.506671 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 15:52:53.506671 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 15:52:53.506671 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 15:52:53.506671 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 15:52:53.506671 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 15:52:53.506671 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 15:52:53.506671 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd8af8c4-d147-4335-90c9-81fe1da1297f could not be found. Jun 17 15:52:53.506671 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:52:53.506671 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:52:53.506671 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:52:53.506671 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:52:53.506671 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:52:53.506671 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:52:53.506671 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 15:52:53.506671 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 15:52:53.506671 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 15:52:53.507635 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 15:52:53.507635 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 15:52:53.507635 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 15:52:53.507635 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 15:52:53.507635 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 15:52:53.507635 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 15:52:53.507635 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 15:52:53.507635 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd8af8c4-d147-4335-90c9-81fe1da1297f could not be found. Jun 17 15:52:53.507635 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:52:53.507635 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:52:53.507635 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:52:53.507635 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:52:53.507635 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:52:53.507635 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:52:53.507635 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 15:52:53.507635 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 15:52:53.507635 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd8af8c4-d147-4335-90c9-81fe1da1297f could not be found. Jun 17 15:52:53.507635 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:52:53.508808 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-1a29f227-3732-4a74-b303-69f346afb49d tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] Returning 404 to user: Instance fd8af8c4-d147-4335-90c9-81fe1da1297f could not be found. {{(pid=117649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 15:52:53.508808 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-1a29f227-3732-4a74-b303-69f346afb49d tempest-AttachVolumeTestJSON-1503700068 tempest-AttachVolumeTestJSON-1503700068-project] 10.222.0.48 "GET /compute/v2.1/servers/fd8af8c4-d147-4335-90c9-81fe1da1297f" status: 404 len: 111 microversion: 2.1 time: 0.032568 Jun 17 15:52:53.508808 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1632/3679] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:52:53 2022] GET /compute/v2.1/servers/fd8af8c4-d147-4335-90c9-81fe1da1297f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 15:52:57.982242 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-3e86e59c-1a23-42f9-a459-52f134502219 tempest-VolumesNegativeTest-324330740 tempest-VolumesNegativeTest-324330740-project] Action: 'create', calling method: .version_select at 0x7faf50d5e310>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1026681803", "metadata": {"Type": "work"}}} {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:52:58.036551 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-3e86e59c-1a23-42f9-a459-52f134502219 tempest-VolumesNegativeTest-324330740 tempest-VolumesNegativeTest-324330740-project] Request method failure captured: Jun 17 15:52:58.036551 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 17 15:52:58.036551 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Accept: application/json Jun 17 15:52:58.036551 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Accept-Encoding: identity Jun 17 15:52:58.036551 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Connection: close Jun 17 15:52:58.036551 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Content-Length: 122 Jun 17 15:52:58.036551 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Content-Type: application/json Jun 17 15:52:58.036551 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Host: 10.222.0.48 Jun 17 15:52:58.036551 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Openstack-System-Scope: None Jun 17 15:52:58.036551 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: User-Agent: python-urllib3/1.26.9 Jun 17 15:52:58.036551 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Auth-Token: gAAAAABirKNZ4QLCym-gj2dJBb9NONKrWh2RS9QmSB5V-hOt_1YQyukIl7XEe2wEhUFQwbzXQV_uY-VXOi7xf_UFg9XxVBKNzYc6vzYYdEmKMrlnTg89-20z8W6WVN367ruog1jSHtjgPruO7xU-pCvf1XulVSljvbPwZBVCE7guPW-dJtnJwO4 Jun 17 15:52:58.036551 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Domain-Id: None Jun 17 15:52:58.036551 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Domain-Name: None Jun 17 15:52:58.036551 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Identity-Status: Confirmed Jun 17 15:52:58.036551 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Is-Admin-Project: True Jun 17 15:52:58.036551 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Domain-Id: default Jun 17 15:52:58.036551 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Domain-Name: Default Jun 17 15:52:58.036551 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Id: 4d1bc51a8b824fb19c0bb9ec77f7ee55 Jun 17 15:52:58.036551 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Name: tempest-VolumesNegativeTest-324330740 Jun 17 15:52:58.036551 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Role: reader,member Jun 17 15:52:58.036551 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Roles: reader,member Jun 17 15:52:58.037961 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_4d1bc51a8b824fb19c0bb9ec77f7ee55", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/4d1bc51a8b824fb19c0bb9ec77f7ee55"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4d1bc51a8b824fb19c0bb9ec77f7ee55"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4d1bc51a8b824fb19c0bb9ec77f7ee55"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Jun 17 15:52:58.037961 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant: tempest-VolumesNegativeTest-324330740 Jun 17 15:52:58.037961 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant-Id: 4d1bc51a8b824fb19c0bb9ec77f7ee55 Jun 17 15:52:58.037961 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant-Name: tempest-VolumesNegativeTest-324330740 Jun 17 15:52:58.037961 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User: tempest-VolumesNegativeTest-324330740-project Jun 17 15:52:58.037961 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Domain-Id: default Jun 17 15:52:58.037961 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Domain-Name: Default Jun 17 15:52:58.037961 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Id: 56c82367929242f3bdf71cf1a2b4e3bf Jun 17 15:52:58.037961 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Name: tempest-VolumesNegativeTest-324330740-project Jun 17 15:52:58.037961 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Jun 17 15:52:58.037961 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1026681803", "metadata": {"Type": "work"}}} Jun 17 15:52:58.037961 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: method: Jun 17 15:52:58.037961 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 17 15:52:58.038687 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1026681803', 'metadata': {'Type': 'work'}}}} Jun 17 15:52:58.038687 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 15:52:58.038687 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:52:58.038687 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 17 15:52:58.038687 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 17 15:52:58.038687 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 17 15:52:58.038687 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise error Jun 17 15:52:58.038687 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 17 15:52:58.038687 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:52:58.038687 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 17 15:52:58.038687 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 17 15:52:58.038687 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:52:58.038687 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 17 15:52:58.038687 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi '#$%' Jun 17 15:52:58.038687 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:52:58.038687 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:52:58.038687 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:52:58.038687 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:52:58.038687 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:52:58.038687 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:52:58.038687 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 15:52:58.038687 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 15:52:58.039896 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 17 15:52:58.039896 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 17 15:52:58.039896 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 15:52:58.039896 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 15:52:58.039896 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 17 15:52:58.039896 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 17 15:52:58.039896 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 17 15:52:58.039896 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 17 15:52:58.039896 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 17 15:52:58.039896 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 17 15:52:58.039896 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 17 15:52:58.039896 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:52:58.039896 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:52:58.039896 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:52:58.039896 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:52:58.039896 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:52:58.039896 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:52:58.039896 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 17 15:52:58.039896 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 17 15:52:58.041802 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 17 15:52:58.041802 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:52:58.041802 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-3e86e59c-1a23-42f9-a459-52f134502219 tempest-VolumesNegativeTest-324330740 tempest-VolumesNegativeTest-324330740-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117650) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 15:52:58.041802 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-3e86e59c-1a23-42f9-a459-52f134502219 tempest-VolumesNegativeTest-324330740 tempest-VolumesNegativeTest-324330740-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.172807 Jun 17 15:52:58.046058 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 2048/3680] 10.222.0.48 () {60 vars in 1155 bytes} [Fri Jun 17 15:52:57 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 181 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 17 15:52:58.051750 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-507e7b34-f4cd-4726-b5d4-d66a9cbf6a71 tempest-VolumesNegativeTest-324330740 tempest-VolumesNegativeTest-324330740-project] Action: 'create', calling method: .version_select at 0x7faf54c40820>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1749654511", "metadata": {"Type": "work"}}} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:52:58.054991 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-507e7b34-f4cd-4726-b5d4-d66a9cbf6a71 tempest-VolumesNegativeTest-324330740 tempest-VolumesNegativeTest-324330740-project] Request method failure captured: Jun 17 15:52:58.054991 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 17 15:52:58.054991 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Accept: application/json Jun 17 15:52:58.054991 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Accept-Encoding: identity Jun 17 15:52:58.054991 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Connection: close Jun 17 15:52:58.054991 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Content-Length: 120 Jun 17 15:52:58.054991 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Content-Type: application/json Jun 17 15:52:58.054991 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Host: 10.222.0.48 Jun 17 15:52:58.054991 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Openstack-System-Scope: None Jun 17 15:52:58.054991 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: User-Agent: python-urllib3/1.26.9 Jun 17 15:52:58.054991 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Auth-Token: gAAAAABirKNZ4QLCym-gj2dJBb9NONKrWh2RS9QmSB5V-hOt_1YQyukIl7XEe2wEhUFQwbzXQV_uY-VXOi7xf_UFg9XxVBKNzYc6vzYYdEmKMrlnTg89-20z8W6WVN367ruog1jSHtjgPruO7xU-pCvf1XulVSljvbPwZBVCE7guPW-dJtnJwO4 Jun 17 15:52:58.054991 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Domain-Id: None Jun 17 15:52:58.054991 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Domain-Name: None Jun 17 15:52:58.054991 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Identity-Status: Confirmed Jun 17 15:52:58.054991 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Is-Admin-Project: True Jun 17 15:52:58.054991 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Domain-Id: default Jun 17 15:52:58.054991 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Domain-Name: Default Jun 17 15:52:58.054991 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Id: 4d1bc51a8b824fb19c0bb9ec77f7ee55 Jun 17 15:52:58.054991 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Name: tempest-VolumesNegativeTest-324330740 Jun 17 15:52:58.054991 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Role: reader,member Jun 17 15:52:58.054991 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Roles: reader,member Jun 17 15:52:58.056165 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_4d1bc51a8b824fb19c0bb9ec77f7ee55", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/4d1bc51a8b824fb19c0bb9ec77f7ee55"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4d1bc51a8b824fb19c0bb9ec77f7ee55"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4d1bc51a8b824fb19c0bb9ec77f7ee55"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Jun 17 15:52:58.056165 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant: tempest-VolumesNegativeTest-324330740 Jun 17 15:52:58.056165 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant-Id: 4d1bc51a8b824fb19c0bb9ec77f7ee55 Jun 17 15:52:58.056165 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant-Name: tempest-VolumesNegativeTest-324330740 Jun 17 15:52:58.056165 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User: tempest-VolumesNegativeTest-324330740-project Jun 17 15:52:58.056165 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Domain-Id: default Jun 17 15:52:58.056165 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Domain-Name: Default Jun 17 15:52:58.056165 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Id: 56c82367929242f3bdf71cf1a2b4e3bf Jun 17 15:52:58.056165 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Name: tempest-VolumesNegativeTest-324330740-project Jun 17 15:52:58.056165 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Jun 17 15:52:58.056165 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1749654511", "metadata": {"Type": "work"}}} Jun 17 15:52:58.056165 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: method: Jun 17 15:52:58.056165 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 17 15:52:58.056929 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1749654511', 'metadata': {'Type': 'work'}}}} Jun 17 15:52:58.056929 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 15:52:58.056929 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:52:58.056929 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 17 15:52:58.056929 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 17 15:52:58.056929 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 17 15:52:58.056929 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise error Jun 17 15:52:58.056929 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 17 15:52:58.056929 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:52:58.056929 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 17 15:52:58.056929 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 17 15:52:58.056929 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:52:58.056929 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 17 15:52:58.056929 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi '0' Jun 17 15:52:58.056929 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:52:58.056929 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:52:58.056929 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:52:58.056929 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:52:58.056929 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:52:58.056929 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:52:58.056929 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 15:52:58.056929 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 15:52:58.058554 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 17 15:52:58.058554 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 17 15:52:58.058554 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 15:52:58.058554 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 15:52:58.058554 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 17 15:52:58.058554 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 17 15:52:58.058554 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 17 15:52:58.058554 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 17 15:52:58.058554 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 17 15:52:58.058554 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 17 15:52:58.058554 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 17 15:52:58.058554 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:52:58.058554 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:52:58.058554 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:52:58.058554 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:52:58.058554 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:52:58.058554 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:52:58.058554 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 17 15:52:58.058554 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 17 15:52:58.059657 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 17 15:52:58.059657 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:52:58.059657 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-507e7b34-f4cd-4726-b5d4-d66a9cbf6a71 tempest-VolumesNegativeTest-324330740 tempest-VolumesNegativeTest-324330740-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 15:52:58.059657 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-507e7b34-f4cd-4726-b5d4-d66a9cbf6a71 tempest-VolumesNegativeTest-324330740 tempest-VolumesNegativeTest-324330740-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.008761 Jun 17 15:52:58.059657 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1633/3681] 10.222.0.48 () {60 vars in 1155 bytes} [Fri Jun 17 15:52:58 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 17 15:52:58.066663 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-58136b48-5109-4d19-8fda-2000e1113843 tempest-VolumesNegativeTest-324330740 tempest-VolumesNegativeTest-324330740-project] Action: 'create', calling method: .version_select at 0x7faf501cd5e0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-452439361", "metadata": {"Type": "work"}}} {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:52:58.070050 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-58136b48-5109-4d19-8fda-2000e1113843 tempest-VolumesNegativeTest-324330740 tempest-VolumesNegativeTest-324330740-project] Request method failure captured: Jun 17 15:52:58.070050 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 17 15:52:58.070050 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Accept: application/json Jun 17 15:52:58.070050 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Accept-Encoding: identity Jun 17 15:52:58.070050 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Connection: close Jun 17 15:52:58.070050 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Content-Length: 118 Jun 17 15:52:58.070050 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Content-Type: application/json Jun 17 15:52:58.070050 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Host: 10.222.0.48 Jun 17 15:52:58.070050 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Openstack-System-Scope: None Jun 17 15:52:58.070050 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: User-Agent: python-urllib3/1.26.9 Jun 17 15:52:58.070050 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Auth-Token: gAAAAABirKNZ4QLCym-gj2dJBb9NONKrWh2RS9QmSB5V-hOt_1YQyukIl7XEe2wEhUFQwbzXQV_uY-VXOi7xf_UFg9XxVBKNzYc6vzYYdEmKMrlnTg89-20z8W6WVN367ruog1jSHtjgPruO7xU-pCvf1XulVSljvbPwZBVCE7guPW-dJtnJwO4 Jun 17 15:52:58.070050 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Domain-Id: None Jun 17 15:52:58.070050 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Domain-Name: None Jun 17 15:52:58.070050 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Identity-Status: Confirmed Jun 17 15:52:58.070050 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Is-Admin-Project: True Jun 17 15:52:58.070050 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Domain-Id: default Jun 17 15:52:58.070050 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Domain-Name: Default Jun 17 15:52:58.070050 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Id: 4d1bc51a8b824fb19c0bb9ec77f7ee55 Jun 17 15:52:58.070050 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Name: tempest-VolumesNegativeTest-324330740 Jun 17 15:52:58.070050 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Role: reader,member Jun 17 15:52:58.070050 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Roles: reader,member Jun 17 15:52:58.071351 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_4d1bc51a8b824fb19c0bb9ec77f7ee55", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/4d1bc51a8b824fb19c0bb9ec77f7ee55"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4d1bc51a8b824fb19c0bb9ec77f7ee55"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4d1bc51a8b824fb19c0bb9ec77f7ee55"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Jun 17 15:52:58.071351 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant: tempest-VolumesNegativeTest-324330740 Jun 17 15:52:58.071351 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant-Id: 4d1bc51a8b824fb19c0bb9ec77f7ee55 Jun 17 15:52:58.071351 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant-Name: tempest-VolumesNegativeTest-324330740 Jun 17 15:52:58.071351 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User: tempest-VolumesNegativeTest-324330740-project Jun 17 15:52:58.071351 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Domain-Id: default Jun 17 15:52:58.071351 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Domain-Name: Default Jun 17 15:52:58.071351 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Id: 56c82367929242f3bdf71cf1a2b4e3bf Jun 17 15:52:58.071351 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Name: tempest-VolumesNegativeTest-324330740-project Jun 17 15:52:58.071351 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Jun 17 15:52:58.071351 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-452439361", "metadata": {"Type": "work"}}} Jun 17 15:52:58.071351 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: method: Jun 17 15:52:58.071351 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 17 15:52:58.072210 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-452439361', 'metadata': {'Type': 'work'}}}} Jun 17 15:52:58.072210 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 15:52:58.072210 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:52:58.072210 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 17 15:52:58.072210 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 17 15:52:58.072210 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 17 15:52:58.072210 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise error Jun 17 15:52:58.072210 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 17 15:52:58.072210 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:52:58.072210 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 17 15:52:58.072210 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 17 15:52:58.072210 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:52:58.072210 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 17 15:52:58.072210 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi '' Jun 17 15:52:58.072210 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:52:58.072210 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:52:58.072210 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:52:58.072210 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:52:58.072210 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:52:58.072210 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:52:58.072210 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 15:52:58.072210 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 15:52:58.074261 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 17 15:52:58.074261 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 17 15:52:58.074261 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 15:52:58.074261 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 15:52:58.074261 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 17 15:52:58.074261 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 17 15:52:58.074261 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 17 15:52:58.074261 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 17 15:52:58.074261 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 17 15:52:58.074261 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 17 15:52:58.074261 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 17 15:52:58.074261 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:52:58.074261 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:52:58.074261 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:52:58.074261 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:52:58.074261 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:52:58.074261 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:52:58.074261 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 17 15:52:58.074261 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 17 15:52:58.075273 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 17 15:52:58.075273 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:52:58.075273 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-58136b48-5109-4d19-8fda-2000e1113843 tempest-VolumesNegativeTest-324330740 tempest-VolumesNegativeTest-324330740-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117650) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 15:52:58.075273 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-58136b48-5109-4d19-8fda-2000e1113843 tempest-VolumesNegativeTest-324330740 tempest-VolumesNegativeTest-324330740-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008624 Jun 17 15:52:58.075273 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 2049/3682] 10.222.0.48 () {60 vars in 1155 bytes} [Fri Jun 17 15:52:58 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 17 15:52:58.081524 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-eb40d08e-faa9-41a0-b589-f5542af5a079 tempest-VolumesNegativeTest-324330740 tempest-VolumesNegativeTest-324330740-project] Calling method '.version_select at 0x7faf5063ddc0>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:52:58.110991 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.wsgi [None req-eb40d08e-faa9-41a0-b589-f5542af5a079 tempest-VolumesNegativeTest-324330740 tempest-VolumesNegativeTest-324330740-project] HTTP exception thrown: Volume tempest-invalid-525544529 could not be found. Jun 17 15:52:58.113093 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-eb40d08e-faa9-41a0-b589-f5542af5a079 tempest-VolumesNegativeTest-324330740 tempest-VolumesNegativeTest-324330740-project] Request method failure captured: Jun 17 15:52:58.113093 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-525544529 HTTP/1.1 Jun 17 15:52:58.113093 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Accept: application/json Jun 17 15:52:58.113093 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Accept-Encoding: identity Jun 17 15:52:58.113093 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Connection: close Jun 17 15:52:58.113093 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Content-Length: 0 Jun 17 15:52:58.113093 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Content-Type: application/json Jun 17 15:52:58.113093 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Host: 10.222.0.48 Jun 17 15:52:58.113093 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Openstack-System-Scope: None Jun 17 15:52:58.113093 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: User-Agent: python-urllib3/1.26.9 Jun 17 15:52:58.113093 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Auth-Token: gAAAAABirKNZ4QLCym-gj2dJBb9NONKrWh2RS9QmSB5V-hOt_1YQyukIl7XEe2wEhUFQwbzXQV_uY-VXOi7xf_UFg9XxVBKNzYc6vzYYdEmKMrlnTg89-20z8W6WVN367ruog1jSHtjgPruO7xU-pCvf1XulVSljvbPwZBVCE7guPW-dJtnJwO4 Jun 17 15:52:58.113093 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Domain-Id: None Jun 17 15:52:58.113093 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Domain-Name: None Jun 17 15:52:58.113093 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Identity-Status: Confirmed Jun 17 15:52:58.113093 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Is-Admin-Project: True Jun 17 15:52:58.113093 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Domain-Id: default Jun 17 15:52:58.113093 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Domain-Name: Default Jun 17 15:52:58.113093 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Id: 4d1bc51a8b824fb19c0bb9ec77f7ee55 Jun 17 15:52:58.113093 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Name: tempest-VolumesNegativeTest-324330740 Jun 17 15:52:58.113093 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Role: reader,member Jun 17 15:52:58.113093 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Roles: reader,member Jun 17 15:52:58.114409 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_4d1bc51a8b824fb19c0bb9ec77f7ee55", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/4d1bc51a8b824fb19c0bb9ec77f7ee55"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4d1bc51a8b824fb19c0bb9ec77f7ee55"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4d1bc51a8b824fb19c0bb9ec77f7ee55"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Jun 17 15:52:58.114409 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant: tempest-VolumesNegativeTest-324330740 Jun 17 15:52:58.114409 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant-Id: 4d1bc51a8b824fb19c0bb9ec77f7ee55 Jun 17 15:52:58.114409 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant-Name: tempest-VolumesNegativeTest-324330740 Jun 17 15:52:58.114409 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User: tempest-VolumesNegativeTest-324330740-project Jun 17 15:52:58.114409 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Domain-Id: default Jun 17 15:52:58.114409 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Domain-Name: Default Jun 17 15:52:58.114409 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Id: 56c82367929242f3bdf71cf1a2b4e3bf Jun 17 15:52:58.114409 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Name: tempest-VolumesNegativeTest-324330740-project Jun 17 15:52:58.114409 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: method: Jun 17 15:52:58.114409 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: exception: Volume tempest-invalid-525544529 could not be found. Jun 17 15:52:58.114409 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: action_args: {'id': 'tempest-invalid-525544529'} Jun 17 15:52:58.114409 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 15:52:58.115278 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:52:58.115278 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 15:52:58.115278 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 15:52:58.115278 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 17 15:52:58.115278 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 17 15:52:58.115278 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 17 15:52:58.115278 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 17 15:52:58.115278 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 17 15:52:58.115278 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 17 15:52:58.115278 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 17 15:52:58.115278 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 17 15:52:58.115278 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 15:52:58.115278 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 15:52:58.115278 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 15:52:58.115278 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 15:52:58.115278 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-525544529 could not be found. (HTTP 404) (Request-ID: req-5798e097-cce5-4291-8a10-ef1d29c5a09f) Jun 17 15:52:58.115278 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:52:58.115278 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:52:58.115278 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:52:58.116611 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:52:58.116611 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 17 15:52:58.116611 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 17 15:52:58.116611 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 15:52:58.116611 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 15:52:58.116611 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 17 15:52:58.116611 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 17 15:52:58.116611 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 15:52:58.116611 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 15:52:58.116611 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 15:52:58.116611 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 15:52:58.116611 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 17 15:52:58.116611 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 17 15:52:58.116611 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 17 15:52:58.116611 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 17 15:52:58.116611 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 17 15:52:58.116611 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 17 15:52:58.116611 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 17 15:52:58.116611 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 17 15:52:58.117748 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 15:52:58.117748 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 15:52:58.117748 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 15:52:58.117748 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 15:52:58.117748 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-525544529 could not be found. Jun 17 15:52:58.117748 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:52:58.117748 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:52:58.117748 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:52:58.117748 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:52:58.117748 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:52:58.117748 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:52:58.117748 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 15:52:58.117748 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 15:52:58.117748 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 17 15:52:58.117748 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 17 15:52:58.117748 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 15:52:58.117748 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 15:52:58.117748 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 17 15:52:58.117748 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 15:52:58.117748 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-525544529 could not be found. Jun 17 15:52:58.119433 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:52:58.119433 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:52:58.119433 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:52:58.119433 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:52:58.119433 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:52:58.119433 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:52:58.119433 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 15:52:58.119433 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 15:52:58.119433 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-525544529 could not be found. Jun 17 15:52:58.119433 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:52:58.119433 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-eb40d08e-faa9-41a0-b589-f5542af5a079 tempest-VolumesNegativeTest-324330740 tempest-VolumesNegativeTest-324330740-project] Returning 404 to user: Volume tempest-invalid-525544529 could not be found. {{(pid=117649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 15:52:58.119433 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-eb40d08e-faa9-41a0-b589-f5542af5a079 tempest-VolumesNegativeTest-324330740 tempest-VolumesNegativeTest-324330740-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/tempest-invalid-525544529" status: 404 len: 98 microversion: 2.1 time: 0.037205 Jun 17 15:52:58.119433 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1634/3683] 10.222.0.48 () {58 vars in 1214 bytes} [Fri Jun 17 15:52:58 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-525544529 => generated 98 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 17 15:52:58.124665 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-4545f21d-bd91-47a3-a7a6-a7ff08643229 tempest-VolumesNegativeTest-324330740 tempest-VolumesNegativeTest-324330740-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004357 Jun 17 15:52:58.125152 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 2050/3684] 10.222.0.48 () {58 vars in 1139 bytes} [Fri Jun 17 15:52:58 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 17 15:52:58.133369 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-829a4156-2b5b-4bd3-8270-d6a7c19e5c45 tempest-VolumesNegativeTest-324330740 tempest-VolumesNegativeTest-324330740-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003663 Jun 17 15:52:58.133850 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1635/3685] 10.222.0.48 () {58 vars in 1136 bytes} [Fri Jun 17 15:52:58 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 17 15:52:58.144795 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-fa9290a1-7a6c-48e8-b8e6-883e69ad076b tempest-VolumesNegativeTest-324330740 tempest-VolumesNegativeTest-324330740-project] Calling method '.version_select at 0x7faf50d5e4c0>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:52:58.173246 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.wsgi [None req-fa9290a1-7a6c-48e8-b8e6-883e69ad076b tempest-VolumesNegativeTest-324330740 tempest-VolumesNegativeTest-324330740-project] HTTP exception thrown: Volume 043e204a-7133-4d74-a6b5-6aa35787f777 could not be found. Jun 17 15:52:58.175184 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-fa9290a1-7a6c-48e8-b8e6-883e69ad076b tempest-VolumesNegativeTest-324330740 tempest-VolumesNegativeTest-324330740-project] Request method failure captured: Jun 17 15:52:58.175184 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: request: DELETE /compute/v2.1/os-volumes/043e204a-7133-4d74-a6b5-6aa35787f777 HTTP/1.1 Jun 17 15:52:58.175184 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Accept: application/json Jun 17 15:52:58.175184 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Accept-Encoding: identity Jun 17 15:52:58.175184 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Connection: close Jun 17 15:52:58.175184 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Content-Length: 0 Jun 17 15:52:58.175184 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Content-Type: application/json Jun 17 15:52:58.175184 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Host: 10.222.0.48 Jun 17 15:52:58.175184 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Openstack-System-Scope: None Jun 17 15:52:58.175184 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: User-Agent: python-urllib3/1.26.9 Jun 17 15:52:58.175184 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Auth-Token: gAAAAABirKNZ4QLCym-gj2dJBb9NONKrWh2RS9QmSB5V-hOt_1YQyukIl7XEe2wEhUFQwbzXQV_uY-VXOi7xf_UFg9XxVBKNzYc6vzYYdEmKMrlnTg89-20z8W6WVN367ruog1jSHtjgPruO7xU-pCvf1XulVSljvbPwZBVCE7guPW-dJtnJwO4 Jun 17 15:52:58.175184 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Domain-Id: None Jun 17 15:52:58.175184 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Domain-Name: None Jun 17 15:52:58.175184 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Identity-Status: Confirmed Jun 17 15:52:58.175184 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Is-Admin-Project: True Jun 17 15:52:58.175184 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Domain-Id: default Jun 17 15:52:58.175184 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Domain-Name: Default Jun 17 15:52:58.175184 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Id: 4d1bc51a8b824fb19c0bb9ec77f7ee55 Jun 17 15:52:58.175184 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Project-Name: tempest-VolumesNegativeTest-324330740 Jun 17 15:52:58.175184 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Role: reader,member Jun 17 15:52:58.175184 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Roles: reader,member Jun 17 15:52:58.176512 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_4d1bc51a8b824fb19c0bb9ec77f7ee55", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/4d1bc51a8b824fb19c0bb9ec77f7ee55"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4d1bc51a8b824fb19c0bb9ec77f7ee55"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4d1bc51a8b824fb19c0bb9ec77f7ee55"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Jun 17 15:52:58.176512 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant: tempest-VolumesNegativeTest-324330740 Jun 17 15:52:58.176512 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant-Id: 4d1bc51a8b824fb19c0bb9ec77f7ee55 Jun 17 15:52:58.176512 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-Tenant-Name: tempest-VolumesNegativeTest-324330740 Jun 17 15:52:58.176512 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User: tempest-VolumesNegativeTest-324330740-project Jun 17 15:52:58.176512 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Domain-Id: default Jun 17 15:52:58.176512 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Domain-Name: Default Jun 17 15:52:58.176512 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Id: 56c82367929242f3bdf71cf1a2b4e3bf Jun 17 15:52:58.176512 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: X-User-Name: tempest-VolumesNegativeTest-324330740-project Jun 17 15:52:58.176512 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: method: Jun 17 15:52:58.176512 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: exception: Volume 043e204a-7133-4d74-a6b5-6aa35787f777 could not be found. Jun 17 15:52:58.176512 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: action_args: {'id': '043e204a-7133-4d74-a6b5-6aa35787f777'} Jun 17 15:52:58.176512 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 15:52:58.177762 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:52:58.177762 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 15:52:58.177762 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 15:52:58.177762 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 17 15:52:58.177762 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 17 15:52:58.177762 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 17 15:52:58.177762 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 17 15:52:58.177762 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 17 15:52:58.177762 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 17 15:52:58.177762 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 17 15:52:58.177762 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 17 15:52:58.177762 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 15:52:58.177762 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 15:52:58.177762 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 15:52:58.177762 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 15:52:58.177762 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 043e204a-7133-4d74-a6b5-6aa35787f777 could not be found. (HTTP 404) (Request-ID: req-fe321154-d4a8-482b-9ba0-460b45586766) Jun 17 15:52:58.177762 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:52:58.177762 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:52:58.177762 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:52:58.178949 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:52:58.178949 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 17 15:52:58.178949 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 17 15:52:58.178949 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 15:52:58.178949 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 15:52:58.178949 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 17 15:52:58.178949 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 17 15:52:58.178949 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 15:52:58.178949 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 15:52:58.178949 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 15:52:58.178949 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 15:52:58.178949 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 17 15:52:58.178949 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 17 15:52:58.178949 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 17 15:52:58.178949 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 17 15:52:58.178949 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 17 15:52:58.178949 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 17 15:52:58.178949 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 17 15:52:58.178949 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 17 15:52:58.179932 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 15:52:58.179932 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 15:52:58.179932 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 15:52:58.179932 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 15:52:58.179932 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 043e204a-7133-4d74-a6b5-6aa35787f777 could not be found. Jun 17 15:52:58.179932 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:52:58.179932 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:52:58.179932 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:52:58.179932 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:52:58.179932 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:52:58.179932 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:52:58.179932 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 15:52:58.179932 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 15:52:58.179932 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 17 15:52:58.179932 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 17 15:52:58.179932 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 15:52:58.179932 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 15:52:58.179932 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 17 15:52:58.179932 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 15:52:58.180906 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 043e204a-7133-4d74-a6b5-6aa35787f777 could not be found. Jun 17 15:52:58.180906 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:52:58.180906 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:52:58.180906 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:52:58.180906 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:52:58.180906 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:52:58.180906 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:52:58.180906 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 15:52:58.180906 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 15:52:58.180906 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 043e204a-7133-4d74-a6b5-6aa35787f777 could not be found. Jun 17 15:52:58.180906 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: ERROR nova.api.openstack.wsgi Jun 17 15:52:58.180906 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-fa9290a1-7a6c-48e8-b8e6-883e69ad076b tempest-VolumesNegativeTest-324330740 tempest-VolumesNegativeTest-324330740-project] Returning 404 to user: Volume 043e204a-7133-4d74-a6b5-6aa35787f777 could not be found. {{(pid=117650) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 15:52:58.180906 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-fa9290a1-7a6c-48e8-b8e6-883e69ad076b tempest-VolumesNegativeTest-324330740 tempest-VolumesNegativeTest-324330740-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/043e204a-7133-4d74-a6b5-6aa35787f777" status: 404 len: 109 microversion: 2.1 time: 0.037281 Jun 17 15:52:58.180906 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 2051/3686] 10.222.0.48 () {58 vars in 1247 bytes} [Fri Jun 17 15:52:58 2022] DELETE /compute/v2.1/os-volumes/043e204a-7133-4d74-a6b5-6aa35787f777 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 15:52:58.187176 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-8e50906b-b730-4775-b460-ee6dc4c8c83c tempest-VolumesNegativeTest-324330740 tempest-VolumesNegativeTest-324330740-project] Calling method '.version_select at 0x7faf54b5e0d0>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:52:58.214193 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.wsgi [None req-8e50906b-b730-4775-b460-ee6dc4c8c83c tempest-VolumesNegativeTest-324330740 tempest-VolumesNegativeTest-324330740-project] HTTP exception thrown: Volume 66ace27c-fd54-43b9-b75e-487fc058e2e4 could not be found. Jun 17 15:52:58.216139 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-8e50906b-b730-4775-b460-ee6dc4c8c83c tempest-VolumesNegativeTest-324330740 tempest-VolumesNegativeTest-324330740-project] Request method failure captured: Jun 17 15:52:58.216139 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: request: GET /compute/v2.1/os-volumes/66ace27c-fd54-43b9-b75e-487fc058e2e4 HTTP/1.1 Jun 17 15:52:58.216139 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Accept: application/json Jun 17 15:52:58.216139 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Accept-Encoding: identity Jun 17 15:52:58.216139 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Connection: close Jun 17 15:52:58.216139 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Content-Length: 0 Jun 17 15:52:58.216139 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Content-Type: application/json Jun 17 15:52:58.216139 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Host: 10.222.0.48 Jun 17 15:52:58.216139 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Openstack-System-Scope: None Jun 17 15:52:58.216139 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: User-Agent: python-urllib3/1.26.9 Jun 17 15:52:58.216139 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Auth-Token: gAAAAABirKNZ4QLCym-gj2dJBb9NONKrWh2RS9QmSB5V-hOt_1YQyukIl7XEe2wEhUFQwbzXQV_uY-VXOi7xf_UFg9XxVBKNzYc6vzYYdEmKMrlnTg89-20z8W6WVN367ruog1jSHtjgPruO7xU-pCvf1XulVSljvbPwZBVCE7guPW-dJtnJwO4 Jun 17 15:52:58.216139 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Domain-Id: None Jun 17 15:52:58.216139 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Domain-Name: None Jun 17 15:52:58.216139 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Identity-Status: Confirmed Jun 17 15:52:58.216139 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Is-Admin-Project: True Jun 17 15:52:58.216139 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Domain-Id: default Jun 17 15:52:58.216139 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Domain-Name: Default Jun 17 15:52:58.216139 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Id: 4d1bc51a8b824fb19c0bb9ec77f7ee55 Jun 17 15:52:58.216139 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Name: tempest-VolumesNegativeTest-324330740 Jun 17 15:52:58.216139 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Role: reader,member Jun 17 15:52:58.216139 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Roles: reader,member Jun 17 15:52:58.217432 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_4d1bc51a8b824fb19c0bb9ec77f7ee55", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/4d1bc51a8b824fb19c0bb9ec77f7ee55"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4d1bc51a8b824fb19c0bb9ec77f7ee55"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4d1bc51a8b824fb19c0bb9ec77f7ee55"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Jun 17 15:52:58.217432 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant: tempest-VolumesNegativeTest-324330740 Jun 17 15:52:58.217432 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant-Id: 4d1bc51a8b824fb19c0bb9ec77f7ee55 Jun 17 15:52:58.217432 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant-Name: tempest-VolumesNegativeTest-324330740 Jun 17 15:52:58.217432 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User: tempest-VolumesNegativeTest-324330740-project Jun 17 15:52:58.217432 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Domain-Id: default Jun 17 15:52:58.217432 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Domain-Name: Default Jun 17 15:52:58.217432 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Id: 56c82367929242f3bdf71cf1a2b4e3bf Jun 17 15:52:58.217432 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Name: tempest-VolumesNegativeTest-324330740-project Jun 17 15:52:58.217432 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: method: Jun 17 15:52:58.217432 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: exception: Volume 66ace27c-fd54-43b9-b75e-487fc058e2e4 could not be found. Jun 17 15:52:58.217432 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: action_args: {'id': '66ace27c-fd54-43b9-b75e-487fc058e2e4'} Jun 17 15:52:58.217432 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 15:52:58.218233 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:52:58.218233 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 15:52:58.218233 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 15:52:58.218233 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 17 15:52:58.218233 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 17 15:52:58.218233 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 17 15:52:58.218233 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 17 15:52:58.218233 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 17 15:52:58.218233 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 17 15:52:58.218233 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 17 15:52:58.218233 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 17 15:52:58.218233 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 15:52:58.218233 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 15:52:58.218233 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 15:52:58.218233 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 15:52:58.218233 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 66ace27c-fd54-43b9-b75e-487fc058e2e4 could not be found. (HTTP 404) (Request-ID: req-a2a557f6-4222-4934-81ea-5a3a2eb76f97) Jun 17 15:52:58.218233 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:52:58.218233 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:52:58.218233 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:52:58.219277 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:52:58.219277 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 17 15:52:58.219277 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 17 15:52:58.219277 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 17 15:52:58.219277 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 17 15:52:58.219277 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 17 15:52:58.219277 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 17 15:52:58.219277 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 17 15:52:58.219277 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 17 15:52:58.219277 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 17 15:52:58.219277 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 17 15:52:58.219277 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 17 15:52:58.219277 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 17 15:52:58.219277 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 17 15:52:58.219277 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 17 15:52:58.219277 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 17 15:52:58.219277 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 17 15:52:58.219277 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 17 15:52:58.219277 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 17 15:52:58.220290 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 17 15:52:58.220290 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 17 15:52:58.220290 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 17 15:52:58.220290 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 17 15:52:58.220290 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 66ace27c-fd54-43b9-b75e-487fc058e2e4 could not be found. Jun 17 15:52:58.220290 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:52:58.220290 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:52:58.220290 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:52:58.220290 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:52:58.220290 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:52:58.220290 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:52:58.220290 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 15:52:58.220290 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 15:52:58.220290 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 17 15:52:58.220290 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 17 15:52:58.220290 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 15:52:58.220290 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 15:52:58.220290 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 17 15:52:58.220290 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 15:52:58.221279 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 66ace27c-fd54-43b9-b75e-487fc058e2e4 could not be found. Jun 17 15:52:58.221279 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:52:58.221279 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:52:58.221279 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:52:58.221279 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:52:58.221279 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:52:58.221279 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:52:58.221279 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 15:52:58.221279 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 15:52:58.221279 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 66ace27c-fd54-43b9-b75e-487fc058e2e4 could not be found. Jun 17 15:52:58.221279 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:52:58.221279 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-8e50906b-b730-4775-b460-ee6dc4c8c83c tempest-VolumesNegativeTest-324330740 tempest-VolumesNegativeTest-324330740-project] Returning 404 to user: Volume 66ace27c-fd54-43b9-b75e-487fc058e2e4 could not be found. {{(pid=117649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 15:52:58.221279 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-8e50906b-b730-4775-b460-ee6dc4c8c83c tempest-VolumesNegativeTest-324330740 tempest-VolumesNegativeTest-324330740-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/66ace27c-fd54-43b9-b75e-487fc058e2e4" status: 404 len: 109 microversion: 2.1 time: 0.034840 Jun 17 15:52:58.221279 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1636/3687] 10.222.0.48 () {58 vars in 1244 bytes} [Fri Jun 17 15:52:58 2022] GET /compute/v2.1/os-volumes/66ace27c-fd54-43b9-b75e-487fc058e2e4 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 15:52:58.917419 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 15:52:58.917666 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Fri Jun 17 15:52:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 15:53:24.436865 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:53:24.437609 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:53:24.442604 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-97e96493-cbaf-46d0-8479-217cc9c914da tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-132384682", "imageRef": "8c105ca4-6fe3-4e70-af71-b03c64fe1efe", "flavorRef": "452"}} {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:53:24.496534 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.network.neutron [None req-97e96493-cbaf-46d0-8479-217cc9c914da tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] validate_networks() for None {{(pid=117650) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 17 15:53:24.766671 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.virt.hardware [None req-97e96493-cbaf-46d0-8479-217cc9c914da tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] Flavor limits 0:0:0 {{(pid=117650) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 17 15:53:24.767093 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.virt.hardware [None req-97e96493-cbaf-46d0-8479-217cc9c914da tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] Image limits 0:0:0 {{(pid=117650) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 17 15:53:24.767567 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.virt.hardware [None req-97e96493-cbaf-46d0-8479-217cc9c914da tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] Flavor pref 0:0:0 {{(pid=117650) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 17 15:53:24.767975 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.virt.hardware [None req-97e96493-cbaf-46d0-8479-217cc9c914da tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] Image pref 0:0:0 {{(pid=117650) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 17 15:53:24.768404 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.virt.hardware [None req-97e96493-cbaf-46d0-8479-217cc9c914da tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117650) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 17 15:53:24.777212 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-97e96493-cbaf-46d0-8479-217cc9c914da tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:53:24.777656 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-97e96493-cbaf-46d0-8479-217cc9c914da tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:53:24.778446 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-97e96493-cbaf-46d0-8479-217cc9c914da tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:53:24.778876 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-97e96493-cbaf-46d0-8479-217cc9c914da tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:53:24.796210 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.quota [None req-97e96493-cbaf-46d0-8479-217cc9c914da tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] Getting quotas for project 903403e17c8f4051bd46cf63f44b652e. Resources: {'cores', 'ram', 'instances'} {{(pid=117650) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 17 15:53:24.800218 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.quota [None req-97e96493-cbaf-46d0-8479-217cc9c914da tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] Getting quotas for user 268e2032c3f84e628b4b6968b0753577 and project 903403e17c8f4051bd46cf63f44b652e. Resources: {'cores', 'ram', 'instances'} {{(pid=117650) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 17 15:53:24.811716 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-97e96493-cbaf-46d0-8479-217cc9c914da tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] Going to run 1 instances... {{(pid=117650) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 17 15:53:24.813993 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-97e96493-cbaf-46d0-8479-217cc9c914da tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] [instance: f554f56e-3d3e-4164-b04f-31669b784320] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8c105ca4-6fe3-4e70-af71-b03c64fe1efe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117650) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 17 15:53:24.858605 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-97e96493-cbaf-46d0-8479-217cc9c914da tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.423121 Jun 17 15:53:24.859245 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 2052/3688] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Jun 17 15:53:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 424 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 17 15:53:24.867356 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_api:SELECT=3 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:53:24.868365 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell1:SELECT=3 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:53:24.873218 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-84410e56-9247-4d41-8f02-0d77473669c4 tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:53:24.873863 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-84410e56-9247-4d41-8f02-0d77473669c4 tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] [instance: f554f56e-3d3e-4164-b04f-31669b784320] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:53:24.926528 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-84410e56-9247-4d41-8f02-0d77473669c4 tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268e2032c3f84e628b4b6968b0753577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903403e17c8f4051bd46cf63f44b652e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:53:24.933572 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-84410e56-9247-4d41-8f02-0d77473669c4 tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] 10.222.0.48 "GET /compute/v2.1/servers/f554f56e-3d3e-4164-b04f-31669b784320" status: 200 len: 1214 microversion: 2.1 time: 0.068229 Jun 17 15:53:24.934688 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1637/3689] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:53:24 2022] GET /compute/v2.1/servers/f554f56e-3d3e-4164-b04f-31669b784320 => generated 1214 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:53:25.953183 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-4dbe2a13-e1ea-404d-99e5-de51db0e26e8 tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:53:25.954891 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-4dbe2a13-e1ea-404d-99e5-de51db0e26e8 tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] [instance: f554f56e-3d3e-4164-b04f-31669b784320] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:53:25.962114 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4dbe2a13-e1ea-404d-99e5-de51db0e26e8 tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:53:25.962566 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4dbe2a13-e1ea-404d-99e5-de51db0e26e8 tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:53:25.963344 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4dbe2a13-e1ea-404d-99e5-de51db0e26e8 tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:53:25.963784 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-4dbe2a13-e1ea-404d-99e5-de51db0e26e8 tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:53:26.226881 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-4dbe2a13-e1ea-404d-99e5-de51db0e26e8 tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268e2032c3f84e628b4b6968b0753577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903403e17c8f4051bd46cf63f44b652e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:53:26.236269 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-4dbe2a13-e1ea-404d-99e5-de51db0e26e8 tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] 10.222.0.48 "GET /compute/v2.1/servers/f554f56e-3d3e-4164-b04f-31669b784320" status: 200 len: 1272 microversion: 2.1 time: 0.288811 Jun 17 15:53:26.237148 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 2053/3690] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:53:25 2022] GET /compute/v2.1/servers/f554f56e-3d3e-4164-b04f-31669b784320 => generated 1272 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:53:27.255411 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-db563ddf-154a-40f5-acea-024b0c9ce43c tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:53:27.256076 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-db563ddf-154a-40f5-acea-024b0c9ce43c tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] [instance: f554f56e-3d3e-4164-b04f-31669b784320] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:53:27.263570 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-db563ddf-154a-40f5-acea-024b0c9ce43c tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:53:27.264103 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-db563ddf-154a-40f5-acea-024b0c9ce43c tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:53:27.264979 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-db563ddf-154a-40f5-acea-024b0c9ce43c tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:53:27.265493 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-db563ddf-154a-40f5-acea-024b0c9ce43c tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:53:27.474144 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-db563ddf-154a-40f5-acea-024b0c9ce43c tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268e2032c3f84e628b4b6968b0753577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903403e17c8f4051bd46cf63f44b652e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:53:27.482412 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-db563ddf-154a-40f5-acea-024b0c9ce43c tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] 10.222.0.48 "GET /compute/v2.1/servers/f554f56e-3d3e-4164-b04f-31669b784320" status: 200 len: 1314 microversion: 2.1 time: 0.231039 Jun 17 15:53:27.482996 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1638/3691] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:53:27 2022] GET /compute/v2.1/servers/f554f56e-3d3e-4164-b04f-31669b784320 => generated 1314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:53:27.763166 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [req-0d320279-b360-4962-8db6-cbbe8fd9d3e3 req-f5551647-9d12-40c4-b0e4-b8236bba39cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f554f56e-3d3e-4164-b04f-31669b784320", "tag": "80bf928f-a572-497e-a393-342cc96f9289"}]} {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:53:27.773523 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [req-0d320279-b360-4962-8db6-cbbe8fd9d3e3 req-f5551647-9d12-40c4-b0e4-b8236bba39cc service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:53:27.774077 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [req-0d320279-b360-4962-8db6-cbbe8fd9d3e3 req-f5551647-9d12-40c4-b0e4-b8236bba39cc service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:53:27.794932 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.compute.server_external_events [req-0d320279-b360-4962-8db6-cbbe8fd9d3e3 req-f5551647-9d12-40c4-b0e4-b8236bba39cc service nova] Creating event network-changed:80bf928f-a572-497e-a393-342cc96f9289 for instance f554f56e-3d3e-4164-b04f-31669b784320 on hv-cinder-82549 Jun 17 15:53:27.801699 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [req-0d320279-b360-4962-8db6-cbbe8fd9d3e3 req-f5551647-9d12-40c4-b0e4-b8236bba39cc service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042598 Jun 17 15:53:27.802689 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 2054/3692] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 15:53:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:53:28.499452 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-9185fe9f-ef4d-4f29-b05b-c1229559e855 tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:53:28.500077 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-9185fe9f-ef4d-4f29-b05b-c1229559e855 tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] [instance: f554f56e-3d3e-4164-b04f-31669b784320] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:53:28.507850 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9185fe9f-ef4d-4f29-b05b-c1229559e855 tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:53:28.508409 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9185fe9f-ef4d-4f29-b05b-c1229559e855 tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:53:28.509233 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9185fe9f-ef4d-4f29-b05b-c1229559e855 tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:53:28.509679 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-9185fe9f-ef4d-4f29-b05b-c1229559e855 tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:53:28.647523 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-9185fe9f-ef4d-4f29-b05b-c1229559e855 tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268e2032c3f84e628b4b6968b0753577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903403e17c8f4051bd46cf63f44b652e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:53:28.655806 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-9185fe9f-ef4d-4f29-b05b-c1229559e855 tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] 10.222.0.48 "GET /compute/v2.1/servers/f554f56e-3d3e-4164-b04f-31669b784320" status: 200 len: 1314 microversion: 2.1 time: 0.160284 Jun 17 15:53:28.656392 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1639/3693] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:53:28 2022] GET /compute/v2.1/servers/f554f56e-3d3e-4164-b04f-31669b784320 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:53:29.674491 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-f27a468a-cb24-4e88-930b-bbcc472a7b59 tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:53:29.675562 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-f27a468a-cb24-4e88-930b-bbcc472a7b59 tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] [instance: f554f56e-3d3e-4164-b04f-31669b784320] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:53:29.682416 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f27a468a-cb24-4e88-930b-bbcc472a7b59 tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:53:29.682855 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f27a468a-cb24-4e88-930b-bbcc472a7b59 tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:53:29.683610 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f27a468a-cb24-4e88-930b-bbcc472a7b59 tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:53:29.684161 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-f27a468a-cb24-4e88-930b-bbcc472a7b59 tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:53:29.815377 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-f27a468a-cb24-4e88-930b-bbcc472a7b59 tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268e2032c3f84e628b4b6968b0753577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903403e17c8f4051bd46cf63f44b652e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:53:29.822681 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-f27a468a-cb24-4e88-930b-bbcc472a7b59 tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] 10.222.0.48 "GET /compute/v2.1/servers/f554f56e-3d3e-4164-b04f-31669b784320" status: 200 len: 1314 microversion: 2.1 time: 0.152950 Jun 17 15:53:29.823239 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 2055/3694] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:53:29 2022] GET /compute/v2.1/servers/f554f56e-3d3e-4164-b04f-31669b784320 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:53:30.839758 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-993534a7-02cd-40d7-bbc4-84c71de1a8ea tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:53:30.841078 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-993534a7-02cd-40d7-bbc4-84c71de1a8ea tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] [instance: f554f56e-3d3e-4164-b04f-31669b784320] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:53:30.847823 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-993534a7-02cd-40d7-bbc4-84c71de1a8ea tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:53:30.848259 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-993534a7-02cd-40d7-bbc4-84c71de1a8ea tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:53:30.849047 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-993534a7-02cd-40d7-bbc4-84c71de1a8ea tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:53:30.849473 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-993534a7-02cd-40d7-bbc4-84c71de1a8ea tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:53:30.986742 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-993534a7-02cd-40d7-bbc4-84c71de1a8ea tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268e2032c3f84e628b4b6968b0753577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903403e17c8f4051bd46cf63f44b652e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:53:30.994274 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-993534a7-02cd-40d7-bbc4-84c71de1a8ea tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] 10.222.0.48 "GET /compute/v2.1/servers/f554f56e-3d3e-4164-b04f-31669b784320" status: 200 len: 1314 microversion: 2.1 time: 0.158400 Jun 17 15:53:30.994844 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1640/3695] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:53:30 2022] GET /compute/v2.1/servers/f554f56e-3d3e-4164-b04f-31669b784320 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:53:32.011122 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-036ab345-e033-4ab6-a901-b6e5c9c7eda7 tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:53:32.011728 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-036ab345-e033-4ab6-a901-b6e5c9c7eda7 tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] [instance: f554f56e-3d3e-4164-b04f-31669b784320] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:53:32.018479 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-036ab345-e033-4ab6-a901-b6e5c9c7eda7 tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:53:32.018920 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-036ab345-e033-4ab6-a901-b6e5c9c7eda7 tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:53:32.019681 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-036ab345-e033-4ab6-a901-b6e5c9c7eda7 tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:53:32.020114 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-036ab345-e033-4ab6-a901-b6e5c9c7eda7 tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:53:32.156470 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-036ab345-e033-4ab6-a901-b6e5c9c7eda7 tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268e2032c3f84e628b4b6968b0753577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903403e17c8f4051bd46cf63f44b652e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:53:32.163768 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-036ab345-e033-4ab6-a901-b6e5c9c7eda7 tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] 10.222.0.48 "GET /compute/v2.1/servers/f554f56e-3d3e-4164-b04f-31669b784320" status: 200 len: 1314 microversion: 2.1 time: 0.156575 Jun 17 15:53:32.164631 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 2056/3696] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:53:32 2022] GET /compute/v2.1/servers/f554f56e-3d3e-4164-b04f-31669b784320 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:53:33.180614 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-2dc04512-dd59-4691-8d24-9a001d86e2bb tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:53:33.181233 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-2dc04512-dd59-4691-8d24-9a001d86e2bb tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] [instance: f554f56e-3d3e-4164-b04f-31669b784320] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:53:33.187982 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2dc04512-dd59-4691-8d24-9a001d86e2bb tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:53:33.188450 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2dc04512-dd59-4691-8d24-9a001d86e2bb tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:53:33.189220 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2dc04512-dd59-4691-8d24-9a001d86e2bb tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:53:33.189660 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-2dc04512-dd59-4691-8d24-9a001d86e2bb tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:53:33.261774 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [req-b1cd852a-20cf-4ea0-b7b5-31e57fe66349 req-40133499-be6c-41a8-907d-2338ee5133e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f554f56e-3d3e-4164-b04f-31669b784320", "name": "network-vif-plugged", "status": "completed", "tag": "80bf928f-a572-497e-a393-342cc96f9289"}]} {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:53:33.275381 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [req-b1cd852a-20cf-4ea0-b7b5-31e57fe66349 req-40133499-be6c-41a8-907d-2338ee5133e2 service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:53:33.275840 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [req-b1cd852a-20cf-4ea0-b7b5-31e57fe66349 req-40133499-be6c-41a8-907d-2338ee5133e2 service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:53:33.288494 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.compute.server_external_events [req-b1cd852a-20cf-4ea0-b7b5-31e57fe66349 req-40133499-be6c-41a8-907d-2338ee5133e2 service nova] Creating event network-vif-plugged:80bf928f-a572-497e-a393-342cc96f9289 for instance f554f56e-3d3e-4164-b04f-31669b784320 on hv-cinder-82549 Jun 17 15:53:33.293591 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [req-b1cd852a-20cf-4ea0-b7b5-31e57fe66349 req-40133499-be6c-41a8-907d-2338ee5133e2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035578 Jun 17 15:53:33.294538 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 2057/3697] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 15:53:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 17 15:53:33.328838 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-2dc04512-dd59-4691-8d24-9a001d86e2bb tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268e2032c3f84e628b4b6968b0753577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903403e17c8f4051bd46cf63f44b652e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:53:33.341658 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-2dc04512-dd59-4691-8d24-9a001d86e2bb tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] 10.222.0.48 "GET /compute/v2.1/servers/f554f56e-3d3e-4164-b04f-31669b784320" status: 200 len: 1314 microversion: 2.1 time: 0.164901 Jun 17 15:53:33.342241 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1641/3698] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:53:33 2022] GET /compute/v2.1/servers/f554f56e-3d3e-4164-b04f-31669b784320 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:53:34.359169 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-8948ffa2-52b3-4dea-ba0c-c7accdd66f02 tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:53:34.359855 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-8948ffa2-52b3-4dea-ba0c-c7accdd66f02 tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] [instance: f554f56e-3d3e-4164-b04f-31669b784320] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:53:34.366524 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8948ffa2-52b3-4dea-ba0c-c7accdd66f02 tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:53:34.366964 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8948ffa2-52b3-4dea-ba0c-c7accdd66f02 tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:53:34.367708 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8948ffa2-52b3-4dea-ba0c-c7accdd66f02 tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:53:34.368135 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-8948ffa2-52b3-4dea-ba0c-c7accdd66f02 tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:53:34.504727 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-8948ffa2-52b3-4dea-ba0c-c7accdd66f02 tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268e2032c3f84e628b4b6968b0753577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903403e17c8f4051bd46cf63f44b652e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:53:34.512590 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-8948ffa2-52b3-4dea-ba0c-c7accdd66f02 tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] 10.222.0.48 "GET /compute/v2.1/servers/f554f56e-3d3e-4164-b04f-31669b784320" status: 200 len: 1314 microversion: 2.1 time: 0.157558 Jun 17 15:53:34.513171 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 2058/3699] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:53:34 2022] GET /compute/v2.1/servers/f554f56e-3d3e-4164-b04f-31669b784320 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:53:35.529932 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-be88a280-760e-45e7-9c50-b3a65e36caa9 tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:53:35.530544 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-be88a280-760e-45e7-9c50-b3a65e36caa9 tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] [instance: f554f56e-3d3e-4164-b04f-31669b784320] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:53:35.532940 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG dbcounter [-] [117649] Writing DB stats nova_cell0:SELECT=2 {{(pid=117649) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:53:35.538460 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-be88a280-760e-45e7-9c50-b3a65e36caa9 tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:53:35.538910 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-be88a280-760e-45e7-9c50-b3a65e36caa9 tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:53:35.539674 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-be88a280-760e-45e7-9c50-b3a65e36caa9 tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:53:35.540111 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-be88a280-760e-45e7-9c50-b3a65e36caa9 tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:53:35.670243 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-be88a280-760e-45e7-9c50-b3a65e36caa9 tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268e2032c3f84e628b4b6968b0753577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903403e17c8f4051bd46cf63f44b652e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:53:35.677652 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-be88a280-760e-45e7-9c50-b3a65e36caa9 tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] 10.222.0.48 "GET /compute/v2.1/servers/f554f56e-3d3e-4164-b04f-31669b784320" status: 200 len: 1464 microversion: 2.1 time: 0.151587 Jun 17 15:53:35.678218 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1642/3700] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:53:35 2022] GET /compute/v2.1/servers/f554f56e-3d3e-4164-b04f-31669b784320 => generated 1464 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:53:35.715767 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-bfb8ec1f-b92e-4210-b991-ed9633826423 tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:53:35.716254 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-bfb8ec1f-b92e-4210-b991-ed9633826423 tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] [instance: f554f56e-3d3e-4164-b04f-31669b784320] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:53:35.718213 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell0:SELECT=2 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:53:35.718973 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG dbcounter [-] [117650] Writing DB stats nova_cell0:SELECT=6 {{(pid=117650) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 15:53:35.725670 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bfb8ec1f-b92e-4210-b991-ed9633826423 tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:53:35.726110 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bfb8ec1f-b92e-4210-b991-ed9633826423 tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:53:35.726866 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bfb8ec1f-b92e-4210-b991-ed9633826423 tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:53:35.727291 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-bfb8ec1f-b92e-4210-b991-ed9633826423 tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:53:35.753100 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-bfb8ec1f-b92e-4210-b991-ed9633826423 tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] [instance: f554f56e-3d3e-4164-b04f-31669b784320] Going to try to terminate instance {{(pid=117650) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 17 15:53:35.827120 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-bfb8ec1f-b92e-4210-b991-ed9633826423 tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] 10.222.0.48 "DELETE /compute/v2.1/servers/f554f56e-3d3e-4164-b04f-31669b784320" status: 204 len: 0 microversion: 2.1 time: 0.115283 Jun 17 15:53:35.827755 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 2059/3701] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jun 17 15:53:35 2022] DELETE /compute/v2.1/servers/f554f56e-3d3e-4164-b04f-31669b784320 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 17 15:53:35.837182 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-a0ee07f7-c6ed-4c48-8932-ec73fd13f658 tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:53:35.837797 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-a0ee07f7-c6ed-4c48-8932-ec73fd13f658 tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] [instance: f554f56e-3d3e-4164-b04f-31669b784320] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:53:35.844435 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a0ee07f7-c6ed-4c48-8932-ec73fd13f658 tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:53:35.844882 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a0ee07f7-c6ed-4c48-8932-ec73fd13f658 tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:53:35.845631 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a0ee07f7-c6ed-4c48-8932-ec73fd13f658 tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:53:35.846060 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-a0ee07f7-c6ed-4c48-8932-ec73fd13f658 tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:53:35.972872 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.policy [None req-a0ee07f7-c6ed-4c48-8932-ec73fd13f658 tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268e2032c3f84e628b4b6968b0753577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903403e17c8f4051bd46cf63f44b652e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117649) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:53:35.980591 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-a0ee07f7-c6ed-4c48-8932-ec73fd13f658 tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] 10.222.0.48 "GET /compute/v2.1/servers/f554f56e-3d3e-4164-b04f-31669b784320" status: 200 len: 1470 microversion: 2.1 time: 0.148190 Jun 17 15:53:35.981201 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1643/3702] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:53:35 2022] GET /compute/v2.1/servers/f554f56e-3d3e-4164-b04f-31669b784320 => generated 1470 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:53:36.999787 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-85b8a9d9-60b8-4a45-aab4-c63abf95204a tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:53:37.000524 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-85b8a9d9-60b8-4a45-aab4-c63abf95204a tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] [instance: f554f56e-3d3e-4164-b04f-31669b784320] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:53:37.007005 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-85b8a9d9-60b8-4a45-aab4-c63abf95204a tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:53:37.007445 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-85b8a9d9-60b8-4a45-aab4-c63abf95204a tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:53:37.008201 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-85b8a9d9-60b8-4a45-aab4-c63abf95204a tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:53:37.008673 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-85b8a9d9-60b8-4a45-aab4-c63abf95204a tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:53:37.140449 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-85b8a9d9-60b8-4a45-aab4-c63abf95204a tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268e2032c3f84e628b4b6968b0753577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903403e17c8f4051bd46cf63f44b652e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:53:37.147912 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-85b8a9d9-60b8-4a45-aab4-c63abf95204a tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] 10.222.0.48 "GET /compute/v2.1/servers/f554f56e-3d3e-4164-b04f-31669b784320" status: 200 len: 1470 microversion: 2.1 time: 0.153131 Jun 17 15:53:37.148515 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 2060/3703] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:53:36 2022] GET /compute/v2.1/servers/f554f56e-3d3e-4164-b04f-31669b784320 => generated 1470 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 17 15:53:37.727614 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [req-a139e46e-fc15-45d5-81a4-90639cd7b640 req-5fefb4ba-eeb4-4e89-8640-29379ade4bbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f554f56e-3d3e-4164-b04f-31669b784320", "name": "network-vif-deleted", "tag": "80bf928f-a572-497e-a393-342cc96f9289"}]} {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 17 15:53:37.739101 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-a139e46e-fc15-45d5-81a4-90639cd7b640 req-5fefb4ba-eeb4-4e89-8640-29379ade4bbc service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:53:37.739549 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [req-a139e46e-fc15-45d5-81a4-90639cd7b640 req-5fefb4ba-eeb4-4e89-8640-29379ade4bbc service nova] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:53:37.752551 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.compute.server_external_events [req-a139e46e-fc15-45d5-81a4-90639cd7b640 req-5fefb4ba-eeb4-4e89-8640-29379ade4bbc service nova] Creating event network-vif-deleted:80bf928f-a572-497e-a393-342cc96f9289 for instance f554f56e-3d3e-4164-b04f-31669b784320 on hv-cinder-82549 Jun 17 15:53:37.758241 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [req-a139e46e-fc15-45d5-81a4-90639cd7b640 req-5fefb4ba-eeb4-4e89-8640-29379ade4bbc service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034886 Jun 17 15:53:37.758759 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1644/3704] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 17 15:53:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 17 15:53:38.165640 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.api.openstack.wsgi [None req-abd76a5f-2a61-41f0-a356-e83a8ed43c91 tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] Calling method '>' {{(pid=117650) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:53:38.166258 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.compute.api [None req-abd76a5f-2a61-41f0-a356-e83a8ed43c91 tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] [instance: f554f56e-3d3e-4164-b04f-31669b784320] Fetching instance by UUID {{(pid=117650) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:53:38.173230 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-abd76a5f-2a61-41f0-a356-e83a8ed43c91 tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:53:38.173662 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-abd76a5f-2a61-41f0-a356-e83a8ed43c91 tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:53:38.174426 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-abd76a5f-2a61-41f0-a356-e83a8ed43c91 tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:53:38.174853 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-abd76a5f-2a61-41f0-a356-e83a8ed43c91 tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:53:38.211724 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-abd76a5f-2a61-41f0-a356-e83a8ed43c91 tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:53:38.212167 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG oslo_concurrency.lockutils [None req-abd76a5f-2a61-41f0-a356-e83a8ed43c91 tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117650) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:53:38.212899 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.objects.instance [None req-abd76a5f-2a61-41f0-a356-e83a8ed43c91 tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] Lazy-loading 'fault' on Instance uuid f554f56e-3d3e-4164-b04f-31669b784320 {{(pid=117650) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 17 15:53:38.256420 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: DEBUG nova.policy [None req-abd76a5f-2a61-41f0-a356-e83a8ed43c91 tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '268e2032c3f84e628b4b6968b0753577', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '903403e17c8f4051bd46cf63f44b652e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117650) authorize /opt/stack/nova/nova/policy.py:199}} Jun 17 15:53:38.263831 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO nova.api.openstack.requestlog [None req-abd76a5f-2a61-41f0-a356-e83a8ed43c91 tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] 10.222.0.48 "GET /compute/v2.1/servers/f554f56e-3d3e-4164-b04f-31669b784320" status: 200 len: 1304 microversion: 2.1 time: 0.102405 Jun 17 15:53:38.264416 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: [pid: 117650|app: 0|req: 2061/3705] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:53:38 2022] GET /compute/v2.1/servers/f554f56e-3d3e-4164-b04f-31669b784320 => generated 1304 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 17 15:53:39.282767 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-5ef65e7f-3111-4625-9d95-277473d70c70 tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] Calling method '>' {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 17 15:53:39.283470 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.compute.api [None req-5ef65e7f-3111-4625-9d95-277473d70c70 tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] [instance: f554f56e-3d3e-4164-b04f-31669b784320] Fetching instance by UUID {{(pid=117649) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 17 15:53:39.290041 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5ef65e7f-3111-4625-9d95-277473d70c70 tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:53:39.290499 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5ef65e7f-3111-4625-9d95-277473d70c70 tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:53:39.291303 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5ef65e7f-3111-4625-9d95-277473d70c70 tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 17 15:53:39.291736 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG oslo_concurrency.lockutils [None req-5ef65e7f-3111-4625-9d95-277473d70c70 tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] Lock "b6b5fdf2-9eb8-4963-9495-5b73caa9f013" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117649) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 17 15:53:39.307524 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.wsgi [None req-5ef65e7f-3111-4625-9d95-277473d70c70 tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] HTTP exception thrown: Instance f554f56e-3d3e-4164-b04f-31669b784320 could not be found. Jun 17 15:53:39.309415 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-5ef65e7f-3111-4625-9d95-277473d70c70 tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] Request method failure captured: Jun 17 15:53:39.309415 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: request: GET /compute/v2.1/servers/f554f56e-3d3e-4164-b04f-31669b784320 HTTP/1.1 Jun 17 15:53:39.309415 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Accept: application/json Jun 17 15:53:39.309415 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Accept-Encoding: identity Jun 17 15:53:39.309415 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Connection: close Jun 17 15:53:39.309415 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Content-Length: 0 Jun 17 15:53:39.309415 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Content-Type: application/json Jun 17 15:53:39.309415 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Host: 10.222.0.48 Jun 17 15:53:39.309415 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Openstack-System-Scope: None Jun 17 15:53:39.309415 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: User-Agent: python-urllib3/1.26.9 Jun 17 15:53:39.309415 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Auth-Token: gAAAAABirKNyNC_43f7pwvMhZQkaLngNOqkb7SrMQceS0G12tV2MgAKfCHHCRMgUQ_HNwGSjRh9qI3F2H8SJMBu9D4b_mY0JKRe-anLsl-4ioS9y1SIOgkLhEQ-EHONWtalfXZe5BVaqDE9cQ-Bw0ABfKJkqjcEwz7jaCyUbAtgk_p1Ssg0F79o Jun 17 15:53:39.309415 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Domain-Id: None Jun 17 15:53:39.309415 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Domain-Name: None Jun 17 15:53:39.309415 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Identity-Status: Confirmed Jun 17 15:53:39.309415 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Is-Admin-Project: True Jun 17 15:53:39.309415 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Domain-Id: default Jun 17 15:53:39.309415 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Domain-Name: Default Jun 17 15:53:39.309415 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Id: 903403e17c8f4051bd46cf63f44b652e Jun 17 15:53:39.309415 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Project-Name: tempest-VolumesNegativeTest-915060958 Jun 17 15:53:39.309415 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Role: reader,member Jun 17 15:53:39.309415 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Roles: reader,member Jun 17 15:53:39.311335 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_903403e17c8f4051bd46cf63f44b652e", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/903403e17c8f4051bd46cf63f44b652e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/903403e17c8f4051bd46cf63f44b652e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/903403e17c8f4051bd46cf63f44b652e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}] Jun 17 15:53:39.311335 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant: tempest-VolumesNegativeTest-915060958 Jun 17 15:53:39.311335 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant-Id: 903403e17c8f4051bd46cf63f44b652e Jun 17 15:53:39.311335 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-Tenant-Name: tempest-VolumesNegativeTest-915060958 Jun 17 15:53:39.311335 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User: tempest-VolumesNegativeTest-915060958-project Jun 17 15:53:39.311335 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Domain-Id: default Jun 17 15:53:39.311335 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Domain-Name: Default Jun 17 15:53:39.311335 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Id: 268e2032c3f84e628b4b6968b0753577 Jun 17 15:53:39.311335 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: X-User-Name: tempest-VolumesNegativeTest-915060958-project Jun 17 15:53:39.311335 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: method: > Jun 17 15:53:39.311335 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: exception: Instance f554f56e-3d3e-4164-b04f-31669b784320 could not be found. Jun 17 15:53:39.311335 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: action_args: {'id': 'f554f56e-3d3e-4164-b04f-31669b784320'} Jun 17 15:53:39.313031 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: {{(pid=117649) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 17 15:53:39.313031 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:53:39.313031 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 17 15:53:39.313031 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 17 15:53:39.313031 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 17 15:53:39.313031 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 17 15:53:39.313031 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 17 15:53:39.313031 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 17 15:53:39.313031 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 17 15:53:39.313031 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 17 15:53:39.313031 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f554f56e-3d3e-4164-b04f-31669b784320 could not be found. Jun 17 15:53:39.313031 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:53:39.313031 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:53:39.313031 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:53:39.313031 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:53:39.313031 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:53:39.313031 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:53:39.313031 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 17 15:53:39.313031 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 17 15:53:39.313031 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 17 15:53:39.315177 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 17 15:53:39.315177 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 17 15:53:39.315177 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 17 15:53:39.315177 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 17 15:53:39.315177 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 17 15:53:39.315177 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 17 15:53:39.315177 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 17 15:53:39.315177 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f554f56e-3d3e-4164-b04f-31669b784320 could not be found. Jun 17 15:53:39.315177 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:53:39.315177 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 17 15:53:39.315177 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:53:39.315177 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 17 15:53:39.315177 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 17 15:53:39.315177 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 17 15:53:39.315177 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 17 15:53:39.315177 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 17 15:53:39.315177 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f554f56e-3d3e-4164-b04f-31669b784320 could not be found. Jun 17 15:53:39.315177 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: ERROR nova.api.openstack.wsgi Jun 17 15:53:39.317202 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: DEBUG nova.api.openstack.wsgi [None req-5ef65e7f-3111-4625-9d95-277473d70c70 tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] Returning 404 to user: Instance f554f56e-3d3e-4164-b04f-31669b784320 could not be found. {{(pid=117649) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 17 15:53:39.317202 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO nova.api.openstack.requestlog [None req-5ef65e7f-3111-4625-9d95-277473d70c70 tempest-VolumesNegativeTest-915060958 tempest-VolumesNegativeTest-915060958-project] 10.222.0.48 "GET /compute/v2.1/servers/f554f56e-3d3e-4164-b04f-31669b784320" status: 404 len: 111 microversion: 2.1 time: 0.033494 Jun 17 15:53:39.317202 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: [pid: 117649|app: 0|req: 1645/3706] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 17 15:53:39 2022] GET /compute/v2.1/servers/f554f56e-3d3e-4164-b04f-31669b784320 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 17 15:54:35.459956 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 15:54:35.460514 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Fri Jun 17 15:54:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 15:56:16.853851 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 15:56:16.854942 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Fri Jun 17 15:56:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 15:56:18.927036 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 15:56:18.927670 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Fri Jun 17 15:56:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 15:56:35.350115 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 15:56:35.350720 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Fri Jun 17 15:56:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 15:56:38.818093 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 15:56:38.818643 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Fri Jun 17 15:56:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 15:57:51.635808 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 15:57:51.636564 dv-cinder-825492-23-iscsi devstack@n-api.service[117649]: Fri Jun 17 15:57:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 17 15:57:55.468380 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 17 15:57:55.468987 dv-cinder-825492-23-iscsi devstack@n-api.service[117650]: Fri Jun 17 15:57:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!